Interactive 3D scene

Simple render + image composite. All the objects are modelled in Cinema 4D and ZBrush except for the girl. Everything is composited together in Cinema 4D where the models and textures are baked and exported as GLTF files.

The scene is then recreated in Three.js to make it semi - interactive. A live demo is in the link below. NOTE: the loading time is currently very very slow as the models / textures could be optimised way more. Also only cursor based, could for example make it gyroscope based for phone interaction as well.

https://holo-scene.netlify.app/

immersive memories

The thought behind this project was to be able to enter past memories through photos. Less so about telepresence, but a way to allow people to connect with the past. This was made in Cinema 4D and after effects and is simply a conceptual video. To develop this I think it would be possible to recreate something similar by using depth maps.

It is currently very linear. Given for example a 360 photo as input it could be way more immersive, but given that most people don't have a 360 degree camera, I thought the current version is more accessible.

Chose a photo. Then use HiFill or any other image Inpainting model to remove subjects / objects in focus from image.

Keep two copies of the image, one with subject, one without. Then use a depth estimation model to calculate a depth map, e.g MiDaSv2.

Use image as a texture on a plane and use the depth map for vertex displacement.