Yup. I'm doing a VR project, urban environment. Haven't really found a good enough solution for 3D reconstruction from images.
Yes, there is gaussian splatting, NeRF and derivatives, but their outputs _really don't look good_. It's also necessary to have the surface remeshed if you go through that route, and then you need to retexture it.
Crazy thing being able to see things up to scale and so close up :)
Not meta VR, but one of my favorite things to do in gran turismo 7 with my PSVR2 is just “sit” in the cars and look around the cabins. The level of detail the devs put in is on another level.
I find it much easier to remesh and deal with textures with a crappy 3d reconstruction vs working with 2d images only. I also shoot HDRI and photos for PBR. I find sculpting tools super useful for VR, but yeah its still an Art even with all the AI help.
Given the scale it wouldn't be wise to render them directly. There's also the issue of being able to record in real life without changes happening while doing so.
I should've have clarified it, but yes I was talking about the extracted surface geometry.
Yes, there is gaussian splatting, NeRF and derivatives, but their outputs _really don't look good_. It's also necessary to have the surface remeshed if you go through that route, and then you need to retexture it.
Crazy thing being able to see things up to scale and so close up :)