I was hoping someone had found a better way than radiance fields to generate actual 3D models. This is creating 360 panoramic images, which are not "3D" unless I'm missing something. Still impressive tech, though.
I do it with heightmaps. It can generate human faces, rocks, planets, terrains, all at high detail. There is no need for attempting to generate 3d models for everything, when you can create “blueprints”.
If you check out their Discord they have tools in (closed I think) beta that generative full 3d scenes. Lots of really cool demos get posted their daily. I'd actually say that as someone using it purely for panorama generation that I'm in the minority of use cases.
while nerf.studio is impressive, the parent comment is asking about radiance field free methods. NeRF stands for Neural Radiance Fields and all of the algorithms in that repo use radiance fields
1. Point-NeRF: Point-based Neural Radiance Fields - 2022: This paper presents Point-NeRF, a localized neural representation that combines volumetric radiance fields with point clouds to model complex local scene geometry and appearance. It achieves better rendering quality than NeRF and is more efficient in reconstructing complex and large-scale scenes.
2. TensoRF: Tensorial Radiance Fields - 2022: TensoRF proposes a tensorial radiance field representation that can achieve fast reconstruction and high rendering quality. It is significantly faster than NeRF and many previous methods.
3. GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields - 2022: GazeNeRF incorporates 3D awareness with gaze redirection by applying a rotation matrix to the disentangled eyeball feature maps. It represents a static scene with multi-layer perceptrons and maps the 3D positions and viewing directions to a density and radiance for generating novel views with volume rendering.
