Direct 3d Diffusion

Two Ways to Teach Diffusion Models the Third Dimension: 2D-Lifted vs. Direct 3D Generation

Diffusion models can generate 3D objects through two main strategies: lifting 3D content from pre-trained 2D models or diffusing directly in 3D space. Each approach presents unique challenges, such as 3D consistency for lifted methods and data scarcity for direct 3D diffusion.