Gen AI

SViM3D: Stable Video Material Diffusion for Single Image 3D Generation featured image

SViM3D: Stable Video Material Diffusion for Single Image 3D Generation

We present Stable Video Materials 3D (SViM3D), a framework to predict multi-view consistent physically based rendering (PBR) materials, given a single image. Recently, video …

andreas-engelhardt
MARBLE: Material Recomposition and Blending in CLIP-Space featured image

MARBLE: Material Recomposition and Blending in CLIP-Space

Editing materials of objects in images based on exemplar images is an active area of research in computer vision and graphics. We propose MARBLE, a method for performing material …

ta-ying-cheng
Stable Virtual Camera: Generative View Synthesis with Diffusion Models featured image

Stable Virtual Camera: Generative View Synthesis with Diffusion Models

We present Stable Virtual Camera (Seva), a generalist diffusion model that creates novel views of a scene, given any number of input views and target cameras. Existing works …

jensen-zhou
SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images featured image

SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images

We study the problem of single-image 3D object reconstruction. Recent works have diverged into two directions: regression-based modeling and generative modeling. Regression methods …

zixuan-huang
SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement featured image

SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement

We present SF3D, a novel method for rapid and high-quality textured mesh reconstruction from a single image. Utilizing the Large Reconstruction Model (LRM) as its foundation, SF3D …

avatar
Mark Boss
SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion featured image

SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

We present Stable Video 3D (SV3D) - a latent video diffusion model for high-resolution, image-to-multi-view generation of orbital videos around a 3D object. Recent work on 3D …

vikram-voleti
Collaborative Control for Geometry-Conditioned PBR Image Generation featured image

Collaborative Control for Geometry-Conditioned PBR Image Generation

Current 3D content generation builds on generative models that output RGB images. Modern graphics pipelines, however, require physically-based rendering (PBR) material properties. …

shimon-vainer