Varun Jampani

ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination featured image

ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination

A unified feed-forward pipeline for relightable 3D reconstruction from sparse views in under one second.

jan-niklas-dihlmann
ReSWD: ReSTIR‘d, not shaken. Combining Reservoir Sampling and Sliced Wasserstein Distance for Variance Reduction. featured image

ReSWD: ReSTIR‘d, not shaken. Combining Reservoir Sampling and Sliced Wasserstein Distance for Variance Reduction.

Distribution matching is central to many vision and graphics tasks, where the widely used Wasserstein distance is too costly to compute for high dimensional distributions. The …

avatar
Mark Boss
SViM3D: Stable Video Material Diffusion for Single Image 3D Generation featured image

SViM3D: Stable Video Material Diffusion for Single Image 3D Generation

We present Stable Video Materials 3D (SViM3D), a framework to predict multi-view consistent physically based rendering (PBR) materials, given a single image. Recently, video …

andreas-engelhardt
MARBLE: Material Recomposition and Blending in CLIP-Space featured image

MARBLE: Material Recomposition and Blending in CLIP-Space

Editing materials of objects in images based on exemplar images is an active area of research in computer vision and graphics. We propose MARBLE, a method for performing material …

ta-ying-cheng
Stable Virtual Camera: Generative View Synthesis with Diffusion Models featured image

Stable Virtual Camera: Generative View Synthesis with Diffusion Models

We present Stable Virtual Camera (Seva), a generalist diffusion model that creates novel views of a scene, given any number of input views and target cameras. Existing works …

jensen-zhou
SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images featured image

SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images

We study the problem of single-image 3D object reconstruction. Recent works have diverged into two directions: regression-based modeling and generative modeling. Regression methods …

zixuan-huang
SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement featured image

SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement

We present SF3D, a novel method for rapid and high-quality textured mesh reconstruction from a single image. Utilizing the Large Reconstruction Model (LRM) as its foundation, SF3D …

avatar
Mark Boss
SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion featured image

SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

We present Stable Video 3D (SV3D) - a latent video diffusion model for high-resolution, image-to-multi-view generation of orbital videos around a 3D object. Recent work on 3D …

vikram-voleti
SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild featured image

SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild

We present SHINOBI, an end-to-end framework for the reconstruction of shape, material, and illumination from object images captured with varying lighting, pose, and background. …

andreas-engelhardt
SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections featured image

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections

Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved …

avatar
Mark Boss