Mark Boss

Mark Boss

Co-Head of Visual Research
I’m a research lead in 3D at Stability AI with research interests in the intersection of machine learning and computer graphics.
Stable Virtual Camera: Generative View Synthesis with Diffusion Models featured image

Stable Virtual Camera: Generative View Synthesis with Diffusion Models

We present Stable Virtual Camera (Seva), a generalist diffusion model that creates novel views of a scene, given any number of input views and target cameras. Existing works …

jensen-zhou
•
SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images featured image

SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images

We study the problem of single-image 3D object reconstruction. Recent works have diverged into two directions: regression-based modeling and generative modeling. Regression methods …

zixuan-huang
•
SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement featured image

SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement

We present SF3D, a novel method for rapid and high-quality textured mesh reconstruction from a single image. Utilizing the Large Reconstruction Model (LRM) as its foundation, SF3D …

avatar
Mark Boss
•
SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion featured image

SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

We present Stable Video 3D (SV3D) - a latent video diffusion model for high-resolution, image-to-multi-view generation of orbital videos around a 3D object. Recent work on 3D …

vikram-voleti
•
Collaborative Control for Geometry-Conditioned PBR Image Generation featured image

Collaborative Control for Geometry-Conditioned PBR Image Generation

Current 3D content generation builds on generative models that output RGB images. Modern graphics pipelines, however, require physically-based rendering (PBR) material properties. …

shimon-vainer
•
SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild featured image

SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild

We present SHINOBI, an end-to-end framework for the reconstruction of shape, material, and illumination from object images captured with varying lighting, pose, and background. …

andreas-engelhardt
•

NeRF at CVPR 2023

It is now my third time writing a summary of NeRFy things at a conference. This time it is the big one: CVPR. The list of accepted papers is massive again, with 2359 papers.

avatar
Mark Boss
•
Neural Reflectance Decomposition featured image

Neural Reflectance Decomposition

Creating relightable objects from images or collections is a fundamental challenge in computer vision and graphics. This problem is also known as inverse rendering. One of the main …

avatar
Mark Boss
•
SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections featured image

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections

Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved …

avatar
Mark Boss
•
An open-source smartphone app for the quantitative evaluation of thin-layer chromatographic analyses in medicine quality screening featured image

An open-source smartphone app for the quantitative evaluation of thin-layer chromatographic analyses in medicine quality screening

Substandard and falsified medicines present a serious threat to public health. Simple, low-cost screening tools are important in the identification of such products in low- and …

cathrin-hauk
•