Mark Boss

Mark Boss

Co-Head of 3D & Image
I’m a research lead in 3D at Stability AI with research interests in the intersection of machine learning and computer graphics.
SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion featured image

SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

We present Stable Video 3D (SV3D) - a latent video diffusion model for high-resolution, image-to-multi-view generation of orbital videos around a 3D object. Recent work on 3D …

vikram-voleti
Collaborative Control for Geometry-Conditioned PBR Image Generation featured image

Collaborative Control for Geometry-Conditioned PBR Image Generation

Current 3D content generation builds on generative models that output RGB images. Modern graphics pipelines, however, require physically-based rendering (PBR) material properties. …

shimon-vainer
SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild featured image

SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild

We present SHINOBI, an end-to-end framework for the reconstruction of shape, material, and illumination from object images captured with varying lighting, pose, and background. …

andreas-engelhardt

NeRF at CVPR 2023

It is now my third time writing a summary of NeRFy things at a conference. This time it is the big one: CVPR. The list of accepted papers is massive again, with 2359 papers.

avatar
Mark Boss
Neural Reflectance Decomposition featured image

Neural Reflectance Decomposition

Creating relightable objects from images or collections is a fundamental challenge in computer vision and graphics. This problem is also known as inverse rendering. One of the main …

avatar
Mark Boss
SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections featured image

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections

Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved …

avatar
Mark Boss
An open-source smartphone app for the quantitative evaluation of thin-layer chromatographic analyses in medicine quality screening featured image

An open-source smartphone app for the quantitative evaluation of thin-layer chromatographic analyses in medicine quality screening

Substandard and falsified medicines present a serious threat to public health. Simple, low-cost screening tools are important in the identification of such products in low- and …

cathrin-hauk
Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition featured image

Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition

Decomposing a scene into its shape, reflectance and illumination is a fundamental problem in computer vision and graphics. Neural approaches such as NeRF have achieved remarkable …

avatar
Mark Boss
NeRD: Neural Reflectance Decomposition from Image Collections featured image

NeRD: Neural Reflectance Decomposition from Image Collections

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more …

avatar
Mark Boss
Two-shot Spatially-varying BRDF and Shape Estimation featured image

Two-shot Spatially-varying BRDF and Shape Estimation

Capturing the shape and spatially-varying appearance (SVBRDF) of an object from images is a challenging task that has applications in both computer vision and graphics. Traditional …

avatar
Mark Boss