Shimon Vainer

4Director: Controlling Video World Models with Rigid 3D Geometry featured image

4Director: Controlling Video World Models with Rigid 3D Geometry

A video world model that uses rigid 3D geometry to control camera and object motion from a single image.

wei-cao
•
SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation featured image

SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation

A flexible video tokenizer that puts semantics in early tokens for efficient, high-fidelity autoregressive video generation.

mikhail-dereviannykh
•
OCTOPUS: Optimized KV Cache for Transformers via Octahedral Parametrization Under Optimal Squared Error Quantization featured image

OCTOPUS: Optimized KV Cache for Transformers via Octahedral Parametrization Under Optimal Squared Error Quantization

A rotation-preconditioned KV cache codec that jointly quantizes coordinate triplets via an octahedral map, achieving state-of-the-art compression across text, video, and audio …

avatar
Mark Boss
•
Collaborative Control for Geometry-Conditioned PBR Image Generation featured image

Collaborative Control for Geometry-Conditioned PBR Image Generation

Current 3D content generation builds on generative models that output RGB images. Modern graphics pipelines, however, require physically-based rendering (PBR) material properties. …

shimon-vainer
•