Ayush Tewari

S2PD: Serial-to-Parallel Diffusion for Physically and Logically Consistent Video Generation

Jeffrey Hu, Daniel Olmeda Reino, and Ayush Tewari

arXiv 2026

Understanding Multi-view Transformers

Julien Gaubil*, Michal Stary*, Louis Martinez, Andreas Geiger, Maks Ovsjanikov†, Ayush Tewari†, and Vincent Sitzmann†

NeurIPS 2026

paper / code

UGG: Unified Generative Geometry Model

Amani Kiruga*, Zhiyi Li*, Ruojin Cai*, Hansen Lillemark, Xiaoshan Wu, Ayush Tewari, and Yilun Du

NeurIPS 2026

project page / paper / code

VDAWorld: World Modelling via VLM-Directed Abstraction and Simulation

Felix O'Mahony, Roberto Cipolla, and Ayush Tewari

SIGGRAPH Asia 2026

project page / paper / code / HSPBench / ConwayBench

ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes

Honglin Chen, Karran Pandey, Rundi Wu, Matheus Gadelha, Yannick Hold-Geoffroy, Ayush Tewari, Niloy Mitra, Changxi Zheng, and Paul Guerrero

SIGGRAPH Asia (ACM Transactions on Graphics) 2026

Faster 3D Gaussian Splatting Convergence via Structure-Aware Densification

Linjie Lyu, Ayush Tewari, Jianchun Chen, Thomas Leimkuehler, and Christian Theobalt

SIGGRAPH 2026

Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Rendering

Jieying Chen, Jeffrey Hu, Joan Lasenby, and Ayush Tewari

arXiv 2026

3D-Belief: Embodied Belief Inference via Generative 3D World Modeling

Yifan Yin*, Zehao Wen*, Suyu Ye, Jieneng Chen, Zehan Zheng, Nanru Dai, Haojun Shi, Aydan Huang, Zheyuan Zhang, Alan Yuille, Jianwen Xie, Ayush Tewari, and Tianmin Shu

CoRL 2026 Workshop: Do Robots Need World Models?

Perceived authenticity drives gaze behavior when watching AI-generated videos of physical scenes

Danqing Shi, Lan Jiang, Katherine M. Collins, Shangzhe Wu, Ayush Tewari, and Miri Zilka

Scientific Reports 2026

Approximating Human-Level 3D Visual Inferences With Deep Neural Networks

Thomas P. O’Connell, Tyler Bonnen, Yoni Friedman, Ayush Tewari, Vincent Sitzmann, Joshua B. Tenenbaum, and Nancy Kanwisher

Open Mind 2025

FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent

Cameron Smith*, David Charatan*, Ayush Tewari, and Vincent Sitzmann

3DV 2025

Manifold Sampling for Differentiable Uncertainty in Radiance Fields

Linjie Lyu, Ayush Tewari, Marc Habermann, Shunsuke Saito, Michael Zollhoefer, Thomas Leimkuehler, and Christian Theobalt

SIGGRAPH Asia 2024

PickScan: Object discovery and reconstruction from handheld interactions

Vincent van der Brugge, Marc Pollefeys, Joshua B. Tenenbaum, Krishna Murthy Jatavallabhula†, and Ayush Tewari†

IROS 2024

GAURA: Generalizable Approach for Unified Restoration and Rendering of Arbitrary Views

Vinayak Gupta*, Girish Rongali*, Mukund Varma T*, Ayush Tewari, and Kaushik Mitra

ECCV 2024

COCO-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery

Anne Harrington, Vasha DuTell, Mark Hamilton, Ayush Tewari, Simon Stent, William T. Freeman, and Ruth Rosenholtz

ICLR 2024

paper / code

Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision

Ayush Tewari*, Tianwei Yin*, George Cazenavette, Semon Rezchikov, Joshua B. Tenenbaum, Fredo Durand, William T. Freeman, and Vincent Sitzmann

NeurIPS 2023 (Spotlight)

FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flow

Cameron Smith, Yilun Du, Ayush Tewari, and Vincent Sitzmann

NeurIPS 2023

Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering

Linjie Lyu, Ayush Tewari, Marc Habermann, Shunsuke Saito, Michael Zollhoefer, Thomas Leimkuehler, and Christian Theobalt

SIGGRAPH Asia 2023

AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars

Mohit Mendiratta, Xingang Pan, Mohamed Elgharib, Kartik Teotia, Mallikarjun B R, Ayush Tewari, Vladislav Golyanik, Adam Kortylewski, and Christian Theobalt

SIGGRAPH Asia 2023

ModalNeRF: Neural Modal Analysis and Synthesis for Free-Viewpoint Navigation in Dynamically Vibrating Scenes

Automne Petitjean, Yohan Poirier-Ginter, Ayush Tewari, Guillaume Cordonnier, and George Drettakis

EGSR, Computer Graphics Forum 2023

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

Xingang Pan, Ayush Tewari, Thomas Leimkuehler, Lingjie Liu, Abhimitra Meka, and Christian Theobalt

SIGGRAPH 2023

Learning to Render Novel Views from Wide-Baseline Stereo Pairs

Yilun Du, Cameron Smith, Ayush Tewari†, and Vincent Sitzmann†

CVPR 2023

ConceptFusion: Open-set Multimodal 3D Mapping

Krishna Murthy Jatavallabhula, ..., Ayush Tewari, et. al

RSS 2023

Neural Groundplans: Persistent Neural Scene Representations from a Single Image

Prafull Sharma, Ayush Tewari, Yilun Du, Sergey Zakharov, Rares Ambrus, Adrien Gaidon, William T. Freeman, Fredo Durand, Joshua B. Tenenbaum, and Vincent Sitzmann

ICLR 2023

Exploring Perceptual Straightness in Learned Visual Representations

Anne Harrington, Vasha DuTell, Ayush Tewari, Mark Hamilton, Simon Stent, Ruth Rosenholtz, and William T. Freeman

ICLR 2023

Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination

Linjie Lyu, Ayush Tewari, Thomas Leimkuehler, Marc Habermann, and Christian Theobalt

ECCV 2022 (Oral Presentation)

GAN2X: Non-Lambertian Inverse Rendering of Image GANs

Xingang Pan, Ayush Tewari, Lingjie Liu, and Christian Theobalt

3DV 2022

VoRF: Volumetric Relightable Faces

Pramod Rao, Mallikarjun B R, Gereon Fox, Tim Weyrich, Bernd Bickel, Hanspeter Pfister, Wojciech Matusik, Ayush Tewari, Christian Theobalt, and Mohamed Elgharib

BMVC 2022 (Oral Presentation, Best Paper Honorable Mention)

Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images

Ayush Tewari, Mallikarjun B R, Xingang Pan, Ohad Fried, Maneesh Agrawala, and Christian Theobalt

CVPR 2022

Advances in Neural Rendering

Ayush Tewari*, Justus Thies*, Ben Mildenhall*, Pratul Srinivasan*, Edith Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stepehen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, and Vladislav Golyanik

Eurographics State-of-the-Art Report 2022

StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN

Gereon Fox, Ayush Tewari, Mohamed Elgharib, and Christian Theobalt

BMVC 2021 (Oral Presentation)

Efficient and Differentiable Shadow Computation for Inverse Problems

Linjie Lyu, Marc Habermann, Lingjie Liu, Mallikarjun B R, Ayush Tewari, and Christian Theobalt

ICCV 2021

Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video

Edith Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhoefer, Christoph Lassner, and Christian Theobalt

ICCV 2021

PhotoApp: Photorealistic Appearance Editing of Head Portraits

Mallikarjun B R, Ayush Tewari, Abdallah Dib, Tim Weyrich, Bernd Bickel, Hans-Peter Seidel, Hanspeter Pfister, Wojciech Matusik, Louis Chevallier, Mohamed Elgharib, and Christian Theobalt

SIGGRAPH 2021

i3DMM: Deep Implicit 3D Morphable Model of Human Heads

Tarun Yenamandra, Ayush Tewari, Florian Bernard, Hans-Peter Seidel, Mohamed Elgharib, Daniel Cremers, and Christian Theobalt

CVPR 2021 (Oral Presentation)

Monocular Reconstruction of Neural Face Reflectance Fields

Mallikarjun B R, Ayush Tewari, Tae-Hyun Oh, Tim Weyrich, Bernd Bickel, Hans-Peter Seidel, Hanspeter Pfister, Wojciech Matusik, Mohamed Elgharib, and Christian Theobalt

CVPR 2021

Learning Complete 3D Morphable Face Models from Images and Videos

Mallikarjun B R, Ayush Tewari, Hans-Peter Seidel, Mohamed Elgharib, and Christian Theobalt

CVPR 2021

Monocular Real-time Full Body Capture with Inter-part Correlations

Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, and Feng Xu

CVPR 2021

3D Morphable Face Models - Past, Present and Future

Bernhard Egger, Will Smith, Ayush Tewari, Stefanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernard, Timo Bolkart, Adam Kortylewski, Sami Romdhani, Christian Theobalt, Volker Blanz, and Thomas Vetter

ACM Transactions on Graphics 2021

Egocentric Videoconferencing

Mohamed Elgharib*, Mohit Mendiratta*, Justus Thies, Matthias Niessner, Hans-Peter Seidel, Ayush Tewari, Vladislav Golyanik, and Christian Theobalt

SIGGRAPH Asia 2020

PIE: Portrait Image Embedding for Semantic Control

Ayush Tewari, Mohamed Elgharib, Mallikarjun B R, Florian Bernard, Hans-Peter Seidel, Patrick Perez, Michael Zollhoefer, and Christian Theobalt

SIGGRAPH Asia 2020

PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations

Edith Tretschk, Ayush Tewari, Michael Zollhoefer, Vladislav Golyanik, and Christian Theobalt

ECCV 2020

Neural Voice Puppetry: Audio-driven Facial Reenactment

Justus Thies, Mohamed Elgharib, Ayush Tewari, Christian Theobalt, and Matthias Niessner

ECCV 2020

State of the Art on Neural Rendering

Ayush Tewari*, Ohad Fried*, Justus Thies*, Vincent Sitzmann*, Stepehen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Niessner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Schectman, Dan B Goldman, and Michael Zollhoefer

Eurographics State-of-the-Art Report 2020

StyleRig: Rigging StyleGAN for 3D Control over Portrait Images

Ayush Tewari, Mohamed Elgharib, Gaurav Bharaj, Florian Bernard, Hans-Peter Seidel, Patrick Perez, Michael Zollhoefer, and Christian Theobalt

CVPR 2020 (Oral Presentation)

Text-based Editing of Talking-head Video

Ohad Fried, Ayush Tewari, Michael Zollhoefer, Adam Finkelstein, Eli Schectman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, and Maneesh Agrawala

SIGGRAPH 2019

FML: Face Model Learning from Videos

Ayush Tewari, Florian Bernard, Pablo Garrido, Gaurav Bharaj, Mohamed Elgharib, Hans-Peter Seidel, Patrick Perez, Michael Zollhoefer, and Christian Theobalt

CVPR 2019 (Oral Presentation)

High-Fidelity Monocular Face Reconstruction based on an Unsupervised Model-based Face Autoencoder

Ayush Tewari, Michael Zollhoefer, Florian Bernard, Pablo Garrido, Hyeongwoo Kim, Patrick Perez, and Christian Theobalt

TPAMI 2018, special issue on The Best of ICCV 2017

A Hybrid Model for Identity Obfuscation by Face Replacement

Qianru Sun, Ayush Tewari, Weipeng Xu, Mario Fritz, Christian Theobalt, and Bernt Schiele

ECCV 2018

Deep Video Portraits

Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Niessner, Patrick Perez, Christian Richardt, Michael Zollhoefer, and Christian Theobalt

SIGGRAPH 2018

Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz

Ayush Tewari, Michael Zollhoefer, Pablo Garrido, Florian Bernard, Hyeongwoo Kim, Patrick Perez, and Christian Theobalt

CVPR 2018 (Oral Presentation)

InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image

Hyeongwoo Kim, Michael Zollhoefer, Ayush Tewari, Justus Thies, Christian Richardt, and Christian Theobalt

CVPR 2018

MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction

Ayush Tewari, Michael Zollhoefer, Hyeongwoo Kim, Pablo Garrido, Florian Bernard, Patrick Perez, and Christian Theobalt

ICCV 2017 (Oral Presentation)