A photo of Ayush Tewari

Ayush Tewari

at2164@cam.ac.uk

Assistant Professor, Department of Engineering
University of Cambridge
Fellow, St John's College

Group / Publications / CV

I work on visual perception and world modelling, studying how to turn observations into representations that support reconstruction, editing, reasoning, and planning. I was previously a postdoc at MIT CSAIL and completed my Ph.D. at the Max Planck Institute for Informatics.

Information for prospective PhD students

PhD Students

Photo of Felix O'Mahony

Felix O'Mahony

Photo of Jieying Chen

Jieying Chen

Photo of Jeffrey Hu

Jeffrey Hu

Photo of Ziyang Fu

Ziyang Fu

Publications

S2PD: Serial-to-Parallel Diffusion for Physically and Logically Consistent Video Generation

Jeffrey Hu, Daniel Olmeda Reino, and Ayush Tewari

arXiv 2026

project page / paper / code
Teaser for Understanding Multi-view Transformers

Understanding Multi-view Transformers

Julien Gaubil*, Michal Stary*, Louis Martinez, Andreas Geiger, Maks Ovsjanikov†, Ayush Tewari†, and Vincent Sitzmann†

NeurIPS 2026

paper / code

UGG: Unified Generative Geometry Model

Amani Kiruga*, Zhiyi Li*, Ruojin Cai*, Hansen Lillemark, Xiaoshan Wu, Ayush Tewari, and Yilun Du (* equal contribution)

NeurIPS 2026

project page / paper / code

3D-Belief: Embodied Belief Inference via Generative 3D World Modeling

Yifan Yin*, Zehao Wen*, Suyu Ye, Jieneng Chen, Zehan Zheng, Nanru Dai, Haojun Shi, Aydan Huang, Zheyuan Zhang, Alan Yuille, Jianwen Xie, Ayush Tewari, and Tianmin Shu (* equal contribution)

arXiv 2026

project page / paper / code

VDAWorld: World Modelling via VLM-Directed Abstraction and Simulation

Felix O'Mahony, Roberto Cipolla, and Ayush Tewari

SIGGRAPH Asia 2026

project page / paper / code / HSPBench / ConwayBench

ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes

Honglin Chen, Karran Pandey, Rundi Wu, Matheus Gadelha, Yannick Hold-Geoffroy, Ayush Tewari, Niloy Mitra, Changxi Zheng, and Paul Guerrero

SIGGRAPH Asia (ACM Transactions on Graphics) 2026

project page / paper

Faster 3D Gaussian Splatting Convergence via Structure-Aware Densification

Linjie Lyu, Ayush Tewari, Jianchun Chen, Thomas Leimkuehler, and Christian Theobalt

SIGGRAPH 2026

project page / paper / code

Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Rendering

Jieying Chen, Jeffrey Hu, Joan Lasenby, and Ayush Tewari

arXiv 2026

project page / paper
Teaser for Perceived authenticity drives gaze behavior when watching AI-generated videos of physical scenes

Perceived authenticity drives gaze behavior when watching AI-generated videos of physical scenes

Danqing Shi, Lan Jiang, Katherine M. Collins, Shangzhe Wu, Ayush Tewari, and Miri Zilka

Scientific Reports 2026

paper
Teaser for Approximating Human-Level 3D Visual Inferences With Deep Neural Networks

Approximating Human-Level 3D Visual Inferences With Deep Neural Networks

Thomas P. O’Connell, Tyler Bonnen, Yoni Friedman, Ayush Tewari, Vincent Sitzmann, Joshua B. Tenenbaum, and Nancy Kanwisher

Open Mind 2025

paper

FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent

Cameron Smith*, David Charatan*, Ayush Tewari, and Vincent Sitzmann (* equal contribution)

3DV 2025

project page / paper / code
Teaser for Manifold Sampling for Differentiable Uncertainty in Radiance Fields

Manifold Sampling for Differentiable Uncertainty in Radiance Fields

Linjie Lyu, Ayush Tewari, Marc Habermann, Shunsuke Saito, Michael Zollhoefer, Thomas Leimkuehler, and Christian Theobalt

SIGGRAPH Asia 2024

project page / paper / code

PickScan: Object discovery and reconstruction from handheld interactions

Vincent van der Brugge, Marc Pollefeys, Joshua B. Tenenbaum, Krishna Murthy Jatavallabhula†, and Ayush Tewari† († equal advising)

IROS 2024

project page / paper
Teaser for COCO-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery

COCO-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery

Anne Harrington, Vasha DuTell, Mark Hamilton, Ayush Tewari, Simon Stent, William T. Freeman, and Ruth Rosenholtz

ICLR 2024

paper / code

Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision

Ayush Tewari*, Tianwei Yin*, George Cazenavette, Semon Rezchikov, Joshua B. Tenenbaum, Fredo Durand, William T. Freeman, and Vincent Sitzmann (* equal contribution)

NeurIPS 2023 (Spotlight)

project page / paper / code

FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flow

Cameron Smith, Yilun Du, Ayush Tewari, and Vincent Sitzmann

NeurIPS 2023

project page / paper / code

Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering

Linjie Lyu, Ayush Tewari, Marc Habermann, Shunsuke Saito, Michael Zollhoefer, Thomas Leimkuehler, and Christian Theobalt

SIGGRAPH Asia 2023

project page / paper

AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars

Mohit Mendiratta, Xingang Pan, Mohamed Elgharib, Kartik Teotia, Mallikarjun B R, Ayush Tewari, Vladislav Golyanik, Adam Kortylewski, and Christian Theobalt

SIGGRAPH Asia 2023

project page / paper

ModalNeRF: Neural Modal Analysis and Synthesis for Free-Viewpoint Navigation in Dynamically Vibrating Scenes

Automne Petitjean, Yohan Poirier-Ginter, Ayush Tewari, Guillaume Cordonnier, and George Drettakis

EGSR, Computer Graphics Forum 2023

project page / paper

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

Xingang Pan, Ayush Tewari, Thomas Leimkuehler, Lingjie Liu, Abhimitra Meka, and Christian Theobalt

SIGGRAPH 2023

project page / paper / code

Learning to Render Novel Views from Wide-Baseline Stereo Pairs

Yilun Du, Cameron Smith, Ayush Tewari†, and Vincent Sitzmann† († equal advising)

CVPR 2023

project page / paper / code

ConceptFusion: Open-set Multimodal 3D Mapping

Krishna Murthy Jatavallabhula, ..., Ayush Tewari, et. al

RSS 2023

project page / paper

Neural Groundplans: Persistent Neural Scene Representations from a Single Image

Prafull Sharma, Ayush Tewari, Yilun Du, Sergey Zakharov, Rares Ambrus, Adrien Gaidon, William T. Freeman, Fredo Durand, Joshua B. Tenenbaum, and Vincent Sitzmann

ICLR 2023

project page / paper
Teaser for Exploring Perceptual Straightness in Learned Visual Representations

Exploring Perceptual Straightness in Learned Visual Representations

Anne Harrington, Vasha DuTell, Ayush Tewari, Mark Hamilton, Simon Stent, Ruth Rosenholtz, and William T. Freeman

ICLR 2023

paper

Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination

Linjie Lyu, Ayush Tewari, Thomas Leimkuehler, Marc Habermann, and Christian Theobalt

ECCV 2022 (Oral Presentation)

project page / paper

GAN2X: Non-Lambertian Inverse Rendering of Image GANs

Xingang Pan, Ayush Tewari, Lingjie Liu, and Christian Theobalt

3DV 2022

project page / paper
Teaser for VoRF: Volumetric Relightable Faces

VoRF: Volumetric Relightable Faces

Pramod Rao, Mallikarjun B R, Gereon Fox, Tim Weyrich, Bernd Bickel, Hanspeter Pfister, Wojciech Matusik, Ayush Tewari, Christian Theobalt, and Mohamed Elgharib

BMVC 2022 (Oral Presentation, Best Paper Honorable Mention)

project page / paper

Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images

Ayush Tewari, Mallikarjun B R, Xingang Pan, Ohad Fried, Maneesh Agrawala, and Christian Theobalt

CVPR 2022

project page / paper
Teaser for Advances in Neural Rendering

Advances in Neural Rendering

Ayush Tewari*, Justus Thies*, Ben Mildenhall*, Pratul Srinivasan*, Edith Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stepehen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, and Vladislav Golyanik (* equal contribution)

Eurographics State-of-the-Art Report 2022

paper
Teaser for StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN

StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN

Gereon Fox, Ayush Tewari, Mohamed Elgharib, and Christian Theobalt

BMVC 2021 (Oral Presentation)

project page / paper
Teaser for Efficient and Differentiable Shadow Computation for Inverse Problems

Efficient and Differentiable Shadow Computation for Inverse Problems

Linjie Lyu, Marc Habermann, Lingjie Liu, Mallikarjun B R, Ayush Tewari, and Christian Theobalt

ICCV 2021

project page / paper
Teaser for Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video

Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video

Edith Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhoefer, Christoph Lassner, and Christian Theobalt

ICCV 2021

project page / paper / code
Teaser for PhotoApp: Photorealistic Appearance Editing of Head Portraits

PhotoApp: Photorealistic Appearance Editing of Head Portraits

Mallikarjun B R, Ayush Tewari, Abdallah Dib, Tim Weyrich, Bernd Bickel, Hans-Peter Seidel, Hanspeter Pfister, Wojciech Matusik, Louis Chevallier, Mohamed Elgharib, and Christian Theobalt

SIGGRAPH 2021

project page / paper
Teaser for i3DMM: Deep Implicit 3D Morphable Model of Human Heads

i3DMM: Deep Implicit 3D Morphable Model of Human Heads

Tarun Yenamandra, Ayush Tewari, Florian Bernard, Hans-Peter Seidel, Mohamed Elgharib, Daniel Cremers, and Christian Theobalt

CVPR 2021 (Oral Presentation)

project page / paper / code
Teaser for Monocular Reconstruction of Neural Face Reflectance Fields

Monocular Reconstruction of Neural Face Reflectance Fields

Mallikarjun B R, Ayush Tewari, Tae-Hyun Oh, Tim Weyrich, Bernd Bickel, Hans-Peter Seidel, Hanspeter Pfister, Wojciech Matusik, Mohamed Elgharib, and Christian Theobalt

CVPR 2021

project page / paper
Teaser for Learning Complete 3D Morphable Face Models from Images and Videos

Learning Complete 3D Morphable Face Models from Images and Videos

Mallikarjun B R, Ayush Tewari, Hans-Peter Seidel, Mohamed Elgharib, and Christian Theobalt

CVPR 2021

project page / paper
Teaser for Monocular Real-time Full Body Capture with Inter-part Correlations

Monocular Real-time Full Body Capture with Inter-part Correlations

Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, and Feng Xu

CVPR 2021

project page / paper
Teaser for 3D Morphable Face Models - Past, Present and Future

3D Morphable Face Models - Past, Present and Future

Bernhard Egger, Will Smith, Ayush Tewari, Stefanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernard, Timo Bolkart, Adam Kortylewski, Sami Romdhani, Christian Theobalt, Volker Blanz, and Thomas Vetter

ACM Transactions on Graphics 2021

paper
Teaser for Egocentric Videoconferencing

Egocentric Videoconferencing

Mohamed Elgharib*, Mohit Mendiratta*, Justus Thies, Matthias Niessner, Hans-Peter Seidel, Ayush Tewari, Vladislav Golyanik, and Christian Theobalt (* equal contribution)

SIGGRAPH Asia 2020

project page / paper
Teaser for PIE: Portrait Image Embedding for Semantic Control

PIE: Portrait Image Embedding for Semantic Control

Ayush Tewari, Mohamed Elgharib, Mallikarjun B R, Florian Bernard, Hans-Peter Seidel, Patrick Perez, Michael Zollhoefer, and Christian Theobalt

SIGGRAPH Asia 2020

project page / paper
Teaser for PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations

PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations

Edith Tretschk, Ayush Tewari, Michael Zollhoefer, Vladislav Golyanik, and Christian Theobalt

ECCV 2020

project page / paper
Teaser for Neural Voice Puppetry: Audio-driven Facial Reenactment

Neural Voice Puppetry: Audio-driven Facial Reenactment

Justus Thies, Mohamed Elgharib, Ayush Tewari, Christian Theobalt, and Matthias Niessner

ECCV 2020

project page / paper / code
Teaser for State of the Art on Neural Rendering

State of the Art on Neural Rendering

Ayush Tewari*, Ohad Fried*, Justus Thies*, Vincent Sitzmann*, Stepehen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Niessner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Schectman, Dan B Goldman, and Michael Zollhoefer (* equal contribution)

Eurographics State-of-the-Art Report 2020

paper
Teaser for StyleRig: Rigging StyleGAN for 3D Control over Portrait Images

StyleRig: Rigging StyleGAN for 3D Control over Portrait Images

Ayush Tewari, Mohamed Elgharib, Gaurav Bharaj, Florian Bernard, Hans-Peter Seidel, Patrick Perez, Michael Zollhoefer, and Christian Theobalt

CVPR 2020 (Oral Presentation)

project page / paper
Teaser for Text-based Editing of Talking-head Video

Text-based Editing of Talking-head Video

Ohad Fried, Ayush Tewari, Michael Zollhoefer, Adam Finkelstein, Eli Schectman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, and Maneesh Agrawala

SIGGRAPH 2019

project page / paper
Teaser for FML: Face Model Learning from Videos

FML: Face Model Learning from Videos

Ayush Tewari, Florian Bernard, Pablo Garrido, Gaurav Bharaj, Mohamed Elgharib, Hans-Peter Seidel, Patrick Perez, Michael Zollhoefer, and Christian Theobalt

CVPR 2019 (Oral Presentation)

project page / paper
Teaser for High-Fidelity Monocular Face Reconstruction based on an Unsupervised Model-based Face Autoencoder

High-Fidelity Monocular Face Reconstruction based on an Unsupervised Model-based Face Autoencoder

Ayush Tewari, Michael Zollhoefer, Florian Bernard, Pablo Garrido, Hyeongwoo Kim, Patrick Perez, and Christian Theobalt

TPAMI 2018, special issue on The Best of ICCV 2017

project page / paper
Teaser for A Hybrid Model for Identity Obfuscation by Face Replacement

A Hybrid Model for Identity Obfuscation by Face Replacement

Qianru Sun, Ayush Tewari, Weipeng Xu, Mario Fritz, Christian Theobalt, and Bernt Schiele

ECCV 2018

project page / paper
Teaser for Deep Video Portraits

Deep Video Portraits

Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Niessner, Patrick Perez, Christian Richardt, Michael Zollhoefer, and Christian Theobalt

SIGGRAPH 2018

project page / paper
Teaser for Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz

Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz

Ayush Tewari, Michael Zollhoefer, Pablo Garrido, Florian Bernard, Hyeongwoo Kim, Patrick Perez, and Christian Theobalt

CVPR 2018 (Oral Presentation)

project page / paper
Teaser for InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image

InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image

Hyeongwoo Kim, Michael Zollhoefer, Ayush Tewari, Justus Thies, Christian Richardt, and Christian Theobalt

CVPR 2018

project page / paper
Teaser for MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction

MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction

Ayush Tewari, Michael Zollhoefer, Hyeongwoo Kim, Pablo Garrido, Florian Bernard, Patrick Perez, and Christian Theobalt

ICCV 2017 (Oral Presentation)

project page / paper