News
01/2025 Our paper on GS compression is presented in Arxiv.
07/2024 Our paper on NeRF compression is accepted to MMSP 2024 (Oral).
02/2024 Our paper on MIV system is accepted to TOMM.
09/2023 Our paper on 360 VR streaming is accepted to VCIP 2023 (Oral).
05/2023 Our paper on INR compression is accepted to SPL.
Your browser does not support the video tag.
MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes
Christian Reiser ,
Richard Szeliski ,
Dor Verbin ,
Pratul Srinivasan ,
Ben Mildenhall ,
Andreas Geiger ,
Jonathan T. Barron ,
Peter Hedman
SIGGRAPH , 2023
project page
/
video
/
arXiv
We use volumetric rendering with a sparse 3D feature grid and 2D feature planes to do real-time view synthesis.
AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training
Yifan Jiang ,
Peter Hedman ,
Ben Mildenhall ,
Dejia Xu ,
Jonathan T. Barron ,
Zhangyang Wang ,
Tianfan Xue
CVPR , 2023
project page
/
arXiv
Accounting for misalignment due to scene motion or calibration errors improves NeRF reconstruction quality.
Your browser does not support the video tag.
DreamFusion: Text-to-3D using 2D Diffusion
Ben Poole ,
Ajay Jain ,
Jonathan T. Barron ,
Ben Mildenhall
ICLR , 2023   (Oral Presentation, Outstanding Paper Award)
project page
/
arXiv
/
gallery
We optimize a NeRF from scratch using a pretrained text-to-image diffusion model to do text-to-3D generative modeling.
Learning a Diffusion Prior for NeRFs
Guandao Yang ,
Abhijit Kundu ,
Leonidas J. Guibas ,
Jonathan T. Barron ,
Ben Poole
ICLR Workshop , 2023
Training a diffusion model on grid-based NeRFs lets you (conditionally) sample NeRFs.
MIRA: Mental Imagery for Robotic Affordances
Lin Yen-Chen ,
Pete Florence ,
Andy Zeng , Jonathan T. Barron ,
Yilun Du ,
Wei-Chiu Ma ,
Anthony Simeonov ,
Alberto Rodriguez ,
Phillip Isola
CoRL , 2022
NeRF lets us synthesize novel orthographic views that work well with pixel-wise algorithms for robotic manipulation.
SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image Collections
Mark Boss ,
Andreas Engelhardt ,
Abhishek Kar ,
Yuanzhen Li ,
Deqing Sun ,
Jonathan T. Barron ,
Hendrik P. A. Lensch ,
Varun Jampani
NeurIPS , 2022
project page /
video /
arXiv
A joint optimization framework for estimating shape, BRDF, camera pose, and illumination from in-the-wild image collections.
Micropapers
Squareplus: A Softplus-Like Algebraic Rectifier
A Convenient Generalization of Schlick's Bias and Gain Functions
Continuously Differentiable Exponential Linear Units
Scholars & Big Models: How Can Academics Adapt?
Recorded Talks
View Dependent Podcast, 2024
Bay Area Robotics Symposium, 2023
EGSR Keynote, 2021
TUM AI Lecture Series, 2020
Vision & Graphics Seminar at MIT, 2020
Academic Service
Lead Area Chair, ICCV 2025
Lead Area Chair, CVPR 2025
Area Chair, CVPR 2024
Demo Chair, CVPR 2023
Area Chair, CVPR 2022
Area Chair & Award Committee Member, CVPR 2021
Area Chair, CVPR 2019
Area Chair, CVPR 2018
Teaching
Graduate Student Instructor, CS188 Spring 2011
Graduate Student Instructor, CS188 Fall 2010
Figures, "Artificial Intelligence: A Modern Approach", 3rd Edition