Publications
A (probably not up to date) list of our publications.
CHI 2025
ARticulate: Interactive Visual Guidance for Demonstrated Rotational Degrees of Freedom in Mobile AR
Nhan Tran, Ethan Yang, and Abe Davis.
More details coming soon!
CVPR 2020 (Selected for Oral Presentation)
Visual Chirality
Zhiqiu Lin, Jin Sun, Abe Davis, Noah Snavely
Nominated for Best Paper
How does reflection change what we learn from images? Despite widespread use in data augmentation, people had not looked closely at this question before our work.
CVPR Workshop on Computer Vision for Augmented and Virtual Reality
Head-mounted Augmented Reality for Guided Surface Reflectance Capture
Harald Haraldsson, Søren Skovsen, Ser-Nam Lim, Steve Marschner, Serge Belongie, Abe Davis
CVPR Workshop on Computer Vision for Augmented and Virtual Reality
Decoupled Localization and Sensing with HMD-based AR for Interactive Scene Acquisition
Søren Skovsen, Harald Haraldsson, Abe Davis, Henrik Karstoft, Serge Belongie
IWSHM 2019
Modal Imaging of Portsmouth, New Hampshire Bridge for Video-Based Structural Health Monitoring
Abe Davis, Justin G. Chen, Abe Davis, Travis M. Adams, Hao Sun, Erin S. Bell, Fredo Durand, Oral Buyukozturk
Comparing modal images of a bridge with an FEM model of that bridge.
IWSHM 2017
Structural Health Monitoring from the Window Seat of a Passenger Airplane
Abe Davis, Justin G. Chen, Oral Buyukozturk, Fredo Durand, Doug L. James
Winner, SHM In Action 2017
Monitoring the vibration modes of an airplane wing from the window seat using a mobile phone.
SIGGRAPH 2017
Computational Video Editing for Dialogue-Driven Scenes
Mackenzie Leake, Abe Davis, Anh Truong and Maneesh Agrawala
Computational tools for fast, high-level, editing of multiple video takes for dialogue driven scenes.
PAMI 2016
Visual Vibrometry: Estimating Material Properties from Small Motions in Video
Abe Davis*, Katherine L. Bouman*, Justin G. Chen, Michael Rubinstein, Oral Buyukozturk, Fredo Durand, William T. Freeman
Improving on our CVPR 2015 paper, we adding additional analysis, showed you could do damping estimation, and infer hidden structure (e.g., tell whether a container is leaking).
19th World Conference on Non-Destructive Testing 2016 (WCNDT)
Smaller Than the Eye Can See: Vibration Analysis with Video Cameras
Oral Buyukozturk, Justin G. Chen, Neal Wadhwa, Abe Davis, Frédo Durand, and William T. Freeman
Including visual vibration analysis of earthquakes!
MIT EECS PhD Thesis
Visual Vibration Analysis
Abe Davis
Winner of the MIT Sprowls thesis award
ACM SIGGRAPH Thesis Award, Honorable mention
My dissertation on visual vibration analysis and its applications.
SIGGRAPH Asia 2015
"Image-Space Modal Bases for Plausible Manipulation of Objects in Video"
Abe Davis, Justin Chen, Fredo Durand
This paper describes an improved version of the demo I showed at the end of my TED 2015 talk (with some improvements since TED) and demonstrates applications related to low-cost special effects.
International Symposium Non-Destructive Testing in Civil Engineering
Video Camera-based Vibration Measurement for Condition Assessment of Civil Infrastructure
Chen, J. G.; Davis, A.; Wadhwa, N.; Durand, F.; Freeman, W. T.; Buyukozturk, O.
More work with folks from the Civil Engineering department on NDT of structures using visual vibration analysis.
10th International Workshop on Structural Health Monitoring (IWSHM 2015)
Long Distance Video Camera Measurements Of Structures
Justin G. Chen, Neal Wadhwa, Abe Davis, Fredo Durand, William T. Freeman, Oral Buyukozturk
Work with folks from the Civil Engineering department looking at how distance effects visual vibration analysis for NDT of structures. I presented this at IWSHM 2015.
TOG / SIGGRAPH 2015
Light Field Reconstruction Using Sparsity in the Continuous Fourier Domain
Lixin Shi, Haitham Hassanieh, Abe Davis, Dina Katabi, Fredo Durand
1) We show that light fields are really only sparse in the continuous frequency domain,
and 2) We show how to leverage that sparsity in an optimization over continuous frequencies to reconstruct even highly non-Lambertian light fields.
SIGGRAPH 2014
The Visual Microphone: Passive Recovery of Sound from Video
Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham J. Mysore, Fredo Durand, William T. Freeman
Discover Magazine Best Science Breakthroughs of 2014, #32
This project received a lot of press. Check out the project webpage for some examples. Also check out the Code.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR 2012)
Laser Speckle Photography for Surface Tampering Detection
YiChang Shih, Abe Davis, Samuel W. Hasinoff, Fredo Durand, and William T. Freeman
Google Student Travel Award
Use lasers to detect tampering with a surface. We can detect whether someone has lightly touched a surface even if they were wearing gloves! This system also uses AR for ultra-precise rephotography.
