Carl Vondrick

Carl Vondrick

Research Scientist, Google
Assistant Professor, Columbia University

cvondrick@gmail.com

Research Overview

My research studies computer vision and machine learning. My work often capitalizes on large amounts of raw data to efficiently teach machines, for example by learning without human supervision or transferring knowledge between tasks and modalities. I am interested in learning rich models of events and scenes that generalize to new tasks and predict unseen outcomes. Other interests include interpretable models, high-level reasoning, and perception for robotics.

We are looking for graduate students, undergraduates, and postdocs to start September 2018.

About Me

I am currently a research scientist at Google Research.

In Fall 2018, I will be an assistant professor in the computer science department at Columbia University.

I received my Ph.D. from MIT where I was advised by Antonio Torralba. My thesis was supported by fellowships from Google and NSF. I obtained my bachelors degree from UC Irvine advised by Deva Ramanan.

News

  • A paper accepted to PAMI, a paper at ICCV 2017, and a paper at CVPR 2017.
  • I will be an area chair for CVPR 2018.
  • Our sound recognition work is covered on NPR, New Scientist, and a children's magazine!
  • Our video generation work is covered on NBC and Scientific American.
  • Two papers at NIPS 2016.
  • Our action prediction work is covered on CNN, NPR, AP, Wired and Colbert!
  • Three papers at CVPR 2016.

Papers

Cross-Modal Scene Networks New!
Yusuf Aytar*, Lluis Castrejon*, Carl Vondrick, Hamed Pirsiavash, Antonio Torralba
PAMI 2017
Paper Project Page

Following Gaze in Video New!
Adria Recasens, Carl Vondrick, Aditya Khosla, Antonio Torralba
ICCV 2017
Paper

See, Hear, and Read: Deep Aligned Representations New!
Yusuf Aytar, Carl Vondrick, Antonio Torralba
arXiv
Paper Project Page

Generating the Future with Adversarial Transformers New!
Carl Vondrick, Antonio Torralba
CVPR 2017
Paper Project Page

Generating Videos with Scene Dynamics New!
Carl Vondrick, Hamed Pirsiavash, Antonio Torralba
NIPS 2016
Paper Project Page Code NBC Scientific American New Scientist MIT News

Who is Mistaken?
Benjamin Eysenbach, Carl Vondrick, Antonio Torralba
arXiv
Paper Project Page

Predicting Motivations of Actions by Leveraging Text
Carl Vondrick, Deniz Oktay, Hamed Pirsiavash, Antonio Torralba
CVPR 2016
Paper Dataset

Learning Aligned Cross-Modal Representations from Weakly Aligned Data
Lluis Castrejon*, Yusuf Aytar*, Carl Vondrick, Hamed Pirsiavash, Antonio Torralba
CVPR 2016
Paper Project Page Demo

Visualizing Object Detection Features
Carl Vondrick, Aditya Khosla, Hamed Pirsiavash, Tomasz Malisiewicz, Antonio Torralba
IJCV 2016
Paper Project Page Slides MIT News

Where are they looking?
Adria Recasens*, Aditya Khosla*, Carl Vondrick, Antonio Torralba
NIPS 2015
Paper Project Page Demo

Do We Need More Training Data?
Xiangxin Zhu, Carl Vondrick, Charless C. Fowlkes, Deva Ramanan
IJCV 2015
Paper Dataset

Learning Visual Biases from Human Imagination
Carl Vondrick, Hamed Pirsiavash, Aude Oliva, Antonio Torralba
NIPS 2015
Paper Project Page Technology Review

Assessing the Quality of Actions
Hamed Pirsiavash, Carl Vondrick, Antonio Torralba
ECCV 2014
Paper Project Page

HOGgles: Visualizing Object Detection Features
Carl Vondrick, Aditya Khosla, Tomasz Malisiewicz, Antonio Torralba
ICCV 2013
Paper Project Page Slides MIT News

Do We Need More Training Data or Better Models for Object Detection?
Xiangxin Zhu, Carl Vondrick, Deva Ramanan, Charless C. Fowlkes
BMVC 2012
Paper Dataset

Efficiently Scaling Up Crowdsourced Video Annotation
Carl Vondrick, Donald Patterson, Deva Ramanan
IJCV 2012
Paper Project Page

Efficiently Scaling Up Video Annotation with Crowdsourced Marketplaces
Carl Vondrick, Deva Ramanan, Donald Patterson
ECCV 2010
Paper Project Page