 |
|
About me
I am an assistant professor in EECS at MIT studying computer vision, machine learning, and AI.
Previously, I spent a year as a visiting research scientist at OpenAI, and before that I was a postdoctoral scholar with Alyosha Efros in the EECS department at UC Berkeley. I completed my Ph.D. in Brain & Cognitive Sciences at MIT, under the supervision of Ted Adelson, where I also frequently worked with Aude Oliva. I received my undergraduate degree in Computer Science from Yale, where I got my start on research working with Brian Scholl.
I study why we represent the world the way we do, and how we can replicate these abilities in machines.
Teaching
6.819/6.869: Advances in Computer Vision (Fall 2019)6.882: Embodied Intelligence (Spring 2019)
6.819/6.869: Advances in Computer Vision (Fall 2018)
Students
Lucy ChaiYen-Chen Lin
Joseph Suarez
Yonglong Tian (co-advised with Josh Tenenbaum)
Tongzhou Wang (co-advised with Antonio Torralba)
Papers
| Preprints | |
| On the "steerability" of generative adversarial networks Ali Jahanian*, Lucy Chai*, Phillip Isola arXiv 2019. [Paper][Website][Code] | |
| Contrastive Multiview Coding Yonglong Tian, Dilip Krishnan, Phillip Isola arXiv 2019. [Paper][Website][Code] | |
| Learning to Control Self-Assembling Morphologies: A Study of Generalization via Modularity Deepak Pathak*, Chris Lu*, Trevor Darrell, Phillip Isola, Alexei A. Efros arXiv 2019. [Paper][Website][Code] | |
| Neural MMO: A Massively Multiagent Game Environment for Training and Evaluating Intelligent Agents Joseph Suarez, Yilun Du, Phillip Isola, Igor Mordatch arXiv 2019. [Paper][Blog][Code] | |
2019 | |
| GANalyze: Toward Visual Definitions of Cognitive Image Properties Lore Goetschalckx*, Alex Andonian, Aude Oliva, Phillip Isola ICCV 2019. [Paper][Website][Code] | |
| InGAN: Capturing and Remapping the "DNA" of a Natural Image Assaf Shocher, Shai Bagon, Phillip Isola, Michal Irani ICCV 2019 (oral). [Paper][Website] | |
| Omnipush: accurate, diverse, real-world dataset of pushing dynamics with RGBD images Maria Bauza, Ferran Alet, Yen-Chen Lin, Tomás Lozano-Pérez, Leslie P. Kaelbling, Phillip Isola, Alberto Rodriguez IROS 2019. [Paper][Website] | |
2018 | |
| Evolved Policy Gradients Rein Houthooft, Richard Y. Chen, Phillip Isola, Bradly C. Stadie, Filip Wolski, Jonathan Ho, Pieter Abbeel NeurIPS 2018. [Paper][Blog][Code] | |
| CyCADA: Cycle-Consistent Adversarial Domain Adaptation Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei A. Efros, Trevor Darrell ICML 2018. [Paper] | |
| Memorable words are monogamous: The role of synonymy and homonymy in word recognition memory Kyle Mahowald*, Phillip Isola*, Evelina Fedorenko, Edward Gibson, Aude Oliva PsyArXiv 2018. [Paper] | |
| The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Schechtman, Oliver Wang CVPR 2018. [Paper][Website][Code] | |
| What You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction Johanna Delanoy, Adrien Bousseau, Mathieu Aubry, Phillip Isola, Alexei A. Efros I3D 2018. [Paper][Video] | |
2017 | |
| Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks Jun-Yan Zhu*, Taesung Park*, Phillip Isola, Alexei A. Efros ICCV 2017. [Paper][Website][Code] | |
| Combining Self-Supervised Learning and Imitation for Vision-Based Rope Manipulation Ashvin Nair, Pulkit Agrawal, Dian Chen, Phillip Isola, Pieter Abbeel, Jitendra Malik, Sergey Levine ICRA 2017. [Paper][Website][Video] | |
| Richard Zhang*, Jun-Yan Zhu*, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, Alexei A. Efros Real-Time User-Guided Image Colorization with Learned Deep Priors SIGGRAPH 2017. [Paper][Website][Code][Video] | |
| Ali Jahanian, Phillip Isola, Donglai Wei Mining Visual Evolution in 21 Years of Web Design CHI Extended Abstract, 2017. [Paper] | |
| Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A. Efros Image-to-Image Translation with Conditional Adversarial Networks CVPR, 2017. [Paper][Website][Code][Demo] | |
| Richard Zhang, Phillip Isola, Alexei A. Efros Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction CVPR, 2017. [Paper][Website][Code] | |
2016 | |
| Richard Zhang, Phillip Isola, Alexei A. Efros Colorful Image Colorization European Conference on Computer Vision (ECCV), 2016 (oral). [Paper][Website][Code][Demo] | |
| Andrew Owens, Phillip Isola, Josh McDermott, Antonio Torralba, Edward H. Adelson, William T. Freeman Visually Indicated Sounds IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (oral). [Paper][Website][Video][Dataset (50GB)] | |
| Phillip Isola, Daniel Zoran, Dilip Krishnan, Edward H. Adelson Learning Visual Groups From Co-occurrences in Space and Time International Conference on Learning Representations, Workshop paper, 2016 [Paper] | |
2015 | |
| Daniel Zoran, Phillip Isola, Dilip Krishnan, William T. Freeman Learning Ordinal Relationships for Mid-Level Vision International Conference on Computer Vision (ICCV), 2015. [Paper][Website][Code] | |
| Phillip Isola*, Joseph J. Lim*, Edward H. Adelson Discovering States and Transformations in Image Collections IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015 (oral). [Paper][Website][Dataset] | |
| Zoya Bylinskii, Phillip Isola, Constance Bainbridge, Antonio Torralba, Aude Oliva Intrinsic and Extrinsic Effects on Image Memorability Vision Research, 2015. [Paper][Website][Code][Dataset] | |
| Zhengdong Zhang, Phillip Isola, Edward H. Adelson Sparkle Vision: Seeing the World through Random Specular Microfacets 4th IEEE International Workshop on Computational Cameras and Displays, 2015. [Paper] | |
2014 | |
| Phillip Isola, Daniel Zoran, Dilip Krishnan, Edward H. Adelson Crisp Boundary Detection Using Pointwise Mutual Information European Conference on Computer Vision (ECCV), 2014 (oral). [Paper][Website][Code] | |
| Phillip Isola, Jianxiong Xiao, Devi Parikh, Antonio Torralba, Aude Oliva What Makes a Photograph Memorable? Pattern Analysis and Machine Intelligence (PAMI), 2013. [Paper][Website][Dataset] | |
2013 | |
| Phillip Isola and Ce Liu Scene Collaging: Analysis and Synthesis of Natural Images with Semantic Layers. International Conference on Computer Vision (ICCV), 2013. [Paper][Website] | |
| Michelle Borkin, Azalea Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, Hanspeter Pfister What Makes a Visualization Memorable? IEEE Transactions on Visualization and Computer Graphics (Infovis), 2013. [Paper][Website] | |
| Wilma A. Bainbridge, Phillip Isola, Aude Oliva The Intrinsic Memorability of Face Images. Journal of Experimental Psychology: General, 2013. [Paper][Website][Dataset] | |
| Aude Oliva, Phillip Isola, Aditya Khosla, Wilma A. Bainbridge What makes a picture memorable? SPIE Newsroom Article, 2013. [Article] | |
2012 | |
| Aditya Khosla*, Jianxiong Xiao*, Phillip Isola, Antonio Torralba, Aude Oliva Image Memorability and Visual Inception. SIGGRAPH Asia Technical Briefs (Invited Paper), 2012. [Paper] | |
| Forrester Cole, Phillip Isola, William T. Freeman, Fredo Durand, Edward H. Adelson Shapecollage: Occlusion-aware, example-based shape interpretation. European Conference on Computer Vision (ECCV), 2012. [Paper][Website] | |
| Wilma A. Bainbridge*, Phillip Isola*, Idan Blank, Aude Oliva Establishing a database for studying human face photograph memorability. Proceedings of the Annual Conference of the Cognitive Sciences Society, 2012. [Paper][Website][Dataset] | |
2011 | |
| Phillip Isola, Devi Parikh, Antonio Torralba, Aude Oliva Understanding the intrinsic memorability of images. NeurIPS, 2011. [Paper]Website] | |
| Phillip Isola, Jianxiong Xiao, Antonio Torralba, Aude Oliva What makes an image memorable? IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011. [Paper][Website][Dataset] | |
2008 | |
| Nicholas B. Turk-Browne, Phillip Isola, Brian J. Scholl, Teresa A. Treat Multidimensional visual statistical learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 2008. [Paper] |
