Jacob Andreas

My research focuses on using natural language as a tool for building intelligent systems, and on understanding the prediction problems that shape language and other learned representations.

I'm an assistant professor at MIT in EECS and CSAIL. I earned my PhD at Berkeley, where I was a member of the Berkeley NLP Group and the Berkeley AI Research Lab. Previously I worked with the Cambridge NLIP Group, and the Center for Computational Learning Systems and NLP Group at Columbia.

Prospective students: apply through the MIT graduate admissions portal in the fall. (I'm afraid I can't respond to emails individually.)

jda@mit.edu, Curriculum vitæ, Google scholar, elsewhere


Talks / Papers


Some current research directions:

Learning from language

Much of humans' abstract knowledge comes from descriptions (texts, diagrams, etc.), but almost all machine learning research focuses on learning from demonstrations or interactions. How do we enable more natural and efficient learning from natural language supervision instead?

Papers:
Modular multitask reinforcement learning with policy sketches (ICML 2017)
Learning with latent language (NAACL 2018)

Interpretation and explanation

How can we help humans understand the features and representational strategies that black-box machine learning algorithms discover? To what extent do these strategies reflect abstractions that we already have names for?

Papers:
Translating neuralese (ACL 2017)
Analogs of linguistic structure in deep representations (EMNLP 2017)

Compositionality and learning

Compositionality and modularity are core features of representational systems in language, software and biology. But what problem do compositional representations actually solve? Can we use descriptions of abstract compositional structure in one domain (e.g. language) to learn modular representations in another (e.g. vision)?

Papers:
Neural module networks (CVPR 2016)
Measuring compositionality in representation learning (ICLR 2019)

I'm also interested in trees, graphs, games, and pianos.


Collaboration graph trivia: My Erdős number is at most three (J Andreas to R Kleinberg to L Lovász to P Erdős). My Kevin Bacon number (and consequently my Erdős-Bacon number) remains lamentably undefined, but my Kevin Knight number (since apparently that's a thing) is one. I have never starred in a film with Kevin Knight. Noam Chomsky is my great-great-grand-advisor (J Andreas to D Klein to C Manning to J Bresnan to N Chomsky).


Opinionated bibliographies on:
module networks
language and behavior