6.829 Fall 2020 Paper Questions

For each paper, by 12AM the evening before lecture:

Submit your answer for each lecture's paper question via the submission web site

Q1: What are the differences between Data Parallelism, Model Parallelism, and Pipeline Parallelism in distributed training?

6.829 home