| Date | Class Type | Topic | Resources | Announcements |
|---|---|---|---|---|
| Mon Jan 13, 2025 | Lecture | Overview / Slides |
|
HW - Entity Resolution in Spark |
| Wed Jan 15, 2025 | Lecture | Map-Reduce and Spark / Slides | ||
| Fri Jan 17, 2025 | Recitation | Recitation: PySpark |
|
|
| Wed Jan 22, 2025 | Lecture | Workflows for Map-Reduce Systems |
|
|
| Fri Jan 24, 2025 | Recitation | Recitation: Linear Algebra Review |
|
|
| Mon Jan 27, 2025 | Lecture | Learning as Optimization |
|
HW parallel linear regression with Spark |
| Wed Jan 29, 2025 | Lecture | Parallel Optimization 1 |
|
|
| Fri Jan 31, 2025 | Recitation | Recitation: TBD |
|
|
| Mon Feb 3, 2025 | Lecture | Parallel Optimization 2 |
|
|
| Wed Feb 5, 2025 | Lecture | AutoDiff as Optimization Infrastructure |
|
|
| Fri Feb 7, 2025 | Recitation | Recitation: TBD |
|
|
| Mon Feb 10, 2025 | Lecture | Randomized Algorithms 1 |
|
HW: LSH |
| Wed Feb 12, 2025 | Lecture | Randomized Algorithms 2 |
|
|
| Fri Feb 14, 2025 | Recitation | Recitation: TBD |
|
|
| Mon Feb 17, 2025 | Lecture | Parallel Optimization with GPUs 1 |
|
|
| Wed Feb 19, 2025 | Lecture | Parallel Optimization with GPUs 2 |
|
|
| Fri Feb 21, 2025 | Recitation | Recitation: Practice Exam |
|
Previous HW due |
| Mon Feb 24, 2025 | Lecture | Exam Review and QA |
|
|
| Wed Feb 26, 2025 | Lecture | Exam 1 |
|
|
| Mon Mar 10, 2025 | Lecture | Deep Learning: Background and Architectures |
|
HW: LoRA |
| Wed Mar 12, 2025 | Lecture | Deep Learning: Architectures and Param Efficient Tuning |
|
|
| Fri Mar 14, 2025 | Recitation | Recitation: PyTorch |
|
|
| Mon Mar 17, 2025 | Lecture | Deep Learning: Scaling Transformers 1 |
|
|
| Wed Mar 19, 2025 | Lecture | Deep Learning: Scaling Transformers 1 |
|
|
| Fri Mar 21, 2025 | Lecture | Recitation TBD |
|
|
| Mon Mar 24, 2025 | Lecture | Hyperparameter Search and Scaling Laws |
|
HW: GPT-2 Training and Miniproject released |
| Wed Mar 26, 2025 | Lecture | Distributed Training Methods |
|
|
| Fri Mar 28, 2025 | Recitation | Recitation TBD |
|
|
| Mon Mar 31, 2025 | Lecture | Contrastive learning 1 |
|
|
| Wed Apr 2, 2025 | Lecture | Retrieval Augmented Generation 1 |
|
|
| Mon Apr 7, 2025 | Lecture | Retrieval Augmented Generation 2 |
|
Previous HW due |
| Wed Apr 9, 2025 | Lecture | Parameter Servers |
|
|
| Fri Apr 11, 2025 | Recitation | Recitation TBD |
|
|
| Mon Apr 14, 2025 | Lecture | Scalable Graph Processing 1 |
|
|
| Wed Apr 16, 2025 | Lecture | Scalable Graph Processing 2 |
|
|
| Fri Apr 18, 2025 | Recitation | Recitation TBD |
|
|
| Mon Apr 21, 2025 | Lecture | Exam Review and QA |
|
Miniproject due |
| Wed Apr 23, 2025 | Lecture | Exam 2 |
|
|