| Date | Class Type | Topic | Resources | Announcements |
|---|---|---|---|---|
| Mon Aug 24, 2026 | Lecture | Overview / Slides (pdf) | Resources
|
HW 1 out - Scalable Entity Resolution and Naive Bayes |
| Wed Aug 26, 2026 | Lecture | Map-Reduce and Spark / Slides (pdf) / Slides (pptx) | ||
| Fri Aug 28, 2026 | Recitation | Recitation: Python Polars | ||
| Mon Aug 31, 2026 | Lecture | Workflows for Map-Reduce Systems / Slides (pdf) / Slides (pptx) | ||
| Wed Sep 2, 2026 | Lecture | Learning as Optimization 1 - Linear and logistic regression, coordinate Descent / Slides (pdf) / Slides (pptx) | ||
| Fri Sep 4, 2026 | Recitation | Recitation: Linear Algebra Review / Slides (pdf) / Notebook | ||
| Wed Sep 9, 2026 | Lecture | Learning as Optimization 2 - Distributed learning, parameter mixing, kernels, all-reduce / Slides (pdf) / Slides (pptx) | HW 1 Slot A due HW 2 out - Parallel Linear Regression |
|
| Fri Sep 11, 2026 | Recitation | HW1 Writing Session | HW 1 Slot A Grading deadline: Sat Sept 12 | |
| Mon Sep 14, 2026 | Lecture | Learning as Optimization 3 - sparsity, hash kernels, matrix factorization / Slides (pdf) / Slides (pptx) | ||
| Wed Sep 16, 2026 | Lecture | Randomized Algorithms 1 - Bloom filters and Count-Min sketches / Slides (pdf) / Slides (pptx) | HW1 Slot B due | |
| Fri Sep 18, 2026 | Recitation | Recitation 3: Probability, Evaluation Metrics and Minhashing | ||
| Mon Sep 21, 2026 | Lecture | Randomized Algorithms 2 - Locality Sensitive Hashing, Minhash and Simhash / Slides (pdf) / Slides (pptx) | HW 2 slot A due HW 3 out - Locality-Sensitive Hashing |
|
| Wed Sep 23, 2026 | Recitation | HW2 Writing Session | HW 2 slot A grading deadline: Sept 26 | |
| Fri Sep 25, 2026 | Lecture | AutoDiff / Slides (pdf) / Slides (pptx) | ||
| Mon Sep 28, 2026 | Lecture | Parallel Optimization with GPUs / Slides (pdf) / Slides (pptx) | HW 3 Slot A due | |
| Wed Sep 30, 2026 | Recitation | HW3 Writing Session | HW 3 Slot A grading deadline: Oct 4 | |
| Fri Oct 2, 2026 | Lecture | Exam Review and QA / Slides (pdf) / Slides (pptx) | HW 3 Slot B due | |
| Mon Oct 5, 2026 | Lecture | Exam 1 | ||
| Wed Oct 7, 2026 | Recitation | No Recitation | Miniproject: 10-605 students apply to lead a miniproject | |
| Fri Oct 9, 2026 | Lecture | Deep Learning: Background and Architectures / Slides (pdf) / Slides (pptx) | HW 4 out - LoRA | |
| Mon Oct 19, 2026 | Lecture | Deep Learning: Transformers / Slides (pdf) / Slides (pptx) | Miniproject: open-ended miniproject proposals due | |
| Wed Oct 21, 2026 | Recitation | Recitation: PyTorch / HW4 / Notebook | ||
| Fri Oct 23, 2026 | Lecture | Hyperparameter Search / Slides (pdf) / Slides (pptx) | Miniproject: feedback on open-ended miniproject proposals given; proposals are posted for class | |
| Mon Oct 26, 2026 | Lecture | Model compression / Slides (pdf) / Slides (pptx) | ||
| Wed Oct 28, 2026 | Recitation | Recitation - HW5 | ||
| Fri Oct 30, 2026 | Lecture | Embarrassingly Parallel Training / Slides (pdf) / Slides (pptx) | HW 4 Slot A due HW 5 out - GPT-2 Training Miniproject: Structured miniproject details released, project teams formed, and declaration form due |
|
| Mon Nov 2, 2026 | Lecture | KV-Caching for LLMs / Slides (pdf) / Slides (pptx) | Miniproject: structured miniproject survey due | |
| Wed Nov 4, 2026 | Recitation | Recitation - Structured miniproject / Slides (pdf) | HW 4 Grading deadline: Nov 5 | |
| Fri Nov 6, 2026 | Lecture | KV Caching and Model Compression Recap / Slides (pdf) / Slides (pptx) | HW4 Slot B Deadline | |
| Mon Nov 9, 2026 | Lecture | Contrastive learning and retrieval | ||
| Wed Nov 11, 2026 | Recitation | HW4 Writing Session | ||
| Fri Nov 13, 2026 | Lecture | RAG / Optimizing Transformer Architectures | HW5 Slot A Due | |
| Mon Nov 16, 2026 | Lecture | Guest Lecture - Leo Boytsov - Robustness, Generalization, and Practical Limits of Deep Learning, A Practitioner’s Perspective | Miniproject: project check in due (written report OR oral check-in - see miniproject handouts). | |
| Wed Nov 18, 2026 | Recitation | HW5 Writing Session | HW5 Slot A grading deadline | |
| Fri Nov 20, 2026 | Lecture | Network Effects and Scalable Evaluation / Slides (pdf) / Slides (pptx) | HW5 slot B deadline | |
| Mon Nov 23, 2026 | Lecture | Exam Review and QA / Slides (pdf) / Slides (pptx) | Miniprojects due | |
| Mon Nov 30, 2026 | Lecture | Exam 2 | ||