Course links

Work in progress: this part of the notes is still being revised.

Course links

CourseLinksRole
Stanford CS224N, Spring 2024 — Christopher Manning, Natural Language Processing with Deep LearningCourse · Lecture playlistMain course: word vectors, language models, pretraining, post-training, evaluation, reasoning and agents, machine translation, and parsing (chapters 2–3, 5, 9–16). Its four assignments cover word vectors, a neural dependency parser, attention-based translation, and pretraining and fine-tuning a small transformer.
Stanford CS336, Spring 2025 — Percy Liang and Tatsunori Hashimoto, Language Modeling from ScratchCourse · Lecture playlist · Lecture materials · Spring 2026 recordingsMain course: building a language model end to end, from tokenization, architectures, mixture of experts, and resource accounting to scaling laws, inference, evaluation, data, and alignment with reinforcement learning (chapters 1, 4, 6–8, 11–12, 14). Several lectures are executable Python files viewed in the course’s trace viewer. Its five assignments build a tokenizer and transformer, systems optimizations, a scaling-law study, a data pipeline, and post-training for mathematical reasoning.
CMU 11-711, Fall 2025 — Sean Welleck, Advanced Natural Language ProcessingCourse page with slides · CodeSupplement: in-context learning, fine-tuning, decoding and inference-time algorithms, retrieval, evaluation and experimental design, reinforcement learning for language models, and agents (chapters 5, 8–10, 12–14). The code repository has short notebooks for many lectures.

Code resources complement the courses:

ResourceLinkRole
Andrej Karpathy, Neural Networks: Zero to HeroPlaylistCode-along lectures from a counting bigram model to a GPT, and a byte-level BPE tokenizer (chapters 1, 2, and 4).
nanoGPT and minbpenanoGPT · minbpeMinimal, readable implementations of a GPT training loop and a BPE tokenizer (chapters 1 and 4).
CS336 assignmentsCourseThe five assignments with tests and handouts, the most thorough exercises for chapters 1, 4, 6–7, and 11–12.

The reading plan maps individual lectures, slides, and readings to the study sequence. Video links arranges the recordings by chapter, and the NLP overview maps the reading-plan topics to the chapters.