Stanford CME295 Transformers and LLMs | Autumn 2026 | Lecture 1 - Transformers

Stanford Online: University Courses & Lectures · Oct 19, 2026 · 1h 51m

For more information about Stanford’s graduate programs, visit: https://online.stanford.edu/graduate-educationTo follow along with the course schedule and syllabus, visit: https://cme295.stanford.edu/syllabus/Chapters:00:00:00 Welcome00:03:43 Difference from last year’s edition00:05:01 Class logistics00:12:42 Timeline00:16:56 Tokenization00:37:27 Word2vec (CBOW, Skip-gram)00:48:26 RNN, LSTM00:55:18 Attention00:57:16 Self-attention mechanism00:59:54 Query, key, value01:09:35 Transformer architecture01:12:19 Input01:16:27 Transformer Encoder01:18:19 Transformer Decoder01:22:16 Computational…