Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 1 - Transformer
1.1M views · Oct 17, 2025 · Education
Comments · 233
@LedioBerdellima · 9 months ago
Bros A/B tested MIT/Stanford
501
@TristanChambers · 2 months ago
Note: The transformer architecture outlined in this lecture is an encoder-decoder design, whereas the typical modern LLM (like GPT) is a decoder only design. The original Attention is All You Need paper was focused on a translation use case exclusively. LLMs like GPT are general purpose models that do not benefit from an encoder stage.
8
@bongkem2723 · 10 months ago
thanks Standford for making this public !!!
175
@DarrylRuggles · 11 months ago
Thanks for providing this fundamental content for free online!!
127
@sfguy4739 · 9 months ago
Basically one person in two bodies
39
@rabbithole9853 · 5 months ago
Thanks for sharing the excellent course. Please keep the video focused on the slides instead of the speaker. In the whole scene view, I can barely see anything on the slides. Thanks again.
18
@apeksytchannel · 7 months ago
I am very pleased that such valuable information is publicly available! Thanks!
33
@DhruvGhulatiG · 1 month ago
In self-attention its not just attention of one word over other words, but across multiple dimensions (grammar, style etc)
1
@sahaneakanayaka3394 · 3 months ago
This is pure gold for anyone learning LLMs. Thanks for sharing your knowledge!
4
@LON310 · 11 months ago
never knew transformers could be this deep
12
@thekingspider241 · 11 months ago
never thought transformers were so cool
17
@vrajpat3lll · 11 months ago
Hey Stanford, I am really grateful to you guys for giving out such golden lectures that have helped me gain some understanding about AI and deep learning! Thanks so much.
18
Up next

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 2 - Transformer-Based Models & Tricks
Stanford Online · 221K views

Stanford CME295 Transformers & LLMs | Autumn 2026 | Lecture 1 - Transformers
Stanford Online · 170K views

How LLMs Work – From Tokens to Embeddings | Embeddings Explained in Hindi| Episode 2
TechWithShas · 12 views

Don't learn AI Agents without Learning these Fundamentals
KodeKloud · 1.2M views

1: Introduction to Neural Networks and Deep Learning; Training Deep NNs
MIT OpenCourseWare · 419K views

Yann LeCun's $1B Bet Against LLMs [Part 1]
Welch Labs · 1.2M views

Prompting Is Dead in 6 Months. Andrew Ng, Stanford
philia · 229K views

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 7 - Agentic LLMs
Stanford Online · 149K views

AI Infrastructure Explained (GPUs, vLLM, and LLM-D)
KodeKloud · 327K views

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 3 - Tranformers & Large Language Models
Stanford Online · 132K views

Deep Dive into LLMs like ChatGPT
Andrej Karpathy · 9.8M views

Stanford CS229 I Machine Learning I Building Large Language Models (LLMs)
Stanford Online · 2.8M views

Bill Gates: A.I. ‘Makes Nuclear Weapons Look Like Nothing’ | The Ezra Klein Show
The Ezra Klein Show and 2 more · 680K views

System Design Course – APIs, Databases, Caching, CDNs, Load Balancing & Production Infra
freeCodeCamp.org · 1.4M views

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 5 - LLM tuning
Stanford Online · 76K views

Transformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown · 11M views

How does AI actually work? Transformers explained
AI Search · 231K views

AI Is Making Coding Cheap. Here's What Matters Now
Perfology Clips · 521K views

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 4 - LLM Training
Stanford Online · 112K views

Visualizing transformers and attention | Talk for TNG Big Tech Day '24
Grant Sanderson · 1.3M views

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 8 - LLM Evaluation
Stanford Online · 193K views

ML Foundations for AI Engineers (in 34 Minutes)
Shaw Talebi · 519K views

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 9 - Recap & Current Trends
Stanford Online · 238K views

System Design Explained: APIs, Databases, Caching, CDNs, Load Balancing & Production Infra
Hayk Simonyan · 687K views

Sir Demis Hassabis on the AI Revolution, the Future of AI and Human Creativity | Hannah Fry
Royal Society of Arts · 223K views