LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Language Models
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Language Models

77 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 21

MIT's Deep Learning course (6.7960, Fall 2024) turns this session over to a guest lecturer covering large language models in practice. The lecture works through prompting strategies, chain-of-thought reasoning, and instruction-tuning, framing these techniques through the lens of in-context learning: how a model trained only to predict text can be steered, at inference time, to follow instructions or reason step by step without additional gradient updates. The talk builds on the course's earlier neural network foundations to explain why these behaviors emerge and what they reveal about how transformer-based LMs represent tasks internally. Delivered as a 77-minute session, it sits within MIT OpenCourseWare's public release of the full course, aimed at students who already have some background in deep learning architectures and want a focused treatment of how modern LMs are prompted and adapted.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Generalization Theory

Generalization Theory

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Hacker's Guide to Deep Learning

Hacker's Guide to Deep Learning

MIT · 76 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Representation Learning: Similarity-Based

Representation Learning: Similarity-Based

MIT · 76 MIN