LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Lecture 13: Representation Learning Theory
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Lecture 13: Representation Learning Theory

75 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 13

Jeremy Bernstein lectures on the theory behind representation learning in MIT's 6.7960 Deep Learning course, Fall 2024. The lecture examines architectural inductive biases, the assumptions built into a network's structure that shape what it can learn efficiently, and works through the connection between wide neural networks and Gaussian processes. Bernstein develops the mathematical framework linking these two areas, showing how infinite-width limits of neural networks converge to Gaussian process behavior and what that reveals about generalization. The talk builds on earlier sessions in the course and assumes familiarity with basic deep learning concepts and probability. Runtime is 75 minutes, delivered as a standard chalkboard and slides lecture with MIT OpenCourseWare production values.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Generalization Theory

Generalization Theory

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Hacker's Guide to Deep Learning

Hacker's Guide to Deep Learning

MIT · 76 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Representation Learning: Similarity-Based

Representation Learning: Similarity-Based

MIT · 76 MIN