LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Generalization Theory
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Generalization Theory

81 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 6

MIT's 6.7960 Deep Learning, taught by Phillip Isola, devotes this lecture to why overparameterized neural networks generalize at all despite classical statistical learning theory predicting they should overfit. Isola walks through VC dimension and explains why it fails to account for the behavior of modern networks with far more parameters than training examples. He covers the double descent phenomenon, where test error falls, rises, and then falls again as model capacity grows past the interpolation threshold, and connects this to empirical observations across model sizes. The lecture closes on inductive bias, the built-in assumptions that steer a network toward some solutions over others even when many fit the training data equally well. Delivered as a chalkboard and slides lecture at 81 minutes, it assumes familiarity with basic statistical learning concepts and is aimed at students already working through the course's earlier material on optimization and architectures.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Hacker's Guide to Deep Learning

Hacker's Guide to Deep Learning

MIT · 76 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Representation Learning: Similarity-Based

Representation Learning: Similarity-Based

MIT · 76 MIN
Lecture 13: Representation Learning Theory

Lecture 13: Representation Learning Theory

MIT · 75 MIN