LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Metrized Deep Learning
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Metrized Deep Learning

68 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 22

Jeremy Bernstein presents his research on metrized deep learning as part of MIT's 6.7960 Deep Learning course, Fall 2024. The lecture works through modular neural network design, treating a network as a composition of modules that each carry their own notion of size, and shows how this metric structure informs optimization. Bernstein connects the framework to scaling behavior, explaining why certain architectural choices allow training to remain stable as models grow larger. He develops duality principles that link the geometry of weight space to the geometry of gradients, and uses these ideas to motivate optimizer design choices that depart from standard gradient descent. Running 68 minutes, the talk assumes familiarity with neural network basics and moves quickly into original research territory, aimed at students and researchers who want the mathematical reasoning behind modern large scale training methods rather than an introductory survey of deep learning.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Generalization Theory

Generalization Theory

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Hacker's Guide to Deep Learning

Hacker's Guide to Deep Learning

MIT · 76 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Representation Learning: Similarity-Based

Representation Learning: Similarity-Based

MIT · 76 MIN