LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Hacker's Guide to Deep Learning
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Hacker's Guide to Deep Learning

76 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 9

Phillip Isola devotes this MIT 6.7960 Deep Learning session to the practical craft of getting neural networks to actually work, rather than to new theory. He runs through opinionated, hard won tips on debugging training runs, diagnosing why a network refuses to learn, choosing learning rates and initialization schemes, and reading loss curves for early warning signs of trouble. The lecture leans on anecdotes from his own research practice, treating deep learning training as an empirical, almost experimental skill rather than a purely mathematical one. Topics include overfitting checks, sanity tests for new code, and the small habits that separate a model that trains cleanly from one that silently fails. Delivered to MIT students as part of the Fall 2024 course, it is aimed at anyone who already knows the basic architecture of neural networks and wants to know how working researchers actually get them to converge.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Generalization Theory

Generalization Theory

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Representation Learning: Similarity-Based

Representation Learning: Similarity-Based

MIT · 76 MIN
Lecture 13: Representation Learning Theory

Lecture 13: Representation Learning Theory

MIT · 75 MIN