LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Transfer Learning: Models
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Transfer Learning: Models

86 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 18

MIT's 6.7960 Deep Learning course, taught by Sara Beery, devotes this lecture to transfer learning, the practice of adapting a model trained on one task or dataset to work on another. Beery walks through fine-tuning, where a pretrained network's weights are further adjusted on new data, and linear probing, which freezes the backbone and trains only a lightweight output layer on top of its learned representations. She covers knowledge distillation, the technique of training a smaller student model to reproduce a larger teacher model's behavior, and closes with foundation models, large networks pretrained on broad data that serve as a starting point for many downstream applications. The lecture runs 86 minutes and builds on the course's earlier material on representation learning, treating transfer learning as the practical link between research-scale pretraining and deployable models with limited data or compute.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Generalization Theory

Generalization Theory

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Hacker's Guide to Deep Learning

Hacker's Guide to Deep Learning

MIT · 76 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Representation Learning: Similarity-Based

Representation Learning: Similarity-Based

MIT · 76 MIN