LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Representation Learning: Similarity-Based
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Representation Learning: Similarity-Based

76 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Deep Learning · LECTURE 12

Sara Beery lectures on similarity-based representation learning as part of MIT's 6.7960 Deep Learning course. She covers metric learning and contrastive learning, comparing self-supervised and supervised approaches to building useful embeddings. The lecture works through the InfoNCE loss function and the alignment and uniformity principles used to evaluate whether a learned representation space is well structured. Beery also addresses the practical problem of hard negatives, explaining why the choice of negative examples during training strongly affects what a model actually learns. Running about 76 minutes, the session fits into the course's broader unit on representation learning and assumes familiarity with basic neural network training concepts. It is a technical, board-and-slides style lecture aimed at students already working through the course's deep learning curriculum.

More from this course

12 LECTURES
Introduction to Deep Learning

Introduction to Deep Learning

MIT · 61 MIN
How to Train a Neural Net

How to Train a Neural Net

MIT · 80 MIN
Approximation Theory

Approximation Theory

MIT · 83 MIN
Architectures: Grids

Architectures: Grids

MIT · 84 MIN
Architectures: Graphs

Architectures: Graphs

MIT · 81 MIN
Generalization Theory

Generalization Theory

MIT · 81 MIN
Scaling Rules for Optimization

Scaling Rules for Optimization

MIT · 81 MIN
Architectures: Transformers

Architectures: Transformers

MIT · 75 MIN
Hacker's Guide to Deep Learning

Hacker's Guide to Deep Learning

MIT · 76 MIN
Architectures: Memory

Architectures: Memory

MIT · 73 MIN
Lec 11: Representation Learning: Reconstruction-Based

Lec 11: Representation Learning: Reconstruction-Based

MIT · 81 MIN
Lecture 13: Representation Learning Theory

Lecture 13: Representation Learning Theory

MIT · 75 MIN