LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Deep Learning for Natural Language: Embeddings
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Deep Learning for Natural Language: Embeddings

78 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Hands-On Deep Learning Spring 2024 · LECTURE 6

Rama Ramakrishnan continues MIT's Hands-On Deep Learning course (15.773, Spring 2024) with a lecture on how machines represent words and text numerically. He covers stand-alone embeddings, the fixed vector representations produced by methods like word2vec, and contextual embeddings, which shift a word's representation depending on surrounding text, the innovation behind models like BERT. The lecture builds on prior sessions in the course's natural language processing sequence, walking through why raw text needs to become numbers before a neural network can use it, and how embedding spaces end up capturing semantic relationships between words. Ramakrishnan keeps the discussion grounded in practical deep learning workflow rather than pure theory, consistent with the course's hands-on framing for MIT Sloan students. Runtime runs about 78 minutes, delivered as a standard classroom lecture with slides and instructor narration.

At a glance

Lecture facts

Runtime compared with the other 350 Mathematics lectures
Runtime1 h 18 m
Compared with MathematicsLonger than 65%
This series

Hands-On Deep Learning Spring 2024

Every lecture in order, sized by its length.

  • Earlier lectures
  • This lecture
  • Still to come
Lecture 6 of 116 h 5 m before this · 13 h 46 m in total

More from this course

10 LECTURES
Introduction to Neural Networks and Deep Learning; Training Deep NNs

Introduction to Neural Networks and Deep Learning; Training Deep NNs

MIT · 57 MIN
Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

MIT · 78 MIN
Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

MIT · 77 MIN
Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

MIT · 76 MIN
Deep Learning for Natural Language: The Basics

Deep Learning for Natural Language: The Basics

MIT · 77 MIN
Deep Learning for Natural Language: Transformers

Deep Learning for Natural Language: Transformers

MIT · 77 MIN
Deep Learning for Natural Language: Transformers, Self-Supervised Learning

Deep Learning for Natural Language: Transformers, Self-Supervised Learning

MIT · 77 MIN
Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

MIT · 75 MIN
Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

MIT · 78 MIN
Generative AI: Text-to-Image Models

Generative AI: Text-to-Image Models

MIT · 76 MIN