LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Deep Learning for Natural Language: Transformers
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Deep Learning for Natural Language: Transformers

77 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Hands-On Deep Learning Spring 2024 · LECTURE 7

Rama Ramakrishnan teaches lecture seven of MIT's Hands-On Deep Learning course (15.773, Spring 2024), covering how transformer models process natural language. He builds the explanation around an airline travel example, using it to walk through attention mechanisms and how transformers weigh relationships between words in a sequence rather than processing them strictly in order. The session runs 77 minutes and fits into the course's broader arc on modern deep learning architectures, following earlier lectures on foundational neural network concepts. Ramakrishnan keeps the focus practical and applied, aimed at students who want to understand why transformers replaced earlier sequence models like RNNs for language tasks, using the concrete example to ground otherwise abstract architecture details in something students can visualize step by step.

At a glance

Lecture facts

Runtime compared with the other 350 Mathematics lectures
Runtime1 h 17 m
Compared with MathematicsLonger than 60%
This series

Hands-On Deep Learning Spring 2024

Every lecture in order, sized by its length.

  • Earlier lectures
  • This lecture
  • Still to come
Lecture 7 of 117 h 23 m before this · 13 h 46 m in total

More from this course

10 LECTURES
Introduction to Neural Networks and Deep Learning; Training Deep NNs

Introduction to Neural Networks and Deep Learning; Training Deep NNs

MIT · 57 MIN
Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

MIT · 78 MIN
Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

MIT · 77 MIN
Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

MIT · 76 MIN
Deep Learning for Natural Language: The Basics

Deep Learning for Natural Language: The Basics

MIT · 77 MIN
Deep Learning for Natural Language: Embeddings

Deep Learning for Natural Language: Embeddings

MIT · 78 MIN
Deep Learning for Natural Language: Transformers, Self-Supervised Learning

Deep Learning for Natural Language: Transformers, Self-Supervised Learning

MIT · 77 MIN
Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

MIT · 75 MIN
Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

MIT · 78 MIN
Generative AI: Text-to-Image Models

Generative AI: Text-to-Image Models

MIT · 76 MIN