LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

75 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Hands-On Deep Learning Spring 2024 · LECTURE 9

Rama Ramakrishnan teaches session nine of MIT's 15.773 Hands-On Deep Learning, continuing from the transformer encoder architecture covered in the previous class. He walks through how large language models predict the next word in a sequence, building up the mechanics that let transformers generate coherent text. From there the lecture turns to Retrieval Augmented Generation, explaining how retrieval systems feed external documents into a language model's context so it can answer questions grounded in specific source material rather than relying only on what it memorized during training. The session is part of MIT's Sloan School curriculum on applied deep learning for management and business students, and treats LLMs and RAG as practical tools rather than abstract theory, with an eye toward how these systems get built and deployed in real applications.

At a glance

Lecture facts

Runtime compared with the other 148 Computer Science lectures
Runtime1 h 15 m
Compared with Computer ScienceLonger than 53%
This series

Hands-On Deep Learning Spring 2024

Every lecture in order, sized by its length.

  • Earlier lectures
  • This lecture
  • Still to come
Lecture 9 of 119 h 57 m before this · 13 h 46 m in total

More from this course

10 LECTURES
Introduction to Neural Networks and Deep Learning; Training Deep NNs

Introduction to Neural Networks and Deep Learning; Training Deep NNs

MIT · 57 MIN
Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

MIT · 78 MIN
Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

MIT · 77 MIN
Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

MIT · 76 MIN
Deep Learning for Natural Language: The Basics

Deep Learning for Natural Language: The Basics

MIT · 77 MIN
Deep Learning for Natural Language: Embeddings

Deep Learning for Natural Language: Embeddings

MIT · 78 MIN
Deep Learning for Natural Language: Transformers

Deep Learning for Natural Language: Transformers

MIT · 77 MIN
Deep Learning for Natural Language: Transformers, Self-Supervised Learning

Deep Learning for Natural Language: Transformers, Self-Supervised Learning

MIT · 77 MIN
Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

MIT · 78 MIN
Generative AI: Text-to-Image Models

Generative AI: Text-to-Image Models

MIT · 76 MIN