LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Generative AI: Adapting LLMs with Parameter-Efficient Fine-Tuning

78 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Hands-On Deep Learning Spring 2024 · LECTURE 10

Rama Ramakrishnan teaches this session of MIT's 15.773 Hands-On Deep Learning, covering how large language models built on the Generative Pretrained Transformer architecture get adapted for specific tasks. He walks through differences across GPT versions, the role and quality of training data, and instruction tuning as a method for steering base models toward useful behavior. The core of the lecture is parameter-efficient fine-tuning, the techniques that let practitioners adjust a small fraction of a model's parameters rather than retraining the whole network, making customization feasible without massive compute budgets. Running 78 minutes, the session fits into the course's broader hands-on approach to deep learning, aimed at students who already have some grounding in neural networks and want to understand the practical mechanics behind adapting modern LLMs for real applications.

At a glance

Lecture facts

Runtime compared with the other 148 Computer Science lectures
Runtime1 h 18 m
Compared with Computer ScienceLonger than 66%
This series

Hands-On Deep Learning Spring 2024

Every lecture in order, sized by its length.

  • Earlier lectures
  • This lecture
  • Still to come
Lecture 10 of 1111 h 12 m before this · 13 h 46 m in total

More from this course

10 LECTURES
Introduction to Neural Networks and Deep Learning; Training Deep NNs

Introduction to Neural Networks and Deep Learning; Training Deep NNs

MIT · 57 MIN
Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

Training Deep Neural Networks (cont.); Introduction to Keras/TensorFlow; Application to Tabular Data

MIT · 78 MIN
Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

Deep Learning for Computer Vision: Building Convolutional Neural Networks from Scratch

MIT · 77 MIN
Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

Deep Learning for Computer Vision: Transfer Learning and Fine-Tuning; Intro to HuggingFace

MIT · 76 MIN
Deep Learning for Natural Language: The Basics

Deep Learning for Natural Language: The Basics

MIT · 77 MIN
Deep Learning for Natural Language: Embeddings

Deep Learning for Natural Language: Embeddings

MIT · 78 MIN
Deep Learning for Natural Language: Transformers

Deep Learning for Natural Language: Transformers

MIT · 77 MIN
Deep Learning for Natural Language: Transformers, Self-Supervised Learning

Deep Learning for Natural Language: Transformers, Self-Supervised Learning

MIT · 77 MIN
Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

Generative AI: Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)

MIT · 75 MIN
Generative AI: Text-to-Image Models

Generative AI: Text-to-Image Models

MIT · 76 MIN