LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
From Large Language Models to Large Multimodal Models
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

From Large Language Models to Large Multimodal Models

80 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
STANFORD

Ming Ding, a research scientist at Zhipu AI and Tsinghua PhD, delivers this Stanford CS25 Transformers United guest lecture on the move from text-only language models toward multimodal systems. He covers the basics of large language models before tracing the academic community's attempts over the past year to fuse visual perception with language capabilities. The core of the talk introduces CogVLM, a 17 billion parameter open-source multimodal model comparable in efficiency to a 7B dense model, and CogAgent, a model built for GUI navigation and OCR tasks. Ding closes by surveying applications of multimodal models and open research directions. The talk assumes familiarity with transformer architectures and is pitched at students and researchers already versed in the CS25 course's core material on attention and language modeling, with Ding drawing on his own work on CogView, CogVideo, and GLM.

At a glance

Lecture facts

Runtime compared with the other 387 Computer Science lectures
Runtime1 h 20 m
Compared with Computer ScienceLonger than 75%
Source channelStanford Online (YouTube)