LECTURES A GRATIS GLOBAL SERVICE
⌕ SEARCH GRATIS GLOBAL ↗
LECTURES
Transmitting Information Reliably over a Noisy Channel & Shannon's Noisy Coding Theorem
SOURCE: YOUTUBE · NO TRACKING UNTIL YOU PRESS PLAY · TROUBLE PLAYING? WATCH AT THE SOURCE ↗

Transmitting Information Reliably over a Noisy Channel & Shannon's Noisy Coding Theorem

72 MIN · EN · STATUS: [ STREAMING ]
RATE THIS
MIT · Principles of Discrete Applied Mathematics · LECTURE 18

Ankur Moitra, teaching MIT's 18.200 Principles of Discrete Applied Mathematics, works through how information can be sent reliably even when a channel introduces errors. He starts with repetition codes, the simplest scheme imaginable, and shows concretely why they waste bandwidth without buying much reliability. The lecture then turns to Shannon's noisy coding theorem, which guarantees that far more efficient codes exist, and Moitra proves the theorem's simplest case for the binary symmetric channel, where each transmitted bit flips independently with some fixed probability. The proof leans on probabilistic arguments about random codes and typical error patterns rather than explicit constructions. This is lecture eighteen in the course sequence, assuming familiarity with earlier probability and combinatorics material, and it gives a rigorous entry point into information theory for students who want the mathematics behind data transmission rather than just the engineering intuition.

At a glance

Lecture facts

Runtime compared with the other 148 Computer Science lectures
Runtime1 h 12 m
Compared with Computer ScienceShorter than 53%
This series

Principles of Discrete Applied Mathematics

Every lecture in order, sized by its length.

  • Earlier lectures
  • This lecture
  • Still to come
Lecture 17 of 1919 h 46 m before this · 23 h 23 m in total

More from this course

12 LECTURES
Pigeonhole Principle

Pigeonhole Principle

MIT · 74 MIN
Lecture 2: Independence and Conditioning

Lecture 2: Independence and Conditioning

MIT · 71 MIN
Lecture 3: Inclusion-Exclusion

Lecture 3: Inclusion-Exclusion

MIT · 79 MIN
Lecture 4: Counting

Lecture 4: Counting

MIT · 78 MIN
More Counting and Generating Functions

More Counting and Generating Functions

MIT · 72 MIN
More on Generating Functions

More on Generating Functions

MIT · 80 MIN
Generating Functions for Catalan Numbers

Generating Functions for Catalan Numbers

MIT · 72 MIN
Tail Bounds

Tail Bounds

MIT · 81 MIN
Lecture 9: Chernoff Bounds

Lecture 9: Chernoff Bounds

MIT · 55 MIN
Basic Group Theory

Basic Group Theory

MIT · 75 MIN
Introduction to Linear Programming

Introduction to Linear Programming

MIT · 74 MIN
Duality in Linear Programming

Duality in Linear Programming

MIT · 76 MIN