Information Theory
A graduate-level MIT OpenCourseWare course covering the mathematics behind information theory. Topics include information entropy, lossless data compression, binary hypothesis testing, channel coding, and lossy data compression, moving from classical Shannon theory into more modern techniques. Materials include lecture notes and problem sets typical of MIT's OCW offerings, drawn from the Electrical Engineering and Computer Science department. The course builds the theoretical foundations behind compression algorithms, communication limits, and statistical decision problems, giving a rigorous mathematical treatment rather than an applied survey. Suited to students who already have a background in probability and linear algebra. As with other MIT OCW courses, all materials are free to access under a Creative Commons license, with no certificate offered.