CMPS 3280 Information Theory

CMPS 3280 Information Theory
Information Theory
This course is an introduction to Shannon's mathematical theory of information. It considers basic concepts such as information content, entropy and the Kullback-Leibler distance, as well as areas such as data compression and Shannon's Source Coding Theorem, coding, prefix codes, lossless channels and their capacity, and Shannon's Noisy Coding Theorem. Applications to various areas are also featured in the course.
Pre-requistites: MATH 3050 or 3090 and familiarity with discrete probability or permission of instructor.
credit hours: 3