SySc 545 Information Theory
June 22-August 13, 4 credits
Establishes theoretical limits on the performance of techniques for
compression or error correction of signals. This course focuses on
communications applications, specifically source coding and channel
coding for discrete signals. Topics will include: Entropy and Mutual
Information, Asymptotic Equipartition (the Ergodic Theorem of
Information Theory), Entropy Rates of Information Sources, Data
Compression, and Channel Capacity.