Back to Browse

Information Theory Tutorial: Shannons Coding Theorem

8.6K views
Apr 3, 2019
9:13

These videos are from the Information Theory Tutorial on Complexity Explorer. This tutorial introduces fundamental concepts in information theory. Information theory has made considerable impact in complex systems, and has in part co-evolved with complexity science. Research areas ranging from ecology and biology to aerospace and information technology have all seen benefits from the growth of information theory. In this tutorial, students will follow the development of information theory from bits to modern application in computing and communication. Along the way Seth Lloyd introduces valuable topics in information theory such as mutual information, boolean logic, channel capacity, and the natural relationship between information and entropy. Lloyd coherently covers a substantial amount of material while limiting discussion of the mathematics involved. When formulas or derivations are considered, Lloyd describes the mathematics such that less advanced math students will find the tutorial accessible. Prerequisites for this tutorial are an understanding of logarithms, and at least a year of high-school algebra. For more, visit courses.complexityexplorer.org

Download

1 formats

Video Formats

360pmp428.2 MB

Right-click 'Download' and select 'Save Link As' if the file opens in a new tab.

Information Theory Tutorial: Shannons Coding Theorem | NatokHD