Information Theory: Codebreaking, Gambling, Inference
Statistical inference from observed data to hidden parameters always involve a degree of uncertainty. Information theory is a mathematical tool that can meaningfully quantify this uncertainty and thus express the limits of what one can learn from incomplete or noisy data.
This has implications for how we understand human learning and communication. It also has important applications in engineering problems like data compression, design of digital communication protocols, etc.
The January 2014 project course Information Theory: Codebreaking, Gambling, Inference will introduce the central concepts of information theory and discuss their interpretation in contexts like forecasting, gambling, and modeling. The course can be taken in tandem with Christian Schaffner's information theory course, which starts immediately after.
This has implications for how we understand human learning and communication. It also has important applications in engineering problems like data compression, design of digital communication protocols, etc.
The January 2014 project course Information Theory: Codebreaking, Gambling, Inference will introduce the central concepts of information theory and discuss their interpretation in contexts like forecasting, gambling, and modeling. The course can be taken in tandem with Christian Schaffner's information theory course, which starts immediately after.
Who, When, and Where?
The project course is targeted at students at the Master of Logic and has no specific prerequisites. It is held at the ILLC by Mathias Winther Madsen in the academic month of January 2014 (that is, 6 to 31 January). The registration deadline was 20 December 2013, and the course has started.
The core of the program is a five-day intensive crash course which is held between 13 January and 17 January 2014, both days included. The location is the meeting room at the ILLC, room F1.15, and the time slot is 12:00 to 14:00. Slides, exercises, and other materials related to this part of the course are uploaded on this site as they become available.
In the week of 27 January, participants in course will give presentations on information-theoretical topics of their own choice. A tentative list of suggested presentation topics is available on this site and will be expanded continually.
The core of the program is a five-day intensive crash course which is held between 13 January and 17 January 2014, both days included. The location is the meeting room at the ILLC, room F1.15, and the time slot is 12:00 to 14:00. Slides, exercises, and other materials related to this part of the course are uploaded on this site as they become available.
In the week of 27 January, participants in course will give presentations on information-theoretical topics of their own choice. A tentative list of suggested presentation topics is available on this site and will be expanded continually.