course info from 376b (inf. theory) by late thomas cover

2
EE 376A Handout #2 Information Theory Tuesday, March 30, 2011 T. Cover Information Theory Course Information Web Page: http://www.stanford.edu/class/ee376b/ Instructor: Prof. Tom Cover Packard 254 723-4505 [email protected] Office hours: Wednesday 2-3 pm. Generally available mid-afternoons. Administrative Associate: Denise Murphy Packard 267 723-4731 [email protected] TA: Gowtham Kumar, Packard 251, [email protected] Textbook: Elements of Information Theory, Second Edition, T. Cover and J. Thomas, Wiley, 2006. Several texts can serve as auxiliary or reference texts: “Information Theory and Reliable Communications,” by Gallager, New York, Wiley 1968.

Upload: skywrought

Post on 03-Dec-2015

6 views

Category:

Documents


3 download

DESCRIPTION

Late Thomas Cover gave this course in Stanford University, based on Elements of Inf/Th by Cover and Thomas

TRANSCRIPT

Page 1: Course Info from 376B (Inf. Theory) by Late Thomas Cover

EE 376A Handout #2Information Theory Tuesday, March 30, 2011T. Cover

Information TheoryCourse Information

Web Page:

http://www.stanford.edu/class/ee376b/

Instructor:

Prof. Tom CoverPackard [email protected] hours: Wednesday 2-3 pm. Generally available mid-afternoons.

Administrative Associate:

Denise MurphyPackard [email protected]

TA:

Gowtham Kumar, Packard 251, [email protected]

Textbook:

Elements of Information Theory, Second Edition, T. Cover and J. Thomas, Wiley, 2006.Several texts can serve as auxiliary or reference texts:

• “Information Theory and Reliable Communications,” by Gallager, New York, Wiley1968.

Page 2: Course Info from 376B (Inf. Theory) by Late Thomas Cover

• “Key Papers in Development of Information Theory,” edited by Slepian, New York,IEEE Press, 1974.

• “Information Theory,” by Csiszar and Korner, New York, Academic Press, 1981.

• “Claude Shannon, Collected Papers,” edited by N.J.A. Sloane and Aaron D. Wyner,New York: IEEE Press, 1993.

PrerequisitesEE376a

Course Description

Maximum entropy and Burg’s theorem. Gaussian Channel Capacity. Rate Distortion theoryand Kolmogorov Complexity. Information theory and statistics. Stein’s Lemma. AEP.Network Information theory. Slepian-Wolf Theorem. Optimal Investment and informationtheory. Universal Portfolios and data compression.