E2 201
Information Theory
AugustDecember 2014
Click here
for important class announcements.
[ Announcements 
Lectures 
Homework 
Course Outline 
References ]
 Instructor

Navin Kashyap
Office: SP 2.17
 Teaching Assistants

M. Ashok Kumar
Office: SP 1.11
 Lectures

Tuesdays & Thursdays, 3:30  5:00pm
Location: ECE 1.08
 Discussion Sessions
 Fridays, 6:00  7:30pm
Location: ECE 1.08
 Homework Assignments
 Homework assignments will be posted on this website once every two weeks.
Students are expected to solve all homework problems. However, only undergraduate
students are required to submit their homework solutions, which will be graded.
Discussion sessions will be held for the purpose of helping students solve homework problems.
 Quizzes
 Quizzes based on the homework assignments will be held once in two weeks, at the start of the discussion sessions. Quizzes are mandatory for graduate students, and optional for undergraduates.
 Exams
 There will be one midterm exam and one final exam. The midterm was held in class on
Thursday, October 9, 3:305:00pm.
The final exam has been scheduled for Wednesday, December 3, 2:005:00pm, in ECE 1.08. See announcements page for additional information.
 Grading
 The course grade will be based on the following:
20% weightage assigned to homeworks/quizzes,
30% to the midterm exam, and 50% to the final exam.
 Course Outline
 Entropy, mutual information, source coding, channel capacity, channel coding theorems, differential entropy, Gaussian channel, ratedistortion theory, brief overview of network information theory.
 References
 T.M. Cover and J.A. Thomas,
Elements of Information Theory, 2nd ed., Wiley, 2006.
(The second edition is now available from Tata Book House, IISc, at an affordable price. The second edition contains a more detailed exposition of network information theory.)
 I. Csiszár and J. Körner,
Information Theory: Coding Theorems for Discrete Memoryless Systems,
2nd ed., Cambridge University Press, 2011
(The first edition was published in 1981 by Academic Press. The new, second edition has been updated considerably.)
 R.G. Gallager,
Information Theory and Reliable Communication,
John Wiley & Sons, 1968.
 R.W. Yeung,
A First Course in Information Theory,
Springer, 2002.
[ Announcements 
Lectures 
Homework 
Course Outline 
References ]