These problem sets are provided for your practice only. However, these problems will reinforce your understanding of the material, and completing them is a good way to practice for the tests.

Chapters and problem numbers are given for the recommended textbook, Elements of Information Theory, 2nd ed., by Cover and Thomas.

7.1, 7.2, 7.4, 7.5, 7.6, 7.7, 7.10, 7.12, 7.15, 7.27, 7.37.

2.2, 2.5, 2.9, 2.12(a-d), 2.18, 2.19, 2.26, 2.29(a,c), 2.31, 2.40, 2.42

3.5, 3.7, 3.8, 3.9, 3.13

5.4, 5.6, 5.7, 5.11, 5.17, 5.18, 5.19, 5.37