Due January 21
Problems 1-4 refer to the following set of joint probabilities:
p(a=0,b=0) = 0.4 p(a=0,b=1) = 0.1
p(a=1,b=0) = 0.0 p(a=1,b=1) = 0.5
1. Compute H(A) and H(B).
2. Compute H(A,B)
3. Compute H(B|A)
4. Compute I(A;B)
5. Find a binary Huffman code for the set of probabilites 0.60, 0.25,
0.09, 0.06 and compute the average length.
6. Repeat problem 5 for a radix 3 code.