S6 ECE ITC, 1st Internal
S6 ECE ITC, 1st Internal
PART A
Answer All Questions
3. Consider a source S= {S1, S2, S3} with P = {1/2, 1/4, 1/4}. find self-information of
CO1 3 (3)
each message and entropy of source S?
4. Draw the channel diagram of Binary erasure channel CO2 2 (3)
5. What is meant by a symmetric channel? How do we find the capacity? CO2 1 (3)
6. Explain the trade off between signal to noise ratio and bandwidth for a continous
CO2 2 (3)
Guassian channel
PART B
Answer All One Full Question From Each Module
MODULE 1
7. a) State & Prove Kraft's inequality CO1 2 (8)
b) The Five symbols S1, S2, S3, S4 & S5 of a source have probabilities 0.4, 0.2, 0.2, 0.1
CO1 3 (8)
& 0.1 respectively. Obtain the codewords using Huffman algorithm.
OR
8. a) If X and Y are discrete random sources and P(X, Y) is their joint probability
distribution and is given as.
0.08 0.05 0.02 0.05
P(X, Y) = 0.15 0.13 0.01 0.09 CO1 3 (10)
0.10 0.05 0.02 0.05
0.01 0.12 0.01 0.06
Calculate H(X), H(Y), H(X/Y), H(Y/X) and H(X, Y).
b) Describe Mutual Information along with its properties CO1 2 (6)
MODULE 2
9. a) A Guassian channel has 10MHZ bandwidth. If SNR is 100, calculate the channel
CO2 3 (8)
capacity and the maximum information rate.
b) Explain channel capacity and also find the channel capacity of a Binary Symmetric
CO2 2 (8)
channel?
OR
1 of 2
10. a) A voice grade channel of the telephone network has a bandwidth of 3.4KHZ calculate
(a) channel capacity of the telephone channel for signa to noise ratio of 30 dB (b)
CO2 2 (8)
calculate the minimum SNR is required to support information transmission through
the telephone channel ath the rate of 4800 bit/sec.
b) Explain Bandwidth-efficiency relation and Shannon's Limit of a continuous Gaussian
CO2 2 (8)
channel
2 of 2