Information Theory & Coding
- Unit 1
Introduction:Objective, scope and outcome of the course.
1 hr - Unit 2
Introduction to information theory: Uncertainty, Information and Entropy, Information measures for continuous random variables, source coding theorem. Discrete Memory less channels, Mutual information, Conditional entropy.
5 hrs - Unit 3
Source coding schemes for data compaction: Prefix code, Huffman code, Shanon -Fane code &Hempel -Ziv coding channel capacity. Channel coding theorem. Shannon limit.
5 hrs - Unit 4
Linear Block Code: Introduction to error connecting codes, coding & decoding of linear block code, minimum distance consideration, conversion of non -systematic form of matrices into systematic form.
5 hrs - Unit 5
Cyclic Code: Code Algebra, Basic properties of Galois fields (GF) polynomial operations over Galois fields, generating cyclic code by generating polynomial, parity check polynomial. Encoder & decoder for cyclic codes.
6 hrs - Unit 6
Convolutional Code: Convolutional encoders of different rates. Code Tree, Trllis and state diagram. Maximum likelihood decoding of convolutional code: The viterbi Algorithm fee distance of a convolutional code.
6 hrs
Total: 28 lecture hours