1. Introduction to Information Theory
Objectives, Introduction, Uncertainty and Information, Information and Entropy, Average Information (Entropy), Chain Rules for Entropy, Properties of Entropy, Information Rate, Amount of Information, The Conditional and Joint Entropies, Mutual Information, Relationship between Entropy and Mutual Information, The Source Coding, Few Terms Related to Source Coding Process, The Source Coding Theorem, The Kraft Inequality, The Discrete Memory less Channels (DMC), Channel Representation, The Channel Matrix, Type of Channels, Lossless Channel, Deterministic Channel, Noiseless Channel, Binary Symmetric Channel (BSC), Random Variables, Maximization of the Entropy of a Continuous Random Variable, Solved Examples, Unsolved Questions.
2. Source Coding Schemes
Objectives, Introduction, Prefix Code, Techniques, Huffman Encoding, Shannon-Fano Encoding, Lempel-Ziv Coding or Lempel-Ziv Algorithm, Dictionary Coding, LZ77, LZ78, LZW, Channel Capacity, Shannon Hartley Theorem, Channel Efficiency(h), Calculation of Channel Capacity, Channel Coding Theorem (Shannon’s Second Theorem), Shannon Limit, Solved Examples, Unsolved Questions.
3. Linear Block Code for Error Correction
Objectives, Introduction, Types of Errors and Terms Common to Error-Control Coding, Error Detection and Correction Techniques, Error Detection, Error Correction, Error-correcting Codes, Coding & Decoding of Linear Block Code, Principle of Block Coding, Linear Codes, Types of Linear Block Codes, it’s Properties and Applications, Matrix Description of Linear Block Codes, Closure Property of Linear Block Codes, Syndrome Decoding, Minimum Distance Considerations, Hamming Codes, Solved Examples, Unsolved Questions.
4. Cyclic Codes
Objectives, Introduction, Types of Cyclic Codes, Golay Codes, Bose Chaudhari Hocquenqhem (BCH) Codes, Reed Solomon Code, Cyclic Redundancy Check Codes, Maximum Length Codes, Galois Field, Fields, Properties of Galois Fields, Polynomial Operations Over Galois Fields, Addition Operation, Square Operation, Multiplication Operation, Generating Cyclic Codes by Generating Polynomial, Parity-Check Polynomial, Encoder for Cyclic Codes, Decodes for Cylic Codes, Solved Examples, Unsolved Questions.
5. Convolutional Code
Objectives, Introduction, Encoding of Convolutional Code, Code Tree State Diagram and Trellis Diagram, Code Tree, State Diagram, Trellis Diagram, Decoding of Convolutional Code, Sequential Decoding, Maximum Likely-Hood and Viterbi Decoding, Free Distance and Coding Gain, Transfer Function of the Convolutional Code, Advantages and Disadvantages of Convolutional Codes, Soft-Decision Decoding, Log-Likelyhood Ratio, Applications of Convolutional Codes, Solved Examples, Unsolved Questions.
P. Papers