Exercise in Information Theory

Course Purpose
The goal of this course is to acquire basic knowledge on information theory and communication theory which are useful and applied in other fields of information science.
Learning Goals
Students should understand the principle of some simple source and channel coding schemes and write programs for simulating them.
Topic
Session 1Fundamentals of information theory
Session 2Information source encoding: Huffman encoding
Session 3Information source encoding: Arithmetic encoding
Session 4Information source encoding: Universal encoding (Lempel-Ziv encoding)
Session 5Channel coding: Linear codes and their coding
Session 6Channel coding: Error correction by Hamming code
Session 7Channel coding: Erasure correction using linear codes
Session 8Channel coding: Erasure correction using low-density parity check codes
Session 9Channel coding: Error correction using low-density parity check codes
Session 10Channel coding: Error correction using polar codes
Session 11Common key encryption AES (Advanced Encryption Standard)
Session 12Public key cryptography based on the computational difficulty of the discrete logarithm problem (Diffie-Hellman key agreement, ElGamal cryptography)
Session 13Public key cryptography based on the computational difficulty of prime factorization (RSA cryptography)
Session 14Digital communication method
**This content is based on April 1, 2025. For the latest syllabus information and details, please check the syllabus information inquiry page provided by the university.**