1 Introduction and PreviewΒΆ
- Information theory answers two fundamental questions in communication theory:
What is the ultimate data compression (answer: the entropy \(H\))
What is the ultimate transmission rate of communication (answer: the channel capacity \(C\))
The figure below illustrates the relationship of information theory to other fields.
