concept

Information theory

The branch of mathematics Claude Shannon founded in 1948 to measure information precisely - divorced entirely from meaning. Information is defined as the resolution of uncertainty: a message carries more information the more possibilities it rules out. From this footing grow the bit, the concept of entropy, and the channel-capacity theorem - the framework that sets hard limits on every communication system, from a fibre-optic strand to a Na'vi neural queue.