Information Theory (IT) was born in 1948 when Claude Shannon published its a Mathematical Theory of Communication. This seminal work uses linguistic examples, so Information Theory is related to language since its inception. There were many attempts to explain IT to the general audience, but Rényi’s Diary is outstanding with its unique style, clear prose and rigor. If you read only one book on IT, read this one!

(more…)