本文共 1200 字，大约阅读时间需要 4 分钟。

• Overview

  需要了解信息论。秉着大牛+历史这两条学习主线。调研一下有哪些学习资料。

• 入门

  . It’s a website, not a book.

  A First Course in Information Theory; Yeung, Raymond W. 2002

  ; Abbas El Gamal, Young-Han Kim

  Information Theory, Inference and Learning Algorithms, by David J. C. MacKay, 2003. Another .

  ; Stefan M. Moser;

  Information Theory: A Tutorial Introduction; James V Stone; 2015;

• 进阶

  The Information: A History, A Theory, A Flood; James Gleick; 2011

  Elements of Information Theory, Thomas M.Cove, Joy A. Thomas ; 1991

  Information Theory: A Concise Introduction; Stefan Hollos; 2015

  Time Travel: A History; James Gleick; 2016

  ; Y. Polyanskiy, Y. Wu; 2017.

  ; John Duchi; 2019

  Information Theory: Coding Theorems for Discrete Memoryless Systems; Imre; 1982

  An Introduction to Single-User Information Theory; Alajaji, Fady, Chen, Po-Ning; 2018

  Information-Spectrum Methods in Information Theory; Te Sun Han; 2003

  Information Theory and Reliable Communication; Robert G. Gallager; 1968

  Principles of Digital Communication; Robert Gallager

• Shannon

  The Mathematical Theory of Communication, Claude E Shannon, Warren Weaver; 1971.

  Claude E. Shannon; Neil J. A. Sloane; 1993.

  Shannon’s work is brilliantly analyzed in the paper .

• References