<p>Maybe not so math oriented but with math rigor:</p>
<p>Elements of Information Theory by Thomas M. Cover, Joy A. Thomas</p>
<p><a href="https://cse.buffalo.edu/faculty/atri/courses/coding-theory/book/web-coding-book.pdf" rel="noreferrer">Essential Coding Theory by Venkatesan Guruswami, Atri Rudra and Madhu Sudan</a></p>

CC BY-SA 4.0
2021-08-26T03:09:06.797Z
2021-08-26T03:09:06.797Z
Zunchen Huang
<p>Both texts in the other answer are great texts, and the Guruswami, Rudra, Sudan book is more based in the TCS approach to coding theory, which may be relevant to the potential reader. The books below have been split into the &quot;mainly information theory&quot; and &quot;mainly coding theory&quot; subsets.</p>
<p><strong>Information Theory:</strong></p>
<p>For mathematical rigour, the following text</p>
<p><a href="https://www.sciencedirect.com/book/9780121984502/information-theory" rel="nofollow noreferrer">Csiszar and Korner: Information Theory: Coding Theorems for Discrete Memoryless Systems (1981)</a></p>
<p>and its updated second edition</p>
<p><a href="https://www.amazon.com.au/Information-Theory-Theorems-Discrete-Memoryless/dp/0521196817" rel="nofollow noreferrer">Csiszar and Korner: Information Theory: Coding Theorems for Discrete Memoryless Systems (2011)</a></p>
<p>has not been surpassed in my opinion. For example have a look at the Network Information Theory chapter (Chapter 3 in the first edition) and compare with Cover and Thomas (which is itself a great book to learn/teach from but not really that rigorous).</p>
<p>Another text which is dated now but is really nice is</p>
<p><strong>Coding Theory:</strong></p>
<p>A modern rigorous text mainly focused on the algebraic approach:</p>
<p><a href="https://www.amazon.com.au/Coding-Theory-Course-San-Ling/dp/0521529239" rel="nofollow noreferrer">Ling and Xing: Coding Theory</a></p>
<p>Somewhat dated, but a classic and rigorous:</p>
<p><a href="https://www.amazon.com.au/Theory-Error-correcting-Codes-F-MacWilliams/dp/0444850112/ref=sr_1_14?dchild=1&amp;qid=1630194740&amp;refinements=p_27%3AN.J.A.%20Sloane&amp;s=books&amp;sr=1-14&amp;text=N.J.A.%20Sloane" rel="nofollow noreferrer">MacWilliams and Sloane: Theory of Error-Correcting Codes</a></p>
<p>Finally, a <strong>Hybrid</strong> text which covers both bases that is rigorous and an excellent textbook is
<a href="https://www.springer.com/gp/book/9780387978123" rel="nofollow noreferrer">Roman: Coding and Information Theory</a></p>

CC BY-SA 4.0
2021-08-28T23:54:44.543Z
2021-08-28T23:54:44.543Z
kodlu
<p>I am coming from a pure mathematics (in analysis) background and am curious to learn some information and coding theory. I am after some recommendations on texts. Due to my personal background I am more inclined to prefer books with a higher level of mathematical rigour, however I still greatly appreciate examples that enable and develop the readers intuition.</p>
<p>Can anyone recommend introductory texts on the topics of information and coding theory that has the above properties?</p>

<it.information-theory><coding-theory><books>
Information and Coding Theory Texts
Zeta-Squared
# Information and Coding Theory Texts

(Asked by: username_0 on 2021-08-26)

I am coming from a pure mathematics (in analysis) background and am curious to learn some information and coding theory. I am after some recommendations on texts. Due to my personal background I am more inclined to prefer books with a higher level of mathematical rigour, however I still greatly appreciate examples that enable and develop the readers intuition.

Can anyone recommend introductory texts on the topics of information and coding theory that has the above properties?

**Tags:** it.information-theory, coding-theory, books

---

## 2 answers

### Answer by username_1 on 2021-08-26. Score: 7

Maybe not so math oriented but with math rigor:

Elements of Information Theory by Thomas M. Cover, Joy A. Thomas

[Essential Coding Theory by Venkatesan Guruswami, Atri Rudra and Madhu Sudan](https://cse.buffalo.edu/faculty/atri/courses/coding-theory/book/web-coding-book.pdf)


---

### Answer by username_2 on 2021-08-28. Score: 4

Both texts in the other answer are great texts, and the Guruswami, Rudra, Sudan book is more based in the TCS approach to coding theory, which may be relevant to the potential reader. The books below have been split into the "mainly information theory" and "mainly coding theory" subsets.

**Information Theory:**

For mathematical rigour, the following text

[Csiszar and Korner: Information Theory: Coding Theorems for Discrete Memoryless Systems (1981)](https://www.sciencedirect.com/book/9780121984502/information-theory)

and its updated second edition

[Csiszar and Korner: Information Theory: Coding Theorems for Discrete Memoryless Systems (2011)](https://www.amazon.com.au/Information-Theory-Theorems-Discrete-Memoryless/dp/0521196817)

has not been surpassed in my opinion. For example have a look at the Network Information Theory chapter (Chapter 3 in the first edition) and compare with Cover and Thomas (which is itself a great book to learn/teach from but not really that rigorous).

Another text which is dated now but is really nice is

**Coding Theory:**

A modern rigorous text mainly focused on the algebraic approach:

[Ling and Xing: Coding Theory](https://www.amazon.com.au/Coding-Theory-Course-San-Ling/dp/0521529239)

Somewhat dated, but a classic and rigorous:

[MacWilliams and Sloane: Theory of Error-Correcting Codes](https://www.amazon.com.au/Theory-Error-correcting-Codes-F-MacWilliams/dp/0444850112/ref=sr_1_14?dchild=1&qid=1630194740&refinements=p_27%3AN.J.A.%20Sloane&s=books&sr=1-14&text=N.J.A.%20Sloane)

Finally, a **Hybrid** text which covers both bases that is rigorous and an excellent textbook is
[Roman: Coding and Information Theory](https://www.springer.com/gp/book/9780387978123)


---

