<p>I suggest 
<em>Probability and Computing: Randomized Algorithms and Probabilistic Analysis</em> by Mitzenmacher and Upfal. Probability is at the foundation of machine learning and it's one of the weakest points for many beginners, in my experience.</p>

CC BY-SA 4.0
2019-09-24T21:00:15.790Z
I definitely feel my lack of prob/stats knowledge in taking these classes. However, I'm also in the middle of a probability theory class and I already have some other books on this topic, but they might be more theoretical in nature than the one you recommended, so I'll check it out!
saxon_dr
CC BY-SA 4.0
2019-09-23T18:51:28.330Z
2019-09-23T18:51:28.330Z
Aryeh
<p>This is usually a classical University textbook: <em>Artificial Intelligence: a modern approach</em> by Stuart Russel and Peter Norvig.
The book covers the problem of soft and hard AI, how to think about intelligent agents, the inference problem and a wide variety of techniques for both supervised and unsupervised learning. In my opinion it's the best book to dive into Artificial Intelligence and Machine Learning, not only from a calculus point of view.</p>

<p>If then you are exclusively interested in enriching your knowledge in calculus and numerical techniques useful for research in AI, I would suggest: <em>Nonnegative Matrix and Tensor Factorizations</em> by Cichocki, Zdunek, Phan, Amari.</p>

CC BY-SA 4.0
2019-09-25T10:51:50.080Z
2019-09-25T10:51:50.080Z
gifa
<p>I'm a computer science major and I'm taking a lot of machine learning courses. I'm finding that my theoretical foundation on subjects like calculus and linear algebra are not as strong as I'd like them to be, so I'm wondering about resources for these two topics. I'm not new to either areas, but I would like to build a really solid theoretical foundation since I enjoy being rigorous and I also potentially want to do research in ML in the future.</p>

<ul>
<li><p>Calculus: I took calc 1 and calc 2 in high school, but my AP class didn't really cover that much more beyond basic derivatives, integrals, and Taylor series. I took calc 3 recently but I feel that my intuition about multivariate calculus is still relatively weak.</p></li>
<li><p>Linear algebra: I took a rigorous proof-based book on linear algebra as a first course on linear algebra. While I enjoyed the class and did well in it, I don't know that much about the applications, and we didn't get to things like diagonalization. I've been reading <em>Linear Algebra Done Right</em> since it's been recommended to me by a friend and I've heard great things about it.</p></li>
</ul>

<p>What are some resources (online or books) that I can use to review and strengthen my theoretical understanding on these two topics, especially calculus? Preferably I'd like something with a lot of exercises and not necessarily aimed at someone with no prior knowledge of it.</p>

<reference-request><machine-learning><linear-algebra>
What are some good resources for strengthening my theoretical foundation for machine learning?
saxon_dr
# What are some good resources for strengthening my theoretical foundation for machine learning?

(Asked by: username_0 on 2019-09-22)

I'm a computer science major and I'm taking a lot of machine learning courses. I'm finding that my theoretical foundation on subjects like calculus and linear algebra are not as strong as I'd like them to be, so I'm wondering about resources for these two topics. I'm not new to either areas, but I would like to build a really solid theoretical foundation since I enjoy being rigorous and I also potentially want to do research in ML in the future.

* Calculus: I took calc 1 and calc 2 in high school, but my AP class didn't really cover that much more beyond basic derivatives, integrals, and Taylor series. I took calc 3 recently but I feel that my intuition about multivariate calculus is still relatively weak.
* Linear algebra: I took a rigorous proof-based book on linear algebra as a first course on linear algebra. While I enjoyed the class and did well in it, I don't know that much about the applications, and we didn't get to things like diagonalization. I've been reading *Linear Algebra Done Right* since it's been recommended to me by a friend and I've heard great things about it.

What are some resources (online or books) that I can use to review and strengthen my theoretical understanding on these two topics, especially calculus? Preferably I'd like something with a lot of exercises and not necessarily aimed at someone with no prior knowledge of it.

**Tags:** reference-request, machine-learning, linear-algebra

---

## 2 answers

### Answer by username_1 on 2019-09-23. Score: 5

I suggest
*Probability and Computing: Randomized Algorithms and Probabilistic Analysis* by Mitzenmacher and Upfal. Probability is at the foundation of machine learning and it's one of the weakest points for many beginners, in my experience.

> **Comments:**
> **username_0**: I definitely feel my lack of prob/stats knowledge in taking these classes. However, I'm also in the middle of a probability theory class and I already have some other books on this topic, but they might be more theoretical in nature than the one you recommended, so I'll check it out!  

---

### Answer by username_2 on 2019-09-25. Score: 2

This is usually a classical University textbook: *Artificial Intelligence: a modern approach* by Stuart Russel and Peter Norvig.
The book covers the problem of soft and hard AI, how to think about intelligent agents, the inference problem and a wide variety of techniques for both supervised and unsupervised learning. In my opinion it's the best book to dive into Artificial Intelligence and Machine Learning, not only from a calculus point of view.

If then you are exclusively interested in enriching your knowledge in calculus and numerical techniques useful for research in AI, I would suggest: *Nonnegative Matrix and Tensor Factorizations* by Cichocki, Zdunek, Phan, Amari.


---

