<p>I am taking advanced macro course in Fall. Could you please advise me a simple introduction to Markov processes and dynamic programming? I mean easy. Thanks!</p>

CC BY-SA 4.0
2021-08-18T04:38:57.937Z
Could you please clarify what you mean by easy? I.e. what is your background, what branches of math did you study?
Giskard
CC BY-SA 4.0
2021-08-18T06:52:44.443Z
As an introduction to the topic, I found it useful to look at the reinforcement learning (RI) community. Certain classes in RI are more descriptive than those you're likely to find in advanced macro, yet both are discussing equivalent materials in terms of Markov processes, Bellman equations, value function iterations etc. Once you've introduced yourself to those topics, I would brush up some function analysis/contraction mapping theorem stuff.
EB3112
CC BY-SA 4.0
2021-08-18T09:51:24.373Z
Overall I had 2 university math courses, so very few. My math level is not very high (some calculus, linear algebra, probability). That is why I want smth simple.
Mr. T
<macroeconomics><reference-request><dynamic-programming><markov-chain>
Easy introduction to Markov processes and dynamic programming
Mr. T
# Easy introduction to Markov processes and dynamic programming

(Asked by: username_0 on 2021-08-17)

I am taking advanced macro course in Fall. Could you please advise me a simple introduction to Markov processes and dynamic programming? I mean easy. Thanks!

**Tags:** macroeconomics, reference-request, dynamic-programming, markov-chain

> **Comments:**
> **username_1**: Could you please clarify what you mean by easy? I.e. what is your background, what branches of math did you study?  
> **username_2**: As an introduction to the topic, I found it useful to look at the reinforcement learning (RI) community. Certain classes in RI are more descriptive than those you're likely to find in advanced macro, yet both are discussing equivalent materials in terms of Markov processes, Bellman equations, value function iterations etc. Once you've introduced yourself to those topics, I would brush up some function analysis/contraction mapping theorem stuff.  
> **username_0**: Overall I had 2 university math courses, so very few. My math level is not very high (some calculus, linear algebra, probability). That is why I want smth simple.  

---

## 0 answers

