Chapter 2

MDPs, Rewards, and Value Functions

Formalize sequential decision-making with Markov decision processes, then define rewards, returns, value functions, and Bellman equations.

• 1. Markov Decision Processes→
• 2. Rewards, Returns, and Discounting→
• 3. State-Value and Action-Value Functions→
• 4. Bellman Equations→