Chapter 3

Tabular RL and Q-Learning

Use small finite environments to understand learning from experience, balancing exploration and exploitation, and updating action values.

• 1. Planning vs. Learning→
• 2. Exploration vs. Exploitation→
• 3. Q-Learning Update Rule→
• 4. Convergence Intuition→