Chapter 4

Reward Design

Study how reward signals shape behavior, why proxies fail, and how reward design connects technical RL to safety and alignment.

• 1. Intended Goals vs. Specified Rewards→
• 2. Sparse, Dense, Shaped, and Proxy Rewards→
• 3. Reward Hacking→