Chapter 3

Safety, Generalization, and Exploration

Study how agents discover useful behavior, fail under distribution shift, and require evaluation beyond training return.

• 1. Exploration Strategies→
• 2. Curiosity-Driven Learning→
• 3. Distribution Shift→
• 4. Generalization Failures→
• 5. Safety Constraints and Evaluation→