Chapter 1

Offline RL

Learn policies from fixed datasets without new environment interaction, and study why out-of-distribution actions become central.

• 1. Learning from Fixed Datasets→
• 2. Distributional Mismatch→
• 3. Conservative Objectives→
• 4. Decision Transformers→