Chapter 1

Value-Based Deep RL

Extend value-based learning with neural networks, then examine the stabilizing tricks and failure modes that define DQN-style agents.

• 1. Deep Q-Networks→
• 2. Experience Replay→
• 3. Target Networks→
• 4. Double DQN→
• 5. Dueling DQN→
• 6. Instability and Overestimation→