Schematic-RL

Deep RL Workshop, 2024

Venue: Kresit classroom SIC 201

Lectures Completed

Host: Harshad Khadilkar

harshadk@iitb.ac.in

Office: New CSE Bldg, 207

Sign-up sheet: Click here



Lecture Resources (2024 version)

0) Consolidated references and workshop storyline

Consolidated summary of Deep RL Workshop lectures -- Download: Document


1) Connecting RL theory to Deep RL via value-based methods
March 06, 2024

Basics of RL, connection to control theory, tabular RL, simple DQN -- Download: Documents, Video recording


2) Stabilisation of value-based methods, exploration-exploitation
March 13, 2024

Target networks, Prioritised replay, Hindsight replay, Rainbow, Directed exploration -- Download: Documents, Video recording


3) Policy gradient and actor-critics in Deep RL
March 20, 2024

Policy gradients, REINFORCE, A2C, A3C, DDPG, SAC -- Download: Documents, Video recording


4) Trust region based methods
March 27, 2024

TRPO, PPO -- Download: Documents, Video recording


5) Model based methods and Neural MCTS
April 03, 2024

Model based Deep RL, Dream to Control, Alpha Go, Modern chess engines (guest talk) -- Download: Documents, Video recording


6) Latest literature in Deep RL
April 10, 2024

RL as sequence prediction, RL for static optimisation, Multi-Agent RL, Reward shaping -- Download: Documents, Video recording