Roadmap and Resources

For a fresher, to break into the field of reinforcement learning, the following resources are suggested,

  1. Books

    1. Reinforcement Learning: An Introduction By Richard S. Sutton and Andrew G. Barto

    2. Deep Reinforcement Learning Hands-On By Maxim Lapan

    3. Deep Reinforcement Learning Fundamentals, Research and Applications, Springer

    4. Deep Reinforcement Learning Frontiers of Artificial Intelligence, Springer

  2. Python Libraries

    1. OpenAI (Gym, Spinning Up)

    2. stable-baselines3

    3. RLlib, and more

  3. Blogs and Courses

    1. This is a good introductory blog that can serve as an excellent first-read for freshers breaking into this field.

    2. This is an excellent course by David Silver.

    3. This is a good Coursera specialization for getting started with RL.

    4. This is DeepMind x UCL RL 2021 Lecture Series YouTube Playlist

Note

  • Book #1 offers a well-formulated, comprehensive and detailed introduction to the building blocks of RL. It serves as an excellent first-read for those unfamiliar with RL, however the theory goes into a lot of depth which may be time-consuming. So, it is suggested to use this in tandem with the libraries and other resources.

  • Books #2,3,4 offer a brief introduction to RL before exploring the field of Deep Reinforcement Learning (DRL).

  • Book #2 has been built on Pytorch, while Books #3,4 develop on Tensorflow.

  • Book #2 offers step by step tutorial on DRL, covering a wide variety of functionalities and examples.

  • Book #3 discusses all the nitty-gritty details associated with DRL in a consise manner, which would otherwise require thorough sweeping of research papers. It is an excellent read to understand DRL and how it differs from traditional RL. It comes with a supporting github repo which provides sample code for the examples used.

  • Book #4 is similar to #3 in its intend to discuss about DRL. However, the two differ in their approaches. The latter focuses on detailed disuccion on the nuances of DRL, the former however, focuses more on the code build up corresponding to the content flow.


  • Though multiple libraries are available, I’ll personally suggest using gym and stable-baselines as a first step.


  • Within blogs and courses, #1 is highly recommended for a fresher as it disusses the basics with code implementations, and offers both blog and video format.

  • #2 and #4 can offer a very comprehensive detailing of RL fundamentals.

  • #3 serves as a good starting course that follows along the Barto and Sutton RL book.