# Very good book for rllib - Mastering Reinforcement Learning with Python

**URL:** <https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005>\
**Category:** RLlib\
**Created:** [May 3, 2022, 7:54am UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005 "2022-05-03T07:54:16Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Peter\_Pirog](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/peter_pirog/32/234_2.png) [@Peter\_Pirog](https://discuss.ray.io/u/Peter_Pirog)\
**Post date:** [May 3, 2022, 7:54am UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005/1 "2022-05-03T07:54:16Z")

</div>

Few days ago I found very good book for rllib framework, I know that it can look like advertisement but I spent a lot of time find book about rllib practical issues. This book shows step by step how to use rllib.

![mastering](https://us1.discourse-cdn.com/flex020/uploads/ray/original/2X/a/a4e5e32c1319d82356d802ab23c030b57182b361.png)

I hope it will be useful:  
[Mastering Reinforcement Learning with Python](https://www.packtpub.com/product/mastering-reinforcement-learning-with-python/9781838644147)

Here is [Github repo](https://github.com/PacktPublishing/Mastering-Reinforcement-Learning-with-Python) for the book , rllib examples start from Chapter 6: [example](https://github.com/PacktPublishing/Mastering-Reinforcement-Learning-with-Python/blob/master/Chapter06/rllib_apex_dqn.py)

I recommend the book to better understand the code from github.

---

<div class="post-metadata">

**Author:** ![arturn](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/arturn/32/2096_2.png) [@arturn](https://discuss.ray.io/u/arturn)\
**Post date:** [May 3, 2022, 1:40pm UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005/2 "2022-05-03T13:40:10Z")

</div>

Awesome!  
Keep in mind that Ray 2.0 is on the horizon and some API’s may not be stable over that change. The book is a little “older”.  
For example the `config['learning_starts'] = 5000` is moving and being renamed.  
If you want to learn about RLlib right now this is not too bad, since you can transition to Ray 2.0 later and take most of your knowledge with you.

[Max Pumperla](https://maxpumperla.com/) is also writing a book on Ray that will feature RLlib and that we can look forward to. 🙂

---

<div class="post-metadata">

**Author:** ![Peter\_Pirog](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/peter_pirog/32/234_2.png) [@Peter\_Pirog](https://discuss.ray.io/u/Peter_Pirog)\
**Post date:** [May 3, 2022, 1:51pm UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005/3 "2022-05-03T13:51:21Z")

</div>

@arturn , Thank You fot the info about the book. Of course You are right that API will be changed, but for the beginner the main problem is to understand main ideas and main schemas how to use different algorithms with different envs, how to customize envs, how to use masking, how to configure cluster. There are so many configuration dictionaries that in some point beginner doesn’t know what configuration for what functionality is.  
For example, is your config dictionary for cluster, experiment, algorithm, model, hyperparemeters tuning scheduler or something else.

---

<div class="post-metadata">

**Author:** ![Peter\_Pirog](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/peter_pirog/32/234_2.png) [@Peter\_Pirog](https://discuss.ray.io/u/Peter_Pirog)\
**Post date:** [June 21, 2022, 4:24pm UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005/4 "2022-06-21T16:24:39Z")

</div>

I found some new book about ray usage. I haven’t read it yet but some published parts of the book show that it can be interesting.  
[Practical Deep Learning at Scale with MLflow](https://www.packtpub.com/product/practical-deep-learning-at-scale-with-mlflow/9781803241333)

[Sample pages from the book](https://books.google.pl/books?id=2Nh1EAAAQBAJ&printsec=frontcover&hl=eng#v=onepage&q&f=false) by permission of Packt Publishing.

 ![content](https://us1.discourse-cdn.com/flex020/uploads/ray/original/2X/e/e316b792235f67870202dd657fca0cc564e1eecd.jpeg)

---

<div class="post-metadata">

**Author:** ![luzgui](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/luzgui/32/2281_2.png) [@luzgui](https://discuss.ray.io/u/luzgui)\
**Post date:** [September 20, 2022, 4:32pm UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005/5 "2022-09-20T16:32:22Z")

</div>

Will the Max Pumperla book already be using ray2.0?

---

<div class="post-metadata">

**Author:** ![arturn](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/arturn/32/2096_2.png) [@arturn](https://discuss.ray.io/u/arturn)\
**Post date:** [September 21, 2022, 9:41am UTC](https://discuss.ray.io/t/very-good-book-for-rllib-mastering-reinforcement-learning-with-python/6005/6 "2022-09-21T09:41:03Z")

</div>

Yes, and it will launch in the coming months, maybe in early 2023 🙂
