How severe does this issue affect your experience of using Ray? High: It blocks me to complete my task. I am struggling to understand what is the proper way to use a custom model with the DQN algorithm. The steps I’m taking are: 1. Create a class MyModel that extends TFModelV2. class MyModel(T…

I finally understood the issue: DQN always adds a linear layer on top of the forward() output. This means that forward() must not return the Q values, but just an embedding that will be transformed into Q values by RLlib. How to disable this behavior and directly handle Q values in the custom model…

Cannot understand how to create custom model for DQN

RLlib

arturn April 29, 2022, 2:59pm 3

Topic		Replies	Views
[RLlib] Multi-headed DQN RLlib	5	1394	June 13, 2021
Value of num_outputs of DQNTrainer RLlib	3	611	May 9, 2022
Override get_q_value_distributions RLlib	6	734	October 19, 2021
Apply preprocessor in custom model RLlib	19	2600	May 13, 2024
Why does DQN can have custom function? RLlib	1	275	January 9, 2023

Cannot understand how to create custom model for DQN

Related topics