This question is related with this thread. I have a problem of NN saturation, I have tried modifying the hyper-parameters, algorithms and the data. However, the problem has not been solved. As a last option, I have thought in implementing custom models for the algorithms. I have seen that the docume…

Hi @carlorop , you can find an example of a custom model here . Note that often people confuse model with network. In RLlib a model is a reinforcement learning model that trains a loss. This loss is often composed of several values from which more than one comes from a neural network. A model might …

@Lars_Simon_Zehnder . Thank you for your help, your suggestions have been greatly appreciated. Unfortunately, the problem is not solved yet. I have taken a look at the example that you have linked, however, I can’t quite figure out out how it works. I have the feeling that maybe my NN is saturated …

@carlorop , here is an example that shows maybe clearer how you can build your own model. As it inherits from the TF(or Torch)ModelV2 (all models should) it overrides some functions of its super and you have to see which functions should be overridden depending on what your model actually needs. I…

Thank you for your reply @Lars_Simon_Zehnder . I am still wondering how to pass a custom model. I have tried to pass it as: from custom_ddpg import DDPGTFModel from ray.rllib.models import ModelCatalog ModelCatalog.register_custom_model("my_tf_model", DDPGTFModel) experiment_params = { "…

Example of custom tensorflow or pytorch neural network

RLlib

carlorop December 10, 2021, 11:27am 6

edit: since this question could be relevant for other people and it is a bit off topic I have created this discussion

Topic		Replies	Views
What happens when you pass a custom model to an actor-critic method RLlib	1	304	March 16, 2022
Custom pytorch policy network RLlib	3	1380	July 7, 2022
Passing custom policy multi-agent RLlib	3	894	December 28, 2021
NN model for RLLib A3CPolicy RLlib	1	445	July 23, 2021
Using custom neural network in RLlib RLlib	5	1298	December 22, 2022

Example of custom tensorflow or pytorch neural network

Related topics