NN model for RLLib A3CPolicy

mannyv · July 23, 2021, 1:14pm

Here is one example:

ray-project/ray/blob/master/rllib/examples/models/simple_rpg_model.py

from ray.rllib.models.tf.tf_modelv2 import TFModelV2
from ray.rllib.models.tf.fcnet import FullyConnectedNetwork as TFFCNet
from ray.rllib.models.torch.torch_modelv2 import TorchModelV2
from ray.rllib.models.torch.fcnet import FullyConnectedNetwork as TorchFCNet
from ray.rllib.utils.framework import try_import_tf, try_import_torch

tf1, tf, tfv = try_import_tf()
torch, nn = try_import_torch()


class CustomTorchRPGModel(TorchModelV2, nn.Module):
    """Example of interpreting repeated observations."""

    def __init__(self, obs_space, action_space, num_outputs, model_config,
                 name):
        super().__init__(obs_space, action_space, num_outputs, model_config,
                         name)
        nn.Module.__init__(self)
        self.model = TorchFCNet(obs_space, action_space, num_outputs,
                                model_config, name)

This file has been truncated. show original

There are many more examples of things rllib can do in the example directory for you to look through.

There is also a walk through in the documentation:

https://docs.ray.io/en/master/rllib-models.html?highlight=custom%20model#custom-models-implementing-your-own-forward-logic

Topic		Replies	Views
Custom resnet error RLlib	2	527	May 9, 2022
Issue with Custom PyTorch Model in Ray RLlib RLlib	0	298	November 3, 2023
Example of custom tensorflow or pytorch neural network RLlib	5	641	December 10, 2021
Custom RNN Model with Examples - why do they fail? RLlib	11	2334	May 5, 2022
Using LSTM for custom model RLlib	2	85	March 3, 2025

NN model for RLLib A3CPolicy

Related topics