Hello, I’m trying to train a Graph Network on RLLib. For this purpose I’m using the Pytorch Geometric library. This library has a specific way to collate samples together in a batch (because each sample has a graph of different size, more info here ). I’m a bit lost on how to integrate Pytorch Geo…

[image] Astariul: This library has a specific way to collate samples together in a batch (because each sample has a graph of different size, more info here ). I use torch geometric in ray rllib here: https://github.com/smorad/graph-conv-memory-paper/blob/master/src/models/ray_graph.py

Pytorch Geometric in RLLib?

RLlib

smorad August 9, 2021, 12:27pm 3

I use torch geometric in ray rllib here: https://github.com/smorad/graph-conv-memory-paper/blob/master/src/models/ray_graph.py

2 Likes

GNN (DGL) with Multi-Agent Reinforcement Learning

Topic		Replies	Views
How to define a graph type observation space and use torch_geometric? RLlib	7	705	July 17, 2023
Why is my `rllib.models.torch.torch_modelv2.TorchModelV2` receiving a Tensor of shape ( 32, <observation size> )? Configure Algorithm, Training, Evaluation, Scaling	1	685	November 15, 2022
GNN (DGL) with Multi-Agent Reinforcement Learning RLlib	4	1612	January 5, 2022
Error: two structures are not the same. GNN Model RLlib	1	276	December 14, 2022
[RLlib] Variable-length Observation Spaces without padding RLlib	7	2621	March 9, 2021

Pytorch Geometric in RLLib?

Related topics