RLlib compatible with GNNs (e.g. TF-GNN, GraphTensor) or Spektral

[kourosh]

Hi @klausk55, We still don’t have native support for GNN frameworks in RLlib. I found some old threads that you were already part of. I am not sure if you will find them helpful, but these are the only solutions that we have found in the short term.

How to integrate GGNN model to agent policy models

I am using the PPO trainer with a custom environment whose observation space is a graph, I am modeling the graph as a GGNN model. Node representations returned from GGNN are given input to the agent as observations. I want the GGNN model to get updated when agent networks are getting updated, how can I integrate GGNN with the agent model?