Multi-Agent Transformer

Hi @Aidan_McLaughlin ,

We have a DT implementation that was merged into master 28 days ago.
Other than that, afaik, there are no plans on our roadmap for the near future of implementing this paper. Skimming the paper, Ray Clusters should certainly be able to handle such a workload. Models with such large numbers of parameters are only limited by the nodes’ memory of your cluster.

And lastly: Yes, please care about an implementation. We welcome community contributions very much. Even if we have no plan of implementing this ourselves. If well executed and aligned with our APIs, we will certainly merge it. Depending on how much maintenance it needs, you will have to help us maintain it though. If you are interested, please open a PR early so we can give feedback from time to time.

Cheers

1 Like