I am trying to implement an meta RL. For example a outer RL loop with a RL inner loop. How would one start with RLlib? I am asking for some ideas and guidance. Thanks!

Thank you for the quick reply. I will take a look there!

Hi @RickLan , Another place that might also make sense is the hierarchical training example. It essentially boils down to an outer and inner loop. https://docs.ray.io/en/latest/rllib-env.html?highlight=multiagent#hierarchical-environments ray-project/ray/blob/master/rllib/examples/hierarch…

Thanks, @mannyv ! Will look as well.

How to implement a meta RL

RLlib

sven1977 June 29, 2021, 2:17pm 2

Hey @RickLan , could you take a look at our MAML implementation (rllib/agents/maml/...)? @michaelzhiluo already solved this problem of the different loops in there.

Topic		Replies	Views
Hierachical multi-agent RL RLlib	1	589	February 15, 2023
Special case MultiAgent Environment RLlib	1	28	May 22, 2025
[rllib] Hierarchical Reinforcement Learning (HRL) implementation? RLlib	1	1341	September 30, 2021
Multiple hierarchical agents possible? RLlib	2	598	August 11, 2021
Ensemble Learner with rule-based policies RLlib	1	374	January 12, 2022

How to implement a meta RL

Related topics