How can i use A2C with PPO in RLLIB?

RLlib
1

How can i use A2C with PPO in RLLIB?

2

Hi @Seyar_Barez,

I do not understand exactly what you are asking. Can you clarify?

3

One can extend Actor-Critic Agent with PPO (Book Foundation of Deep Reinforcement Learning Page 177). How can i do that in RLLIB?

4

Hi @Seyar_Barez,

RLlib has both A2C and PPO available for use to train your environment.

If you are looking for an turtorial on how to use RLlib perhaps this will be useful.

5

@mannyv thanks! i know how to use RLLIB. I would like to use actor-critic agent in combination of ppo.

6

@Seyar_Barez,

I am sorry but I still cannot understand what you are asking. Perhaps you can describe what you are trying to do in more detail than a single sentence.

There is an example in the repo where they show how to use DQN to train for an iteration then switch to PPO and alternate between them. You could set something like that up for A2C and PPO butI do not think that is exactly what you are asking.

1 Like
7

@Seyar_Barez,

The PPO implementation in RLlib is an actor critic algorithm. Is that what you wanted to know?

8

yes that helps alot thanks!