Hi, When using a dqn agents (or any other relevant algorithms for that matter) - is there a way that I can manipulate the agent’s memory buffer during the training? *By manipulation I intend to adding or removing transitions from/to the buffer.

Hi @Ofir_Abu , this manipulation is certainly not trivial. As you can see in the source code , the ReplayBuffer holds in _storage a list of SampleBatches that contain the experiences from the environment. This means, you either need to add (by using add() or remove SampleBatches directly from this b…

Accessing the memory buffer dqn

RLlib

Roller44 November 10, 2021, 3:50pm 5

Yes. Sorry. I have started a new topic. Here is the link, if you are interested in it.

Topic		Replies	Views
Load/save replay buffer RLlib	5	601	September 18, 2022
Sample form the reply buffer sequentially in DQN RLlib	1	176	June 27, 2022
Rllib trainig step customize RLlib	6	484	March 31, 2021
Add the experiences to the buffer "by hand" RLlib	7	803	December 14, 2021
How to configure the neural networks in A3C? RLlib	2	381	November 10, 2021

Accessing the memory buffer dqn

Related Topics