Replay buffer - simple how-to question

RLlib
1

Hello,
I’m a bit lost reading the documentation so I thought I could ask a simple question here if you may.

I have a simple task which is to store experience tuples (S, A, R, S′) as weel as models into a replay buffer and eventually sample them (using any existing approaches if any at all)
I can’t find the right way to do it :frowning:
Also, I’d like this replay buffer to be shared accross multiple nodes and stored somehow so that I can reload it later.

Does it make any sense?

nb: I’m using pytorch

2

Hi @Mike,

Welcome to the forums. I am not sure how to go about answering your question because I am not sure what you are trying to do.

Are you planning on using on of the built in algorithms or implement your own algorithm from scratch?

Can you provide more information on your bigger picture plan?

3

Hi @mannyv ,
From scratch. All I’m interested in right now is a distributed and persistent replay buffer.

Thanx.