How severe does this issue affect your experience of using Ray?
High: It blocks me to complete my task.
Hello,
I am using a custom environment and I would like to investigate the effects of using sequences and episodes in the replay buffer on my training convergence.
I have changed the ‘replay_buffer_config’ to reflect this but I am getting errors as soon as I am changing the ‘storage_unit’ field.
For example, when I set storage_unit to episodes, the error says that I am not defining the ‘T’ field used by the replay buffer when using this specific storage unit. Similar error when I choose ‘sequences’ as a storage unit, I am missing ‘SEQ_LENS’.
Do I need to add any additional output to my environment, or what other settings should I change in the configuration to get it to work?
Thanks!