Error when using offline data (.json) for validation

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

I have been trying to train an algorithm using offline data from a .json file while also doing off policy evaluation again using offline data from a .json. I have follow the guide here for creating the offline data using external experiences. However, there is some issues when passing the offline validation data that I can’t understand how to resolve: “ValueError: eps_id 501 was already passed to the peek function. Make sure dataset contains only unique episodes with unique ids.” For a given sample trajectory, I have made sure that the eps_id within the sample are the same. Moreover, different samples have different eps_ids. I really don’t understand what this error means. Any help is appreciated.

The data json and code with the error can be found here.