How severe does this issue affect your experience of using Ray?
Medium: It contributes to significant difficulty to complete my task, but I can work around it.
Is there a recommended way to deal with variable observation size, other than padding the observations to a fixed size ?
From the page Variable length, complex observation space, I tried to use a Repeated space. but observations are padded under the hood before being stored in the train batch (I am using PPO). The problem in my case is that observation size can possibly vary a lot, so the max_len of the repeated space is usually way bigger than the actual observation size: a lot of useless padding is stored, to the point where I am running out of memory.
Is there any solution for this problem ? What are the alternatives ?
There was a similar discussion here, but at the time it seems that there was no solution.