Register a custom environment and runing PPOTrainer on that environment not working

[mannyv]

Hi @fardinabbasi,

This is where your error is coming from
return self._get_obs() if not terminated else None

You cannot return None. You will need to come up with some dummy observation to return.