Hi @iykim ,
If you are using the new API, you probably encountered the same issue as me, you can look up my post here and the “hacky” solution I proposed: Using Dict observation space with custom RLModule - #6 by adrienJeg
1 Like