When using PPO with Curiosity exploration in conjunction with a fully discrete obs/action space external environment I get the error below. However, this issue seems like it is a mix-up due to exploration or fully discreten external environment, as per multiple sources ( python - ValueError: Shape mi…

Possible miscall when using curiosity explore mode?

Denys_Ashikhin May 9, 2021, 4:28am 2

Issue has been solved in the github issue link!

1 Like

Topic		Replies	Views
Evaluation of PPO agent fails due to wrongly shaped actions Configure Algorithm, Training, Evaluation, Scaling	2	92	October 8, 2024
Observation space is shrinking while changing from PPO to APPO RLlib	0	15	January 10, 2025
TFActionDistribution Incompatible shapes Configure Algorithm, Training, Evaluation, Scaling	0	127	April 12, 2024
Assert seq_lens is not None -> PPOTrainer RLlib	4	1480	October 14, 2021
Unpack_obs doesn't know to expect 1-hot RLlib	5	894	September 27, 2021