Hi there! I was using a action_space = gym.Discrete(6) in my custom environment and everithing was good. Now, I’m traying to experiment with a continuos action spaces (the rest of the configuration remaind as before). To do this I write action_space = gym.Box(low=0.0, high=1.0, shape=(1,), dtype=np…

[image] PPO nan in actor logits RLlib Hi @tlaurie99 , Welcome to the forum. If I had to venture a guess as to where the Nan’s originate it would be here: 250 self.dist = torch.distributions.normal.Normal(mean, torch.exp(log_std)) It has been my experience that when usi…

Continuous action space

RLlib Configure Algorithm, Training, Evaluation, Scaling

mannyv July 29, 2024, 10:24pm 2

Topic		Replies	Views
Continuous actions go beyond defined action_space and then nan for multi-agent PPO RLlib	0	333	July 3, 2021
There was an error changing the trajecy_tory_view_api into continuous action space RLlib	7	601	February 22, 2022
Nan in train_batch[SampleBatch.ACTION_LOGP] RLlib	7	896	July 8, 2021
PPO nan in actor logits RLlib	7	738	October 1, 2024
Initial action for Dict action space RLlib	5	1351	July 23, 2021

Continuous action space

Related topics