Hi there! I was using a action_space = gym.Discrete(6) in my custom environment and everithing was good. Now, I’m traying to experiment with a continuos action spaces (the rest of the configuration remaind as before). To do this I write action_space = gym.Box(low=0.0, high=1.0, shape=(1,), dtype=np…

[image] PPO nan in actor logits RLlib Hi @tlaurie99 , Welcome to the forum. If I had to venture a guess as to where the Nan’s originate it would be here: 250 self.dist = torch.distributions.normal.Normal(mean, torch.exp(log_std)) It has been my experience that when usi…

Continuous action space

RLlib Configure Algorithm, Training, Evaluation, Scaling

mannyv July 29, 2024, 10:24pm 2

Topic		Replies	Views
PPO nan in actor logits RLlib	7	895	October 1, 2024
Continuous actions go beyond defined action_space and then nan for multi-agent PPO RLlib	0	339	July 3, 2021
There was an error changing the trajecy_tory_view_api into continuous action space RLlib	7	610	February 22, 2022
Error: nan Tensors in PyTorch with Ray RLlib for MARL RLlib	12	1261	August 10, 2024
Action masking error RLlib	9	1734	February 6, 2023

Continuous action space

Related topics