Use Policy_Trainer with TensorBoard

[mannyv]

@Denys_Ashikhin,

What version of ray are you currently using?

There is a bug with rnn sequencing in the latest release.

You can avoid it with these settings (assuming you are not trying to train with multi-gpu).

TrajectoryTracking with RLLIB

@mg64ve You can a avoid the issue even in the current version by doing 2 things. Set the config[“simple_optimizer”]=True Set sgd_minibatch_size > max_seq_len