Training works in ray 1.3, how to get it to work in ray 1.13?

RLlib
1

I used ray 1.3 and python 3.7 and training1.py and rollout1.py was successful. Training exhibited mean reward going up and reduced episode reward over time.
I’m trying to get the training/rollout script to work in ray 1.13 and python 3.8 because there’s a complementary policy trained with ray1.13/python3.8 that needs to be integrated with the policy from training1.py and rollout1.py. so I’m trying to get everything functioning on the same environment.

If I train in ray 1.13 and set the following: config[“_disable_preprocessor_api”]=True,
I get this error:

(PPOTrainer pid=44716) File “C:\Users\christopher\AppData\Local\anaconda3\envs\RLCLEANUPENV\lib\site-packages\ray\rllib\models\modelv2.py”, line 411, in restore_original_dimensions
(PPOTrainer pid=44716) return _unpack_obs(obs, original_space, tensorlib=tensorlib)
(PPOTrainer pid=44716) File " C:\Users\christopher\AppData\Local\anaconda3\envs\RLCLEANUPENV\lib\site-packages\ray\rllib\models\modelv2.py", line 445, in _unpack_obs
(PPOTrainer pid=44716) raise ValueError(
(PPOTrainer pid=44716) ValueError: Expected flattened obs shape of […, 80], got (?, 23)
Traceback (most recent call last):
File “train.py”, line 87, in
tune.run(ppo.PPOTrainer, config=my_config, stop=stop_dict, local_dir=output_dir,
File " C:\Users\christopher\AppData\Local\anaconda3\envs\RLCLEANUPENV \lib\site-packages\ray\tune\tune.py", line
741, in run
raise TuneError(“Trials did not complete”, incomplete_trials)
ray.tune.error.TuneError: (‘Trials did not complete’, [PPOTrainer_MultiAgentTravelingSalesman_30ef6_00000])

when I set config[“_disable_preprocessor_api”]=True, training can occur but the rewards are decreasing instead of increasing.

I’m using
observation_dict = {“pos”: MultiDiscrete([20 for i in range(self.agent_count)]),
“visited”: Box(low=np.NINF, high=np.inf, shape=(20, 1))
}
self.observation_space = spaces.Dict(observation_dict)
self.action_space = MultiDiscrete([20 for i in range(self.agent_count)])

What can I do to get training/rollout script to work in ray 1.13 if it is already works in 1.3?
THanks!