I go back to ray 0.8-something.
I’ve frequently run into examples that just don’t work. For instant, try to run the following on a fresh install of ray 2.40.0:
cd ~/anaconda3/lib/python/3.12/site-packages/ray/rllib/examples/rl_modules
python ./action_masking_rl_module.py --enable-new-api-stack --num-env-runners 2
Fails every time, with error
TypeError: ActionMaskingRLModule.init() got an unexpected keyword argument ‘observation_space’
In fact, I can’t find an action_masking examples that DOES work, and my work depends on it.
This would be understandable on ray 3.0.0dev0, which is in beta, but not for 2.40.0. Earlier versions of ray easily handled action_masking, but that broke somewhere along the way, and release testing just doesn’t uncover it.
Examples are important. The documentation relies on examples. User understanding relies on documentation.
It should be a standard practice to test a release against everything in ray.rllib.examples so that the examples can be adjusted as needed.