Feature request - toggle logging into experiment.json

Hi Guys,

My experiment.json files are getting huge pretty fast. Running RLlib at scale (via Tune) on a big cluster makes the shared drive explode. I might be missing - why is experiment.json even being logged? Is it valuable to post-training analysis? Is there any automation/tool to analyze it?

And anyway, I’d opt for letting users toggle it off to save storage space.

Yeah, you should be able to do this by setting TUNE_GLOBAL_CHECKPOINT_S=1000000000 (some very large number)

2 Likes