Hello, so Ray Tune writes hundrets of thousands of files and that’s just too much for me. I’m not interested in those files, I write my own output for now using the analysis object. How can I turn file writing off? Can I use ASHAScheduler without it writing checkpoints?

Hi, can you elaborate a bit on your problem? Which files are written? How does you training code look like? Hundreds of thousands of files is not normal behavior and unexpected, so chances are that there is a configuration error. For instance, if you set the checkpoint frequency to each iteration …

First let me ask this: Does ASHAScheduler need checkpoints or could I just get rid of that checkpoint saving? I do save a ton of checkpoints apparently. I really just want it to not write any files. Maybe you just want to test something, debug something or whatever. I mean there must be such an opt…

I am also interested in knowing how to turn off all checkpointing. I tried: checkpoint_freq=0, in tune.run doesn’t seem to work.

@ggerog checkpoint_freq would not work in my opinion as the argument is named checkpoint_frequency.

I get the following if I set that to zero: [image] and if I run with checkpoint_freq=0 I still get checkpoints and it is impossible to put keep_checkpoints_num=0 without getting an error: RuntimeError: If checkpointing is enabled, Ray Tune requires keep_checkpoints_num to be None or a number gre…

@ggerog What Ray version are you using?

Same issue here. Ray Tune wrote 50GB into some /home/ray_results folder which killed my server. How can I make all HD writing stop?

Make Ray Tune not write files

Ray Tune

Lars_Simon_Zehnder October 10, 2022, 12:40pm 5

Hi @someuser @ggerog does this thread help?

Topic		Replies	Views
[Tune] How to turn off checkpointing for testing Ray Tune	20	3277	April 18, 2023
How to disable Ray Tune Trial controller checkpointing?	0	322	December 14, 2023
Getting Tune to read Train checkpoint in ray.train.report Dashboard, Monitoring & Debugging	2	45	April 4, 2025
RAY tune does not save checkpoint information under experiment path	0	122	April 7, 2024
Ray Tune event loop backlogged, slow with checkpointing Ray Tune	7	1675	September 28, 2021

Make Ray Tune not write files

Related topics