BOHB Scheduler Restarting Experiments without providing checkpoint_dir

Note for others following: Based on this post you can build a custom context function to wrap the trainer for loop and this could automatically save a checkpoint on model cleanup.