I’m using ray tune to find hyperparameters for a model using cross-validation. One of the hyperparameters modifies how much training data the model receives, as I noticed that sometimes using less training data yielded greater results.
The batch_size should depend on this parameter, because it can’t be higher than the number of elements in the training set. How can I skip running experiments for the hyperparamenters where the batch_size is higher than the number of elements in train?
I don’t want them to even appear in the table of results, or count towards the experiment count. Is that possible?