How to set head pod NoSchedule

[Dmitri]

The method suggested above was to decorate remote tasks with the gpu requirement:
@ray.remote(num_gpus=1)

Another method is to declare the head node as having 0 CPU. Ray tasks implicitly assume 1 CPU so no Ray tasks will run on the head node [unless you explicitly declare the task as requiring num_cpus=0].

To declare that the head pod has 0 CPU, you add --num-cpus = 0 to the head’s Ray start command. Alternatively, if you are using the Ray Kubernetes Operator, you can {“CPU”:0} to head podType’s rayResources field.

See also the discussion here:

How to create @ray.remote jobs that will only run on the workers from the local node?

Hello Ray Community! I have a pre-processing step in the pipeline in which a worker downloads the data from cloud storage, then loads it from disk and processes in chunks. I would like to parallelize the load + process step, however, when running in a cluster setting, the jobs created with @ray.remote get submitted to the other nodes of the cluster that do not have the necessary data to read from disk resulting in FileNotFound errors. I wonder if it is possible to somehow limit the jobs that …