I have an environment where it is important to eliminate any side effects between workers. In particular, my environment runs benchmarks that are dependent on the current cache pressure, so I don’t want to mix different workers (each running a benchmark) up. Is it possible to set CPU Affinities (a…

Hi @alexanderb14 , When running your experiments via Ray tune (tune.run()) in non-local mode, RLlib makes sure that all RolloutWorkers get their own CPU, so there shouldn’t be any interference into a Worker’s environment coming from another Worker (running in its own env).

Hi @sven1977 Thanks for your fast response! However I think this isn’t a solution for my usecase. I need one worker to run on a specific HW thread that I set. Background is that each worker shall run in a thread of an own QoS unit of the CPU (a Ryzen Threadripper), in order to not interfer on the…

Hmm, yeah, we do not support binding a worker or the driver to a particular HW thread. However, could you also ask this question under the Ray Core category? You may get a more detailed answer there.

Hi @sven1977 , When running your experiments via Ray tune ( tune.run() ) in non-local mode, RLlib makes sure that all RolloutWorkers get their own CPU Does that mean that if I’m using ‘trainer.train()’ RLlib will not make sure of that?

CPU Affinity for Workers

RLlib

alexanderb14 March 11, 2021, 9:17am 6

Hi Sven, thanks a lot for your response. I created a new discussion thread now, tagged with Ray Core: CPU Affinity for Ray Workers

Topic		Replies	Views
CPU Affinity for Ray Workers Ray Core	1	856	March 11, 2021
Most efficient way to use only a CPU for training RLlib	3	3315	April 22, 2021
Ray actor CPU affinity Ray Core	3	116	December 17, 2024
Training and inference ONLY using GPUs and no CPUs RLlib	7	2095	April 12, 2021
How many workers? Best way to determine number of workers? RLlib	3	2475	January 3, 2023

CPU Affinity for Workers

Related topics