I am interested in Ray performance using physical CPUs against logical CPUs. Given Debugging and Profiling — Ray v1.9.1, and particularly:
Do the machines you’re running on have fewer physical cores than logical cores? You can check the number of logical cores with psutil.cpu_count() and the number of physical cores with psutil.cpu_count(logical=False). This is common on a lot of machines and especially on EC2. For many workloads (especially numerical workloads), you often cannot expect a greater speedup than the number of physical CPUs.
I have the following question. Why can’t I expect a greater speedup than the number of physical CPUs for many workloads (especially numerical workloads)?
Thanks in advance!