How to set ray.worker.timeout

Ray Core
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

It seems like I am running into similar scalability problems as Poor spillback scheduling behavior in large clusters · Issue #10150 · ray-project/ray · GitHub, and I would like to configure the ray worker register timeout. From this PR it seems like it is now possible: [Core] Make worker_register_timeout_seconds configurable by yncxcw · Pull Request #9221 · ray-project/ray · GitHub

Can someone show me how to do it in Python?

I am now aware of the _system config option in ray.init. Can someone show how to do that when I am using ray start from the command line to set up the head node?

2

You can set the env var. RAY_ worker_register_timeout_seconds (suffix RAY_ to system config defined within ray_config.h)