Due to several reasons, no kubernetes or any cloud based platform available.
I want to achieve the followings:
Given I have 3 nodes, I want all of nodes to run the same ray deployment (serving the same endpoint) to form a ray cluster. The requests to the endpoint should be routed to these 3 nodes.
How to achieve this?
Thanks.