Does RayData Support multi-node vllm inference

[kourosh]

@DriverSong

Will Ray support this scenarios? Or anyone have similar demand scenarios with solutions? At present, I can only think of building an additional platform on top of ray (kuberay or k8s-operator) to achieve the management of multi-node vllm inference tasks on ray.

On Ray serve side, this example should be a good starting point. Serve DeepSeek — Ray 2.46.0