Ray client unable to connect to minikube cluster from outside

Ray Clusters Kubernetes
1

Hello,

I am trying to connect to minikube cluster by running the below command in new shell from documentation:

python ray/doc/kubernetes/example_scripts/run_local_example.py

I get the below error:

python ray/doc/kubernetes/example_scripts Traceback (most recent call last): File "ray/doc/kubernetes/example_scripts/run_local_example.py", line 57, in <module> ray.util.connect(f"127.0.0.1:{LOCAL_PORT}") File "/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client_connect.py", line 26, in connect conn_str, secure=secure, metadata=metadata, connection_retries=3) File "/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/__init__.py", line 57, in connect connection_retries=connection_retries) File "/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/worker.py", line 120, in __init__ raise ConnectionError("ray client connection timeout") ConnectionError: ray client connection timeout s/run_local_example.pyray-1 learn-ray] python ray/doc/kubernetes/example_scripts
Traceback (most recent call last):
File “ray/doc/kubernetes/example_scripts/run_local_example.py”, line 57, in
ray.util.connect(f"127.0.0.1:{LOCAL_PORT}")
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client_connect.py”, line 26, in connect
conn_str, secure=secure, metadata=metadata, connection_retries=3)
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/init.py”, line 57, in connect
connection_retries=connection_retries)
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/worker.py”, line 120, in init
raise ConnectionError(“ray client connection timeout”)
ConnectionError: ray client connection timeout

am I missing some configuration here?

Thanks

2

Which Ray version is being used locally?
There may be a version mismatch. The issue might be addressed by the note at the bottom of this section of the docs:
https://docs.ray.io/en/master/cluster/kubernetes.html#using-ray-client-to-connect-from-outside-the-kubernetes-cluster

3

Hello, thank you for getting back, I did not change ray version for deployment, on CLI I get this version:

$ ray --version
ray, version 1.2.0

I think the same version is deployed on minikube instance

4

Ah, the issue is that the client server does not start by default in Ray 1.2.0, see this post: