I can access my dashboard at a given URL. (I know b/c running wget <url>
works without issue).
But running env RAY_ADDRESS=<url> ray status
, causes the following stacktrace:
Traceback (most recent call last):
File "/home/ray/anaconda3/lib/python3.8/site-packages/ray/_private/gcs_utils.py", line 120, in check_health
resp = stub.CheckAlive(req, timeout=timeout)
File "/home/ray/anaconda3/lib/python3.8/site-packages/grpc/_channel.py", line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File "/home/ray/anaconda3/lib/python3.8/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed for <url> C-ares status is not ARES_SUCCESS qtype=A name=<url> is_balancer=0: Domain name not found"
debug_error_string = "UNKNOWN:DNS resolution failed for http://100.70.220.231:8265: C-ares status is not ARES_SUCCESS qtype=A name=<url> is_balancer=0: Domain name not found {created_time:"2022-11-11T01:53:24.817252623+00:00", grpc_status:14}"
>
Ray cluster is not found at <url>
Note that the cluster URL is a tailscale IP, not sure if that makes a difference.