Ray serve create endpoint timeout

Ray Core
1

I have an actor creating a backend to which I would like to add endpoints.

When I add the first endpoint I get the following timeout:

2021-03-10 16:18:01,509	ERROR worker.py:76 -- Unhandled error (suppress with RAY_IGNORE_UNHANDLED_ERRORS=1): ray::CamelAnyNode.add_sink() (pid=566, ip=10.244.1.5)
  File "/home/ray/anaconda3/lib/python3.8/site-packages/ray/_private/client_mode_hook.py", line 47, in wrapper
    return func(*args, **kwargs)
ray.exceptions.RayTaskError(TimeoutError): ray::block_until_http_ready() (pid=1297, ip=10.244.1.2)
  File "python/ray/_raylet.pyx", line 501, in ray._raylet.execute_task
  File "/home/ray/anaconda3/lib/python3.8/site-packages/ray/serve/utils.py", line 161, in block_until_http_ready
    raise TimeoutError(
TimeoutError: HTTP proxy not ready after 60 seconds.

During handling of the above exception, another exception occurred:

ray::CamelAnyNode.add_sink() (pid=566, ip=10.244.1.5)
  File "python/ray/_raylet.pyx", line 484, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 491, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 501, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 444, in ray._raylet.execute_task.function_executor
  File "/home/ray/rayvens/rayvens/core/camel_anywhere/impl.py", line 75, in add_sink
    self.kamel_backend.createProxyEndpoint(endpoint_name, route)
  File "/home/ray/rayvens/rayvens/core/camel_anywhere/kamel_backend.py", line 57, in createProxyEndpoint
    self.client.create_endpoint(endpointName,
  File "/home/ray/anaconda3/lib/python3.8/site-packages/ray/serve/api.py", line 62, in check
    return f(self, *args, **kwargs)
  File "/home/ray/anaconda3/lib/python3.8/site-packages/ray/serve/api.py", line 263, in create_endpoint
    raise TimeoutError("Route not available at HTTP proxies "
TimeoutError: Route not available at HTTP proxies after {HTTP_PROXY_TIMEOUT}s.

Any idea what’s going on?

Thanks.

2

Hi @doru1004, happy to help! What’s your Ray version? can you try nightly Ray? Installing Ray — Ray v2.0.0.dev0

3

Thanks for the reply! I am using the latest version. It seems that tweaking the resources required to num_cpus=0 lets the endpoint get created. Is this the Ray way to resolve this problem?