Unable to download whl package from amazon

Ray Core
1

I built a ray cluster environment.

When I run ray.init(), ray automatically creates a conda environment and downloads the whl package from the following URL

But I can’t access this URL in my country
Is there any way I can replace this URL or install ray offline?
Looking forward to your response

2

cc @architkulkarni this is an interesting question!

1 Like
3

Hi @user4,

Sorry to hear you are running into this issue! We unfortunately didn’t anticipate this problem.

A few questions:

  1. Just to clarify, are you using the pip or conda field of runtime_env in your ray.init() command?
  2. Do you mind sharing which country you’re in, and do you happen to know what exactly is blocked (is it all of Amazon S3? does this mean that all of the nightly links at Installing Ray — Ray v1.9.0 are broken in your country as well?)

There are a few short-term options here:

  1. Don’t use the pip or conda field of runtime_env, and instead preinstall your environment on the cluster.
  2. We are working on an enhancement to the pip field of runtime_env that changes the behavior in the following way. Previously, it would dynamically download and install the current Ray version on the cluster in a new isolated virtual environment. The new behavior is that it will only install the non-Ray packages in the pip field, and will inherit the Ray installation that is already present on the cluster. We will have this in Ray 1.10, but the change should be in the Ray nightly wheels by next week. This should circumvent your problem because it won’t download anything from AWS.
4

thank you for reply.

yes. i use conda field in ray.init() command.

i in China.

I solve the problem last weekend.
There are three different ways to solve.
1.Update dns.
2.Build the dockerfile image to preload the python environment without using the runtime_env field in ray.init.
3.When building the image, replace the ray whl file download address and point to your own object store.