Pip install "ray[all]"==2.5.1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Pip installing “ray[all]”==2.5.1 in a Databricks environment 13.0 ML (includes Apache Spark 3.4.0, Scala 2.12) started throwing the error a few hours ago (it was working fine till a few hours ago).

Collecting ray[all]==2.5.1
  Downloading ray-2.5.1-cp310-cp310-manylinux2014_x86_64.whl (56.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.2/56.2 MB 20.7 MB/s eta 0:00:0000:0100:01
Requirement already satisfied: click>=7.0 in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (8.0.4)
Requirement already satisfied: protobuf!=3.19.5,>=3.15.3 in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (3.19.4)
Requirement already satisfied: filelock in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (3.6.0)
Requirement already satisfied: frozenlist in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.3.3)
Requirement already satisfied: grpcio<=1.51.3,>=1.42.0 in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.48.1)
Requirement already satisfied: jsonschema in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (4.16.0)
Requirement already satisfied: attrs in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (21.4.0)
Collecting msgpack<2.0.0,>=1.0.0
  Downloading msgpack-1.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (316 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 316.8/316.8 kB 28.4 MB/s eta 0:00:00
Requirement already satisfied: aiosignal in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.3.1)
Requirement already satisfied: requests in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (2.28.1)
Requirement already satisfied: pyyaml in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (6.0)
Requirement already satisfied: packaging in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (21.3)
Requirement already satisfied: numpy>=1.19.3 in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.21.5)
Collecting kubernetes
  Downloading kubernetes-27.2.0-py2.py3-none-any.whl (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 28.5 MB/s eta 0:00:0000:01
Requirement already satisfied: pyarrow>=6.0.1 in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (7.0.0)
Collecting opencensus
  Downloading opencensus-0.11.2-py2.py3-none-any.whl (128 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.2/128.2 kB 13.5 MB/s eta 0:00:00
Requirement already satisfied: virtualenv<20.21.1,>=20.0.24 in /usr/local/lib/python3.10/dist-packages (from ray[all]==2.5.1) (20.16.3)
Requirement already satisfied: pandas in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.4.4)
Collecting scikit-image
  Downloading scikit_image-0.21.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.8/13.8 MB 67.0 MB/s eta 0:00:0000:0100:01
Collecting gymnasium==0.26.3
  Downloading Gymnasium-0.26.3-py3-none-any.whl (836 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 836.9/836.9 kB 47.6 MB/s eta 0:00:00
Collecting uvicorn
  Downloading uvicorn-0.23.2-py3-none-any.whl (59 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.5/59.5 kB 7.6 MB/s eta 0:00:00
Collecting opentelemetry-exporter-otlp
  Downloading opentelemetry_exporter_otlp-1.19.0-py3-none-any.whl (7.0 kB)
Collecting py-spy>=0.2.0
  Downloading py_spy-0.3.14-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (3.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 68.2 MB/s eta 0:00:00:00:01
Collecting starlette
  Downloading starlette-0.31.1-py3-none-any.whl (69 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69.9/69.9 kB 5.3 MB/s eta 0:00:00
Requirement already satisfied: scipy in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.9.1)
Collecting fastapi
  Downloading fastapi-0.103.1-py3-none-any.whl (66 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.2/66.2 kB 8.4 MB/s eta 0:00:00
Collecting dm-tree
  Downloading dm_tree-0.1.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (152 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 152.8/152.8 kB 15.2 MB/s eta 0:00:00
Collecting tensorboardX>=1.9
  Downloading tensorboardX-2.6.2.2-py2.py3-none-any.whl (101 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 101.7/101.7 kB 10.4 MB/s eta 0:00:00
Requirement already satisfied: typer in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (0.7.0)
Collecting opentelemetry-api
  Downloading opentelemetry_api-1.19.0-py3-none-any.whl (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 7.1 MB/s eta 0:00:00
Requirement already satisfied: pydantic in /databricks/python3/lib/python3.10/site-packages (from ray[all]==2.5.1) (1.10.7)
Requirement already satisfied: lz4 in /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages (from ray[all]==2.5.1) (4.3.2)
Collecting ray-cpp==2.5.1
  Downloading ray_cpp-2.5.1-cp310-cp310-manylinux2014_x86_64.whl (25.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸━━━━━━━━━━━ 17.8/25.0 MB 3.3 MB/s eta 0:00:03m
ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them.
    ray-cpp==2.5.1 from https://files.pythonhosted.org/packages/48/15/f8b7b2f97d0548cb53fc26c3e31906bcef69f675c93f6ccbb357d4e888d3/ray_cpp-2.5.1-cp310-cp310-manylinux2014_x86_64.whl (from ray[all]==2.5.1):
        Expected sha256 0e4d15b8e8b27e602f49c9d922e2d63022979611d7b0f4bbec80d2e57e100745
             Got        630228830efbc432c6b305ee962e31c1738c5000da30461118c38c1f6c05212e

Could you try pip install --no-cache-dir ray[all]==2.5.1?

Could you try latest Ray package on Databricks Runtime 14.x ?

We are actively developing Ray-on-Databricks, https://docs.databricks.com/en/machine-learning/ray-integration.html