Ray Docker Image Python Versions

jaykaye31 · June 10, 2024, 7:08pm

Hey there,

I’m currently using the nightly-py311-aarch64 Ray Docker image in a project. My assumption was it would be using Python 3.11. However, the python build arg has it pinned at 3.8. I’m assuming I’m missing something?

Lonnie_Liu · June 25, 2024, 5:51am

Hi, I am Lonnie. I work for Anyscale on the “Release and Engineering Efficiency” team.

The ARG you see in the history is the default argument value recorded in the Dockerfile:

github.com

ray-project/ray/blob/70a8152766cb4e3e2273dd85cae9cf0cc6bd2537/docker/base-deps/Dockerfile#L16


      
          # FROM directive resets ARG
          ARG BASE_IMAGE
          # If this arg is not "autoscaler" then no autoscaler requirements will be included
          ARG AUTOSCALER="autoscaler"
          ENV TZ=America/Los_Angeles
          ENV LC_ALL=C.UTF-8
          ENV LANG=C.UTF-8
          # TODO(ilr) $HOME seems to point to result in "" instead of "/home/ray"
          ENV PATH "/home/ray/anaconda3/bin:$PATH"
          ARG DEBIAN_FRONTEND=noninteractive
          ARG PYTHON_VERSION=3.8.16
          ARG HOSTTYPE=${HOSTTYPE:-x86_64}
          
          ARG RAY_UID=1000
          ARG RAY_GID=100
          
          RUN apt-get update -y \
              && apt-get install -y sudo tzdata \
              && useradd -ms /bin/bash -d /home/ray ray --uid $RAY_UID --gid $RAY_GID \
              && usermod -aG sudo ray \
              && echo 'ray ALL=NOPASSWD: ALL' >> /etc/sudoers \

When building the image we always overwrite that.

In the actual image, the python version for 311 images are 3.11.x

This is what I run and get this morning:

$ docker run --rm -ti rayproject/ray:nightly-py311-aarch64 python --version
Python 3.11.9

Hope this answers your question.

jaykaye31 · June 25, 2024, 1:20pm

Hi Lonnie, that’s very helpful thank you! Makes sense.

Topic		Replies	Views
GPU Docker image for python 3.10 and ray 2.0.0 Ray Clusters	1	1431	September 12, 2022
Ray Docker Versioning Clarification: I want ray, torchvision, gpu + python >3.9 Ray Libraries (Data, Train, Tune, Serve)	1	627	March 8, 2023
How to use different python versions in the same cluster? Ray Core	1	37	September 22, 2024
Any idea when aarch64 Python 3.12 images will be available?	2	29	September 20, 2024
Keeping up with the Python'eses Ray Core	3	286	August 19, 2022

Ray Docker Image Python Versions

Related topics