As of recently, it looks like we have arm64 images: [docker/arm64] Build docker images (with suffix) for arm64 by krfricke · Pull Request #31861 · ray-project/ray · GitHub
Can you try using the nightly images? Please let us know if you run into any issues!