How severe does this issue affect your experience of using Ray? High: It blocks me to complete my task. I’m using this demo(ray-service.text-summarizer.yaml) to test I had edited yaml’s workerGroupSpecs section,like this workerGroupSpecs: # The pod replicas in this group typed worker - repli…

When use ray train, ray train use transformer+accelerate to set device, accelerate get os.environ[“ACCELERATE_TORCH_DEVICE”] setted by ray/train/torch/config.py——in fact, ray/air/_internal/torch_utils.py, but there only get CUDA devices…

Hi @pengxiang_chen , Ray Train “currently” only supports CPU and GPU. We are working hard to make Ray Train support Huawei Ascend NPU and more third-party devices, the relevant PR is: [Train] Decouple device-related modules and add Huawei NPU support to Ray Train #44086 . Please feel free to follow …

PR looks active here (TY @liuxsh9 for contribution as always) cc @yunxuanx for the context on the community desire for it.

The PR on Ray Train side has been merged! [Train] Decouple device-related modules and add Huawei NPU support to Ray Train by liuxsh9 · Pull Request #44086 · ray-project/ray · GitHub

Does Ray2.7.0 support Ascend NPU？

Ray Core

jjyao March 17, 2024, 5:02am 3

Hi @pengxiang_chen Latest Ray supports Ascend NPU.

Topic		Replies	Views
Can Ray support other hardware, such as TPUs or NPUs in China? Kubernetes	0	408	May 31, 2023
Domestic GPU recognition and adaptation Kubernetes	2	42	December 1, 2025
Ray Feature Support	1	7	March 26, 2026
GPU not used Ray 2.7.1	1	364	November 5, 2023
Ray compatibility with Intel arc a770 gpu Ray Core	3	342	January 9, 2024

Does Ray2.7.0 support Ascend NPU？

Related topics