Does ray-llm support only CPU?

saranya_gouthem October 25, 2023, 4:35pm 1

Does ray-llm model scaling config support only CPU?
or GPU is a must to run Aviary model ?

Topic		Replies	Views
Ray Serve LLM on KubeRay with CPU Kubernetes	1	76	April 30, 2026
Ray Serve LLM on CPU with KubeRay Ray Serve	1	96	April 30, 2026
Ray Serve LLM example in document cannot work Ray Serve LLM APIs	6	669	April 3, 2025
Ray Serve vLLM multiple models per GPU in tensor parallelism Ray Serve LLM APIs	1	1028	August 14, 2025
vLLM Inferencing on multiGPU Ray Serve	7	1822	September 24, 2024