Does ray-llm model scaling config support only CPU?
or GPU is a must to run Aviary model ?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Ray Serve LLM on KubeRay with CPU | 1 | 46 | April 30, 2026 | |
| Ray Serve LLM on CPU with KubeRay | 1 | 48 | April 30, 2026 | |
| Ray Serve LLM example in document cannot work | 6 | 581 | April 3, 2025 | |
| Ray Serve vLLM multiple models per GPU in tensor parallelism | 1 | 720 | August 14, 2025 | |
| vLLM Inferencing on multiGPU | 7 | 1673 | September 24, 2024 |