Does ray-llm support only CPU?

saranya_gouthem October 25, 2023, 4:35pm 1

Does ray-llm model scaling config support only CPU?
or GPU is a must to run Aviary model ?

Topic		Replies	Views
Serving LLM with multiple gpus Ray Serve	0	188	July 3, 2024
LLM model loading	0	51	July 29, 2024
Question about the model yaml config `accelerator_type_a100`	1	436	February 2, 2024
Memory Requirements for distributing LLM	3	571	August 31, 2023
Best practices to run multiple models in multiple GPUs in RayLLM Ray Train	0	680	February 8, 2024