Does ray-llm support only CPU?

saranya_gouthem October 25, 2023, 4:35pm 1

Does ray-llm model scaling config support only CPU?
or GPU is a must to run Aviary model ?

Topic		Replies	Views
Question about the model yaml config `accelerator_type_a100` LLMs/Generative AI/Aviary	1	362	February 2, 2024
Memory Requirements for distributing LLM LLMs/Generative AI/Aviary	3	453	August 31, 2023
Best practices to run multiple models in multiple GPUs in RayLLM LLMs/Generative AI/Aviary	0	375	February 8, 2024
Unable to specify GPU based on number	0	203	February 23, 2024
Multi GPU Usage on Multi VM\|Ray cluster on multi VM instances Ray Clusters	4	809	August 2, 2023