# Does ray-llm support only CPU?

**URL:** <https://discuss.ray.io/t/does-ray-llm-support-only-cpu/12591>\
**Category:** Uncategorized\
**Created:** [October 25, 2023, 4:35pm UTC](https://discuss.ray.io/t/does-ray-llm-support-only-cpu/12591 "2023-10-25T16:35:44Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![saranya\_gouthem](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/saranya_gouthem/32/5240_2.png) [@saranya\_gouthem](https://discuss.ray.io/u/saranya_gouthem)\
**Post date:** [October 25, 2023, 4:35pm UTC](https://discuss.ray.io/t/does-ray-llm-support-only-cpu/12591/1 "2023-10-25T16:35:44Z")

</div>

Does ray-llm model scaling config support only CPU?  
or GPU is a must to run Aviary model ?