# ModuleNotFoundError: No module named 'ray.serve.llm'

**URL:** <https://discuss.ray.io/t/modulenotfounderror-no-module-named-ray-serve-llm/22019>\
**Category:** Ray Serve\
**Created:** [March 11, 2025, 9:53am UTC](https://discuss.ray.io/t/modulenotfounderror-no-module-named-ray-serve-llm/22019 "2025-03-11T09:53:53Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![RajaSekhar\_Kavuri](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/rajasekhar_kavuri/32/7767_2.png) [@RajaSekhar\_Kavuri](https://discuss.ray.io/u/RajaSekhar_Kavuri)\
**Post date:** [March 11, 2025, 9:53am UTC](https://discuss.ray.io/t/modulenotfounderror-no-module-named-ray-serve-llm/22019/1 "2025-03-11T09:53:53Z")

</div>

Trying to just deploy LLM using ray server documentation using below link we are getting the llm module error. i am having ray serve below version  
pip show ray  
WARNING: Ignoring invalid distribution -orch (/usr/local/lib/python3.9/site-packages)  
Name: ray  
Version: 2.42.1

when i try to run the code from the link “[Serving LLMs — Ray 3.0.0.dev0](https://docs.ray.io/en/master/serve/llm/serving-llms.html)” getting this module error

---

<div class="post-metadata">

**Author:** ![kourosh](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/kourosh/32/2130_2.png) [@kourosh](https://discuss.ray.io/u/kourosh)\
**Post date:** [March 20, 2025, 12:00am UTC](https://discuss.ray.io/t/modulenotfounderror-no-module-named-ray-serve-llm/22019/2 "2025-03-20T00:00:48Z")

</div>

Hi @RajaSekhar_Kavuri , the llm apis are available in ray \>= 2.43. It seems like you are on 2.42.1. We changed the import paths and some namings a bit from 2.43 to master (to be released in 2.44). so make sure you use the right doc version when testing out.