# Ray Serve on Openshift

**URL:** <https://discuss.ray.io/t/ray-serve-on-openshift/21972>\
**Category:** Ray Serve\
**Created:** [March 6, 2025, 6:58am UTC](https://discuss.ray.io/t/ray-serve-on-openshift/21972 "2025-03-06T06:58:23Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sokaikai](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/sokaikai/32/7728_2.png) [@sokaikai](https://discuss.ray.io/u/sokaikai)\
**Post date:** [March 6, 2025, 6:58am UTC](https://discuss.ray.io/t/ray-serve-on-openshift/21972/1 "2025-03-06T06:58:23Z")

</div>

High: It blocks me to complete my task.

I am trying to do distributed LLM model inferencing using vllm and ray on Openshift. I tried doing this using RayService API on Openshift following this guide [Serve a Large Language Model with vLLM on Kubernetes — Ray 2.43.0](https://docs.ray.io/en/latest/cluster/kubernetes/examples/vllm-rayservice.html). However I kept running into the following issue when inspecting events:

```auto
pods "llama-3-8b-raycluster-9kkt2-head-" is forbidden: error looking up service account ray-serve/llama-3-8b-raycluster-9kkt2-oauth-proxy-3c567d11: serviceaccount "llama-3-8b-raycluster-9kkt2-oauth-proxy-3c567d11" not found

```

The serviceaccount kept automatically creates and delete immediately, even for the ones I created manually. Note this this deployment worked in vanilla kubernetes I’ve done before, just not working in Openshift. Are there any privilege settings I have to provide this deployment for this to work? Appreciate any advice on this. Thank you