I am trying to deploy a small chatbot on rayserve where the cluster should be deployed on EKS.
I was trying to deploy it via ray-service but somehow it doesn’t work and I am also having confusion on how to expose it via Kong ingress already configured on my eks cluster.
I would be really helpful if I can get some guidance here.
Also , here is my ray-service file.
apiVersion: ray.io/v1alpha1
kind: RayService
metadata:
name: rayservice-chatbot
spec:
serviceUnhealthySecondThreshold: 900
deploymentUnhealthySecondThreshold: 300
serveConfigV2: |
applications:
- name: chatbot_app
import_path: main.QueryEvents
route_prefix: /
runtime_env:
container:
image: 89**********34.dkr.ecr.us-east-1.amazonaws.com/rayapp:2.0.0
deployments:
- name: Chatbot
num_replicas: 1
ray_actor_options:
num_cpus: 1
podTemplate:
spec:
serviceAccountName: ray-operator