Since ray serve support ‘request_timeout_s’ option:
https://docs.ray.io/en/latest/serve/advanced-guides/performance.html#id5
However, when I deploy a k8s yaml as following, it is not work.
rayStartParams:
block: 'true'
num-cpus: '2'
request-timeout-s: '1'
or
rayStartParams:
block: 'true'
num-cpus: '2'
http-options: |
request-timeout-s: '1'
Is it support this config for current version of kuberay?
My kuberay version is 0.6.1
Thank you so much!