[Serve] Can I configure an application to run with an image without privileged mode?

Ray Libraries (Data, Train, Tune, Serve) Ray Serve
1

Can I configure an application to run with an image without privileged mode? Since it is not safe to configure this in k8s.

I learned that there is a framework like kaniko that allows you to run docker in docker without special modes.
Would you consider including kaniko in Ray to safely run application images?

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.
  • High: It blocks me to complete my task.

Versions
ray==2.8.1
python==3.11.5

I’m also curious to know why I can’t run ray apps in images if I have different versions of Python (from documentation)? Can this condition be neglected or somehow bypassed?

2

Could you file this as a feature request on GitHub? We can track it better there.

I’m also curious to know why I can’t run ray apps in images if I have different versions of Python (from documentation)?

Ray performs serialization using cloudpickle and pickle. These serialization methods may change between different Python versions, which is why require the same version.