How to use different python versions in the same cluster?

Ray Core
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Hi, I am CTO of a small startup, we want to use Ray as a framework to scale and run our scientific processes. But we faced a problem that our docker containers have different python versions due to legacy packages, etc. Is this possible to have a different python versions on different workers or is there any workaround? All the python versions are > 3

2

It is not allowed. i believe the reason was python doesn’t guarantee the serialization is correctly done across different major release (3.x).

I recommend you to use multiple clusters instead for this case.