What's the policy of auto-scaling in Ray streaming?

Ray Data
1

How severe does this issue affect your experience of using Ray?

  • None: Just asking a question out of curiosity
2

Will it support DS2 from OSDI 2018? https://www.usenix.org/system/files/osdi18-kalavri.pdf

3

Or using external metrics such as CPU/memory utilizations?

4

Current streaming solution is Mobius (GitHub - ray-project/mobius: Mobius is an AI infra platform including realtime computing and training.), which I don’t think have the support of your linked paper.