After moving to ray, our resource usage on the machine massively increased. Most obvious is that Ray seems to leak file handles at an alarming rate - we’ve reproduced this on a few windows machines, all of which happen to be using 2.33.0. Ray is also leaking memory, albeit more slowly, and we have only had one machine taken down by this.
We opened an issue:
[Core] Enormous file handler and memory leaks on windows · Issue #47459 · ray-project/ray (github.com)
Apologies for the duplication, but we don’t know which forum is best for this.
We are happy to help in any way to solve this issue!