Are there any low (ish) level hooks in ray to intercept what workers print to stdout/stdout or log via an actual logger? Let’s say some of my workers are printing things that I’d like to filter out in the driver side, if everything from a worker was sent to driver through a python loggger’s log functions then I could simply attach a filter to it but I think they’re passed at a lower level?
Here are the docs for ray log Configuring Logging — Ray 2.6.1
The logs work in this way, each node, we have a monitor check whether there is anything new or not. Then it’s streaming from the node to the driver. So streaming happens inside, and logging is something that can be configured