when running ray.train, there are lots of logging messages like:
RayTrainWorker pid=131328) Starting execution of Dataset. Full logs are in
/tmp/ray/session_2024-07-03_17-46-11_385350_130700/logs/ray-data [repeated 58x
across cluster]
(RayTrainWorker pid=131328) Execution plan of Dataset: InputDataBuffer[Input] ->
TaskPoolMapOperator[Write] [repeated 46x across cluster]
(RayTrainWorker pid=131328) Execution plan of Dataset: InputDataBuffer[Input] ->
TaskPoolMapOperator[ReadCSV] [repeated 12x across cluster]
I tried to turn them off by running the following commands but they make no effects:
ray_data_logger = logging.getLogger("ray.data")
ray_rllib_logger = logging.getLogger("ray.rllib")
ray_serve_logger = logging.getLogger("ray.serve")
ray_data_logger.setLevel(logging.CRITICAL)
ray_rllib_logger.setLevel(logging.CRITICAL)
ray_serve_logger.setLevel(logging.CRITICAL)
Any help would be appreciated