What would be a way to persist the entire driver log while submitting a job with something like
ray submit --tmux ray_cluster.yaml --cluster-name jkkwon ?
Simply redirecting with
> logs.txt doesn’t work, since that’ll only contain lines like below
Loaded cached provider configuration If you experience issues with the cloud provider, try re-running the command with --no-config-cache. Fetched IP: 126.96.36.199 Fetched IP: 188.8.131.52 Run `ray attach ray_cluster.yaml --cluster-name=jkkwon--tmux` to check command status.
When I do attach to the cluster (
ray attach ray_cluster.yaml --cluster-name=jkkwon--tmux), I just see the log from tailing, not the entire log.