Ray Monitor Not Connecting to Grafana and Prometheus

Monitoring & Debugging
21

Never mind. I figured it out.

When you run Grafana as a Homebrew service it gets its configuration from /opt/homebrew/opt/grafana/share/grafana (as specified in the ~/Library/LaunchAgents/homebrew.mxcl.grafana.plist file). However, the Grafana setup instructions in the Ray documentation say the following:

Instead, update the /usr/local/etc/grafana/grafana.ini file so that it matches the contents of /tmp/ray/session_latest/metrics/grafana/grafana.ini.

Once I modified /opt/homebrew/opt/grafana/share/grafana instead of /usr/local/etc/grafana/grafana.ini everything worked.

The Ray documentation should be modified to take into account the different possible locations of grafana.ini.

22

@wpm Glad that you figured it out. Would you mind creating an issue to track the modification to be done for ray docs? If you are willing contribute to the doc directly, that would be greatly appreciated!

23

Issue 42430.

1 Like