Ray service profiling

Ray Libraries (Data, Train, Tune, Serve) Ray Serve
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Using ray serve to deploy some model services, about the time-consuming of each function and how to find hot functions, see ray timeline in the official documents

ray timeline：Profiling — Ray 2.2.0

but it does not seem to be used for ray service, I would like to ask what tools can be used for hot spot analysis，time-consuming statistics at the function level

2

@lanmcc If ray timeline works for ray serve (e.g., last 24 hours’ ray tasks created by serve), is that enough for you?

3

what do you mean by “but it does not seem to be used for ray service”? You mean you cannot see more fine grained breakdown of function calls?