Improve documentation for Ray production use cases

It would be really great to have some better documentation on how to use Ray for production workloads. The Ray programming model is well suited to build production systems like web services or serving systems, however at the moment there is no good centralized place where we collect documentation about that and give insights into how to actually build and run such production systems (some existing docs include Ray Monitoring — Ray v2.0.0.dev0 and Ray Serve: Scalable and Programmable Serving — Ray v2.0.0.dev0).

Here are some concrete ideas for improvements we could make along these lines:

These are some ideas and we’d love to hear from people using Ray in production on what their pain points are/where more documentation would help.