How severe does this issue affect your experience of using Ray?
- Medium: It contributes to significant difficulty to complete my task, but I can work around it.
xposting from Slack community (here)
hey all, new to ray datasets. any advise on how to do holistic operations using map_batches()
or map_groups()
?
Use cases that come to mind are counting for histograms and percentile calculations across the entire dataset.
Seems like ray datasets is setup well to do map-reduce operations, but curious on some best practices and approaches.
Thank you!
Emmanuel