Here’s a blog post that explains a bit more: Model Batch Inference in Ray: Actors, ActorPool, and Datasets | Anyscale (though this is perhaps more focused on model inference)
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Keep PyTorch DataLoader when using Ray Data | 0 | 332 | November 7, 2023 | |
Deprecation of ray.utils.ActorPool | 8 | 985 | November 15, 2022 | |
[Core] Question on optimizing machine learning project speed using ray | 5 | 462 | February 1, 2022 | |
Abyssmal perf - How to not do it wrong with ray data reading text
|
1 | 163 | January 27, 2024 | |
Ray Train with Ray datasets (includes images) too slow | 5 | 1245 | February 14, 2023 |