I am trying to read a huge parquet dataset which is partitioned. Is it possible to use ray.data.read_parquet to read this dataset only to read a few selected partitions?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Ray Data read Parquet loads all the data in one go | 4 | 406 | October 21, 2023 | |
| [Ray Data] error with read_parquet from hdfs | 9 | 759 | April 13, 2023 | |
|
Hive Partitioned Datasets
|
0 | 403 | July 3, 2023 | |
| Cannot read parquet files | 2 | 617 | April 19, 2023 | |
| Problem with anything on Ray | 2 | 592 | April 20, 2022 |