I am trying to read a huge parquet dataset which is partitioned. Is it possible to use ray.data.read_parquet to read this dataset only to read a few selected partitions?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Ray Data read Parquet loads all the data in one go
|
4 | 537 | October 21, 2023 | |
[Ray Data] error with read_parquet from hdfs | 9 | 817 | April 13, 2023 | |
Hive Partitioned Datasets
|
0 | 439 | July 3, 2023 | |
Cannot read parquet files | 2 | 637 | April 19, 2023 | |
Problem with anything on Ray | 2 | 619 | April 20, 2022 |