# Ray Dataset Cannot Read Parquet File

**URL:** https://discuss.ray.io/t/ray-dataset-cannot-read-parquet-file/6768
**Category:** Ray Data
**Created:** [July 8, 2022, 9:43am UTC](https://discuss.ray.io/t/ray-dataset-cannot-read-parquet-file/6768 "2022-07-08T09:43:00Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![dan](https://avatars.discourse-cdn.com/v4/letter/d/eada6e/32.png) [@dan](https://discuss.ray.io/u/dan)
#### Post date: [July 8, 2022, 9:43am UTC](https://discuss.ray.io/t/ray-dataset-cannot-read-parquet-file/6768/1 "2022-07-08T09:43:01Z")

</div>

Hi everyone,

I am trying to read an unpartitioned parquet file using “ray.data.read\_parquet”, but I am getting the following error:  
RayTaskError(PickleError): ray::remote\_read() (pid=221, ip=XXX.XXX.XXX.XXX)

File “/opt/conda/lib/python3.8/site-packages/ray/data/read\_api.py”, line 166, in remote\_read

File “/home/ray/anaconda3/lib/python3.8/site-packages/ray/data/datasource/datasource.py”, line 120, in **call**

```
result = self._read_fn()

```

File “/opt/conda/lib/python3.8/site-packages/ray/data/datasource/parquet\_datasource.py”, line 145, in

File “/opt/conda/lib/python3.8/site-packages/ray/data/datasource/parquet\_datasource.py”, line 78, in read\_pieces

File “/opt/conda/lib/python3.8/site-packages/ray/data/datasource/parquet\_datasource.py”, line 79, in

File “stringsource”, line 6, in pyarrow.\_dataset.\_\_pyx\_unpickle\_ParquetReadOptions

\_pickle.PickleError: Incompatible checksums (239187151 vs 0xaef2dd6 = (dictionary\_columns))

I have recreated the issue with multiple different files, and I think it has something to do with the versions of the packages. I am using:  
ray==1.9.2  
pyarrow==5.0.0  
cloudpickle==1.6.0

Any insight on this issue would be greatly appreciated! 😃

---

<div class="post-metadata">

### Author: ![jianxiao](https://avatars.discourse-cdn.com/v4/letter/j/e480ec/32.png) [@jianxiao](https://discuss.ray.io/u/jianxiao)
#### Post date: [August 1, 2022, 5:53pm UTC](https://discuss.ray.io/t/ray-dataset-cannot-read-parquet-file/6768/2 "2022-08-01T17:53:27Z")

</div>

hi @dan, I agree it would be related to version. Have you tried with newer version of Ray? Note it’s currently at 1.13.0 (actually 2.0.0rc0 was just released). If you plan to stick with 1.9.2, could you share some script/file to reproduce it?
