# Losting a lot of files from Blob Storage based on glob

**URL:** <https://discuss.ray.io/t/losting-a-lot-of-files-from-blob-storage-based-on-glob/12344>\
**Category:** Ray Data\
**Created:** [October 6, 2023, 8:25am UTC](https://discuss.ray.io/t/losting-a-lot-of-files-from-blob-storage-based-on-glob/12344 "2023-10-06T08:25:46Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![WaterKnight](https://avatars.discourse-cdn.com/v4/letter/w/9d8465/32.png) [@WaterKnight](https://discuss.ray.io/u/WaterKnight)\
**Post date:** [October 6, 2023, 8:25am UTC](https://discuss.ray.io/t/losting-a-lot-of-files-from-blob-storage-based-on-glob/12344/1 "2023-10-06T08:25:46Z")

</div>

I have seen that ray datasets allows you to read binary files. However, you don’t have any way of filter them based on glob.

[https://docs.ray.io/en/latest/data/api/doc/ray.data.read\_binary\_files.html#ray.data.read\_binary\_files](https://docs.ray.io/en/latest/data/api/doc/ray.data.read_binary_files.html#ray.data.read_binary_files)

I was looking at this because I need to get a list of millions of images based on a glob pattern from an Azure Blob Container that has Hierarchical namespace disabled. Loading them with spark is not fast, even using autoloader. Find takes a lot of time too.

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![bveeramani](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/bveeramani/32/2941_2.png) [@bveeramani](https://discuss.ray.io/u/bveeramani)\
**Post date:** [October 18, 2023, 10:56pm UTC](https://discuss.ray.io/t/losting-a-lot-of-files-from-blob-storage-based-on-glob/12344/2 "2023-10-18T22:56:39Z")

</div>

Hey @WaterKnight,

What does your glob look like?