KeyError: ‘Field “xxxxxyyyyy.png” does not exist in table schema’

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

I have a question regarding pyarrow representation. I am trying to form a dictionary with key value pairs comprising of filenames as keys and values and numpy ndarray. However, when I try to do this I get hit with an error as follows:
File “pyarrow/table.pxi”, line 4168, in pyarrow.lib.Table.column
File “pyarrow/table.pxi”, line 4109, in pyarrow.lib.Table._ensure_integer_index
KeyError: ‘Field “xxxxxyyyyy.png” does not exist in table schema’
Why and what is causing this issue here? Attaching code snippet for reference


Hi @Akshay_Kenchappa_Man - it’s hard to tell which part is failing from the shared snippet. Could you give a complete code snippet to reproduce the same issue? Thanks.

The error seems to be in the dictionary assignment

@chengsu any idea why this is happening?