Error: Can't get attribute 'FromItems'

I am using Ray 3.0.0.dev0 from this wheel https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp38-cp38-manylinux2014_x86_64.whl

My dataset schema:

ray_train_ds.schema()

Column          Type
------          ----
input_ids       numpy.ndarray(shape=(512,), dtype=int64)
token_type_ids  numpy.ndarray(shape=(512,), dtype=int64)
attention_mask  numpy.ndarray(shape=(512,), dtype=int64)
xpath_tags_seq  numpy.ndarray(shape=(512, 50), dtype=int64)
xpath_subs_seq  numpy.ndarray(shape=(512, 50), dtype=int64)
label           int64

When I call HuggingFaceTrainer on the dataset it errors as follows:

ray.exceptions.RayActorError: The actor died because of an error raised in its creation task, ray::_Inner.__init__() (pid=12457, ip=10.12.6.221, actor_id=b954ffe9daca4d62ada41c5f01000000, repr=HuggingFaceTrainer)
  File "/usr/local/lib/python3.8/site-packages/ray/tune/trainable/trainable.py", line 172, in __init__
    self.setup(copy.deepcopy(self.config))
  File "/usr/local/lib/python3.8/site-packages/ray/tune/trainable/util.py", line 305, in setup
    setup_kwargs[k] = parameter_registry.get(prefix + k)
  File "/usr/local/lib/python3.8/site-packages/ray/tune/registry.py", line 301, in get
    return ray.get(self.references[k])
ray.exceptions.RaySystemError: System error: Can't get attribute 'FromItems' on <module 'ray.data._internal.logical.operators.from_items_operator' from '/usr/local/lib/python3.8/site-packages/ray/data/_internal/logical/operators/from_items_operator.py'>
traceback: Traceback (most recent call last):
AttributeError: Can't get attribute 'FromItems' on <module 'ray.data._internal.logical.operators.from_items_operator' from '/usr/local/lib/python3.8/site-packages/ray/data/_internal/logical/operators/from_items_operator.py'>

rebuilding nightly version worked, it might have been a temporary inconsistency

1 Like