Hi, I have this PyTorch scripts that runs fine on a single GPU. I’m trying to parallelize it with Ray Train I followed this tutorial here Ray Train: Distributed Deep Learning — Ray v1.9.1 and added a train_loader = train.torch.prepare_data_loader(train_loader) and a train.torch.prepare_mo…

Sorry, ignore what I said- I misunderstood your code. You are iterating through the DataLoader, but there is a bug in our _WrappedDataLoader where we return a generator instead of a tuple as intended: ray/torch.py at master · ray-project/ray · GitHub . So indexing into the batch will fail. I will ma…

Ray Train creates TypeError: 'generator' object is not subscriptable

Lacruche January 7, 2022, 3:36pm 3

Thanks! I restarted my machine, and for some reason the problem disappeared…
I now have another trouble Ray Train silent for 7 min

Topic		Replies	Views
Ray train examples are broken Ray Train	1	536	May 10, 2022
Ray Train v1.9.1: returns an AttributeError: module 'ray.train' has no attribute 'torch' Ray Train	1	1408	December 29, 2021
Ray Train RuntimeError: unable to write to file </torch_1602_2842463136> Ray Train	3	1045	January 7, 2022
Ray Train code works locally, not in SageMaker PyTorch job Ray Train	15	957	January 12, 2022
RaySGD PyTorch fail: "TypeError: can't pickle SSLContext objects" Ray Train	5	3153	January 7, 2022

Ray Train creates TypeError: 'generator' object is not subscriptable

Related Topics