So the way to do this is using stateful transforms as mentioned in the doc:
https://docs.ray.io/en/latest/data/transforming-data.html#stateful-transforms
We need to create a class with init and call functions
So the way to do this is using stateful transforms as mentioned in the doc:
https://docs.ray.io/en/latest/data/transforming-data.html#stateful-transforms
We need to create a class with init and call functions