Hi, I have just got started with ray so am a total noob. I have setup a cluster of two nodes manually on VMware workstation. Using ray 2.0.0.dev0 on python 3.6.4 on both nodes. I have setup the cluster
Now I run the following code on my child node:
ray.init(address='auto', _redis_password='5241590000000000') df = pd.read_csv('') @ray.remote def f(df): # Make a copy on remote nodes df.export_csv("~/test_ray.csv") # Do some calculations and return df return modified_df # Serialize the dataframe with pyarrow and store it in shared memory. df_id = ray.put(df) result_ids = [f.remote(df)] print(result_ids) # Get the results. results = ray.get(result_ids) print(results)
What I am expecting is to create file on both the nodes. This code only executes on the child node. By using ray.client(“192.168.169.129:10001”).connect(), the code executes only on the parent node and not the child node. Any help would be much appreciated.