# \[Core\] \[Client\] Cloud pickle library missing in ray client dependency

**URL:** <https://discuss.ray.io/t/core-client-cloud-pickle-library-missing-in-ray-client-dependency/1819>\
**Category:** Ray Client\
**Created:** [April 21, 2021, 3:04pm UTC](https://discuss.ray.io/t/core-client-cloud-pickle-library-missing-in-ray-client-dependency/1819 "2021-04-21T15:04:14Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![asm582](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/asm582/32/669_2.png) [@asm582](https://discuss.ray.io/u/asm582)\
**Post date:** [April 21, 2021, 3:04pm UTC](https://discuss.ray.io/t/core-client-cloud-pickle-library-missing-in-ray-client-dependency/1819/1 "2021-04-21T15:04:14Z")

</div>

Hello, I tried using ray client library to connect to minikube cluster by following steps in documentation :

[https://docs.ray.io/en/master/cluster/kubernetes.html](https://docs.ray.io/en/master/cluster/kubernetes.html)

I ran:

python ray/doc/kubernetes/example\_scripts/run\_local\_example.py

I get the below error:

$ python ray/doc/kubernetes/example\_scripts  
Traceback (most recent call last):  
File “ray/doc/kubernetes/example\_scripts/run\_local\_example.py”, line 57, in   
ray.util.connect(f"127.0.0.1:{LOCAL\_PORT}")  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client\_connect.py”, line 26, in connect  
conn\_str, secure=secure, metadata=metadata, connection\_retries=3)  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/ **init**.py”, line 40, in connect  
from ray.util.client.worker import Worker  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/worker.py”, line 22, in   
from ray.util.client.client\_pickler import convert\_to\_arg  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/client\_pickler.py”, line 24, in   
import cloudpickle  
ModuleNotFoundError: No module named ‘cloudpickle’  
Error in atexit.\_run\_exitfuncs:  
Traceback (most recent call last):  
File “”, line 983, in \_find\_and\_load  
File “”, line 953, in \_find\_and\_load\_unlocked  
File “”, line 219, in \_call\_with\_frames\_removed  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/server/ **init**.py”, line 1, in   
from ray.util.client.server.server import serve # noqa  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/server/server.py”, line 20, in   
from ray.util.client.server.server\_pickler import convert\_from\_arg  
File “/home/asmalvan/anaconda3/envs/ray/lib/python3.7/site-packages/ray/util/client/server/server\_pickler.py”, line 14, in   
import cloudpickle  
ModuleNotFoundError: No module named ‘cloudpickle’

For now, I did a conda install of cloudpickle not sure which version of cloudpickle is recommended

---

<div class="post-metadata">

**Author:** ![rliaw](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/rliaw/32/24_2.png) [@rliaw](https://discuss.ray.io/u/rliaw)\
**Post date:** [April 23, 2021, 8:19am UTC](https://discuss.ray.io/t/core-client-cloud-pickle-library-missing-in-ray-client-dependency/1819/2 "2021-04-23T08:19:56Z")

</div>

Can you verify this is still the case on the newest ray install (1.3)?

---

<div class="post-metadata">

**Author:** ![asm582](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/asm582/32/669_2.png) [@asm582](https://discuss.ray.io/u/asm582)\
**Post date:** [April 23, 2021, 8:00pm UTC](https://discuss.ray.io/t/core-client-cloud-pickle-library-missing-in-ray-client-dependency/1819/3 "2021-04-23T20:00:34Z")

</div>

I confirm that this error does not exists for ray 1.3.0 but now I get a different error @rliaw , please find below the trace:

$ python ray/doc/kubernetes/example\_scripts/run\_local\_example.py  
/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/autoscaler/\_private/cli\_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.  
“update your install command.”, FutureWarning)  
Got Error from data channel – shutting down: \<\_MultiThreadedRendezvous of RPC that terminated with:  
status = StatusCode.UNKNOWN  
details = “Exception iterating responses: "  
debug\_error\_string = “{“created”:”@1619207923.847024876”,“description”:“Error received from peer ipv4:127.0.0.1:10001”,“file”:“src/core/lib/surface/call.cc”,“file\_line”:1067,“grpc\_message”:"Exception iterating responses: “,“grpc\_status”:2}”

> 

Exception in thread Thread-5:  
Traceback (most recent call last):  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/threading.py”, line 926, in \_bootstrap\_inner  
self.run()  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/threading.py”, line 870, in run  
self.\_target(\*self.\_args, \*\*self.\_kwargs)  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client/dataclient.py”, line 90, in \_data\_main  
raise e  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client/dataclient.py”, line 64, in \_data\_main  
for response in resp\_stream:  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/grpc/\_channel.py”, line 426, in **next**  
return self.\_next()  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/grpc/\_channel.py”, line 826, in \_next  
raise self  
grpc.\_channel.\_MultiThreadedRendezvous: \<\_MultiThreadedRendezvous of RPC that terminated with:  
status = StatusCode.UNKNOWN  
details = “Exception iterating responses: "  
debug\_error\_string = “{“created”:”@1619207923.847024876”,“description”:“Error received from peer ipv4:127.0.0.1:10001”,“file”:“src/core/lib/surface/call.cc”,“file\_line”:1067,“grpc\_message”:"Exception iterating responses: “,“grpc\_status”:2}”

> 

Traceback (most recent call last):  
File “ray/doc/kubernetes/example\_scripts/run\_local\_example.py”, line 57, in   
ray.util.connect(f"127.0.0.1:{LOCAL\_PORT}")  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client\_connect.py”, line 32, in connect  
ignore\_version=ignore\_version)  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client/ **init**.py”, line 70, in connect  
conn\_info = self.client\_worker.connection\_info()  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client/worker.py”, line 156, in connection\_info  
data = self.data\_client.ConnectionInfo()  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client/dataclient.py”, line 124, in ConnectionInfo  
resp = self.\_blocking\_send(datareq)  
File “/home/asmalvan/anaconda3/envs/ray130/lib/python3.7/site-packages/ray/util/client/dataclient.py”, line 109, in \_blocking\_send  
"Cannot send request due to data channel "  
ConnectionError: Cannot send request due to data channel shutting down. Request: req\_id: 1  
connection\_info {