- High: It blocks me to complete my task.
Hello everyone,
I am new to Ray Tune and I am having trouble running the QuickStart PyTorch example provided in the documentation (Getting Started with Ray Tune — Ray 2.3.0). When I call results = tuner.fit(), I get the following error:
Traceback (most recent call last):
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_common.py", line 443, in wrapper
ret = self._cache[fun]
AttributeError: 'Process' object has no attribute '_cache'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/tune/tuner.py", line 292, in fit
return self._local_tuner.fit()
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/tune/impl/tuner_internal.py", line 455, in fit
analysis = self._fit_internal(trainable, param_space)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/tune/impl/tuner_internal.py", line 572, in _fit_internal
analysis = run(
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/tune/tune.py", line 439, in run
_ray_auto_init()
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/tune/tune.py", line 927, in _ray_auto_init
ray.init()
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/_private/client_mode_hook.py", line 105, in wrapper
return func(*args, **kwargs)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/_private/worker.py", line 1361, in init
bootstrap_address = services.canonicalize_bootstrap_address(address, _temp_dir)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/_private/services.py", line 499, in canonicalize_bootstrap_address
addr = get_ray_address_from_environment(addr, temp_dir)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/_private/services.py", line 376, in get_ray_address_from_environment
gcs_addrs = find_gcs_addresses()
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/_private/services.py", line 347, in find_gcs_addresses
return _find_address_from_flag("--gcs-address")
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/_private/services.py", line 314, in _find_address_from_flag
proc = psutil.Process(pid)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/__init__.py", line 332, in __init__
self._init(pid)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/__init__.py", line 361, in _init
self.create_time()
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/__init__.py", line 714, in create_time
self._create_time = self._proc.create_time()
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_pslinux.py", line 1645, in wrapper
return fun(self, *args, **kwargs)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_pslinux.py", line 1855, in create_time
ctime = float(self._parse_stat_file()['create_time'])
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_pslinux.py", line 1645, in wrapper
return fun(self, *args, **kwargs)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_common.py", line 446, in wrapper
return fun(self)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_pslinux.py", line 1687, in _parse_stat_file
data = bcat("%s/%s/stat" % (self._procfs_path, self.pid))
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_common.py", line 776, in bcat
return cat(fname, fallback=fallback, _open=open_binary)
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_common.py", line 764, in cat
with _open(fname) as f:
File "/home/qzz/anaconda3/envs/tscl/lib/python3.10/site-packages/ray/thirdparty_files/psutil/_common.py", line 728, in open_binary
return open(fname, "rb", buffering=FILE_READ_BUFFER_SIZE)
FileNotFoundError: [Errno 2] No such file or directory: '/proc/32264/stat'
Process finished with exit code 1
To provide more context, here is the version information of some basic libraries in the conda environment that I am using:
python=3.10.10
pytorch=1.13.1 py3.10_cuda11.6_cudnn8.3.2_0
ray = 2.3.1
I am not sure what is causing this problem. If anyone has any insights or suggestions, I would greatly appreciate it. Please let me know if you need any additional information. Thank you in advance for your help.