Could you publish aarch64 linux builds?
I would like to use ray on AWS Graviton.
I tried building it from source but got weird gcc errors
(conda_env) ubuntu@ubuntu:~/ray/python$ pip install -e '.[tune]'
Obtaining file:///home/ubuntu/ray/python
Requirement already satisfied: attrs in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (21.2.0)
Requirement already satisfied: click>=7.0 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (8.0.1)
Requirement already satisfied: filelock in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (3.0.12)
Requirement already satisfied: grpcio>=1.28.1 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (1.38.1)
Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (1.0.2)
Requirement already satisfied: protobuf>=3.15.3 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (3.16.0)
Requirement already satisfied: pyyaml in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (5.4.1)
Requirement already satisfied: redis>=3.5.0 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (3.5.3)
Requirement already satisfied: numpy>=1.19.3 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (1.21.2)
Requirement already satisfied: pandas in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (1.3.2)
Requirement already satisfied: tabulate in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (0.8.9)
Requirement already satisfied: tensorboardX>=1.9 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (2.4)
Requirement already satisfied: requests in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from ray==2.0.0.dev0) (2.26.0)
Requirement already satisfied: six>=1.5.2 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from grpcio>=1.28.1->ray==2.0.0.dev0) (1.16.0)
Requirement already satisfied: python-dateutil>=2.7.3 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from pandas->ray==2.0.0.dev0) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from pandas->ray==2.0.0.dev0) (2021.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from requests->ray==2.0.0.dev0) (1.26.6)
Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from requests->ray==2.0.0.dev0) (2.0.0)
Requirement already satisfied: idna<4,>=2.5 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from requests->ray==2.0.0.dev0) (3.1)
Requirement already satisfied: certifi>=2017.4.17 in /home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages (from requests->ray==2.0.0.dev0) (2021.5.30)
Installing collected packages: ray
Running setup.py develop for ray
ERROR: Command errored out with exit status 1:
command: /home/ubuntu/miniconda3/envs/ml/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/ubuntu/ray/python/setup.py'"'"'; __file__='"'"'/home/ubuntu/ray/python/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
cwd: /home/ubuntu/ray/python/
Complete output (142 lines):
running develop
running egg_info
writing ray.egg-info/PKG-INFO
writing dependency_links to ray.egg-info/dependency_links.txt
writing entry points to ray.egg-info/entry_points.txt
writing requirements to ray.egg-info/requires.txt
writing top-level names to ray.egg-info/top_level.txt
reading manifest file 'ray.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'ray.egg-info/SOURCES.txt'
running build_ext
ERROR: Command errored out with exit status 1:
command: /home/ubuntu/miniconda3/envs/ml/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/setup.py'"'"'; __file__='"'"'/tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ek79gtyf
cwd: /tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/
Complete output (45 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-aarch64-3.9
creating build/lib.linux-aarch64-3.9/psutil
copying psutil/_psaix.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_pslinux.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_compat.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_psbsd.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_pssunos.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_pswindows.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_common.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/__init__.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_psosx.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_psposix.py -> build/lib.linux-aarch64-3.9/psutil
creating build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/__main__.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_unicode.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_system.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/runner.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_memleaks.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_misc.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_aix.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_sunos.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_linux.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_connections.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_testutils.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_windows.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_posix.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_bsd.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/__init__.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_process.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_osx.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_contracts.py -> build/lib.linux-aarch64-3.9/psutil/tests
running build_ext
building 'psutil._psutil_linux' extension
creating build/temp.linux-aarch64-3.9
creating build/temp.linux-aarch64-3.9/psutil
gcc -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -n1 .2-a+fp16+rcpc+dotprod+crypto -isystem /home/ubuntu/miniconda3/envs/ml/include -I/home/ubuntu/miniconda3/envs/ml/include -fPIC -O2 -n1 .2-a+fp16+rcpc+dotprod+crypto -isystem /home/ubuntu/miniconda3/envs/ml/include -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=580 -DPSUTIL_LINUX=1 -I/home/ubuntu/miniconda3/envs/ml/include/python3.9 -c psutil/_psutil_common.c -o build/temp.linux-aarch64-3.9/psutil/_psutil_common.o
gcc: error: .2-a+fp16+rcpc+dotprod+crypto: No such file or directory
gcc: error: .2-a+fp16+rcpc+dotprod+crypto: No such file or directory
gcc: error: unrecognized command line option ‘-n1’; did you mean ‘-n’?
gcc: error: unrecognized command line option ‘-n1’; did you mean ‘-n’?
error: command '/usr/bin/gcc' failed with exit code 1
----------------------------------------
ERROR: Failed building wheel for psutil
ERROR: Command errored out with exit status 1:
command: /home/ubuntu/miniconda3/envs/ml/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/setup.py'"'"'; __file__='"'"'/tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-4cgw9_ut/install-record.txt --single-version-externally-managed --home /tmp/pip-target-g3kpdwf9 --compile --install-headers /tmp/pip-target-g3kpdwf9/include/python/psutil
cwd: /tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/
Complete output (45 lines):
running install
running build
running build_py
creating build
creating build/lib.linux-aarch64-3.9
creating build/lib.linux-aarch64-3.9/psutil
copying psutil/_psaix.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_pslinux.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_compat.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_psbsd.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_pssunos.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_pswindows.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_common.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/__init__.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_psosx.py -> build/lib.linux-aarch64-3.9/psutil
copying psutil/_psposix.py -> build/lib.linux-aarch64-3.9/psutil
creating build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/__main__.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_unicode.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_system.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/runner.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_memleaks.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_misc.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_aix.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_sunos.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_linux.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_connections.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_testutils.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_windows.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_posix.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_bsd.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/__init__.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_process.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_osx.py -> build/lib.linux-aarch64-3.9/psutil/tests
copying psutil/tests/test_contracts.py -> build/lib.linux-aarch64-3.9/psutil/tests
running build_ext
building 'psutil._psutil_linux' extension
creating build/temp.linux-aarch64-3.9
creating build/temp.linux-aarch64-3.9/psutil
gcc -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -n1 .2-a+fp16+rcpc+dotprod+crypto -isystem /home/ubuntu/miniconda3/envs/ml/include -I/home/ubuntu/miniconda3/envs/ml/include -fPIC -O2 -n1 .2-a+fp16+rcpc+dotprod+crypto -isystem /home/ubuntu/miniconda3/envs/ml/include -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=580 -DPSUTIL_LINUX=1 -I/home/ubuntu/miniconda3/envs/ml/include/python3.9 -c psutil/_psutil_common.c -o build/temp.linux-aarch64-3.9/psutil/_psutil_common.o
gcc: error: .2-a+fp16+rcpc+dotprod+crypto: No such file or directory
gcc: error: .2-a+fp16+rcpc+dotprod+crypto: No such file or directory
gcc: error: unrecognized command line option ‘-n1’; did you mean ‘-n’?
gcc: error: unrecognized command line option ‘-n1’; did you mean ‘-n’?
error: command '/usr/bin/gcc' failed with exit code 1
----------------------------------------
ERROR: Command errored out with exit status 1: /home/ubuntu/miniconda3/envs/ml/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/setup.py'"'"'; __file__='"'"'/tmp/pip-install-pqs18u87/psutil_9f973e58cf6e476288b4fbddb1d6f92b/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-4cgw9_ut/install-record.txt --single-version-externally-managed --home /tmp/pip-target-g3kpdwf9 --compile --install-headers /tmp/pip-target-g3kpdwf9/include/python/psutil Check the logs for full command output.
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/home/ubuntu/ray/python/setup.py", line 633, in <module>
setuptools.setup(
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/distutils/core.py", line 148, in setup
dist.run_commands()
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages/setuptools/command/develop.py", line 34, in run
self.install_for_development()
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/site-packages/setuptools/command/develop.py", line 136, in install_for_development
self.run_command('build_ext')
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ubuntu/ray/python/setup.py", line 621, in run
return pip_run(self)
File "/home/ubuntu/ray/python/setup.py", line 531, in pip_run
build(True, BUILD_JAVA, True)
File "/home/ubuntu/ray/python/setup.py", line 447, in build
subprocess.check_call(
File "/home/ubuntu/miniconda3/envs/ml/lib/python3.9/subprocess.py", line 373, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/ubuntu/miniconda3/envs/ml/bin/python', '-m', 'pip', 'install', '-q', '--target=/home/ubuntu/ray/python/ray/thirdparty_files', 'psutil', 'setproctitle==1.2.2', 'colorama']' returned non-zero exit status 1.
----------------------------------------
ERROR: Command errored out with exit status 1: /home/ubuntu/miniconda3/envs/ml/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/ubuntu/ray/python/setup.py'"'"'; __file__='"'"'/home/ubuntu/ray/python/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.