Hi… I installed ray / rllib v2.0.0.dev0 via:
!pip install "ray[rllib]@https://s3-us-west-2.amazonaws.com/ray-wheels/master/ba6cebe30fab6925e5b2d9e859ad064d53015246/ray-2.0.0.dev0-cp37-cp37m-manylinux2014_x86_64.whl"
And did the following:
ray.init(ignore_reinit_error=True)
default_config = td3.TD3_DEFAULT_CONFIG.copy()
custom_config = {
"lr": 0.0001,
"framework": "torch",
"callbacks": CustomCallbacks,
"log_level": "WARN",
"evaluation_interval": 20,
"evaluation_num_episodes": 10,
"num_gpus": 1,
"num_workers": 1,
"num_envs_per_worker": 3,
"seed": SEED,
"evaluation_config": {
"explore": False
},
"evaluation_num_workers": 1,
"env_config": {
"phase": 0
}
}
config = {**default_config, **custom_config}
register_env("example-v0", lambda config: env_creator(config))
...
analysis = tune.run(my_train_fn,
name=experiment_name,
config=config
)
However I get the status message. No ressources are requested:
Resources requested: 0/2 CPUs, 0/1 GPUs, 0.0/7.32 GiB heap, 0.0/3.66 GiB objects (0.0/1.0 accelerator_type:P100)
As you can see her:
== Status ==
Memory usage on this node: 1.8/12.7 GiB
Using FIFO scheduling algorithm.
Resources requested: 0/2 CPUs, 0/1 GPUs, 0.0/7.32 GiB heap, 0.0/3.66 GiB objects (0.0/1.0 accelerator_type:P100)
Result logdir: /root/ray_results/experiment_height_2_date_02-07-2021_time_10-16-50_seed_4_new_rllib
Number of trials: 1/1 (1 PENDING)
Trial name status loc
my_train_fn_None_9d632_00000 PENDING
(pid=1751) WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow/python/compat/v2_compat.py:96: disable_resource_variables (from tensorflow.python.ops.variable_scope) is deprecated and will be removed in a future version.
(pid=1751) Instructions for updating:
(pid=1751) non-resource variables are not supported in the long term
(pid=1751) WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_probability/python/internal/variadic_reduce.py:115: calling function (from tensorflow.python.eager.def_function) with experimental_compile is deprecated and will be removed in a future version.
(pid=1751) Instructions for updating:
(pid=1751) experimental_compile is deprecated, use jit_compile instead
(pid=1751) 2021-07-02 10:16:54,263 WARNING util.py:53 -- Install gputil for GPU system monitoring.
(pid=1751) 2021-07-02 10:16:54,292 INFO trainer.py:687 -- Current log_level is WARN. For more information, set 'log_level': 'INFO' / 'DEBUG' or use the -v and -vv flags.
After that message, it just freezes and does not progress.
Any idea what is wrong? ( I’m mostly using Colab, but should be the same on my machine)