# Assert agent\_key not in self.agent\_collectors **URL:** \ **Category:** RLlib\ **Created:** [March 31, 2021, 12:35pm UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489 "2021-03-31T12:35:37Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![GattiPinheiro](https://avatars.discourse-cdn.com/v4/letter/g/e99b99/32.png) [@GattiPinheiro](https://discuss.ray.io/u/GattiPinheiro)\ **Post date:** [March 31, 2021, 12:35pm UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/1 "2021-03-31T12:35:38Z")
I’m using ray/rllib 1.2.0 and I’m hitting this error after 100 training iterations. ``` Failure # 1 (occurred at 2021-03-31_11-10-22) Traceback (most recent call last): File "/opt/miniconda/lib/python3.7/site-packages/ray/tune/trial_runner.py", line 586, in _process_trial results = self.trial_executor.fetch_result(trial) File "/opt/miniconda/lib/python3.7/site-packages/ray/tune/ray_trial_executor.py", line 609, in fetch_result result = ray.get(trial_future[0], timeout=DEFAULT_GET_TIMEOUT) File "/opt/miniconda/lib/python3.7/site-packages/ray/_private/client_mode_hook.py", line 47, in wrapper return func(*args, **kwargs) File "/opt/miniconda/lib/python3.7/site-packages/ray/worker.py", line 1456, in get raise value.as_instanceof_cause() ray.exceptions.RayTaskError(AssertionError): e[36mray::PPO.train_buffered()e[39m (pid=264, ip=10.1.0.8) File "python/ray/_raylet.pyx", line 480, in ray._raylet.execute_task File "python/ray/_raylet.pyx", line 432, in ray._raylet.execute_task.function_executor File "/opt/miniconda/lib/python3.7/site-packages/ray/tune/trainable.py", line 167, in train_buffered result = self.train() File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 526, in train raise e File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 515, in train result = Trainable.train(self) File "/opt/miniconda/lib/python3.7/site-packages/ray/tune/trainable.py", line 226, in train result = self.step() File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/agents/trainer_template.py", line 157, in step evaluation_metrics = self._evaluate() File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/agents/trainer.py", line 778, in _evaluate for w in self.evaluation_workers.remote_workers() File "/opt/miniconda/lib/python3.7/site-packages/ray/_private/client_mode_hook.py", line 47, in wrapper return func(*args, **kwargs) ray.exceptions.RayTaskError(AssertionError): e[36mray::RolloutWorker.sample()e[39m (pid=375, ip=10.1.0.8) File "python/ray/_raylet.pyx", line 480, in ray._raylet.execute_task File "python/ray/_raylet.pyx", line 432, in ray._raylet.execute_task.function_executor File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/evaluation/rollout_worker.py", line 662, in sample batches = [self.input_reader.next()] File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/evaluation/sampler.py", line 95, in next batches = [self.get_data()] File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/evaluation/sampler.py", line 224, in get_data item = next(self.rollout_provider) File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/evaluation/sampler.py", line 620, in _env_runner sample_collector=sample_collector, File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/evaluation/sampler.py", line 1198, in _process_observations_w_trajectory_view_api new_episode.length - 1, filtered_obs) File "/opt/miniconda/lib/python3.7/site-packages/ray/rllib/evaluation/collectors/simple_list_collector.py", line 487, in add_init_obs assert agent_key not in self.agent_collectors AssertionError ``` There is nothing very particular going on in my code, except few customizations (model, env, action distribution). I’ve checked memory usage and it is mostly below 20%. Does anyone know what it can be? Shall I open a github ticket? ---
**Author:** ![sven1977](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/sven1977/32/53_2.png) [@sven1977](https://discuss.ray.io/u/sven1977)\ **Post date:** [March 31, 2021, 12:48pm UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/2 "2021-03-31T12:48:20Z")
Hey @GattiPinheiro . Could you try this on the latest master? This was fixed and merged yesterday. PR: [[RLlib] Issue: Agent\_id -\> Policy\_id mapping should not need to be fixed between episodes. by sven1977 · Pull Request #15020 · ray-project/ray · GitHub](https://github.com/ray-project/ray/pull/15020) ---
**Author:** ![GattiPinheiro](https://avatars.discourse-cdn.com/v4/letter/g/e99b99/32.png) [@GattiPinheiro](https://discuss.ray.io/u/GattiPinheiro)\ **Post date:** [April 1, 2021, 7:00am UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/3 "2021-04-01T07:00:13Z")
Hello, thanks for the feedback! I’m trying to install the nightly run following instructions from [Installation](https://docs.ray.io/en/master/installation.html#daily-releases-nightlies), i.e. `$ python -m pip install https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-2.0.0.dev0-cp37-cp37m-manylinux2014_x86_64.whl` but I can’t make it work. The job is in the PENDING state forever without any errors. The best feedback I have is the following warning `/opt/miniconda/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install ‘ray[full]’`. Please update your install command. "update your install command.", FutureWarning)` What am I missing? ---
**Author:** ![sven1977](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/sven1977/32/53_2.png) [@sven1977](https://discuss.ray.io/u/sven1977)\ **Post date:** [April 9, 2021, 7:04pm UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/4 "2021-04-09T19:04:34Z")
I think this is a warning you can ignore. If the dashboard is not installed, you can always (re)start ray on your server via: `ray start --head --include-dashboard false` ---
**Author:** ![GattiPinheiro](https://avatars.discourse-cdn.com/v4/letter/g/e99b99/32.png) [@GattiPinheiro](https://discuss.ray.io/u/GattiPinheiro)\ **Post date:** [April 14, 2021, 11:13am UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/5 "2021-04-14T11:13:39Z")
Hello @sven1977, I finally had some time to do the testing. As suggested, I installed ray from the today’s nightly build, but the error is still being raised after a couple of training iterations. I will try to downgrade to version 1.1.0 to check if it helps. ---
**Author:** ![GattiPinheiro](https://avatars.discourse-cdn.com/v4/letter/g/e99b99/32.png) [@GattiPinheiro](https://discuss.ray.io/u/GattiPinheiro)\ **Post date:** [April 14, 2021, 1:29pm UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/6 "2021-04-14T13:29:03Z")
I created the issue at [[rllib] Assert agent\_key not in self.agent\_collectors · Issue #15297 · ray-project/ray · GitHub](https://github.com/ray-project/ray/issues/15297). Good news is that I can reproduce the issue using only standard optimization algorithms and environment implementation. ---
**Author:** ![stefanbschneider](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/stefanbschneider/32/232_2.png) [@stefanbschneider](https://discuss.ray.io/u/stefanbschneider)\ **Post date:** [June 4, 2021, 9:35am UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/7 "2021-06-04T09:35:00Z")
I also run into the same error message. I added some comments/observations/questions in the issue. ---
**Author:** ![ekblad](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/ekblad/32/1530_2.png) [@ekblad](https://discuss.ray.io/u/ekblad)\ **Post date:** [October 7, 2021, 10:22pm UTC](https://discuss.ray.io/t/assert-agent-key-not-in-self-agent-collectors/1489/8 "2021-10-07T22:22:26Z")
I am also running into this. I added a comment in the issue.