DQN MultiAgentReplayBuffer not working

RLlib
7

The error occurs because the value of "type" in your replay_buffer_config is not a string, but a class/type object. The old API stack expects "type" to be a string (e.g., "MultiAgentPrioritizedReplayBuffer"), not a class reference. When the code checks "EpisodeReplayBuffer" in config["replay_buffer_config"]["type"], it fails if "type" is not a string, resulting in TypeError: argument of type 'ABCMeta' is not iterable.

To fix this, ensure that "type" is a string, not a class. For example:

replay_buffer_config={
    "type": "MultiAgentPrioritizedReplayBuffer",  # <-- must be a string
    "capacity": 300_000,
}

This matches the expected usage in the old API stack and avoids the TypeError.

Would you like a step-by-step breakdown or more troubleshooting tips?

Sources:

Hint: Mention @RunLLM in the post for followups.