Can agents be added/removed during training?

During multi-agent training for a custom environment inheriting from MultiAgentEnv, can the _agent_ids be modified during training time? In particular, when the env is reset during training, I would like to begin a new random scenario which could have potentially different agents.