Hello, If I want to set 9 agent.

I set as this:

“multiagent”: {

“policies”: {

‘0’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘1’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘2’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘3’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘4’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘5’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘6’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘7’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

‘8’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {})

},

“policy_mapping_fn”: policy_mapping # Traffic lights are always controlled by this policy

},

There is 9 agent works.

But, I want 9 agent use the same policy, if I set as this:

“multiagent”: {

“policies”: {

‘0’: (PPOTFPolicy, spaces.Box(low=np.zeros(20), high=np.array([‘inf’] * 20)), spaces.Discrete(4), {}),

},

“policy_mapping_fn”: policy_mapping # Traffic lights are always controlled by this policy

},

How many agent works?