This page has a list of supported algorithms:
And some of them support multiagent systems (MAS)
For example, TD3 comes in multiagent version
are those multiagent versions algorithms pure MA algorithms (e.g. MATD3 with CTDE) or Independent agents running that algorithms (e.g. Independent-TD3)
DDPG and MADDPG are both available algorithms.