I tune+rllib working with arm64 linux, see ARM64 Support/CI integration
I have been meaning to try it on my M1(arm64) MacBook, but other things have come up. Seeing as it works for both Darwin x86 and Linux arm64, it should not be too difficult to build for Darwin arm64.