@ttandqq, Yes it’s possible. Building ray for raspberry pi 4 cost me a lot of effort but I did it. I had to build many packages and dependencies from source , especially tensorflow 2 building was very paintful 
Maybe this link will be useful for You:
https://discuss.ray.io/t/ray-for-rapberry-pi-is-possible/451/21