I was just looking through the code for a local provider and I did not see a port option. What I did instead was put it in my ssh config file.
For you this would mean creating or editing the .ssh/config file is the home directory of the user and machine you would be starting the ray cluster from.
The config file itself would look something like this
Host 10.0.0.*
Port 1022
You could also add LocalForward, IdentityFile and other ssh arguments you might want to set in there.