Unable to ssh into head node during Ray up

Ray Clusters
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Hi, I had a working ray cluster earlier using a config file, but this time, when nothing has changed , when trying to launch the cluster via ray up, it is unable to ssh into the head, and repeatedly saying permission denied (publickey), ssh still not available. The command still initializes the ec2 instance for the head node in aws, and I am able to connect to the head node through the aws console just fine.

Any idea whats going wrong? The key pair and security group being used is just the one auto-created by ray, so there shouldn’t be any issues there. I also saw a similar post, and made sure nothing was going wrong there, ie the user was correct (ubuntu) and ray is installed on the ec2 isntance. Any help would be greatly appreciated, thanks!

2

sanity check: key didn’t expire?

3

I made sure to refresh aws credentials right before running. It’s probably been about a week since last launching the cluster. The keypair itself is the one auto-generated by ray. Does that one expire at all?

4

I just tried deleting the key that ray auto-created and reran ray up so that it created a new one, which seemed to work, so maybe that was the case after all. Didn’t realize the ssh keypairs could expire. Thanks so much!