Does Autoscaler for AWS Assume hosting at aws.amazon.com?

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

Does Autoscaler assume for aws instances that you are connected to the internet and able to access aws.amazon.com? I assume that this is an edge case that most users won’t encounter but I am on a government version of AWS that is air gapped but otherwise is the same as the online service in terms of API. When I try to run the autoscaler using the documentation from the ray.io autoscaler config, it is able to spin up a head node instance but then once it tries to spin up worker nodes, it hangs on “INFO monitor.py:388 – Autoscaler has not yet received load metrics. Waiting.” before throwing an endpoint exception "botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: “https://ec2.<My airgapped region>.amazonaws.com/”. The monitor logs don’t otherwise print anything useful. Is there a quick fix around this? It strikes me as somewhat odd that, if it was just an issue of an assumed url, that it would be able to successfully spin up a head node but then fail when trying to launch workers nodes but I’m a relative beginner with this.