I tried creating a simple cluster with the following minimal configuration:
cluster_name: minimal provider: type: aws region: ap-south-1
This is resulting in the following error message:
2022-02-02 10:34:46,317 INFO util.py:282 -- setting max workers for head node type to 0 2022-02-02 10:34:46,317 INFO util.py:286 -- setting max workers for ray.worker.default to 2 Checking AWS environment settings Failed to autodetect node resources: An error occurred (UnauthorizedOperation) when calling the DescribeInstanceTypes operation: You are not authorized to perform this operation.. You can see full stack trace with higher verbosity. Failed to fetch IAM instance profile data for ray-autoscaler-v1 from AWS. Error code: AccessDenied !!! Boto3 error: An error occurred (AccessDenied) when calling the GetInstanceProfile operation: User: arn:aws:sts::847438129436:assumed-role/data-science-emr-s3-access-rw/SageMaker is not authorized to perform: iam:GetInstanceProfile on resource: instance profile ray-autoscaler-v1
Could you guys please help me with this?
Is there any documentation around AWS that covers the following topics before creating a cluster?
- Roles that are required to be manually setup
- Permissions that are required to be manually setup