Error: Missing argument 'CLUSTER_CONFIG_FILE'. Ray GCP

Ray Clusters
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Is there an easy way to generate a CLUSTER_CONFIG_FILE from an existing cluster?

I looked at the documentation, and it is not clear to me because 1) its overwhelming 2) not sure which pieces are the bare minimum 3) i didn’t see any configs on the existing ray head node 4) the step by step guides didn’t make it very clear

https://docs.ray.io/en/latest/cluster/vms/references/ray-cluster-configuration.html#cluster-config

jm/add-ray-raven-tf:$ ray up ./ray-deploy-gcp.yaml
Cluster: minimal

2024-07-08 15:17:08,952	INFO util.py:382 -- setting max workers for head node type to 0
2024-07-08 15:17:08,952	INFO util.py:386 -- setting max workers for ray_worker_small to 2
Checking GCP environment settings
> /home/jm/repos/testray/vertexai_loaders/venv_311/lib/python3.11/site-packages/ray/autoscaler/_private/gcp/config.py(654)_list_subnets()
-> return response["items"]
(Pdb) response
{'kind': 'compute#subnetworkList', 'id': 'projects/genai-qa-1234/regions/us-west1/subnetworks', 'selfLink': 'https://www.googleapis.com/compute/v1/projects/genai-qa-1234/regions/us-west1/subnetworks'}
(Pdb) dir(response)
['__class__', '__class_getitem__', '__contains__', '__delattr__', '__delitem__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__getitem__', '__getstate__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__ior__', '__iter__', '__le__', '__len__', '__lt__', '__ne__', '__new__', '__or__', '__reduce__', '__reduce_ex__', '__repr__', '__reversed__', '__ror__', '__setattr__', '__setitem__', '__sizeof__', '__str__', '__subclasshook__', 'clear', 'copy', 'fromkeys', 'get', 'items', 'keys', 'pop', 'popitem', 'setdefault', 'update', 'values']
(Pdb) response.items
<built-in method items of dict object at 0xffffa5034500>
(Pdb) response.items()
dict_items([('kind', 'compute#subnetworkList'), ('id', 'projects/genai-qa-1234/regions/us-west1/subnetworks'), ('selfLink', 'https://www.googleapis.com/compute/v1/projects/genai-qa-1234/regions/us-west1/subnetworks')])
(Pdb)

Here are more details: google cloud platform - Error: Missing argument 'CLUSTER_CONFIG_FILE'. Ray GCP - Stack Overflow

2

There is not - this is actually a good idea as a future feature request. Can you create one in Github and link it back here? @jm-nab

3
1 Like
4

I tried ray up cluster.yaml with the content

auth:
  ssh_user: ubuntu
cluster_name: minimal
provider:
  availability_zone: us-west1-a
  project_id: genai-qa-1234
  region: us-west1
  type: gcp

and it worked for me.

1 Like