I need to send ray head node arguments as a string but I am not sure how to do so.
Consider this example from Object Spilling — Ray 2.7.0
import json
d = {
"max_io_workers": 4, # More IO workers for remote storage.
"min_spilling_size": 100 * 1024 * 1024, # Spill at least 100MB at a time.
"object_spilling_config": json.dumps(
{
"type": "smart_open",
"params": {
"uri": "s3://bucket/path"
},
"buffer_size": 100 * 1024 * 1024, # Use a 100MB buffer for writes
},
)
}
json.dumps(d)
ray start --head --system-config='{"max_io_workers": 4, "min_spilling_size": 104857600, "object_spilling_config": "{\\"type\\": \\"smart_open\\", \\"params\\": {\\"uri\\": \\"s3://bucket/path\\"}, \\"buffer_size\\": 104857600}"}'
Yields Error: Invalid value