I have two models which runs on two different environments.
I want it to deploy on one ray head node only.
How can i do that.
I did not find any example with multiple environments.
I have two models which runs on two different environments.
I want it to deploy on one ray head node only.
How can i do that.
I did not find any example with multiple environments.
Depending on what you need in your environment, Runtime Environments might fit the bill:
https://docs.ray.io/en/latest/ray-core/handling-dependencies.html#runtime-environments
You can pass this into the ray_actor_options
field in Ray Serve: Handling Dependencies — Ray 2.0.0
Not able to deploy these model together
Lets say if i am deploying with env A then env B dependencies error is being thrown; i have defined run time env as well
Sorry to hear you’re running into errors, is there a simple script you can share that reproduces the issue?