I am trying to deploy some functions that provide access to a trained model. The environment of the model relies on external files as dependencies. When training and evaluation normally everything works fine. But when i try to load an rllib trainer within serve it seems to fail while loading these external files. Can i use a runtime_env to solve this? And how exactly can i provide it to serve? Any help would be appreciated!
serve.start() @serve.deployment(route_prefix="/model-ppo") class ModelServer: def __init__(self) -> None: self.agent = PPOTrainer(config=config, env=MyEnv) ModelServer.deploy()