Does Ray Serve support local model hot update/reload?

Hi Japson,

Currently ray serve doesn’t have the functionality to support the model load/rollback/version control.

(To unblock you) For new version model update, can you directly trigger another deployment (new model) and shit traffic and remove the previous deployment (old model)?

1 Like