[Cluster, Serve] Automatic cleanup of application dependencies

How do I set up automatic dependency cleanup when I upgrade a service?
Configured a ray cluster with manual node connection. Such situations occur when you restart the application several times (specify other settings or dependencies). Each time the service downloads model weights by itself. There is a suspicion that folders with old versions of applications and accordingly with weights are saved. Is there any way to customize ray serve cache clearing?