Announcing Ray Aviary

LLMs/Generative AI/Aviary
1

See the announcement @ Announcing Aviary: Open Source Multi-LLM Serving | Anyscale

And try it out yourself at http://aviary.anyscale.com

2 Likes