Another milestone release for Ray, LLMs, and distributed training.
Ray 2.7 features major stability improvements for Ray AI Libraries, KubeRay and introduces RayLLM, include GA for Ray Train:
Simplified APIs in Ray Train for general availability
Stabilized and enhanced Ray Serve and KubeRay for general availability
Introduced RayLLM – LLM model serving on Ray Serve
Stabilized Ray Data for an upcoming general availability
:woman-running:Added initial Accelerator support for TPUs, Trainium, and Inferentia
Have read, and try it out. Let us know.