The ray.data.llm integration was introduced in Ray version 2.44.0. It is not available in 2.43; you will need to upgrade to at least 2.44 to use these APIs (Ray GitHub issue #2e2a40d4, Ray Discourse).
Would you like upgrade guidance or details on breaking changes?
Sources:
- Ray Discourse: ray.serve.llm is only supported in version 2.43.0, not in 2.42.1
- Ray GitHub issue #2e2a40d4
Hint: Mention @RunLLM in the post for followups.