I’ve read this doc Lazy Computation Graphs with the Ray DAG API — Ray 2.39.0 and want to know if I can get this improvement in Ray Dataset API?
Hi @WinkerDu , note that Ray Compiled Graphs API is different from Ray DAG API, although related:
- Ray DAG API: Lazy Computation Graphs with the Ray DAG API — Ray 2.39.0
- Ray Compiled Graphs (previously known as Ray aDAG): build on top of Ray DAG API, and does compilation before execution. See [PUBLIC] Ray Compiled Graphs developer guide - Google Docs for details
Wondering what you meant by “get this improvement in Ray Dataset API”.