1. Severity of the issue: (select one)
Low: Annoying but doesn’t hinder my work.
Medium: Significantly affects my productivity but can find a workaround.
Not a bug but tried rllib for the first time, used the new api on latest version but a lot of the things seem missing after I read through a lot of the source code and debugging things, like currently I want to implement rainbow dqn with a custom input->output structure but still use some of the existing code like the dueling, distributional, and noisy layers implementation, but after getting it to work after a week I just realized the noisy layer is only implemented in modelv2/old api so I need to implement that myself or switch to old api? The depracation warning says rlmodulespec is deprecated but new api uses the default model which uses the catalog class is also deprecated? And the documentation is really unclear on what are available in new api or what are the workarounds or if it just straight up doesn’t work
I want to know if there’s an estimation of when the new API would be done, what would be the structure after the new API is done transitioning, or what version should I use for the old API if the old API works, if there’s a recommendation maybe add it to the docs? Because the note everywhere says use new API but it doesn’t seem complete to me