How severe does this issue affect your experience of using Ray?
- High: It blocks me to complete my task.
I’ve read the docs about Connectors API and know that one can enable/disable connectors in the .rollouts() AlgorithmConfig. If disabled, then the sampler uses the old “env_runner” function, otherwise it uses the new EnvRunnerV2 which doesn’t allow custom obs preprocessing via an obsveration_fn. As far as I understand, this new Connectors API is a new option to do custom preprocessing for complex raw observations.
BUT, how can I make custom AgentConnectors available to the algorithm? Do I have to set custom Connectors in one of the AlgorithmConfig categories?
maybe the Connectors are just intended for restoring purposes of already trained policies, right?