Apply preprocessor in custom model

RLlib
5

The FullyConnectedNetwork looks at your model config and if config["model"]["no_final_linear"] = False, it will not fit the final layer to your provided observation space.

Does this solve your problem?