Apply preprocessor in custom model

[arturn]

Your model config has a no_final_linear option:

config["model"]["no_final_linear"] = True

This should not have anything to do with DQN per se.