Normalizing Observations

[luzgui]

Thank you very much, the problem is that I am using action masking and it will also normalize the mask. So I am having the issue in this other thread:

MeanStdFilter Observation filter also normalizes action mask

I’m attempting to use the MeanStdFilter observation filter with an environment that uses action masking and I believe the filter is also normalizing the action mask. I’m using ray 0.8.5 with tensorflow 1.15.4. Here is a script to recreate the issue: import argparse import random import numpy as np import gym from gym.spaces import Box, Discrete, Dict, Tuple import ray from ray import tune from ray.rllib.models import ModelCatalog from ray.rllib.models.tf.fcnet_v2 import FullyConnectedNetwork…