Observation space is shrinking while changing from PPO to APPO

RLlib
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Problem:

RLLIB config seems to work fine while using PPO. But when I changed it to APPO, for some reason the observation shape is changing when I access it in my model file. And I get the following error.

Ray Version: 2.7.2

File "/home/miniconda3/envs/rllib_inline_env/lib/python3.7/site-packages/ray/rllib/models/modelv2.py", line 447, in _unpack_obs
    prep.shape[0], obs.shape
ValueError: Expected flattened obs shape of [..., 99103], got torch.Size([128, 99004])