New error in building Algorithm_Config instance

I have beed using the nightly-build of RLlib that supports Gymnasium and training some RL models but all of a sudden I started getting this error AttributeError: '_TFStub' object has no attribute 'Tensor' any idea how I can resolve this issue?