Thanks for your replies.
I have responded in another thread as the following link. Actually, I used two different user names - one with my github, the other for new signup. I am sorry for inconvenience.
https://discuss.ray.io/t/the-hyperparameters-for-sac-to-solve-cartpole-v0/4909