Hey @mannyv ,
I have been, work caught up to me, and get a little burnt out on RL issues/little results (which is just a lack of practical experience on my part) but now I’m back to dip my toes into.
Looks like this is a pretty simple fix if I set the client floats to float32. Will try that later. Was too exhausted migrating my code to the new ray stuff for hours after work and missed this. I went and upvoted your github post (not sure how, but I left a thumbs up, let me know and I’ll do it), and I’ll reply once I get a chance to test out the same dtypes.
Thanks!
P.S.
This means that for training purposes it should be fine though?