It is a single standalone computer with many cores, trying to develop APPO, How to set optimizer settings for new API, I added debug code in Torch to see if these values are passed, but setting this have no effect,
config.optimizer = {
“type”: “Adam”,
“foreach”: False, # Disable foreach optimization
“capturable”: True
}
I am getting this error, “beta1 as a Tensor is not supported for capturable=False and foreach=True”
Capture is always comes as False and foreach always goes as True. Anyone know what is the new way to do?
I will be giving up on this framework. Extremely difficult to work with.