Using RaySGD writing a model, it is pretty much working (awesome!)
With a draft roughly working, I’d like to double check and make sure the “parallel” part truly happened during the training. In particular, those parameter sharing across parallel training instances indeed happens. Any suggestions?
Thanks a lot!