The trials are killed by ASHA, except for that they would look like they are completing. The loss landscape seems to be extremely flat, so I am worried that I am doing something wrong with the hyper-parameters space and I have posed another question on this topic.
I am testing out in the meantime the HyperOpt Searcher to see if the same issue applies.