it would be nice to be able to report evaluation metrics. The results of the evaluation are nested like this result["evaluation"]["episode_reward_mean"] and this is therefore not possible to access them.
Unfortunately, it is not working. I have digged a bit into the code of the CLIReporter and there is only a get call on the results dictionary, therefore it is not possible to report nested metrics.
Maybe is this a feature that is already implemented in some upcoming version ? (I am using ray 1.1.0)