Hi, I’ve used callbacks before to measure custom metrics on episodes. The way I usually do it is by implementing the on_episode_end method, and adding a line like this: (env,) = base_env.get_sub_environments() episode.custom_metrics |= { 'my_metric': env.my_metric, } This works, and then lat…

Accessing custom metrics for episodes

cool-RR January 21, 2023, 9:02pm 2

Oh, I just found keep_per_episode_custom_metrics=True, so this solves my problem.

1 Like

How to obtain single episode reward?

Topic		Replies	Views
Custom metrics only mean value RLlib	3	850	February 16, 2022
Persisting values across callbacks RLlib	2	586	May 8, 2023
Custom metrics over evaluation only RLlib	8	1723	December 16, 2021
RLlib callbacks to get custom metrics such as observation, reward...etc in each episode from SingleAgentEpisode and access it in the trainer RLlib	1	21	November 14, 2024
Logging custom arrays with RLlib+Tune RLlib	2	809	June 16, 2021