Discrete Actions for CQL?

Hi!

Is there any plan to extend the implementation of the CQL algorithm to accept discrete action spaces as well as continuous?

Thanks!

1 Like

@sven1977 Is there any particular reason for not having CQL for Discrete Action space?

@avnishn

Anything particular to keep in mind when trying to implement discrete action space-based CQL by following the guidelines of your answer on this post: CQL for discrete action space - #2 by avnishn

Is there some limitation of CQL for discrete action space that we should keep in mind?

@michaelzhiluo1 Would you happen to have any idea about this? I believe you started the work on CQL. Can you please guide me on how I can implement discrete action space for CQL effectively?