At the moment our CQL doesn’t support discrete spaces. You can extend either the CQL torch or tf policy to implement similar logic as the SAC tf/torch policy in order to implement discrete spaces though.
You’d have to follow one of our custom policy examples to actually implement this.