# Nan in cql training from provided example

**URL:** <https://discuss.ray.io/t/nan-in-cql-training-from-provided-example/4066>\
**Category:** RLlib\
**Created:** [November 8, 2021, 10:46pm UTC](https://discuss.ray.io/t/nan-in-cql-training-from-provided-example/4066 "2021-11-08T22:46:25Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![captainzhao](https://avatars.discourse-cdn.com/v4/letter/c/ea5d25/32.png) [@captainzhao](https://discuss.ray.io/u/captainzhao)\
**Post date:** [November 8, 2021, 10:46pm UTC](https://discuss.ray.io/t/nan-in-cql-training-from-provided-example/4066/1 "2021-11-08T22:46:25Z")

</div>

Hello,

I am testing CQL on RLlib with a provided [example](https://github.com/ray-project/ray/blob/master/rllib/tuned_examples/cql/halfcheetah-cql.yaml). However, when I run

```auto
rllib train -f tuned_examples/cql/halfcheetah-cql.yaml

```

the code runs but returns all `nan` number despite hours of training. The config in yaml looks reasonable to me, so I am not sure why.

Thanks.

---

<div class="post-metadata">

**Author:** ![amogkam](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/amogkam/32/17_2.png) [@amogkam](https://discuss.ray.io/u/amogkam)\
**Post date:** [November 11, 2021, 6:08pm UTC](https://discuss.ray.io/t/nan-in-cql-training-from-provided-example/4066/2 "2021-11-11T18:08:19Z")

</div>

Hey @gjoliver @sven1977 @avnishn any thoughts here?