ImplicitFunc error with Ray tune

Ray Libraries (Data, Train, Tune, Serve) Ray Tune
1

I have been getting this error during training with pbt. Not sure what the errorlog relates to so any support would be great.

Traceback (most recent call last):
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/trial_runner.py", line 726$
    result = self.trial_executor.fetch_result(trial)
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/ray_trial_executor.py", li$
    result = ray.get(trial_future[0], timeout=DEFAULT_GET_TIMEOUT)
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/worker.py", line 1452, in get
    raise value.as_instanceof_cause()
ray.exceptions.RayTaskError(TuneError): ^[[36mray::ImplicitFunc.train()^[[39m (pid=310, i$
  File "python/ray/_raylet.pyx", line 482, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 436, in ray._raylet.execute_task.function_executor
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/trainable.py", line 336, i$
    result = self.step()
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/function_runner.py", line $
    self._report_thread_runner_error(block=True)
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/function_runner.py", line $
    .format(err_tb_str)))
ray.tune.error.TuneError: Trial raised an exception. Traceback:
^[[36mray::ImplicitFunc.train()^[[39m (pid=310, ip=100.66.192.4)
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/function_runner.py", line $
    self._entrypoint()
  File "/home/cdsw/.local/lib/python3.6/site-packages/ray/tune/function_runner.py", line $
2

Hey @meechos, it looks like there’s some error being raised in your training function that you are passing into tune.run. Do you have the full console output? I believe there should be a more descriptive error message being printed out before this stack trace you posted.