Task_spec.cc:162: Check failed: sched_cls_id_ > 0

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

Hi,
I am running Ray with Slurm on a cluster and have a task that I often start and sometime cancel quite fast after starting. It often gives me the following error, for which I can find no further information:

[2022-04-14 16:58:17,538 C 3470719 3470781] task_spec.cc:162: Check failed: sched_cls_id_ > 0
*** StackTrace Information ***
ray::SpdLogMessage::Flush()
ray::RayLog::~RayLog()
ray::TaskSpecification::GetSchedulingClass()
ray::core::CoreWorkerDirectTaskSubmitter::CancelTask()
ray::core::CoreWorker::CancelChildren()
ray::core::CoreWorker::HandleCancelTask()
std::_Function_handler<>::_M_invoke()
boost::asio::detail::completion_handler<>::do_complete()
boost::asio::detail::scheduler::do_run_one()
boost::asio::detail::scheduler::run()
boost::asio::io_context::run()
ray::core::CoreWorker::RunIOService()
execute_native_thread_routine

Can somebody please help me figuring out what is going wrong here or is this even an issue?

It’s difficuilt to know from this output. Is there any way to reproduce the issue?