Issues when trying to use ray memory for local mode

How severe does this issue affect your experience of using Ray?

  • None: Just asking a question out of curiosity
  • Low: It annoys or frustrates me for a moment.
  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.
  • High: It blocks me to complete my task.

For my local run of ray, I use ray.init(ignore_reinit_error=True)

When I use ray memory, i got:

  File "/home/ann.yan/.local/bin/ray", line 11, in <module>
    sys.exit(main())
  File "/home/ann.yan/.local/lib/python3.6/site-packages/ray/scripts/scripts.py", line 1468, in main
    return cli()
  File "/home/ann.yan/.local/lib/python3.6/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/home/ann.yan/.local/lib/python3.6/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/home/ann.yan/.local/lib/python3.6/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/ann.yan/.local/lib/python3.6/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/ann.yan/.local/lib/python3.6/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/home/ann.yan/.local/lib/python3.6/site-packages/ray/scripts/scripts.py", line 1341, in memory
    ray.init(address=address, _redis_password=redis_password)
  File "/home/ann.yan/.local/lib/python3.6/site-packages/ray/worker.py", line 759, in init
    connect_only=True)
  File "/home/ann.yan/.local/lib/python3.6/site-packages/ray/node.py", line 143, in __init__
    redis_client.get("session_name"))
  File "/home/ann.yan/.local/lib/python3.6/site-packages/ray/utils.py", line 221, in decode
    raise ValueError(f"The argument {byte_str} must be a bytes object.")
ValueError: The argument None must be a bytes object.

IIUC, ray memory is for cluster mode of using Ray. I wonder if there is any recommendation for profiling memory for local mode ray

Ah yeah for local mode the data is actually stored on heap instead of plasma store, that why ray memory --stats-only doesn’t work.

Ray doesn’t provide tools for looking into heap memories AFAIK. Some python tools (psutil) or linux tools is the best bet here.