James
James
need this feature
very interesting, would you help add a new test with latest version?
@rngcntr I am also encountering this same issue which block me ingest big data.
@Veken 你成功了吗，我也失败了
@cason0126 worker?我用worker 一直报下边这个错误 data: {"text": "**NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE.**\n\n(ACL stream synchronize failed, error code:507018)", "error_code": 50001}
close it, if you have any questions, please open a new one
can you help to support huge LLM inference in cross node case? https://github.com/ray-project/kuberay/issues/2323
@yuvipanda please help review this feature