cuda-python icon indicating copy to clipboard operation
cuda-python copied to clipboard
verified publisher icon NVIDIA

[EPIC] Support green contexts

Open leofang opened this issue 1 year ago • 1 comments

leofang avatar Sep 19 '24 02:09 leofang

Hi @leofang do you have any updates on this? Python-native green context would be very helpful for overlapping computation and communication in LLM inference engines.

yzh119 avatar Jan 22 '25 17:01 yzh119

Hi @yzh119, thanks for your inquiry. We are discussing a design internally. We currently don't have a timeline for a prototype to land, though.

leofang avatar Apr 26 '25 02:04 leofang