cuda-python icon indicating copy to clipboard operation
cuda-python copied to clipboard

Add peer access support

Open vzhurba01 opened this issue 11 months ago • 1 comments

In a multi-GPU setting, right now it's not possible to memcpy directly between the two devices. A couple of checks would have to be done by cuda.core as part of enabling this:

  • cuDeviceCanAccessPeer
  • cuCtxEnablePeerAccess

vzhurba01 avatar Feb 28 '25 19:02 vzhurba01

This issue is actually very tricky because the modern way of exposing peer access support is again tied to the mempool/VMM APIs, such as cuMemPoolSetAccess/cuMemSetAccess, same as IPC (#103). We'll need a coherent, unified, and consistent solution here.

leofang avatar Mar 05 '25 23:03 leofang