bark.cpp icon indicating copy to clipboard operation
bark.cpp copied to clipboard

Can Bark.cpp support acceleration with AMD GPU with ROCM?

Open eliranwong opened this issue 1 year ago • 2 comments

Can Bark.cpp support acceleration with AMD GPU with ROCM?

eliranwong avatar Apr 29 '24 12:04 eliranwong

Hello @eliranwong ! We are currently working on ggml to support the necessary operations in CuBLAS. I think with CuBLAS we should be able to support AMD GPU.

PABannier avatar May 02 '24 12:05 PABannier

Could this project be helpful? https://docs.scale-lang.com/

mfrederico avatar Jul 16 '24 14:07 mfrederico