harbor icon indicating copy to clipboard operation
harbor copied to clipboard
verified publisher icon av

Add MLX Backend

Open parthpat12 opened this issue 1 year ago • 1 comments

Is it possible to add MLX (eg. MLX-LM or FastMLX) backends to Harbor?

parthpat12 avatar Sep 13 '24 11:09 parthpat12

Unfortunately the GPU support is not possible with Docker on MacOS at the moment

https://docs.docker.com/desktop/gpu/

So, it's possible to integrate these, but they won't be utilised to their full potential

av avatar Sep 13 '24 15:09 av