exo icon indicating copy to clipboard operation
exo copied to clipboard

How to use a custom model?

Open flyfishxu opened this issue 1 year ago • 1 comments

I have been quantized DeepSeek R1 671B 2bit MLX by myself, but I found that I can't load it in exo, and there is no mention of how to use a cus tom model in the README.

flyfishxu avatar Feb 10 '25 03:02 flyfishxu

Read this issue, maybe you can load it via offline loader #80 edit: typo

Alikbra avatar Feb 13 '25 20:02 Alikbra