MocMilo comments

Repositories
Issues
Comments

Results 2 comments of


                                            MocMilo

Option for usage of other AI models (or maybe just 13-b)

I managed to run Vicuna 13B on laptop CPU 12700H 64GB RAM, RTX 3070ti 8 GB, response is in about 3.5 minutes. I used: rnosov/Wizard-Vicuna-13B-Uncensored-HF-sharded (note this is shraded version...

error with run of: TheBloke/Nous-Hermes-13B-GPTQ

Yes, sorry I have tested code from pull request #131 before merge, and on 7B GPTQ had successful run on my computer, but I forgot to remove this ticket. Model...