marc76900 comments

Repositories
Issues
Comments

Results 3 comments of


                                            marc76900

More features: formatting, actual chat, and show PDF

Have any of you coded anything on this? @dezerving @bhaskatripathi @deepankarm @Jeffrey95 @taherfattahi

can I make it work with only local models (no API calls)?

I'm also interested.

How to improve performance?

> I'm also seeing very slow performance, tried CPU and default cuda, on macOS with apple m1 chip and embedded GPU. I see python3.11 process using 400% cpu (assuign pegging...