Pooodle

icon location UK icon location I walk around like everything's fine, but deep down, inside my shoe, my sock is sliding off.

Results 2 comments of Pooodle

Hows the inference speed and mem usage?

Interesting, with almost the same setup as the top comment (AMD 5700G with 32GB RAM but Linux Mint) I get about 20% slower speed per token. Maybe prompt length had...

Hows the inference speed and mem usage?

> > Interesting, with almost the same setup as the top comment (AMD 5700G with 32GB RAM but Linux Mint) I get about 20% slower speed per token. Maybe prompt...