randoentity

Fixes https://github.com/AutoGPTQ/AutoGPTQ/issues/606 Quick fix. Only tested by making the same change in the installed pip package in combination with text-generation-webui. I didn't read the upstream changes. - TypeError: LlamaRotaryEmbedding.forward() got...

imp: linting

3

Just some basic linting. At some point adding (something like) [Pre-Commit](https://pre-commit.com/) might be nice. I'm in favor of line length 79 (or less) because I'm one of the silly people...

multiple whitespace replacer

2

Using codestral and a (badly formatted) C++ codebase I often get whitespace issues when using the diff edit-format. The whole edit-format works better, but there codestral often wants to replace/summarize...

Add q-cache 6 and 8 support for Exllamav2

1

## Checklist: - [x] I have read the [Contributing guidelines](https://github.com/oobabooga/text-generation-webui/wiki/Contributing-guidelines).