artemcrum

Results 4 comments of artemcrum

Error with OPT-13B-4Bit model: "expected scalar type Float but found Half"

Same issue with Nerybus-13b-4bit. Doesn't work with setting model type to OPT, and works SLOWLY with model type set to GPTJ. Windows 11 3080ti 12GB 32GB RAM Oobabooga up to...

Error with OPT-13B-4Bit model: "expected scalar type Float but found Half"

I've managed to run Nerybus-13B-4bit in KoboldAI environment, but it generates out of the context nonsense text. However in webui it generates pretty good replies (but very slow and in...

Implement a conversation buffer with automated summaries

Voting for that!

Flux IP-Adapter Stylization

Would be nice!