SilverJim

# Fix Bug: stopping_strings sometimes do not work ## Issue: stopping_strings sometimes do not work ## Reason: In some models one word can map to multiple token ## Changes in...

Add MPT quantized model support

1

I have test it on: Model: https://huggingface.co/4bit/mpt-7b-storywriter-4bit-128g GPTQ: https://github.com/qwopqwop200/GPTQ-for-LLaMa/commit/5731aa11de56affe6e8c88cea66a171045ad1dce And it is usable using following command: python3 server.py --notebook --api --model 4bit_mpt-7b-storywriter-4bit-128g --trust-remote-code --wbits 4 --groupsize 128 --model_type mpt

RAM Memory Leak

6

### Custom Node Testing - [x] I have tried disabling custom nodes and the issue persists (see [how to disable custom nodes](https://docs.comfy.org/troubleshooting/custom-node-issues#step-1%3A-test-with-all-custom-nodes-disabled) if you need help) ### Expected Behavior Image...