SrVill

The problem with the conversion with the new convert.py

5

Hello! Help me figure out: F:\Models\digitous-Alpacino13b>convert.py --dump-single F:\Models\digitous-Alpacino13b\4bit.safetensors Traceback (most recent call last): File "F:\Models\digitous-Alpacino13b\convert.py", line 1145, in main() File "F:\Models\digitous-Alpacino13b\convert.py", line 1116, in main model_plus = lazy_load_file(args.model) File "F:\Models\digitous-Alpacino13b\convert.py",...

Will it be possible to run MPT in webui?

1

Can you make support for mpt models in webui? https://huggingface.co/mosaicml/mpt-7b-storywriter and other similar (chat, instruct)

Plugin in PyCharm and local model in Windows.

3

Is it possible to connect the plugin via the oobabooga-webui or koboldcpp API to a locally running model (Refact-1.6b, starcoder, etc.)? If possible, how? Or is it possible to work...

Greetings! Is it possible to save the merged model immediately in fp16, and not only in fp32, that is, optional to choose from?