RedmiS22018
RedmiS22018
@zhisbug I've created a pull request here https://github.com/lm-sys/FastChat/pull/1045.
Hi there @andy-yang-1! > On Hugging Face, **there are two versions of llama weights**. I ran into issues with the file_stream loading when I chose the llama-7b-hf version. Could you...
Is that the same model, just split into 1 GB instead of 10 GB? In other words: Will combining the pytorch model files into 10 GB files result in the...
I'm not sure if it's possible to support this version without: - Creating a version of the vicuna model that is split into 1 GB files, and creating delta files...
Hi there @jerzydziewierz, Thank you for sharing your suggestion of increasing the swap file size. However, I'd like to point out that this method doesn't work on macOS. Modifying the...
Thank you for the update. Releasing the merged weights directly is a better soulution.