Vladimir Zorin

The repo was recently forked, but the import paths in subpackages files (store/consul/consul.go, store/redis/redis.go, etc) have not been updated and still point to docker/libkv. This lead to various compilation errors,...

Mixtral training support

1

For reference, LLaMA-Factory [claims](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/discussions/10) that using their toolkit you can QLoRA fine-tune mixtral with 28GB of VRAM.

Dynamic NTK RoPe scaling support

1

transformers merged https://github.com/huggingface/transformers/pull/24653 only dynamic NTK RoPe scaling (NTKv2), would be nice to have it in exllama.