Tom

Support for Groq

8

Any plans on integrating Groq? It is very fast and can save a lot of time when comparing with other options. Groq link: https://console.groq.com/docs/quickstart

Support for Octpus LLM

1

Hi guys!, It will be nice to add support to Octopus LLMs or are they any alternative? The MMLU score of Octopus v4 is 74.8% under 5-shot, very impressive for...

Very high memory usage for a small model

2

### Reminder - [X] I have read the README and searched the existing issues. ### System Info Platform: Kaggle 2xT4 - `llamafactory` version: 0.8.4.dev0 - OS: Linux-5.15.154+-x86_64-with-glibc2.31 - Python version:...

Using CPU when resume training from checkpoint @ patch 2024.7

4

Hi guys! I got the following error when using Unsloth patch 2024.7 to resume training from checkpoint. ``` RuntimeError: Expected all tensors to be on the same device, but found...