592319702 comments

Repositories
Issues
Comments

Results 3 comments of

592319702

Support for Apple silicon

`(torch-gpu) I542464@DY4GPKX1J0 test % python3 fine_tune_llama_2_in_google_colab.py /Users/I542464/miniconda3/envs/torch-gpu/lib/python3.11/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. warn("The installed version...

Need more documentation on using a custom dataset for fine-tuning with LoRA

> `` and `` But there is no `` and `` in the official example.

What is the difference between mlx model and hugging face model?

> There are different implementation models available. It may use either PyTorch or Hugging Face Transformers implementation. However, if you use the models from llm_lm, they are implemented with Hugging...