Satyam Gupta
Satyam Gupta
> Once the device abstraction has been been merged, we can start adding MPS-accelerated versions of the functions Yay. Thanks to all your efforts. One a side note: how can...
Hey I have Macos Sonoma 14.5 and I got the same issue. I tried using Ollama with Llamaindex. The strange thing is "./ollama run phi3:latest" works absolutely fine in the...
Hello, I get the same nan error. The same command works for `mistralai/Mistral-7B-v0.1` though. Here is my command: ``` python -m mlx_lm.lora \ --train \ --model mistralai/Mixtral-8x7B-v0.1 \ --data /Users/macstudiosct/projects/finetune_mlx/finetuning_data/data...
> I noticed also, but don't know if it could be a clue, Total parameters 7411.242M with 4 bits quantized version and Total parameters 46705.579M in the run you mad...
@Rufus31415 , will it hold for streamlit?
Oh I had a similar error. I am running on macos though. Installing visual studio and xcode and then restarting my system did the trick for me.
Hey @Timelessprod , my question is a bit unrelated so really sorry about that, but I just wanted to clarify if I am doing this right. This is an example...
> It looks fine to me. > > > but just adding `--use_dora` outputs rubbish > > What kind of rubbish? Does the loss go down or not really? Well,...