Dre Dyson

icon company @University-of-South-Florida icon location Tampa, Florida icon location Aspiring Data Scientist, earning a M.S. in Data Science by Dec2024. Focused on AI, LLM, Network Analysis, and Data Analytics. Publications on COVID19 discourse

Results 8 comments of Dre Dyson

Error: could not connect to ollama app, is it running?

> sudo chown -R ollama:ollama Thanks, this helped alot. Since I created a different folder i had to give ollama permissions to the new folder by: `sudo chown -R ollama:ollama...

Post your hardware specs here if you got it to work. 🛠

> I just made enough code changes to run the 7B model on the CPU. That involved > > * Replacing `torch.cuda.HalfTensor` with `torch.BFloat16Tensor` > * Deleting every line of...

Post your hardware specs here if you got it to work. 🛠

Gotcha. So all we would run is > python3 llama/generation.py --max_gen_len 1 ?

download.sh doesn't work on default bash on mac

> Nice! This works. Thank you!

I keep being Rick Rolled

It was deepseek chat.

V100 does not work

I also have a V100 and I'm getting this error too.

V100 does not work

Confirmed working. Thanks! > By the way to get Torch 2.4 - simply run `wget -qO- https://raw.githubusercontent.com/unslothai/unsloth/main/unsloth/_auto_install.py | python -` to get the optimal installation command

V100 does not work

> Using Torch 2.4.0 did not solve the issue. Complete installation: > > ```shell > conda create --name unsloth_240 python=3.10 pytorch=2.4.0 pytorch-cuda=12.1 \ > cudatoolkit xformers -c pytorch -c nvidia...