buzzCraft

I'll give it a try tomorrow and report back.. Thank you for the suggestion Ok, so i got ninja, but no build.ninja `ninja -v ninja: error: loading 'build.ninja': No such...

> Is your sagemaker instance running linux? > > Maybe you need to also include: > > !sudo apt-get install -y ninja-build Installed ninja-build, but didnt solve the issue >Unsure...

Closing the issue for now, since its an run enviorment issue. Ill update with the solution if I get around to fix it.

Is that bug still there? I thought I read somewhere that it got fixed.

@young-geng ok,since we are on the bleeding edge of the llm field, I usually go with the dev branch. I also want to thank you and the team for the...

I went for !pip install git+https://github.com/huggingface/transformers.git@6ce6d62b6f20040129ec9831e7c4f6576402ea42 !pip install git+https://github.com/huggingface/accelerate.git@5791d949ff93733c102461ba89c8310745a3fa79 !pip install git+https://github.com/huggingface/peft.git@e2b8e3260d3eeb736edf21a2424e89fe3ecf429d !pip install transformers[deepspeed] I had to include transformers[deepspeed] yesterday, and earlier today I had to cherrypick commits to...

So I run with 3x pods on EKS, and solved it with enabling stickiness.. Not a perfect solution (since the load balancer cant move people around pods, but it works...

Iv done some finetuning to new languages, mostly Norwegian that, and in my experience adding tokens degrade the models performance. If the base model have seen the language in question...