Atlas 3DSS

unsure on how to add flags to the .bat

3

Coming from the simple-lora-fine-tuner so i know i can train LoRas - but at a bit of a loss as to where to add the command line args - i...

requirements.txt

15

mutliple files not available in requirements.txt from nvidia. "ERROR: Could not find a version that satisfies the requirement nvidia-nccl-cu11==2.14.3 (from versions: 0.0.1.dev5) ERROR: No matching distribution found for nvidia-nccl-cu11==2.14.3" "ERROR:...

Attempting to use 13B in the simple tuner -

2

updated the main.py with decapoda-research/llama-13b-hf in all the spots that had 7B It downloaded the sharded parts all right but now im getting this config issue tho. Any advice would...

Not a problem - but like people should know

2

https://arxiv.org/abs/2303.11366 Is a really cool paper about reflection in LLMs  That is after training on like 20 samples for 50 epochs on my 3090 on the 7B model. User:...