Alistair Gillespie
Alistair Gillespie
any update on this? sample config file that leads to the same issue on my end: ``` endpoints: - name: chat endpoints_type: llm/v1/chat model: provider: openai name: gpt-4 config: openai_api_type:...
@younesbelkada That file doesn't exist anymore. Any ideas why?
@younesbelkada thank you for your rapid reply. I gave this a go and I still get the following error: https://github.com/OpenAccess-AI-Collective/axolotl/issues/1280 I can copy over the same issue to bitsandbytes with...
@NanoCode012 Any suggested accelerators? A100s are difficult to get ahold of on AWS. Thanks
``` (task, pid=9078) distributed_backend=nccl (task, pid=9078) All distributed processes registered. Starting with 4 processes (task, pid=9078) ---------------------------------------------------------------------------------------------------- (task, pid=9078) (task, pid=9078) [rank: 1] Seed set to 1337 (task, pid=9078) [rank:...