Tymoteusz Dolega comments

Repositories
Issues
Comments

Results 5 comments of


                                            Tymoteusz Dolega

[BUG] Lost password, now can't log in

How this is a bug?

[Monitor Type] Web Socket Support

Any updates on this?

bf16 & tf32，can they be used together

By setting bf16, the model weights are saved in bf16, but gradients (computed in half-precision but converted to full-precision for the update) and optimizations (optimizer states) are still done in...

LoRA saving and loading: does save_method = 'lora' save full model?

What are your LoRA parameters? 4 GiB can be normal with high `r` saved as float32

[FIXED] Llama 3 Finetuned model is not generating EOS token.

I suggest using for pad token and for eos token.