TAO JIANG

An error occurred in get_chat_template

5

`tokenizer = get_chat_template( tokenizer, chat_template = "chatml", # Supports zephyr, chatml, mistral, llama, alpaca, vicuna, vicuna_old, unsloth mapping = {"role" : "from", "content" : "value", "user" : "human", "assistant" :...

Exploding gradients/weights/logits in a fine-tuning notebook

2

Hello, after I successfully fine-tuned, I run to the last step and when generating text, the following error occurs. May I ask what is the reason?  

[Feature] support min_p sampling

2

### Motivation Motivation The min_p sampling parameter is becoming quite popular. It's conceptually simple and "makes sense", and (at least anecdotally, according to opinions of many model fine-tuners and users...

[bug]UnboundLocalError: cannot access local variable 'temp_77_token_ids' where it is not associated with a value

2

This error occurs with some prompts ``` File "/root/flux-api/flux_emphasis.py", line 364, in get_weighted_text_embeddings_flux prompt_tokens_t5_grouped, prompt_weights_t5_grouped = group_tokens_and_weights( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/flux-api/flux_emphasis.py", line 226, in group_tokens_and_weights new_token_ids.append(temp_77_token_ids) ^^^^^^^^^^^^^^^^^ UnboundLocalError: cannot access local...

[https://github.com/ToTheBeginning/PuLID](https://github.com/ToTheBeginning/PuLID) 

After changing lora many times, the pictures are getting weirder and weirder

3

After changing lora dozens of times, the following picture will be generated