qy1026

Strangely, this problem could be fixed by adding `--max-out-len` and `--max-seq-len` in the eval script. After setting up this two parameters, the UnboundLocalError can be solved and the outputs are...

> 我使用sensevoice2jsonl生成的数据与自己设计的mock数据都会出现"data is empty"的问题，查看配置文件后发现是忽略了finetune.sh中的data_conf中的dataset_conf.batch_type="token"与dataset_conf.batch_size属性，误认为是按照样本分batch，将batch调大一些，问题就解决了。 有用！

> this may be a bug of transformers ? 我还试了4.46.2，4.47.0版本的transformers，会生成另一个错误： ```python File "/home/xxx/anaconda3/envs/trl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 375, in forward bsz, q_len, _ = hidden_states.size() ValueError: too many values to unpack (expected 3)...

添加上 --packing_samples参数就不报错了，即packing_samples=True不报错，packing_samples=False报错。这是为什么呢？