xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard

精调停止在这里,什么问题?

Open chalesguo opened this issue 1 year ago • 2 comments


after_test: (VERY_HIGH ) RuntimeInfoHook

after_run: (BELOW_NORMAL) LoggerHook

Map (num_proc=32): 100%|███████| 665298/665298 [03:29<00:00, 3181.47 examples/s] Map (num_proc=32): 100%|██████| 665298/665298 [00:49<00:00, 13336.60 examples/s] Filter (num_proc=32): 100%|███| 665298/665298 [00:41<00:00, 15848.97 examples/s] Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Map (num_proc=32): 28%|█▍ | 187687/665298 [1:57:46<04:44, 1677.38 examples/s]

chalesguo avatar May 25 '24 12:05 chalesguo

没有看到错误信息。估计是某一个进挂了导致 map 失败了。建议你仔细看看所有输出信息

hhaAndroid avatar May 27 '24 03:05 hhaAndroid

原因找到了,内存需求大,增加虚拟内存容量就可以解决。

chalesguo avatar May 30 '24 07:05 chalesguo