Zhaoyang Wang

@eshellman Hi, anything else I need to do to help merge this PR? I see this PR is labeld with ``waiting for changes``.

> 第二天已经没有问题了。 > 但是第三天就出来了新的问题： > copy /B asmhead.bin+bootpack.hrb haribote.sys > process_begin: CreateProcess((null), copy /B asmhead.bin+bootpack.hrb haribote.sys, ...) failed. > make (e=2): 系统找不到指定的文件。 > make.exe[2]: *** [haribote.sys] Error 2 > >...

@Kha-Zix-1 这应该是KaTex的问题，你需要使\begin{aligned}math here\end{aligned}

为防止泄露过多隐私，请用base64 decode😁 ``` aGhoaGhoaGhoaGjmiJHop4nlvpfkuJbnlYzkuZ/lp KrlsI/kuobvvIzmiJHpmo/miYvngrnkuobkvaDlpLTl g4/nnIvkvaDnmoRwcm9qZWN0c++8jOWPkeeOs OS9oOaYrzE457qnc3lzde+8jOiAjOaIkeaYrzE357qn5aSW5 qCh55qE5L+d56CU5Y675LqGc3lzdQo= ``` @Kha-Zix-1

Hi, thanks for your reply. But actually I don't have any "latest" file in the ``output_dir``. Here is the screenshot:  And in every checkpoint-xxx directory, we have  In...

Hi, sorry for the late response. I test many times and find it very weird. Now the latest file exists. But "zero_pp_rank_x_mp_rank_00_optim_states.pt" this file has some problems in saving. I...

@stas00 Hi, really thanks for your help! Now I find the reason, finally. It's my own code's fault. Since I use time-based as the path of output directory. However, we...

The reason is that vllm project treats the phi3 as llama architecture, i.e., splitting the merged `qkv_proj` into `q, k and v projs`. A simple workaround is to convert the...