JuntongMa

Results 3 comments of JuntongMa

I tried several versions: 0.9.2, 0.9.3, 0.10.0, 0.10.1, 0.10.2, 0.10.3, 0.10.4, 0.11.0-beta.2, 0.11.0-beta.3, 0.11.0-beta.5, 0.11.0 Wave doesn't respond on win11. The Wave interface cannot be opened. The waveapp.log file is...

> I evaluate the quality of `meta-llama/Meta-Llama-3-8B-Instruct` on gsm8k with [this](https://github.com/vllm-project/vllm/blob/main/.buildkite/lm-eval-harness/run-lm-eval-gsm-vllm-baseline.sh). > > ``` > lm_eval --model vllm \ > --model_args "pretrained=$MODEL,tensor_parallel_size=$TP_SIZE,distributed_executor_backend=ray,trust_remote_code=true,max_model_len=4096" \ > --tasks gsm8k --num_fewshot "$FEWSHOT" --limit "$LIMIT"...