linchpinlin

Results 3 comments of linchpinlin

The same question

I upgraded the version of TensorRT-LLM: TensorRT-LLM version: 0.12.0.dev2024070900 export NCCL_DEBUG=INFO mpirun -n 2 --allow-run-as-root python3 ../run.py --input_text "Hi. What's Your Name?" --max_output_len=500 --tokenizer_dir /container_dir/Qwen/models--Qwen--Qwen2-72B-Instruct-GPTQ-Int4/snapshots/6b82a333287651211b1cae443ff2d2a6802597b9/ --engine_dir=/container_dir/Qwen/Qwen2-72B-Instruct-GPTQ-Int4-trtllm_engine_2gpu_Int4/ ``` [TensorRT-LLM] TensorRT-LLM version:...

Actually, we need more than just the screenshot feature, but the post-screenshot topping feature. The Win system I know has a built-in screenshot: Win+Shift+S, but it doesn't have a top-down...