andyluo7

Multi-modal algorithm inference demo error

4

Thanks for your error report and we appreciate it a lot. **Checklist** 1. I have searched related issues but cannot get the expected help. 2. I have read the [FAQ...

Error: cannot run benchmark for chatglm2 6b (The same script works for llama2 7b)

9

### Describe the bug (py310) ubuntu@820e48bcba8b:~/llm$ python run.py --benchmark -m /model/chatglm2_6b/ --dtype bfloat16 --input-tokens 64 --batch-size 1 --num-iter 5 --num-warmup 1 --token-latency Namespace(model_id='/model/chatglm2_6b/', dtype='bfloat16', input_tokens='64', max_new_tokens=32, prompt=None, config_file=None, greedy=False, ipex=False,...

calibration failed

5

The command I use: make calibrate RUN_ARGS="--benchmarks=resnet" The output: [2020-05-20 01:03:19,521 main.py:291 INFO] Using config files: measurements/Xavier/resnet/SingleStream/config.json,measurements/Xavier/resnet/MultiStream/config.json,measurements/Xavier/resnet/Offline/config.json [2020-05-20 01:03:19,522 __init__.py:142 INFO] Parsing config file measurements/Xavier/resnet/SingleStream/config.json ... [2020-05-20 01:03:19,527 __init__.py:142 INFO]...

Fatal error: cuda.h: No such file or directory

6

I am building the project with "make build" command. The following error occurred. Should I modify the Makefile or any environment parameter? [ 20%] Building CXX object lwis/CMakeFiles/lwis.dir/src/lwis.cpp.o In file...