dongteng

请问您这个去掉crf层的问题解决了吗?去掉crf层 后面的 回调函数什么的也需要改吧

> using CUDA shared memory to put the tensors into GPU. can you give some examples for "using CUDA shared memory to put the tensors into GPU." Thanks!

> ImportError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/libth_common.so: undefined symbol: _ZN5torch6detail10class_baseC2ERKSsS3_SsRKSt9type_infoS6_ FATAL: Decoding operators failed to load. This may be caused by the incompatibility between PyTorch and TensorRT-LLM. Please rebuild and install TensorRT-LLM. > >...

同样遇到这个问题

同样问题，感觉一直卡住 ``` [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >> loading file vocab.json [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >> loading file merges.txt [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >> loading file tokenizer.json [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >> loading file added_tokens.json...

> > 同样问题，感觉一直卡住 > > ``` > > [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >> loading file vocab.json > > [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >> loading file merges.txt > > [INFO|tokenization_utils_base.py:2093] 2025-11-21 02:35:48,041 >>...