OpenGVLab
[Bug] ValueError: Unrecognized configuration class <class 'transformers_modules.InternVL-Chat-V1-5.configuration_internvl_chat.InternVLChatConfig'> to build an AutoTokenizer.
Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
Describe the bug
I followed https://internvl.readthedocs.io/en/latest/internvl1.5/finetune.html The tutorial reproduced the V1-5 model and encountered this error. How to solve this problem? What is the model for the vocabulary list?
Traceback (most recent call last):
[rank1]: File "/data/ll/InternVL/internvl_chat/internvl/train/internvl_chat_finetune.py", line 848, in
Reproduction
GPUS=4 PER_DEVICE_BATCH_SIZE=2 sh shell/internvl1.5/2nd_finetune/internvl_chat_v1_5_internlm2_20b_dynamic_res_2nd_finetune_lora.sh
Environment
# packages in environment at /root/anaconda3/envs/internvl:
#
# Name Version Build Channel
_libgcc_mutex 0.1 main defaults
_openmp_mutex 5.1 1_gnu defaults
accelerate 0.34.2 pypi_0 pypi
aiohappyeyeballs 2.4.0 pypi_0 pypi
aiohttp 3.10.5 pypi_0 pypi
aiosignal 1.3.1 pypi_0 pypi
aliyun-python-sdk-core 2.15.2 pypi_0 pypi
aliyun-python-sdk-kms 2.16.5 pypi_0 pypi
annotated-types 0.7.0 pypi_0 pypi
async-timeout 4.0.3 pypi_0 pypi
attrs 24.2.0 pypi_0 pypi
ca-certificates 2024.7.2 h06a4308_0 defaults
certifi 2024.8.30 pypi_0 pypi
cffi 1.17.1 pypi_0 pypi
charset-normalizer 3.3.2 pypi_0 pypi
click 8.1.7 pypi_0 pypi
colorama 0.4.6 pypi_0 pypi
crcmod 1.7 pypi_0 pypi
cryptography 43.0.1 pypi_0 pypi
datasets 3.0.0 pypi_0 pypi
decord 0.6.0 pypi_0 pypi
deepspeed 0.15.1 pypi_0 pypi
dill 0.3.8 pypi_0 pypi
einops 0.8.0 pypi_0 pypi
filelock 3.14.0 pypi_0 pypi
flash-attn 2.3.6 pypi_0 pypi
frozenlist 1.4.1 pypi_0 pypi
fsspec 2024.6.1 pypi_0 pypi
hjson 3.1.0 pypi_0 pypi
huggingface-hub 0.25.0 pypi_0 pypi
idna 3.10 pypi_0 pypi
imageio 2.35.1 pypi_0 pypi
importlib-metadata 8.5.0 pypi_0 pypi
jinja2 3.1.4 pypi_0 pypi
jmespath 0.10.0 pypi_0 pypi
ld_impl_linux-64 2.38 h1181459_1 defaults
libffi 3.4.4 h6a678d5_1 defaults
libgcc-ng 11.2.0 h1234567_1 defaults
libgomp 11.2.0 h1234567_1 defaults
libstdcxx-ng 11.2.0 h1234567_1 defaults
markdown 3.7 pypi_0 pypi
markdown-it-py 3.0.0 pypi_0 pypi
markupsafe 2.1.5 pypi_0 pypi
mdurl 0.1.2 pypi_0 pypi
model-index 0.1.11 pypi_0 pypi
mpmath 1.3.0 pypi_0 pypi
multidict 6.1.0 pypi_0 pypi
multiprocess 0.70.16 pypi_0 pypi
ncurses 6.4 h6a678d5_0 defaults
networkx 3.2.1 pypi_0 pypi
ninja 1.11.1.1 pypi_0 pypi
numpy 2.0.2 pypi_0 pypi
nvidia-cublas-cu12 12.1.3.1 pypi_0 pypi
nvidia-cuda-cupti-cu12 12.1.105 pypi_0 pypi
nvidia-cuda-nvrtc-cu12 12.1.105 pypi_0 pypi
nvidia-cuda-runtime-cu12 12.1.105 pypi_0 pypi
nvidia-cudnn-cu12 9.1.0.70 pypi_0 pypi
nvidia-cufft-cu12 11.0.2.54 pypi_0 pypi
nvidia-curand-cu12 10.3.2.106 pypi_0 pypi
nvidia-cusolver-cu12 11.4.5.107 pypi_0 pypi
nvidia-cusparse-cu12 12.1.0.106 pypi_0 pypi
nvidia-ml-py 12.560.30 pypi_0 pypi
nvidia-nccl-cu12 2.20.5 pypi_0 pypi
nvidia-nvjitlink-cu12 12.6.68 pypi_0 pypi
nvidia-nvtx-cu12 12.1.105 pypi_0 pypi
opencv-python 4.10.0.84 pypi_0 pypi
opendatalab 0.0.10 pypi_0 pypi
openmim 0.3.9 pypi_0 pypi
openssl 3.0.15 h5eee18b_0 defaults
openxlab 0.1.1 pypi_0 pypi
ordered-set 4.1.0 pypi_0 pypi
oss2 2.17.0 pypi_0 pypi
packaging 24.1 pypi_0 pypi
pandas 2.2.2 pypi_0 pypi
peft 0.12.0 pypi_0 pypi
pillow 10.4.0 pypi_0 pypi
pip 24.2 py39h06a4308_0 defaults
psutil 6.0.0 pypi_0 pypi
py-cpuinfo 9.0.0 pypi_0 pypi
pyarrow 17.0.0 pypi_0 pypi
pycparser 2.22 pypi_0 pypi
pycryptodome 3.20.0 pypi_0 pypi
pydantic 2.9.2 pypi_0 pypi
pydantic-core 2.23.4 pypi_0 pypi
pygments 2.18.0 pypi_0 pypi
python 3.9.19 h955ad1f_1 defaults
python-dateutil 2.9.0.post0 pypi_0 pypi
pytz 2023.4 pypi_0 pypi
pyyaml 6.0.2 pypi_0 pypi
readline 8.2 h5eee18b_0 defaults
regex 2024.9.11 pypi_0 pypi
requests 2.32.3 pypi_0 pypi
rich 13.4.2 pypi_0 pypi
safetensors 0.4.5 pypi_0 pypi
setuptools 60.2.0 pypi_0 pypi
six 1.16.0 pypi_0 pypi
sqlite 3.45.3 h5eee18b_0 defaults
sympy 1.13.3 pypi_0 pypi
tabulate 0.9.0 pypi_0 pypi
timm 1.0.9 pypi_0 pypi
tk 8.6.14 h39e8969_0 defaults
tokenizers 0.19.1 pypi_0 pypi
torch 2.4.1 pypi_0 pypi
torchvision 0.19.1 pypi_0 pypi
tqdm 4.66.5 pypi_0 pypi
transformers 4.44.2 pypi_0 pypi
triton 3.0.0 pypi_0 pypi
typing-extensions 4.12.2 pypi_0 pypi
tzdata 2024.1 pypi_0 pypi
urllib3 1.26.20 pypi_0 pypi
wheel 0.44.0 py39h06a4308_0 defaults
xxhash 3.5.0 pypi_0 pypi
xz 5.4.6 h5eee18b_1 defaults
yarl 1.11.1 pypi_0 pypi
zipp 3.20.2 pypi_0 pypi
zlib 1.2.13 h5eee18b_1 defaults
Error traceback
No response
We suspect that there might be some version mismatches between the libraries in your environment and our requirements. To verify, please cross-reference your library versions with the ones listed in https://github.com/OpenGVLab/InternVL/blob/main/requirements/internvl_chat.txt
@qishisuren123 I reinstalled the environment according to the link and it can run normally. thank you！
