运行过程中,不断打印“Load pinyin_en_mix_dict failed”
运行过程中,不断打印“Load pinyin_en_mix_dict failed”。虽然能正常输出音频,但不知道这条log是否表明运行有问题?是不是我配置还缺了啥?
直接用的是SambertHifigan语音合成-中文-多人预训练-16k模型。 主角本如下: #!/bin/bash
SambertHifigan语音合成-中文-多人预训练-16k
git clone -b pretrain http://www.modelscope.cn/speech_tts/speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k.git
speaker_list: 'F7,F74,FBYN,FRXL,M7,xiaoyu'} all except M7 are female
res_zip=../funtts/speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/resource.zip am_ckpt=../funtts/speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/sambert/ckpt/checkpoint_980000.pth voc_ckpt=../funtts/speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/hifigan/ckpt/checkpoint_2000000.pth spk=xiaoyu
outdir=out_$spk [ -d $outdir ] && rm -rf $outdir; mkdir -p $outdir
python ./kantts/bin/text_to_wav.py
--txt ./test_data/txt
--output_dir $outdir
--res_zip $res_zip
--am_ckpt $am_ckpt
--voc_ckpt $voc_ckpt
--speaker $spk
运行过程中打印的log如下: Converting text to symbols... Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed text.cc: festival_Text_init AM is infering... Loading checkpoint: ../funtts/speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/sambert/ckpt/checkpoint_980000.pth Inference sentence: 0_0 x_band_width:7, h_band_width: 7 Inference sentence: 1_0 x_band_width:6, h_band_width: 6 Inference sentence: 2_0 x_band_width:8, h_band_width: 8 Inference sentence: 3_0 x_band_width:7, h_band_width: 7 Vocoder is infering... Loss = {'discriminator_adv_loss': {'enable': True, 'params': {'average_by_discriminators': False}, 'weights': 1.0}, 'feat_match_loss': {'enable': True, 'params': {'average_by_discriminators': False, 'average_by_layers': False}, 'weights': 2.0}, 'generator_adv_loss': {'enable': True, 'params': {'average_by_discriminators': False}, 'weights': 1.0}, 'mel_loss': {'enable': True, 'params': {'fft_size': 2048, 'fmax': 8000, 'fmin': 0, 'fs': 16000, 'hop_size': 200, 'log_base': None, 'num_mels': 80, 'win_length': 1000, 'window': 'hann'}, 'weights': 45.0}, 'stft_loss': {'enable': False}, 'subband_stft_loss': {'enable': False, 'params': {'fft_sizes': [384, 683, 171], 'hop_sizes': [35, 75, 15], 'win_lengths': [150, 300, 60], 'window': 'hann_window'}}} Model = {'Generator': {'optimizer': {'params': {'betas': [0.5, 0.9], 'lr': 0.0002, 'weight_decay': 0.0}, 'type': 'Adam'}, 'params': {'bias': True, 'channels': 256, 'in_channels': 80, 'kernel_size': 7, 'nonlinear_activation': 'LeakyReLU', 'nonlinear_activation_params': {'negative_slope': 0.1}, 'out_channels': 1, 'resblock_dilations': [[1, 3, 5, 7], [1, 3, 5, 7], [1, 3, 5, 7]], 'resblock_kernel_sizes': [3, 7, 11], 'upsample_kernal_sizes': [20, 10, 4, 4], 'upsample_scales': [10, 5, 2, 2], 'use_weight_norm': True}, 'scheduler': {'params': {'gamma': 0.5, 'milestones': [200000, 400000, 600000, 800000]}, 'type': 'MultiStepLR'}}, 'MultiPeriodDiscriminator': {'optimizer': {'params': {'betas': [0.5, 0.9], 'lr': 0.0002, 'weight_decay': 0.0}, 'type': 'Adam'}, 'params': {'discriminator_params': {'bias': True, 'channels': 32, 'downsample_scales': [3, 3, 3, 3, 1], 'in_channels': 1, 'kernel_sizes': [5, 3], 'max_downsample_channels': 1024, 'nonlinear_activation': 'LeakyReLU', 'nonlinear_activation_params': {'negative_slope': 0.1}, 'out_channels': 1, 'use_spectral_norm': False}, 'periods': [2, 3, 5, 7, 11]}, 'scheduler': {'params': {'gamma': 0.5, 'milestones': [200000, 400000, 600000, 800000]}, 'type': 'MultiStepLR'}}, 'MultiScaleDiscriminator': {'optimizer': {'params': {'betas': [0.5, 0.9], 'lr': 0.0002, 'weight_decay': 0.0}, 'type': 'Adam'}, 'params': {'discriminator_params': {'bias': True, 'channels': 128, 'downsample_scales': [4, 4, 4, 4, 1], 'in_channels': 1, 'kernel_sizes': [15, 41, 5, 3], 'max_downsample_channels': 1024, 'max_groups': 16, 'nonlinear_activation': 'LeakyReLU', 'nonlinear_activation_params': {'negative_slope': 0.1}, 'out_channels': 1}, 'downsample_pooling': 'DWT', 'downsample_pooling_params': {'kernel_size': 4, 'padding': 2, 'stride': 2}, 'follow_official_norm': True, 'scales': 3}, 'scheduler': {'params': {'gamma': 0.5, 'milestones': [200000, 400000, 600000, 800000]}, 'type': 'MultiStepLR'}}} allow_cache = True audio_config = {'fmax': 8000.0, 'fmin': 0.0, 'hop_length': 200, 'max_norm': 1.0, 'min_level_db': -100.0, 'n_fft': 2048, 'n_mels': 80, 'norm_type': 'mean_std', 'num_workers': 16, 'phone_level_feature': True, 'preemphasize': False, 'ref_level_db': 20, 'sampling_rate': 16000, 'symmetric': False, 'trim_silence': True, 'trim_silence_threshold_db': 60, 'wav_normalize': True, 'win_length': 1000} batch_max_steps = 9600 batch_size = 16 create_time = 2022-09-18 14:11:30 discriminator_grad_norm = -1 discriminator_train_start_steps = 0 eval_interval_steps = 10000 generator_grad_norm = -1 generator_train_start_steps = 1 git_revision_hash = 22ae438d207c1720b8068a349b070e2be4676a34 log_interval_steps = 1000 model_type = hifigan num_save_intermediate_results = 4 num_workers = 2 pin_memory = True remove_short_samples = False save_interval_steps = 20000 train_max_steps = 2500000 Loaded model parameters from ../funtts/speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/hifigan/ckpt/checkpoint_2000000.pth. Removing weight norm... Finished generation of 4 utterances (RTF = 0.310). ['out_xiaoyu/0_0_mel_gen.wav', 'out_xiaoyu/1_0_mel_gen.wav', 'out_xiaoyu/2_0_mel_gen.wav', 'out_xiaoyu/3_0_mel_gen.wav'] Text to wav finished!
Conda list:
Name Version Build Channel
_libgcc_mutex 0.1 main https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main _openmp_mutex 5.1 1_gnu https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main absl-py 1.4.0 pypi_0 pypi addict 2.4.0 pypi_0 pypi aiohttp 3.8.4 pypi_0 pypi aiosignal 1.3.1 pypi_0 pypi aliyun-python-sdk-core 2.13.36 pypi_0 pypi aliyun-python-sdk-kms 2.16.1 pypi_0 pypi aniso8601 9.0.1 pypi_0 pypi async-timeout 4.0.2 pypi_0 pypi attrs 23.1.0 pypi_0 pypi audioread 3.0.0 pypi_0 pypi autopep8 2.0.2 pypi_0 pypi bitstring 4.0.2 pypi_0 pypi ca-certificates 2023.05.30 h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main certifi 2023.5.7 pypi_0 pypi cffi 1.15.1 pypi_0 pypi cfgv 3.3.1 pypi_0 pypi charset-normalizer 3.1.0 pypi_0 pypi click 8.0.4 pypi_0 pypi cmake 3.26.4 pypi_0 pypi coloredlogs 14.0 pypi_0 pypi contourpy 1.1.0 pypi_0 pypi crcmod 1.7 pypi_0 pypi cryptography 41.0.1 pypi_0 pypi cycler 0.11.0 pypi_0 pypi cython 0.29.35 pypi_0 pypi datasets 2.8.0 pypi_0 pypi decorator 5.1.1 pypi_0 pypi dill 0.3.6 pypi_0 pypi distance 0.1.3 pypi_0 pypi distlib 0.3.6 pypi_0 pypi dnspython 2.3.0 pypi_0 pypi easyasr 0.0.7 pypi_0 pypi edit-distance 1.0.6 pypi_0 pypi editdistance 0.5.2 pypi_0 pypi einops 0.6.1 pypi_0 pypi espnet-tts-frontend 0.0.3 pypi_0 pypi et-xmlfile 1.1.0 pypi_0 pypi eventlet 0.33.3 pypi_0 pypi filelock 3.12.2 pypi_0 pypi flask 2.1.3 pypi_0 pypi flask-cors 3.0.10 pypi_0 pypi flask-restful 0.3.10 pypi_0 pypi flask-socketio 4.3.2 pypi_0 pypi flask-talisman 1.0.0 pypi_0 pypi fonttools 4.40.0 pypi_0 pypi frozenlist 1.3.3 pypi_0 pypi fsspec 2023.6.0 pypi_0 pypi funasr 0.6.1 pypi_0 pypi future 0.18.3 pypi_0 pypi g2p 1.1.20230511 pypi_0 pypi g2p-en 2.1.0 pypi_0 pypi gast 0.5.4 pypi_0 pypi greenlet 2.0.2 pypi_0 pypi grpcio 1.54.2 pypi_0 pypi h5py 3.8.0 pypi_0 pypi huggingface-hub 0.15.1 pypi_0 pypi humanfriendly 10.0 pypi_0 pypi hyperpyyaml 1.2.1 pypi_0 pypi identify 2.5.24 pypi_0 pypi idna 3.4 pypi_0 pypi importlib-metadata 6.6.0 pypi_0 pypi importlib-resources 5.12.0 pypi_0 pypi inflect 6.0.4 pypi_0 pypi itsdangerous 2.1.2 pypi_0 pypi jaconv 0.3.4 pypi_0 pypi jamo 0.4.1 pypi_0 pypi jedi 0.18.2 pypi_0 pypi jinja2 3.1.2 pypi_0 pypi jmespath 0.10.0 pypi_0 pypi joblib 1.2.0 pypi_0 pypi kaldiio 2.18.0 pypi_0 pypi kantts 0.0.1 pypi_0 pypi kiwisolver 1.4.4 pypi_0 pypi kwsbp 0.0.6 pypi_0 pypi ld_impl_linux-64 2.38 h1181459_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main libffi 3.4.4 h6a678d5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main libgcc-ng 11.2.0 h1234567_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main libgomp 11.2.0 h1234567_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main librosa 0.9.2 pypi_0 pypi libstdcxx-ng 11.2.0 h1234567_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main lit 16.0.5.post0 pypi_0 pypi llvmlite 0.40.1rc1 pypi_0 pypi lxml 4.9.2 pypi_0 pypi markdown 3.4.3 pypi_0 pypi markupsafe 2.1.3 pypi_0 pypi matplotlib 3.7.1 pypi_0 pypi mindaec 0.0.2 pypi_0 pypi mir-eval 0.7 pypi_0 pypi modelscope 1.6.1 pypi_0 pypi mpmath 1.3.0 pypi_0 pypi msgpack 1.0.5 pypi_0 pypi multidict 6.0.4 pypi_0 pypi multiprocess 0.70.14 pypi_0 pypi munkres 1.1.4 pypi_0 pypi ncurses 6.4 h6a678d5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main networkx 2.8.4 pypi_0 pypi nltk 3.8.1 pypi_0 pypi nodeenv 1.8.0 pypi_0 pypi numba 0.57.0 pypi_0 pypi numpy 1.22.0 pypi_0 pypi nvidia-cublas-cu11 11.10.3.66 pypi_0 pypi nvidia-cuda-cupti-cu11 11.7.101 pypi_0 pypi nvidia-cuda-nvrtc-cu11 11.7.99 pypi_0 pypi nvidia-cuda-runtime-cu11 11.7.99 pypi_0 pypi nvidia-cudnn-cu11 8.5.0.96 pypi_0 pypi nvidia-cufft-cu11 10.9.0.58 pypi_0 pypi nvidia-curand-cu11 10.2.10.91 pypi_0 pypi nvidia-cusolver-cu11 11.4.0.1 pypi_0 pypi nvidia-cusparse-cu11 11.7.4.91 pypi_0 pypi nvidia-nccl-cu11 2.14.3 pypi_0 pypi nvidia-nvtx-cu11 11.7.91 pypi_0 pypi openpyxl 3.1.2 pypi_0 pypi openssl 3.0.8 h7f8727e_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main oss2 2.18.0 pypi_0 pypi packaging 23.1 pypi_0 pypi pandas 1.5.3 pypi_0 pypi panphon 0.20.0 pypi_0 pypi parso 0.8.3 pypi_0 pypi pexpect 4.8.0 pypi_0 pypi pickleshare 0.7.5 pypi_0 pypi pillow 9.5.0 pypi_0 pypi pip 23.1.2 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main platformdirs 3.5.3 pypi_0 pypi pooch 1.7.0 pypi_0 pypi pre-commit 3.3.3 pypi_0 pypi prompt-toolkit 3.0.38 pypi_0 pypi protobuf 3.20.0 pypi_0 pypi ptflops 0.7 pypi_0 pypi ptyprocess 0.7.0 pypi_0 pypi py-sound-connect 0.2.1 pypi_0 pypi pyarrow 12.0.1 pypi_0 pypi pycodestyle 2.10.0 pypi_0 pypi pycparser 2.21 pypi_0 pypi pycryptodome 3.18.0 pypi_0 pypi pydantic 1.10.9 pypi_0 pypi pygments 2.15.1 pypi_0 pypi pyparsing 3.0.9 pypi_0 pypi pypinyin 0.44.0 pypi_0 pypi pysptk 0.1.21 pypi_0 pypi python 3.8.16 h955ad1f_4 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main python-dateutil 2.8.2 pypi_0 pypi python-engineio 3.14.2 pypi_0 pypi python-socketio 4.6.1 pypi_0 pypi pytorch-wavelets 1.3.0 pypi_0 pypi pytorch-wpe 0.0.1 pypi_0 pypi pytz 2023.3 pypi_0 pypi pywavelets 1.4.1 pypi_0 pypi pyyaml 6.0 pypi_0 pypi readline 8.2 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main regex 2023.6.3 pypi_0 pypi requests 2.31.0 pypi_0 pypi resampy 0.4.2 pypi_0 pypi responses 0.18.0 pypi_0 pypi rotary-embedding-torch 0.2.3 pypi_0 pypi ruamel-yaml 0.17.28 pypi_0 pypi ruamel-yaml-clib 0.2.7 pypi_0 pypi scikit-learn 1.2.2 pypi_0 pypi scipy 1.10.1 pypi_0 pypi sentencepiece 0.1.99 pypi_0 pypi setuptools 67.8.0 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main simplejson 3.19.1 pypi_0 pypi six 1.16.0 pypi_0 pypi sortedcontainers 2.4.0 pypi_0 pypi soundfile 0.12.1 pypi_0 pypi sox 1.4.1 pypi_0 pypi speechbrain 0.5.14 pypi_0 pypi sqlite 3.41.2 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main sympy 1.12 pypi_0 pypi tensorboard 1.15.0 pypi_0 pypi tensorboardx 2.6 pypi_0 pypi text-unidecode 1.3 pypi_0 pypi textgrid 1.5 pypi_0 pypi threadpoolctl 3.1.0 pypi_0 pypi tk 8.6.12 h1ccaba5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main tomli 2.0.1 pypi_0 pypi torch 2.0.1 pypi_0 pypi torch-complex 0.4.3 pypi_0 pypi torchaudio 2.0.2 pypi_0 pypi tqdm 4.65.0 pypi_0 pypi traitlets 5.9.0 pypi_0 pypi triton 2.0.0 pypi_0 pypi ttsfrd 0.2.1 pypi_0 pypi typeguard 2.13.3 pypi_0 pypi typing-extensions 4.6.3 pypi_0 pypi unicodecsv 0.14.1 pypi_0 pypi unidecode 1.3.6 pypi_0 pypi urllib3 2.0.3 pypi_0 pypi virtualenv 20.23.0 pypi_0 pypi wcwidth 0.2.6 pypi_0 pypi werkzeug 2.0.3 pypi_0 pypi wheel 0.38.4 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main xxhash 3.2.0 pypi_0 pypi xz 5.4.2 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main yapf 0.40.0 pypi_0 pypi yarl 1.9.2 pypi_0 pypi zipp 3.15.0 pypi_0 pypi zlib 1.2.13 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
git rev-parse HEAD: 8caf8926fa150e17c3766ee4da14e820012d3ec1
(/media/lab-hp/B23AB5DD3AB59F33/condaenv/maas) lab-hp@labhp-HP:~/桌面/KAN-TTS$ python ./kantts/bin/text_to_wav.py --txt test.txt --output_dir res --res_zip speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/resource.zip --am_ckpt speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/sambert/ckpt/checkpoint_980000.pth --voc_ckpt speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/hifigan/ckpt/checkpoint_2000000.pth --speaker xiaoyu 2023-07-24:22:10:22, INFO [text_to_wav.py:97] Converting text to symbols... Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed Load pinyin_en_mix_dict failed text.cc: festival_Text_init 2023-07-24:22:10:26, INFO [text_to_wav.py:109] AM is infering... 2023-07-24:22:10:29, INFO [infer_sambert.py:198] Loading checkpoint: speech_sambert-hifigan_tts_zh-cn_multisp_pretrain_16k/basemodel_16k/sambert/ckpt/checkpoint_980000.pth 2023-07-24:22:10:29, INFO [infer_sambert.py:210] Inference sentence: 0_0 Could not load library libcudnn_cnn_infer.so.8. Error: /media/lab-hp/B23AB5DD3AB59F33/condaenv/maas/bin/../lib/libnvrtc.so: undefined symbol: nvrtcGetCUBIN 已放弃 (核心已转储)
你遇到过这个问题吗【Could not load library libcudnn_cnn_infer.so.8. Error: /media/lab-hp/B23AB5DD3AB59F33/condaenv/maas/bin/../lib/libnvrtc.so: undefined symbol: nvrtcGetCUBIN 已放弃 (核心已转储)】
没遇到过。。。
我遇到了,也不知道怎么回事,但是也不出结果
ttsfrd 版本问题,重装个低版本 0.0.4,就好了。
ttsfrd 版本问题,重装个低版本 0.0.4,就好了。
安装0.0.4后和tts-autolabel需要的版本又冲突了,怎么破?大佬
ttsfrd 版本问题,重装个低版本 0.0.4,就好了。
安装0.0.4后和tts-autolabel需要的版本又冲突了,怎么破?大佬 建两个conda环境可破之(推理的时候是用不到autolabel的,而预处理时是用不到ttsfrd的,你应该懂了)
ttsfrd 版本问题,重装个低版本 0.0.4,就好了。
安装0.0.4后和tts-autolabel需要的版本又冲突了,怎么破?大佬 建两个conda环境可破之(推理的时候是用不到autolabel的,而预处理时是用不到ttsfrd的,你应该懂了)
感谢大佬,明了!只是即便是有这个错误Load pinyin_en_mix_dict failed,也能出来结果,不知道对结果是否影响,我先试试,感谢!