Hap-Zhang

Results 27 comments of Hap-Zhang

Hi,all i want to load a Hclr.fst by the code "hcl_fst = fst::StdFst::Read(hcl_fst_rxfilename)", and get a error as "ERROR: GenericRegister::GetEntry: lookup failed in shared object: olabel_lookahead-fst.so", would you like to...

Yes,i config openfst-1.6.1 with option --enable-lookahead-fsts and build&install recently.I want to try lookahead graph decoding when online decoding,and unluckily i get this error.

ok,i'll have a try on the OpenFST forums firstly,thank you.

@Malkovsky Yeah,i see. I really export paths like:`export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$KALDI_ROOT/tools/openfst/lib/fst` However, the error is:"lookup failed in shared object: olabel_lookahead-fst.so", and not "olabel_lookahead-fst.so: cannot open shared object file: No such file or...

@feifeibear 好的,谢谢大佬。 我看代码里这块单独处理了pooler层,是有什么讲究吗? ![image](https://user-images.githubusercontent.com/32810063/147438281-7799f7ce-8b8e-4e86-8712-6a232462411d.png) 我基于huggingface预训练模型进行finetuning,出来的模型用turbo作为后端运行,会报下面的错误,后来调试发现模型中其实没有pooler这一层的,TurboTransformer的代码里为什么会特地加入pooler呢? ![image](https://user-images.githubusercontent.com/32810063/147438309-d64f00ad-c1e3-45e8-8bb4-4887683fb80e.png)

我这边用的预训练模型是bert-base-chinese

嗯,的确,我用的是BertForTokenClassification,这个里面没有用到pooler,那是不是意味着我用的话,需要改下turbotransformers底层的代码呢?

请问中文大概多少个字能体现出效果呢,我可以再测试下 onnxrt是有些加速的,虽然我不知道为什么onnxrt这边Torch的时长更长了。。。。 ![image](https://user-images.githubusercontent.com/32810063/129030910-050b5755-43a4-40b7-89fd-2135800580b0.png)

我这边把timeline打出来了,您可以帮忙看看哪块有比较大的嫌疑吗? ![image](https://user-images.githubusercontent.com/32810063/129309698-4c646ed7-175a-4b6b-a97c-e89404a8ad0f.png)

好的,OMP线程数目默认是机器本身CPU个数吗?