riddlegit
riddlegit
same problem here, running openchat-3.5-1210 Q8_0 with 4 slots, mac m1
Same error Solved by adding --use_cached_embd option. This is the codes in train.py, I think it should do something generate embds when this option is no given: ```python if use_cached_embd:...
> > Same error > > Solved by adding --use_cached_embd option. > > This is the codes in train.py, I think it should do something generate embds when this option...
> > [#33](https://github.com/microsoft/KBLaM/pull/33) - I think this PR solves the dataset-loading? Please let me know if that's not the case. > > Yeah, this information was missing in the ReadMe....
同问，除了这几个还支持哪些语气控制
Same error on my Apple M1, @xianqiliu solution works for me, thanks. But it should be better merge to repo?
It should be a coreml issue, I ran into the same problem on macos m1, try this and it works for me: download a custom build onnxruntime_silicon from https://github.com/cansik/onnxruntime-silicon/releases/tag/v1.14.2 pip...
> 效果真的又快又好，打算日常使用，所以增加一个提供 OpenAI 兼容的推理服务接口。 可以在接口里的file支持传入bytes吗？这样如果有实时采集麦克风的场景也可以用上，这里看openai的api应该也是支持的： https://community.openai.com/t/openai-whisper-send-bytes-python-instead-of-filename/84786/4
``` Cannot read properties of undefined (reading 'timeout') ``` I guess this kind of error should be caused by some job config properties missing, maybe try to add a "timeout"...
> With the changes I can run this out of the box with the steps outlined above: > > * Build Triton from source and `pip install -e .` >...