Holden X

Hi! Is this feature in development or planned to be shipped recently? I am using this library to integrate with MongoDB, so nested creation is an essential feature to support...

Thanks a lot @arauchberger ! It worked like a charm!

Hello @yihong1120, Thank you for your thorough analysis and for recognising the potential in our architecture and promising plans. We truly appreciate your attention to detail and the time you've...

Related issue: #52

谢谢 @Gengchunsheng 的建议，请尝试在Python 3.10以上的环境重新安装。我们会找时间确定项目中的Python模块对Python/pip的最低版本要求，并且更新到README中。 以下是我们开发环境中的Python和PIP版本，不低于此版本应当可以顺利安装： * Python: 3.11.4 * pip: 23.0.1 欢迎尝试并反馈你的结果，以更好地帮助出现类似问题的人，谢谢。 === Thanks for @Gengchunsheng‘s suggestion! Please try reinstalling in an environment with Python 3.10 or higher. We will...

我们在 #112 中修复了Python依赖问题。它应该适用于Python 3.8+和pip 19.3+。 --- We have fixed Python dependency issues in #112. It should work on Python 3.8+ and pip 19.3+.

It seems there might be an incompatibility between your building toolchain and our CMake settings. Could you please provide the versions of your cmake, g++, and nvcc? This information will...

感谢你的反馈，我们使用的`stdatomic.h`看起来不兼容Windows。目前我们正在进行Windows平台兼容的工作，我们很快能够设置好Windows的测试环境并尝试逐一解决问题。如果你对llama.cpp在Windows上的编译较为熟悉，我们欢迎你进行尝试修复，并提出PR。 Thank you for your feedback. It appears that `stdatomic.h` we are using is not compatible with Windows. We are currently working on Windows compatibility. We will soon set up...

我们正在PR #73 进行相关更改，它应该可以使得Windows CPU/GPU环境下可以编译运行。我们参考了 @akemimadoka 的宝贵建议，感谢！ --- We are making relevant modifications in PR #73, aimed at enabling smooth compilation of PowerInfer in Windows CPU/GPU environments. We have referred to...

> hi @hodlen . I notice that you provide ReLUFalcon-40B in the HF. Do you have the tuned ReLU-Falcon-7B weights? We haven't tuned the Falcon 7B model and currently have...