Thomas Hiddenpeak
Thomas Hiddenpeak
qanything-container-local | [notice] A new release of pip is available: 23.3.2 -> 24.0 qanything-container-local | [notice] To update, run: python3 -m pip install --upgrade pip qanything-container-local | GPU ID: 0,...
ollama可以使用兼容OpenAI API的方式接入
same, on Jetson Orin
in your application？
@r0kk The Jetson Orin series uses the CUDA architecture SM8.7, which is part of the Ampere architecture. Theoretically, it should be compatible with TEI. However, in practical applications, there are...
> @HiddenPeak I can confirm that this is working on `Jetson AGX 64GB`. Thank you very much 🙏. It's very cool~
add -F dynamic-linking
same torch 2.5.1 + cu 12.8