quantization topic

Everything in Torch Fx

inisis

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

huggingface

QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX

fastmachinelearning

CDMA communication system using Matlab. #github

flandrade

Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization.

seonglae

Hyperspectral CNN compression and band selection

daniel-rychlewski

Run Mixtral-8x7B models in Colab or consumer desktops

dvmazur

LLaMa/RWKV onnx models, quantization and testcase

tpoisonooo

Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine

slavabarkov

Python code (packaged in Docker container) to run the experiments in "A Greedy Algorithm for Quantizing Neural Networks" by Eric Lybrand and Rayan Saab (2020).

elybrand