quantization topic

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

jy-yuan

[CVPR 2024 Highlight] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".

ModelTC

Debugger visualizers and image editor apps built on KGy SOFT Drawing Libraries

koszeggy

Using pruning and quantization algorithm to accelerate your yolov7's inference.

ChristianYang37

A collection of hand on notebook for LLMs practitioner

AntonioGr7

Neural Networks with low bit weights on low end 32 bit microcontrollers such as the CH32V003 RISC-V Microcontroller and others

cpldcpu

Fast library for converting RGBA images to 8-bit palette images. Written in Rust; can be used in C programs

DarthSim

BCQ tutorial for transformers

insoochung

On-device LLM Inference Powered by X-Bit Quantization

Picovoice

mi-optimize is a versatile tool designed for the quantization and evaluation of large language models (LLMs). The library's seamless integration of various quantization methods and evaluation techniqu...

TsingmaoAI