quantization topic

Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)

pranavkumaarofficial

LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

ModelCloud

Over 60 figures and diagrams of LLMs, quantization, low-rank adapters (LoRA), and chat templates FREE TO USE in your blog posts, slides, presentations, or papers.

dvgodoy

A collections of audio codecs with a standardized API

lucadellalib

记录量化LLM中的总结。

taishan1994

A neural speech codec based on discrete WavLM representations

lucadellalib

An intelligent traffic monitoring system that collects traffic flow and metrics including average speed and vehicle counts for each road. Features real-time data visualization with interactive dashboa...

vietanhlee

"Adaptive Hybrid Quantization Framework for deploying 7B+ LLMs on low-VRAM devices (e.g., GTX 1050). Features surgical block alignment and Numba-accelerated inference.

QKV-Core