quantization topic

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...

stochasticai

Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training

raywan-110

Resnet50 Quantization for Inference Speedup in PyTorch

zanvari

Model Compression Made Easy

satabios

Navigating the World of AI, One Step at a Time

adithya-s-k

Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples [NeurIPS 2021]

iamkanghyunchoi

IntLLaMA: A fast and light quantization solution for LLaMA

megvii-research

QuantEase, a layer-wise quantization framework, frames the problem as discrete-structured non-convex optimization. Our work leverages Coordinate Descent techniques, offering high-quality solutions wit...

linkedin

Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

intel

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

OpenGVLab