token-reduction topic

List token-reduction repositories

LightCompress

649
Stars
64
Forks
649
Watchers

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.

TokenPacker

273
Stars
9
Forks
273
Watchers

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025

CntxtPY

112
Stars
12
Forks
112
Watchers

A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your project | Code structure visualization | LLM Context Window Ef...

context-compressor

72
Stars
12
Forks
72
Watchers

AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to 50-60% while preserving semantic meaning with advanced compression strategies.

CntxtJS

62
Stars
7
Forks
62
Watchers

A lightweight tool to optimize your Javascript / Typescript project for LLM context windows by using a knowledge graph | AI code understanding | LLM context enhancement | Code structure visualization...

zon-TS

41
Stars
3
Forks
41
Watchers

ZON → 35-70% cheaper LLM prompts than JSON/TOON. Zero overhead.

GlobalCom2

37
Stars
1
Forks
37
Watchers

[AAAI 2026] Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Models

CntxtCS

33
Stars
2
Forks
33
Watchers

A lightweight tool to optimize your C# project for LLM context windows by using a knowledge graph | Code structure visualization | Static analysis for AI | Large Language Model tooling | .NET ecosyste...

CntxtJV

26
Stars
1
Forks
26
Watchers

A discovery and compression tool for your Java codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your project #LLM #AI #Java #CodeAnalysis #ContextWindow #DeveloperTo...