glide icon indicating copy to clipboard operation
glide copied to clipboard
verified publisher icon EinStack

✨ [Cost] Incoming Token Compression

Open roma-glushko opened this issue 1 year ago • 0 comments

Support incoming request compression natively in Glide to optimize LLM cost:

  • https://github.com/microsoft/LLMLingua

roma-glushko avatar May 13 '24 18:05 roma-glushko