eqimp

Results 1 repositories owned by eqimp

hogwild_llm

136
Stars
8
Forks
136
Watchers

Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache