Parallel LLM Generation with a Concurrent Attention Cache

 (eqimp.github.io)

3 points | by barrenko 4 hours ago

0 comments