Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

 (github.com)

7 points | by sarkory 17 hours ago

1 comments