Mooncake: Trading More Storage for Less Computation - A KVCache-centric Architecture for Serving LLM Chatbot.

Ruoyu Qin Zheming Li Weiran He Jialei Cui Feng Ren Mingxing Zhang Yongwei Wu 0001 Weimin Zheng Xinran Xu Mooncake: Trading More Storage for Less Computation - A KVCache-centric Architecture for Serving LLM Chatbot. 155-170 2025 FAST https://www.usenix.org/conference/fast25/presentation/qin conf/fast/2025 db/conf/fast/fast2025.html#QinLHCRZ0ZX25