Towards Efficient Key-Value Cache Management for Prefix Prefilling in LLM Inference
- Yue Zhu
- Hao Yu
- et al.
- 2025
- CLOUD 2025
Publications
16 results for Chen Wang
Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
- Pol G. Recasens
- Ferran Agullo
- et al.
- 2025
- CLOUD 2025
Voice-based AI Agents: Filling the Economic Gaps in Digital Health Delivery
- Bo Wen
- Chen Wang
- et al.
- 2025
- ICDH 2025
Evaluating the Network Effects of Orchestration Strategies for AI Workloads in Modern Data Centers
- José Santos
- Pavlos Maniotis
- et al.
- 2025
- NetSoft 2025
Power-aware Deep Learning Model Serving with µ-Serve
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- USENIX ATC 2024
Towards Pareto Optimal Throughput in Small Language Model Serving
- Pol G. Recasens
- Yue Zhu
- et al.
- 2024
- EuroMLSys 2024
Acto: Automatic End-to-End Testing for Operation Correctness of Cloud System Management
- Jiawei Tyler Gu
- Xudong Sun
- et al.
- 2023
- SOSP 2023
A Mean-Field Game Approach to Cloud Resource Management with Function Approximation
- Weichao Mao
- Haoran Qiu
- et al.
- 2022
- NeurIPS 2022
SIMPPO: A Scalable and Incremental Online Learning Framework for Serverless Resource Management
- Haoran Qiu
- Weichao Mao
- et al.
- 2022
- SoCC 2022
Reinforcement learning for resource management in multi-Tenant serverless platforms
- Haoran Qiu
- Weichao Mao
- et al.
- 2022
- EuroMLSys 2022