Power-aware Deep Learning Model Serving with μ-Serve
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- USENIX ATC 2024
Publications
Date
Featured collections
Popular topics
5 results for Shengkun Cui
Flash: Fast Model Adaptation in ML-Centric Cloud Platforms
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- MLSys 2024
iPrism: Characterize and Mitigate Risk by Quantifying Change in Escape Routes
- Shengkun Cui
- Saurabh Jha
- et al.
- 2023
- DSN 2023
Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- ASPLOS 2024
Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- ASPLOS 2024