Chen Chen
Associate Professor, Doctoral Supervisor
SEIEE 3-119, SJTU
chen-chen AT sjtu.edu.cn
I am a tenure-track associate professor in the John Hopcroft Center for Computer Science (affiliated under the School of Computer Science), Shanghai Jiao Tong University. At SJTU, I am also a member of Emerging Parallel Computing Center (EPCC). Prior to joining SJTU, I worked as a Researcher at Huawei Hong Kong Research Center (2012 Labs) from Aug. 2018 to Dec. 2021. I obtained my PhD degree in Department of Computer Science and Engineering from Hong Kong University of Science and Technology, under the supervision of Prof. Bo Li and Prof. Wei Wang. During my PhD studies, I also had a fantastic visiting experience at the University of Toronto under the supervision of Prof. Baochun Li. I obtained my Bachelor degree in 2014 from the Department of Automation, Tsinghua University.
My research aims at optimizing distributed systems supporting modern applications, with a special focus on Efficient LLM Training and Inference. I am particularly interested in identifying fundamental system challenges in these areas and investigating system solutions that are efficient and easy to use. I am always looking for self-motivated undergraduate, Master and PhD students. Feel free to drop me an email if you are interested.
News (more...)
| Sep 25, 2026 | Two papers on LLM scheduling, SageSched and Justitia, are accepted by NeurIPS 2026. Congratulations to Zhenghao and Mingyan! |
|---|---|
| Sep 23, 2026 | The Impeller work, which accelerates zero-knowledge proof generation via graph compilation on heterogeneous CPU-GPU systems, is accepted by ASPLOS 2027. |
| Sep 16, 2026 | One paper on efficient serving of agentic LLM workflows is accepted by NPC 2026. Congratulations to Jinglin! |
| Aug 06, 2026 | Our APNet 2026 paper on serving network-intensive LLM inferences receives the Best Paper Runner-up Award. Congratulations to Weiye! |
| Jul 02, 2026 | One paper on scalable and efficient zero-knowledge proof computation is accepted by SC 2026. |
| Jul 01, 2026 | One paper is accepted by ICPP 2026. |
| May 29, 2026 | We release three preprints respectively on efficient sparse attention, agent serving and multimodal model training. |
| May 28, 2026 | One paper is accepted by ACM TACO and two papers are accepted by IEEE JCC. |
| Apr 30, 2026 | One paper on memory-efficient LLM inference is accepted by ICML. Congratulations to Ruoling! |
| Apr 28, 2026 | One paper on accelerating diffussion model training is accepted by ICDCS. |
| Apr 22, 2026 | One paper on accelerating emerging network-intenstive LLM inferences is accepted by APNet 2026. Congratulations to Weiye! |
| Apr 20, 2026 | One paper is accepted by TPDS. Congratulations to Na Lyu, Jiayi Zhang and Zhi Shen! |
| Mar 25, 2026 | Four papers on LLM scheduling and deployment are released on Arxiv. |
| Mar 14, 2026 | One Hermes work, which remarkably accelerates LLM agent serving with a novel probabilistic demand model, is accepted by ACM TACO. Congratulations to Yifei, Zuo, Zhenghao and Weiye! |
| Mar 10, 2026 | One paper is accepted by TMC. Congratulations to Jiayi and Zuo! |
| Feb 28, 2026 | One paper is accepted by TPDS. Congratulations to Zuo and Jiayi! |
| Feb 21, 2026 | Our work on efficient training job configuration is accepted by CVPR’26. Congratulations to Guanjie! |
| Jan 31, 2026 | Two papers on efficient scheduling of LLM training jobs are accepted by EuroSys’26. Congratulations to Yuxuan and Yanbo! |
| Jan 26, 2026 | One paper is accepted by ICLR’26. |
| Jan 21, 2026 | The RetroInfer paper is accepted by VLDB’26. |
| Dec 08, 2025 | One paper accepted by ToN. Congratulations to Jiayi and Zuo! |
| Oct 18, 2025 | One paper on deep learning job scheduling is accepted by TCC. |
| Oct 15, 2025 | The SemanticPrefetcher work is accepted by CloudCom 2025. Congratulations to Tianze! |
| Sep 19, 2025 | The RetrievalAttention work is accepted by NeurIPS 2025. Congratulations to Di! |
| Sep 05, 2025 | One paper on attaining efficient and also fair scheduling for model training jobs accepted by ACM TACO. Congratulations to Yifei! |
| Aug 19, 2025 | One paper on serverless computing accepted by IEEE Transactions on Services Computing. |
| Jun 16, 2025 | One paper accepted by VLDB. |
| Jun 14, 2025 | Two papers respectively on LLM Agent Serving and Unified AI Caching released on Arxiv. |
| May 08, 2025 | One paper on GPU serverless computing accepted by TACO. |
| Mar 27, 2025 | Two papers respectively on LLM application scheduling and Federated Learning accepted by IEEE ICDCS. |
| Mar 22, 2025 | One paper is accepted by ISCA. |
| Dec 21, 2024 | One paper on GPU cluster scheduling is accepted by TACO. |
| Dec 20, 2024 | One paper on GPU resource pooling is accepted by IPDPS 2025. |
| Dec 16, 2024 | The RetrievalAttention work wins the best paper award of the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing. |
| Oct 10, 2024 | The RetrievalAttention work is accepted by the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP). |
| Sep 16, 2024 | RetrievalAttention on accelerating long-context LLM Inference is released on arXiv. |
| Jun 21, 2024 | Our poster on LLM Inference is awarded the Best Poster Award on IWQoS’24. |
| Jun 11, 2024 | FedCA on Federated Learning is accepted by ICPP’24. |
| Apr 15, 2024 | PAS on Federated Learning is accepted by IWQoS’24. |
| Mar 21, 2024 | Parrot on accelerating LLM inference via the abstraction of Semantic Variable is accepted by OSDI’24. |
| Dec 01, 2023 | One paper on Federated Learning accepted by INFOCOM’24. |
| Jan 25, 2023 | APF accepted to IEEE Trans. Parallel and Distributed Systems as an extended version of ICDCS ’21. |
| Nov 30, 2022 | GIFT accepted to JSAC, special issue on Communication-Efficient Distributed Learning over Networks. |
| Sep 09, 2022 | Proposal funded by National Natural Science Foundation of China (Youth Program). |
| Jun 30, 2022 | Awarded CCF-Huawei Populus Grove Fund. |
| Jan 01, 2022 | Started my career at SJTU as an associate professor. |
Teaching
- CS7331, Advanced Computer Architecture (for CS Postgraduates), 2023/2024/2025/2026 Fall.
- SE3357, Operating System (for John Class), 2023/2024/2025/2026 Spring.
- CS2951, Computer System I (for John Class), 2024/2025 Fall.
- Head Teacher for John Hopcroft Class (john2332), 2023-2027.
- COMP3511, Operating System (TA at HKUST), 2015-2017.
Honors
- Best Paper Runner-up, APNet, 2026
- Excellent Paper Award, IEEE CloudCom, 2025
- 上海交通大学优秀班主任, 2024
- Best Paper Award, NeurIPS Workshop on ENLSP, 2024
- Best Poster Award, IEEE/ACM IWQoS, 2024
- Distinguished Artifact Award Runner-up, IEEE HPCA, 2024
- StarTrack Scholar, Microsoft Research Asia, 2023
- Pujiang Talent, Shanghai, 2022
- Huawei Innovation Pioneer, 2019H2, 2020H1, 2020H2
- Best In-Session Presentation Award, IEEE INFOCOM, 2019
- Postgraduate Studentship, HKUST, 2014-2018
- Best In-Session Presentation Award, IEEE INFOCOM, 2017
- Fellowship for Oversea Exchange, Tsinghua University, 2013
- National Encouragement Scholarship, Tsinghua University, 2012.
- Zheng Ge-ru Scholarship, Tsinghua University, 2011.
- Outstanding Student, Henan Province, 2010.
Professional Services
- Technical Program Committee for INFOCOM 2024, ICDCS 2023/2024/2025/2026, IWQoS 2024, ICPADS 2024, NPC 2026, HPCChina 2026
- Reviewer for TPDS, ToN, TCC, JSAC, TIFS
- Web Chair for ICA3PP 2023
- Student Travel Grant Chair for APNet 2023