Chen Chen
Associate Professor, Doctoral Supervisor

SEIEE 3-119, SJTU
I am a tenure-track associate professor in the John Hopcroft Center for Computer Science (affiliated under the School of Electronic Information and Electrical Engineering), Shanghai Jiao Tong University. At SJTU, I am also a member of Emerging Parallel Computing Center (EPCC). Prior to joining SJTU, I worked as a Researcher at Huawei Hong Kong Research Center (2012 Labs) from Aug. 2018 to Dec. 2021. I obtained my PhD degree in Department of Computer Science and Engineering from Hong Kong University of Science and Technology, under the supervision of Prof. Bo Li and Prof. Wei Wang. During my PhD studies, I also had a fantastic visiting experience at the University of Toronto under the supervision of Prof. Baochun Li. I obtained my Bachelor degree in 2014 from the Department of Automation, Tsinghua Univerity.
My research aims at optimizing distributed systems supporting modern applications, with a special focus on machine learning applications in topics of Federated Learning, Deep Learning Scheduling and LLM Inference. I am particularly interested in identifying fundamental system challenges in these areas and investigating system solutions that are efficient and easy to use. I am always looking for self-motivated undergraduate, Master and PhD students. Feel free to drop me an email if you are interested.
News..
Dec 21, 2024 | One paper on GPU cluster scheduling is accepted by TACO. |
---|---|
Dec 20, 2024 | One paper on GPU resource pooling is accepted by IPDPS 2025. |
Dec 16, 2024 | The RetrievalAttention work wins the best paper award of the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing. |
Oct 10, 2024 | The RetrievalAttention work is accepted by the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP). |
Sep 16, 2024 | RetrievalAttention on accelerating long-context LLM Inference is released on arXiv. |
Jun 21, 2024 | Our poster on LLM Inference is awarded the Best Poster Award on IWQoS’24. |
Selected Publications
- ENLSPRetrievalAttention: Accelerating Long-Context LLM Inference via Vector RetrievalIn the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing (Spotlight), 2024
- ICPPFedCA: Efficient Federated Learning with Client AutonomyIn Proceedings of the 53rd ACM International Conference on Parallel Processing, 2024
- IWQoSPAS: Towards Accurate and Efficient Federated Learning with Parameter-Adaptive SynchronizationIn Proceedings of the IEEE/ACM International Symposium on Quality of Service, 2024
- IWQoS PosterTowards Efficient Compound Large Language Model System Serving in the WildIn Proceedings of the IEEE/ACM International Symposium on Quality of Service, 2024
- INFOCOMDPBalance: Efficient and Fair Privacy Budget Scheduling for Federated Learning as a ServiceIn Proceedings of the IEEE Conference on Computer Communications, 2024
- HPCAAn Optimizing Framework on MLIR for Efficient FPGA-based Accelerator GenerationIn Proceedings of the IEEE International Symposium on High-Performance Computer Architecture, 2024
- SCMetis: Learning to schedule long-running applications in shared container clusters at scaleIn Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, 2020
- INFOCOMRound-robin synchronization: Mitigating communication bottlenecks in parameter serversIn Proceedings of the IEEE Conference on Computer Communications, 2019
Teaching
- SE3357, Operating System (for John Class, with Prof. Quan Chen), 2025Spring.
- CS2951, Computer System I (for John Class, with Prof. Yu Feng), 2024Fall.
- CS7331, Advanced Computer Architecture (for CS Postgraduates, with Prof. Jieru Zhao), 2024Fall.
- SE3357, Operating System (for John Class, with Prof. Quan Chen), 2024Spring.
- Head Teacher for John Hopcroft Class (john2332), 2023-2027.
- CS7331, Advanced Computer Architecture (for CS Postgraduates, with Prof. Quan Chen), 2023Fall.
- SE3357, Operating System (for John Class, with Prof. Quan Chen), 2023Spring.
- COMP3511, Operating System (TA at HKUST), 2015-2017.
Honors
- StarTrack Scholar, Microsoft Research Asia, 2023
- Pujiang Talent, Shanghai, 2022
- Huawei Innovation Pioneer, 2019H2, 2020H1, 2020H2
- Postgraduate Studentship, HKUST, 2014-2018
- Fellowship for Oversea Exchange, Tsinghua University, 2013
- National Encouragement Scholarship, Tsinghua University, 2012.
- Zheng Ge-ru Scholarship, Tsinghua University, 2011.
- Outstanding Student, Henan Province, 2010.
Professional Services
- Technical Program Committee for INFOCOM 2024, ICDCS 2023/2024/2025, IWQoS 2024, ICPADS 2024
- Reviewer for TPDS, ToN, TCC, JSAC, TIFS
- Web Chair for ICA3PP 2023
- Student Travel Grant Chair for APNet 2023