Chen Chen

Associate Professor, Doctoral Supervisor

chen.jpg

SEIEE 3-119, SJTU

I am a tenure-track associate professor in the John Hopcroft Center for Computer Science (affiliated under the School of Electronic Information and Electrical Engineering), Shanghai Jiao Tong University. At SJTU, I am also a member of Emerging Parallel Computing Center (EPCC). Prior to joining SJTU, I worked as a Researcher at Huawei Hong Kong Research Center (2012 Labs) from Aug. 2018 to Dec. 2021. I obtained my PhD degree in Department of Computer Science and Engineering from Hong Kong University of Science and Technology, under the supervision of Prof. Bo Li and Prof. Wei Wang. During my PhD studies, I also had a fantastic visiting experience at the University of Toronto under the supervision of Prof. Baochun Li. I obtained my Bachelor degree in 2014 from the Department of Automation, Tsinghua Univerity.

My research aims at optimizing distributed systems supporting modern applications, with a special focus on machine learning applications in topics of Federated Learning, Deep Learning Scheduling and LLM Inference. I am particularly interested in identifying fundamental system challenges in these areas and investigating system solutions that are efficient and easy to use. I am always looking for self-motivated undergraduate, Master and PhD students. Feel free to drop me an email if you are interested.

News..

Dec 21, 2024 One paper on GPU cluster scheduling is accepted by TACO.
Dec 20, 2024 One paper on GPU resource pooling is accepted by IPDPS 2025.
Dec 16, 2024 The RetrievalAttention work wins the best paper award of the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing.
Oct 10, 2024 The RetrievalAttention work is accepted by the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP).
Sep 16, 2024 RetrievalAttention on accelerating long-context LLM Inference is released on arXiv.
Jun 21, 2024 Our poster on LLM Inference is awarded the Best Poster Award on IWQoS’24.

Selected Publications

  1. ENLSP
    RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
    Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Zhenhua Han, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, and Lili Qiu
    In the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing (Spotlight), 2024
  2. ICPP
    FedCA: Efficient Federated Learning with Client Autonomy
    Na Lv, Zhi Shen, Chen Chen, Zhifeng Jiang, Jiayi Zhang, Quan Chen, and Minyi Guo
    In Proceedings of the 53rd ACM International Conference on Parallel Processing, 2024
  3. IWQoS
    PAS: Towards Accurate and Efficient Federated Learning with Parameter-Adaptive Synchronization
    Zuo Gan, Chen Chen, Jiayi Zhang, Gaoxiong Zeng, Yifei Zhu, Jieru Zhao, Quan Chen, and Minyi Guo
    In Proceedings of the IEEE/ACM International Symposium on Quality of Service, 2024
  4. IWQoS Poster
    Towards Efficient Compound Large Language Model System Serving in the Wild
    Yifei Zhu, Botao Zhu, Chen Chen, and Xiaoyi Fan
    In Proceedings of the IEEE/ACM International Symposium on Quality of Service, 2024
  5. OSDI
    Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
    Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, and Lili Qiu
    In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation, 2024
  6. INFOCOM
    DPBalance: Efficient and Fair Privacy Budget Scheduling for Federated Learning as a Service
    Yu Liu, Zibo Wang, Yifei Zhu, and Chen Chen
    In Proceedings of the IEEE Conference on Computer Communications, 2024
  7. HPCA
    An Optimizing Framework on MLIR for Efficient FPGA-based Accelerator Generation
    Weichuang Zhang, Jieru Zhao, Guan Shen, Quan Chen, Chen Chen, and Minyi Guo
    In Proceedings of the IEEE International Symposium on High-Performance Computer Architecture, 2024
  8. ASPLOS
    DataFlower: Exploiting the Data-flow Paradigm for Serverless Workflow Orchestration
    Zijun Li, Chuhao Xu, Quan Chen, Jieru Zhao, Chen Chen, and Minyi Guo
    In Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024
  9. TPDS
    Synchronize Only the Immature Parameters: Communication-Efficient Federated Learning By Freezing Parameters Adaptively
    Chen Chen, Hong Xu, Wei Wang, Baochun Li, Bo Li, Li Chen, and Gong Zhang
    IEEE Transactions on Parallel and Distributed Systems, 2023
  10. JSAC
    GIFT: Towards Accurate and Efficient Federated Learning with Gradient-Instructed Frequency Tuning
    Chen Chen, Hong Xu, Baochun Li, Bo Li, Li Chen, and Gong Zhang
    IEEE Journal on Selected Areas in Communications (special issue on Communication-Efficient Distributed Learning over Networks), 2023
  11. ICDCS
    Communication-Efficient Federated Learning with Adaptive Parameter Freezing
    Chen Chen, Hong Xu, Wei Wang, Baochun Li, Bo Li, Li Chen, and Gong Zhang
    In Proceedings of the IEEE International Conference on Distributed Computing Systems, 2021
  12. SoCC
    Semi-Dynamic Load Balancing: Efficient Distributed Learning in Non-Dedicated Environments
    Chen Chen, Qizhen Weng, Wei Wang, Baochun Li, and Bo Li
    In Proceedings of the ACM Symposium on Cloud Computing, 2020
  13. SC
    Metis: Learning to schedule long-running applications in shared container clusters at scale
    Luping Wang, Qizhen Weng, Wei Wang, Chen Chen, and Bo Li
    In Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, 2020
  14. INFOCOM
    Round-robin synchronization: Mitigating communication bottlenecks in parameter servers
    Chen Chen, Wei Wang, and Bo Li
    In Proceedings of the IEEE Conference on Computer Communications, 2019

Teaching

  • SE3357, Operating System (for John Class, with Prof. Quan Chen), 2025Spring.
  • CS2951, Computer System I (for John Class, with Prof. Yu Feng), 2024Fall.
  • CS7331, Advanced Computer Architecture (for CS Postgraduates, with Prof. Jieru Zhao), 2024Fall.
  • SE3357, Operating System (for John Class, with Prof. Quan Chen), 2024Spring.
  • Head Teacher for John Hopcroft Class (john2332), 2023-2027.
  • CS7331, Advanced Computer Architecture (for CS Postgraduates, with Prof. Quan Chen), 2023Fall.
  • SE3357, Operating System (for John Class, with Prof. Quan Chen), 2023Spring.
  • COMP3511, Operating System (TA at HKUST), 2015-2017.

Honors

  • StarTrack Scholar, Microsoft Research Asia, 2023
  • Pujiang Talent, Shanghai, 2022
  • Huawei Innovation Pioneer, 2019H2, 2020H1, 2020H2
  • Postgraduate Studentship, HKUST, 2014-2018
  • Fellowship for Oversea Exchange, Tsinghua University, 2013
  • National Encouragement Scholarship, Tsinghua University, 2012.
  • Zheng Ge-ru Scholarship, Tsinghua University, 2011.
  • Outstanding Student, Henan Province, 2010.

Professional Services

  • Technical Program Committee for INFOCOM 2024, ICDCS 2023/2024/2025, IWQoS 2024, ICPADS 2024
  • Reviewer for TPDS, ToN, TCC, JSAC, TIFS
  • Web Chair for ICA3PP 2023
  • Student Travel Grant Chair for APNet 2023