Youjie Li

Ph.D. (ABD) at UIUC

Looking for a Job!


I am a Ph.D. (ABD) at UIUC ECE and am graduating this December 2022. I am actively looking for a job (Researcher, Post-doc, Research Engineer, or Software Engineer). Feel free to email me : )


My research surrounds Distributed and Parallel Training, which spans the areas of Efficient Machine Learning, System Optimizations, and Hardware Acceleration. I am one of the pioneers who studied pipelined data parallelism (NeurIPS'18) and in-network acceleration for distributed training with SmartNICs (MICRO'18) and programmable switches (ISCA'19). Recently, I am in massive model training systems (VLDB'22) and GNN training systems (MLSys'22).


As a mature Ph.D., I am capable of not only independently creating research projects from scratch but also mentoring fresh Ph.D. students to publications as well as writing successful funding proposals.

I am advised by Prof. Nam Sung Kim and have been working with Dr. Amar Phanishayee at Microsoft Research. I also worked with Dr. Anirudh Badam at Microsoft ResearchProf. Yingyan Lin at Georgia Tech, Prof. Alexander Schwing at UIUC, and Dr. Ren Wang at Intel Labs.

Before joining UIUC in 2016, I received my Master of Science from ECE of Texas A&M University. I was advised by Prof. Peng Li and was working on Hardware Systems for Spiking Neural Networks.



(VLDB'22) Harmony: Overcoming the Hurdles of GPU Memory Capacity to Train Massive DNN Models on Commodity Servers

Youjie Li, Amar Phanishayee, Derek Murray, Jakub Tarnawski, Nam Sung Kim
The 48th International Conference on Very Large Databases (VLDB), 2022.

[pdf] [slides] [video] [code] [bibtex]

(MLSys'22) BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node Sampling

Cheng Wan*, Youjie Li*, Ang Li, Nam Sung Kim, Yingyan Lin

(*Equal contribution)

The Fifth Conference on Machine Learning and Systems (MLSys), 2022. Acceptance rate of 20%.

[pdf] [slides] [video] [code] [bibtex]

(ICLR'22) PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication

Cheng Wan, Youjie Li, Cameron R. Wolfe, Anastasios Kyrillidis, Nam Sung Kim, Yingyan Lin
The Tenth International Conference on Learning Representations (ICLR), 2022.

[pdf] [slides] [video] [code] [bibtex]

(MobiCom'21) Visage: Enabling Timely Analytics for Drone Imagery

Sagar Jha*, Youjie Li*, Shadi Noghabi, Vaishnavi Ranganathan, Peeyush Kumar, Andrew Nelson, Michael Toelle, Sudipta Sinha, Ranveer Chandra, Anirudh Badam

(*Co-first author, Alphabetical order)

The 27th International Conference on Mobile Computing and Networking (MobiCom), 2021. Acceptance rate of 19%.

[pdf] [code deployed in Microsoft's FarmBeats project] [bibtex]

(HotOS'21) Doing More with Less: Training Large DNN Models on Commodity Servers for the Masses

Youjie Li, Amar Phanishayee, Derek Murray, Nam Sung Kim

The 18th Workshop on Hot Topics in Operating Systems (HotOS XVIII), 2021. Acceptance rate of 26%.

[pdf] [slides] [video] [bibtex]

(MICRO'19) DeepStore: In-Storage Acceleration for Intelligent Queries

Vikram S Mailthody, Zaid Qureshi, Weixin Liang, Ziyan Feng, SimonGarcia de Gonzalo, Youjie Li, Hubertus Franke, Jinjun Xiong, Jian Huang, Wen-mei Hwu

The 52nd International Symposium on Microarchitecture (MICRO), 2019. Acceptance rate of 23%.

[pdf] [slides] [bibtex]

(ISCA'19) Accelerating Distributed Reinforcement Learning with In-Switch Computing

Youjie Li, Iou-Jen Liu, Yifan Yuan, Deming Chen, Alexander Schwing, Jian Huang

The 46th International Symposium on Computer Architecture (ISCA), 2019. Acceptance rate of 17%.

[pdf[slides] [bibtex]

(NeurIPS'18) Pipe-SGD: A Decentralized Pipelined SGD Framework for Distributed Deep Net Training

Youjie Li, Mingchao Yu, Songze Li, Salman Avestimehr, Nam Sung Kim, Alexander Schwing

Advances in Neural Information Processing Systems (NeurIPS), 2018. Acceptance rate of 20%.

[pdf[poster] [bibtex]

(NeurIPS'18) GradiVeQ: Vector Quantization for Bandwidth-Efficient Gradient Aggregation in Distributed CNN Training

Mingchao Yu, Zhifeng Lin, Krishna Narra, Songze Li, Youjie Li, Nam Sung Kim, Alexander Schwing, Murali Annavaram, Salman Avestimehr

Advances in Neural Information Processing Systems (NeurIPS), 2018. Acceptance rate of 20%.

[pdf[poster] [bibtex]

(MICRO'18) A Network-Centric Hardware/Algorithm Co-Design to Accelerate Distributed Training of Deep Neural Networks

Youjie Li, Jongse Park, Mohammad Alian, Yifan Yuan, Zheng Qu, Peitian Pan, Ren Wang, Alexander Schwing, Hadi Esmaeilzadeh, Nam Sung Kim

The 51st International Symposium on Microarchitecture (MICRO), 2018. Acceptance rate of 21%.

[pdf[slides] [bibtex]

(Neurocomputing'17) Energy Efficient Parallel Neuromorphic Architectures with Approximate Arithmetic on FPGA

Qian Wang, Youjie Li, Botang Shao, Siddhartha Dey, Peng Li

Neurocomputing, 2017.

[pdf] [bibtex]

(ISCAS'16) Liquid State Machine based Pattern Recognition on FPGA with Firing-Activity Dependent Power Gating and Approximate Computing

Qian Wang, Youjie Li, Peng Li

The IEEE International Symposium on Circuits and Systems (ISCAS), 2016. 

Best Paper Award

[pdf] [bibtex]


Research Intern

  • Microsoft Research, Redmond, Summer 2020​​​​

    • Amazing mentor: Dr. Amar Phanishayee​

    • Project: Efficient Parallel Training of Massive DNN Models

  • Microsoft Research, Redmond, Summer 2019​​​​

    • Amazing mentors: Dr. Anirudh Badam, Dr. Ranveer Chandra, Dr. Amar Phanishayee​

    • Project: Efficient Inference of Mobile DNNs

  • IBM Research, Yorktown, Summer 2018

    • ​Project: System Acceleration for Large DNN Training

  • IBM Research, Austin, Summer 2017

    • ​Project: Efficient Communication for Distributed DNN Training

"Tenured" Teaching Assistant​

  • ECE385 Digital Systems Laboratory, Fall 2018 & Spring 2022 & Fall 2022

  • ECE411 Computer Architecture, Spring 2021 & Fall 2021

  • ECE438 Computer Networks, Fall 2019

  • ECE446 Machine Learning, Spring 2018

Peer Reviewer​

  • TNNLS, 2022

  • ICCV, 2021

  • NeurIPS, 2020
  • SIGCOMM, 2020


  • Dan Vivoli Endowed Fellowship, ECE, UIUC, 2019-2020

  • Best Paper Award, The IEEE International Symposium on Circuits and Systems (ISCAS), 2016

  • ECE Department Scholarship, Texas A&M University, 2014-2015



  • It's hard to pronounce my name correctly. My name can be pronounced as "Yo-Jay Lee".

  • My last name is actually "黎" : )

  • My dream life is doing research only 996, while playing badminton every week. Yo~


li238 [at] illinois [dot] edu

​FAST Lab, W Main St, Urbana, IL 61801

  • 687474703a2f2f7777772e7075626c69632e6173
  • LinkedIn Social Icon
  • Facebook Social Icon