Yawen Wu


Summary

Yawen Wu is currently a fifth year Ph.D candidate in machine learning at the Department of Computer Engineering, the University of Pittsburgh, advised by Dr. Jingtong Hu and has close collaboration with Dr. Yiyu Shi.

He is currently working on algorithm design and optimization to improve the efficiency and performance of machine learning algorithms and systems. My research interests are efficient deep learning and computer vision on edge devices, self-supervised learning, and federated learning. I have published 10 papers as the first author on these topics, generating more than 100 citations.

Research Interests

  • On-device machine learning.
  • Federated learning.
  • Self-supervised learning.
  • Medical applications of machine learning.

Work Experience

Research Intern, Meta (formerly Facebook), Reality Labs Research, May 2022 - Aug. 2022.
* Project: On-device machine learning for distributed AR glasses.

Deep Learning Research Intern, Baidu USA, Sept. 2021 - Dec. 2021.
* Project: Efficient machine learning model deployment on AI Infrastructures.


Publications

Google Scholar Profile and DBLP

Decentralized Unsupervised Learning of Visual Representations (Acceptance rate 15%) [pdf]
Yawen Wu, Zhepeng Wang, Dewen Zeng, Meng Li, Yiyu Shi, Jingtong Hu
in Proc. of the 31st International Joint Conference on Artificial Intelligence(IJCAI 2022), July 2022.

Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruning [Video][Slides][arXiv]
Yawen Wu, Zhepeng Wang, Yiyu Shi, Jingtong Hu
in Proc. of International Conference on Compilers, Architecture, and Synthesis for Embedded Systems (CASES), in conjunction with ESWEEK, Oct. 2020.
Also appears as part of the ESWEEK-TCAD Special Issue, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (IEEE TCAD).

Intermittent Inference with Nonuniformly Compressed Multi-Exit Neural Network for Energy Harvesting Powered Devices [Video][Slides][arXiv]
Yawen Wu, Zhepeng Wang, Zhenge Jia, Yiyu Shi, Jingtong Hu
in Proc. of IEEE/ACM Design Automation Conference (DAC), 2020. (acceptance rate 23%)

Enabling On-Device Self-Supervised Contrastive Learning With Selective Data Contrast [Video][Slides][arXiv]
Yawen Wu, Zhepeng Wang, Dewen Zeng, Yiyu Shi, Jingtong Hu
in Proc. of IEEE/ACM Design Automation Conference (DAC), 2021.

FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosis (Early accept, acceptance rate 13%) [arxiv]
Yawen Wu*, Dewen Zeng* (* equal contribution), Xiaowei Xu, Yiyu Shi, Jingtong Hu
in Proc. The 25th Medical Image Computing and Computer Assisted Interventions (MICCAI 2022), Sept. 2022.

Federated Contrastive Learning for Dermatological Disease Diagnosis via On-device Learning [arXiv]
Yawen Wu, Dewen Zeng, Zhepeng Wang, Yi Sheng, Lei Yang, Alaina J. James, Yiyu Shi, Jingtong Hu
in Proc. of IEEE/ACM International Conference on Computer-Aided Design (ICCAD 2021), Nov. 2021.

Federated Contrastive Learning for Volumetric Medical Image Segmentation (Early accept, acceptance rate 13%) [arXiv]
Award Nomination: MICCAI Society Young Scientist
Yawen Wu, Dewen Zeng, Zhepeng Wang, Yiyu Shi, Jingtong Hu
in Proc. The 24th Medical Image Computing and Computer Assisted Interventions (MICCAI 2021), Sept. 2021.

Distributed Contrastive Learning for Medical Image Segmentation [pdf]
Yawen Wu, Dewen Zeng, Zhepeng Wang, Yiyu Shi, Jingtong Hu
Medical Image Analysis (in print) (Impact factor=8.5), 2022.

Cooperative Communication Between Two Transiently Powered Sensor Nodes by Reinforcement Learning
Yawen Wu, Zhenge Jia, Fei Fang, Jingtong Hu
IEEE Transactions on COMPUTER-AIDED DESIGN of Integrated Circuits and Systems (TCAD), Jan. 2021.

Positional Contrastive Learning for Volumetric Medical Image Segmentation [arXiv]
Dewen Zeng, Yawen Wu, Xinrong Hu, Xiaowei Xu, Haiyun Yuan, Meiping Huang, Jian Zhuang, Yiyu Shi, Jingtong Hu
in Proc. The 24th Medical Image Computing and Computer Assisted Interventions (MICCAI 2021), Sept. 2021.

The Larger The Fairer? Small Neural Networks Can Achieve Fairness for Edge Devices
Yi Sheng, Junhuan Yang, Yawen Wu, Kevin Mao, Yiyu Shi, Jingtong Hu, Weiwen Jiang, Lei Yang
in Proc. The 59th IEEE/ACM Design Automation Conference (DAC 2022) , July 2022.

Energy-Aware Adaptive Multi-Exit Neural Network Inference Implementation for a Millimeter-Scale Sensing System
Yuyang Li, Yawen Wu, Xincheng Zhang, Jingtong Hu, Inhee Lee
IEEE Transactions on Very Large Scale Integration (VLSI) Systems (TVLSI), April 2022.

Algorithm-Hardware Co-design of Attention Mechanism on FPGA Devices
Xinyi Zhang, Yawen Wu, Peipei Zhou, Xulong Tang, Jingtong Hu
in Proc. International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS) in conjunction with (ESWEEK), Virtual, Oct. 2021.
Also appears as part of the ESWEEK-TECS Special Issue, ACM Transactions on Embedded Computing Systems (ACM TECS).

Enabling Weakly-Supervised Temporal Action Localization from On-Device Learning of the Video Stream
Yue Tang, Yawen Wu, Peipei Zhou, Jingtong Hu
in Proc. International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS) in conjunction with (ESWEEK), Shanghai, China, Oct. 7-14, 2022.
Also appears as part of the ESWEEK-TECS Special Issue, ACM Transactions on Embedded Computing Systems (ACM TECS).

Developing a Miniature Energy-Harvesting-Powered Edge Device with Multi-Exit Neural Network
Yuyang Li, Yawen Wu, Xincheng Zhang, Ehab Hamed, Jingtong Hu, Inhee Lee
in Proc. IEEE Int'l Symposium on Circuits & Systems (ISCAS 2021), May, 2021.

Lightweight Run-Time Working Memory Compression for Deployment of Deep Neural Networks on Resource-Constrained MCUs
Zhepeng Wang, Yawen Wu, Zhenge Jia, Yiyu Shi, Jingtong Hu
The 26th Asia and South Pacific Design Automation Conference (ASP-DAC 2021), Jan. 2021.

Cooperative Communication Between Two Transiently Powered Sensors by Reinforcement Learning: Work-in-Progress
Yawen Wu, Zhenge Jia, Fei Fang, Jingtong Hu
in Proc. of International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS). IEEE, 2019.

Prototyping Energy Harvesting Powered Systems with Nonvolatile Processor
Yawen Wu, Yinan Sun, Zhenge Jia, Lefan Zhang, Yongpan Liu, Jingtong Hu
in Proc. of International Symposium on Rapid System Prototyping (RSP). IEEE, 2018.

Implementation of Multi-Exit Neural-Network Inferences for an Image-Based Sensing System with Energy Harvesting
Yuyang Li, Yuxin Gao, Minghe Shao, Joseph T. Tonecha, Yawen Wu, Jingtong Hu, Inhee Lee
Journal of Low Power Electronics and Applications (JLPEA), Sept. 2021.

Opportunistic Communication with Latency Guarantees for Intermittently-Powered Devices
Kacper Wardega, Wenchao Li, Hyoseung Kim, Yawen Wu, Zhenge Jia, Jingtong Hu
in Proc. The ACM/IEEE Design, Automation and Test in Europe (DATE 2022) , ANTWERP, BELGIUM, March 2022.


Academic Service

Conference Reviewer or Program Committee

  • ECCV 2022
  • AAAI 2023
  • ICML Workshop 2022
  • MLSys AE 2022
  • Medical Image Computing and Computer Assisted Interventions (MICCAI) 2022
  • MICCAI Workshop on Distributed, Collaborative and Federated Learning 2022
  • International Conference on Image and Graphics (ICIG) 2021

Journal Reviewer

  • IEEE Transactions on Medical Imaging (TMI, IF=13.9)
  • Medical Image Analysis (MEDIA, IF=8.5)
  • IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD, IF=2.807)
  • IEEE Transactions on Cyber-Physical Systems (TCPS)
  • Journal of Systems Architecture (JSA)
  • IEEE Embedded Systems Letters (ESL)

Awards

  • MICCAI Society Young Scientist Award Nomination, 2021, USA
  • The Medical Image Computing and Computer Assisted Intervention Society (MICCAI) student travel award, 2021, USA
  • Young student fellow award, Design Automation Conference(DAC), 2020, USA
  • Young student fellow award, Design Automation Conference(DAC), 2019, USA
  • National scholarship (Top scholarship for undergraduates in China, 2%), 2010, China
  • Top prize in national Freescale (NXP) Cup autonomous car racing competition, 2012, China [Video]
  • First prize in national electronic design competition of Shandong province, 2011, China
  • First-class outstanding students scholarship, Shandong University, 2010, 2011 and 2012, China
  • Research and innovation scholarship of Shandong University, 2011 and 2012, China
  • Outstanding individual of innovation activities of Shandong university, 2013, China
  • First prize in science and technology innovation contest of Shandong university, 2012, China

Teaching

  • Problem Solving with C++, Teaching Assistant, Aug. 2019 - Dec. 2019
  • Special Topics: Electronic Microprocessor Systems, Teaching Assistant, Aug. 2018 - April 2019
  • Computer Organization, ECE 0142, Teaching Assistant, Jan. 2018 - April 2018

Activities

  • SHREC Annual Workshop 19-20, FL, USA, Jan. 2020
  • Intel International Science and Engineering Fair (ISEF) - Judge, PA, USA, Jan. 2018

Leading R&D Projects

  • Self-balancing scooter [Video], 2014 - 2015
  • Music analyzer and LED display in the frequency domain [Video], 2014
  • Software development for Ethernet switch based on embedded Linux, 2016 - 2017
  • Development of medical ventilator based on embedded Linux and RTOS, 2013 - 2016
  • Development of micro quadcopter, 2013
  • Development of monitoring instrument for the power grid, 2013
  • Development of TCP/IP communication module for instruments, 2012

Contact

  • Email: yawen.wu [AT] pitt [DOT] edu
  • Github: https://github.com/sdwuyawen
  • Address: 4420 Bayard Street, Pittsburgh, PA 15213, United States of America