Bio

I am currently a PhD student at the School of CS, the University of Sydney (USYD), under the supervision of Prof. Dacheng Tao. Before that, I received BEng from SASEE, Beihang University and MPhil in Computer Science from USYD in 2019 and 2022, respectively. My research interests include data-centric AI, knowledge extraction of large-scale datasets, and deep learning theory.

Selected Publications

* indicates co-first authors

  • Offline Behavior Distillation [paper][code][poster]
    Shiye Lei, Sen Zhang, and Dacheng Tao
    Advances in Neural Information Processing Systems (NeurIPS), 2024

  • A Comprehensive Survey of Dataset Distillation [paper]
    Shiye Lei and Dacheng Tao
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

  • Attentive Learning Facilitates Generalization of Neural Networks [paper][code]
    Shiye Lei, Fengxiang He, Haowen Chen, and Dacheng Tao
    IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2024

  • Understanding Deep Learning via Decision Boundary [paper]
    Shiye Lei, Fengxiang He, Yancheng Yuan, and Dacheng Tao
    IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023

  • Image Captions are Natural Prompts for Text-to-Image Models [paper]
    Shiye Lei*, Hao Chen*, Sen Zhang, Bo Zhao, and Dacheng Tao
    arXiv preprint 2023

Teaching Assistant

  • 2024 S2, COMP5318 Machine Learning and Data Mining

Academic Service

  • Conference reviewer: ICML, NeurIPS, ICLR, AISTATS, CVPR, MM, etc.

  • Journal reviewer: Machine Learning, Neurocomputing, etc.

Contact

leishiye@gmail.com
shiye.lei@sydney.edu.au