Bio
I am currently a PhD student at School of CS, the University of Sydney (USYD), under the supervision of Prof. Dacheng Tao. Before that, I received BEng from SASEE, Beihang University and MPhil in Computer Science from USYD in 2019 and 2022, respectively. My research interests include data-centric AI, knowledge extraction of large-scale datasets, and deep learning theory.
Publications
* indicates co-first authors
Survey Papers
- A Comprehensive Survey of Dataset Distillation
Shiye Lei and Dacheng Tao
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI, IF=23.6, CORE rank A*), 2024
[paper]
Research Papers
Attentive Learning Facilitates Generalization of Neural Networks
Shiye Lei, Fengxiang He, Haowen Chen, and Dacheng Tao
IEEE Transactions on Neural Networks and Learning Systems (TNNLS, IF=14.2, CORE rank A*), 2024
[paper][code]Understanding Deep Learning via Decision Boundary
Shiye Lei, Fengxiang He, Yancheng Yuan, and Dacheng Tao
IEEE Transactions on Neural Networks and Learning Systems (TNNLS, IF=14.2, CORE rank A*), 2023
[paper]Spectral Complexity-scaled Generalisation Bound of Complex-Valued Neural Networks
Haowen Chen, Fengxiang He, Shiye Lei, and Dacheng Tao
Artificial Intelligence (AIJ, IF=14.4, CORE rank A*), 2023
[paper][code]
Preprints
Image Captions are Natural Prompts for Text-to-Image Models
Shiye Lei*, Hao Chen*, Sen Zhang, Bo Zhao, and Dacheng Tao
arXiv preprint 2023
[paper]Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer
Shiye Lei, Zhuozhuo Tu, Leszek Rutkowski, Feng Zhou, Li Shen, Fengxiang He, and Dacheng Tao
arXiv preprint 2021
[paper]Neural Networks Behave as Hash Encoders: An Empirical Study
Fengxiang He*, Shiye Lei*, Jianmin Ji, and Dacheng Tao
arXiv preprint 2021
[paper][code]
Educations
2022.10 - Present, PhD in Computer Science, the University of Sydney
2020.10 - 2022.08, MPhil in Computer Science, the University of Sydney
2019.02 - 2019.06, Exchange student, Universitat Politècnica de Catalunya
2015.09 - 2019.07, BEng in Automation, Beihang University
Internships
2020.12 - 2022.04, Research Intern, JD Explore Academy, JD.COM.
2019.02 - 2019.06, Research Assistant, Barcelona Computing Center
2018.10 - 2019.02, Research Intern, Matrix AI
Honors and Awards
2022.10, International Tuition Fee Scholarship, the University of Sydney
2022.10, Faculty of Engineering Research Stipend Scholarship, the University of Sydney
2017.09, Excellent Academic Scholarship, Beihang University
Teaching
- 2024 S2, Tutor of COMP5318 Machine Learning and Data Mining
Academic Service
Conference reviewer: NeurIPS (22’-24’), ICLR (24’), ICML (22’), ACM MM (24’), AISTATS (22’-24’), ACML (21’/22’)
Journal reviewer: Machine Learning Journal