Zhu Profile Photo

Shengkun Zhu

Supervised by Prof. Yang Liu and Prof. Qiang Yang

📧 shengkun96.zhu@polyu.edu.hk 🏛️ The Hong Kong Polytechnic University 🎓 Google Scholar 🌐 GitHub

🔬 Research Interests

Gauss–Seidel vs. Jacobi Iteration

I am currently interested in one central question: the contrasting convergence behavior of Gauss–Seidel (GS) and Jacobi (JC) iterations. This question has accompanied me throughout my research career. It originated from updating matrices A and B in LoRA, where we observed that GS converges significantly faster than JC during the first half of training, yet ultimately achieves worse convergence.

This puzzling phenomenon has also been consistently observed in deep learning, federated learning, and clustering. We have therefore continued to investigate the underlying reason.

Recently, we finally obtained some theoretical insights. If you are interested in this question, please read our paper below. We will continue to explore it in greater depth.

📄 Read the Paper

📚 Publications

No publications found matching your search.
F3KM: Federated, Fair, and Fast k-means
Shengkun Zhu, Quanqing Xu, Jinshan Zeng, Sheng Wang, Yuan Sun, Zhifeng Yang, Chuanhui Yang, Zhiyong Peng
SIGMOD 2024 (CCF A)
2024
📄 PDF
FedAPM: Federated Learning via ADMM with Partial Model Personalization
Shengkun Zhu, Feiteng Nie, Jinshan Zeng, Sheng Wang, Yuan Sun, Yuan Yao, Shangfeng Chen, Quanqing Xu, Chuanhui Yang
KDD 2025 (CCF A)
2025
📄 PDF
Highly-Efficient Large-Scale k-means with Individual Fairness
Shengkun Zhu, Jinshan Zeng, Yuan Sun, Sheng Wang, Yiming Wang, Yushuai Ji, Feiping Nie, Xiaodong Li, Zhiyong Peng
VLDB 2026 (CCF A)
2026
📄 PDF
LoRA-E2: Effective and Efficient Low-rank Adaptation
Shengkun Zhu, Jinshan Zeng, Yiming Wang, Sheng Wang, Yuan Sun, Shangfeng Chen, Yuan Yao, Qiang Yang
WWW 2026 (CCF A)
2026
📄 PDF
BraveANN: Robust Approximate Nearest Neighbor Search for Billion-Scale Vectors
Shengkun Zhu, Yiming Wang, Xin Jin, Jinshan Zeng, Sheng Wang, Yuan Sun, Yuhui Lai, Zhiyong Peng
WWW Journal (CCF B)
2026
📄 PDF
Federated and Balanced Clustering for High-dimensional Data
Yushuai Ji, Shengkun Zhu (Co-first author), Shixun Huang, Zepeng Liu, Sheng Wang, Zhiyong Peng
VLDB 2025 (CCF A)
2025
📄 PDF

🎓 Education

Ph.D. - Computer Science and Technology

Wuhan University | 2023.09-2026.06

Advised by Prof. Sheng Wang and Prof. Zhiyong Peng

B.S. - Electronic Information Engineering

Dalian University of Technology | 2014.09-2018.06

🏆 Honors & Awards

National Scholarship

Wuhan University | 2023

DiDi Scholarship Second Prize

Wuhan University | 2024

DiDi Scholarship Third Prize

Wuhan University | 2025

Huawei Scholarship

Wuhan University | 2025

🐱 Misc.

🏠 My Feline Family

These are my beloved cats who accompany me through long research hours. They are not just pets, but faithful companions who bring joy and inspiration to my academic journey.

📖 Academic Service

Journal Reviewer

JMLR, IEEE TKDE, ACM TKDD