I am a fourth-year PhD student at Tsinghua Statistical Artificial Intelligence & Learning (TSAIL), advised by Prof. Jianfei Chen. My research focuses on efficient machine learning, particularly model compression for large language models, including pruning, sparsity, distillation, and quantization. Prior to my PhD, I received my bachelor’s degree in Applied Mathematics from Tsinghua University. I am currently a research intern at Tencent TEG, where I work on model compression and efficient deployment of large-scale models.

Research Interests

My research interests is mainly efficient machine learning, particularly model pruning, distillation and quantization.

Selected Publications

• Deterministic Differentiable Structured Pruning for Large Language Models [arXiv] [Project page]

  Weiyu Huang, Pengle Zhang, Xiaolu Zhang, Jun Zhou, Jun Zhu, Jianfei Chen

  International Conference on Machine Learning (ICML), 2026

• Pruning large language models with semi-structural adaptive sparse training [arXiv] [PDF] [Project page]

  Weiyu Huang, Yuezhou Hu, Guohao Jian, Jun Zhu, Jianfei Chen

  Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2025

• Accelerating Transformer Pre-training with 2:4 Sparsity [arXiv] [OpenReview] [PDF] [Project page]

  Yuezhou Hu, Kang Zhao, Weiyu Huang, Jianfei Chen, Jun Zhu

  International Conference on Machine Learning (ICML), 2024

Preprints

• CAST: Continuous and Differentiable Semi-Structured Sparsity-Aware Training for Large Language Models [arXiv]

  Weiyu Huang, Yuezhou Hu, Jun Zhu, Jianfei Chen

  In submission to IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

• Identifying sensitive weights via post-quantization integral [arXiv]

  Yuezhou Hu, Weiyu Huang, Zichen Liang, Chang Chen, Jintao Zhang, Jun Zhu, Jianfei Chen

Academic Service

• Reviewer for ICML, NeurIPS, AAAI and IEEE TPAMI

Awards

• Gold Reviewer, ICML 2026
• Comprehensive Merit Scholarship (Top 5%), Tsinghua University, 2023 and 2025
• Silver Medal, 35th Chinese Physics Olympiad for High School Students, 2018

Contact

Feel free to contact me via email at hwy23@mails.tsinghua.edu.cn.