Zhengmao Ye

email: yezhengmaolove@gmail.com

I am a PhD student in computer science at IDs Lab of Sichuan University under Prof.Mingjie Tang.

Before pursuing my PhD, I earned my bachelor's degree from Southwest Jiaotong University and worked as a member of the technical staff at Huawei and SenseTime.

I focus on training infrastructure for pre-training to mid-training data preparation and orchestration, large-scale distributed training system design and optimization, and algorithm co-design through joint optimization of algorithms and system architecture.

I am passionate about building efficient and scalable systems for training large-scale language models. Feel free to reach me at my email for collaborations or discussions.

📚 Selected Publications

• Polymorphic Universal Transformer
  Yilong Chen, Zitian Gao, Yihao Xiao, Jason Klein Liu, Xinyu Yang, Yifan Luo, 5 more authors
  Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2026
• LoopCoder: Scaling Code Intelligence via Looped Language Models
  Jian Yang, Wei Zhang, Shuyue Guo, Yizhi Li, Linzheng Chai, Zhengmao Ye, 18 more authors
  Findings of the Association for Computational Linguistics: ACL 2026
• DLRover-LM: LLM Pre-Training Framework with Thousands of Accelerators in AntGroup
  Ziling Huang, Zhengmao Ye, Qingsong Cai, Zelong Huang, Bo Sang, Haitao Zhang, 5 more authors
  42nd IEEE International Conference on Data Engineering (ICDE), 2026
• mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
  Zhengmao Ye, Dengchun Li, Zetao Hu, Tingfeng Lan, Jian Sha, Sicong Zhang, 5 more authors
  Proceedings of Very Large Data Bases Conference (VLDB), 2025