Concerto: Automatic Communication Optimization and Scheduling for Large-Scale Deep Learning.

Wei Lin 0016 Alibaba Group, China Microsoft, Redmond, WA, USA https://scholar.google.com/citations?user=LXSkrXkAAAAJ https://openreview.net/profile?id=~Wei_Lin5 https://orcid.org/0000-0002-3003-0150 https://www.wikidata.org/entity/Q130811419 Wei Lin Wei Lin 0001 Case Western Reserve University, Department of Electrical Engineering and Computer Science, Cleveland, OH, USA Harbin Institute of Technology, Shenzhen Graduate School, China Washington University in St. Louis, St. Louis, MO, USA https://engineering.case.edu/about/school-directory/wei-lin http://nonlinear.cwru.edu/~linwei/ https://orcid.org/0000-0003-1718-3539 https://scholar.google.com/citations?user=meBtX7EAAAAJ Wei Lin 0002 National University of Singapore, Singapore Institute of Manufacturing Technology, Singapore http://www.simtech.a-star.edu.sg/about-us/researcher-portfolio/detail.aspx?id=1657 https://orcid.org/0000-0002-3869-6651 https://ieeexplore.ieee.org/author/37278115500 Wei Lin 0003 林伟 Fudan University, School of Mathematical Sciences, Shanghai, China http://homepage.fudan.edu.cn/weilin/?lang=en https://zbmath.org/authors/?q=ai:lin.wei.1 https://orcid.org/0000-0002-1863-4306 https://www.wikidata.org/entity/Q50012678 https://www.researcherid.com/rid/C-9640-2011 Wei Lin 0004 Feng Chia University, School of Architecture, Taichung, Taiwan Hwa Hsia University of Technology, Department of Interior Design, Taipei, Taiwan Chinese Academy of Sciences, Institute of Computing Technology, Key Laboratory of Computer Systems and Architecture, China National Taiwan University of Science and Technology, School of Architecture, Taipei, Taiwan https://archschool.fcu.edu.tw/teachers-detail/?id=T07031&unit_id=AS00 https://orcid.org/0000-0001-9682-3316 Wei Lin 0005 Sun Yat-sen University (Zhongshan University), Department of Mathematics, China Wei Lin 0006 Northwestern Polytechnical University, School of Science, Xi'an, China Northwestern Polytechnical University, Department of Applied Mathematics, Xi'an, China http://web.nwpu.edu.cn/sscience/FacultyandStudents/AssociateProfessor/65883.htm Wei Lin 0007 Northwestern Polytechnical University, School of Computer Science, China Wei Lin 0008 California Institute of Technology Wei Lin 0009 University of Pennsylvania, Department of Radiology, USA Wei Lin 0010 Tsinghua University, Department of Computer Science and Technology, Beijing, China http://s-router.cs.tsinghua.edu.cn/~linwei/ Wei Lin 0011 Oregon State University, Corvallis, OR, USA Wei Lin 0012 State University of New York at Stony Brook, Department of Biomedical Engineering, NY, USA Wei Lin 0013 University of Technology Sydney, Global Big Data Technologies Centre, Ultimo, NSW, Australia City University of Hong Kong, Electronic Engineering, Hong Kong https://orcid.org/0000-0003-0337-8554 https://www.wikidata.org/entity/Q89930726 https://www.researcherid.com/rid/J-8427-2017 https://www.scopus.com/authid/detail.uri?authorId=56437087700 Wei Lin 0014 Baylor Institute for Immunology Research, Dallas, TX, USA Tsinghua University, School of Life Sciences, Beijing, China https://orcid.org/0000-0002-7506-3466 Wei Lin 0015 University of Darmstadt, Germany Wei Lin 0017 Chinese Academy of Sciences, Institute of Computing Technology, Beijing, China https://orcid.org/0000-0003-3939-2067 Wei Lin 0018 City University of Hong Kong, Hong Kong Northwestern Polytechnical University, Center for Optical Imagery Analysis and Learning, Shaanxi, China https://elin24.github.io/ https://scholars.cityu.edu.hk/en/persons/wei-lin(d4e37af5-7376-43aa-afd8-3d860300ac6f).html https://scholar.google.com/citations?user=95iYKsgAAAAJ https://orcid.org/0000-0001-8425-956X https://ieeexplore.ieee.org/author/37087230412 Wei Lin 0019 Graz University of Technology, Austria https://orcid.org/0000-0001-9213-5954 Wei Lin 0020 Peking University, Beijing, China University of Southern California, Department of Mathematics, Los Angeles, CA Fudan University, Laboratory of Nonlinear Mathematics Science, Institute of Mathematics, Shanghai, China https://scholar.google.com/citations?user=DculdNkAAAAJ https://orcid.org/0000-0002-7598-6199 https://www.wikidata.org/entity/Q84572600 https://d-nb.info/gnd/1235857018 https://mathgenealogy.org/id.php?id=174626 Wei Lin 0021 Xiamen University, School of Informatics, China https://orcid.org/0000-0003-4044-897X Wei Lin 0022 Meituan, Beijing, China https://orcid.org/0000-0003-2851-820X https://www.wikidata.org/entity/Q130799259 Wei Lin 0023 Fujian University of Technology, Department of Computer Science and Math, China https://faculty.fjut.edu.cn/19912380/en/index.htm https://orcid.org/0000-0002-7797-2022 Shenggan Cheng Shengjie Lin Lansong Diao Hao Wu 0077 Siyu Wang 0006 Chang Si Ziming Liu Xuanlei Zhao Jiangsu Du Wei Lin 0016 Yang You 0001 Concerto: Automatic Communication Optimization and Scheduling for Large-Scale Deep Learning. 198-213 2025 ASPLOS (1) https://doi.org/10.1145/3669940.3707223 conf/asplos/2025-1 db/conf/asplos/asplos2025-1.html#ChengLDWWSLZD0025 Yangjie Zhou 0001 Wenting Shen Jingwen Leng Shuwen Lu Zihan Liu 0002 Weihao Cui Zhendong Zhang 0004 Wencong Xiao Baole Ai Yong Li 0045 Wei Lin 0016 Deze Zeng Yun Liang 0001 Quan Chen 0001 Ning Liu 0007 Minyi Guo Voyager: Input-Adaptive Algebraic Transformations for High-Performance Graph Neural Networks. 247-263 2025 ASPLOS (3) https://doi.org/10.1145/3676642.3736121 conf/asplos/2025-3 db/conf/asplos/asplos2025-3.html#0001SLL0C0XA00Z25 Shiwei Zhang 0002 Lansong Diao Zisheng Meng Siyu Wang 0006 Wei Lin 0016 Chuan Wu 0001 DyOrc: Efficient Serving of Dynamic Machine Learning Workflows. 111-124 2025 SoCC https://doi.org/10.1145/3772052.3772218 conf/cloud/2025 db/conf/cloud/socc2025.html#0002DMW0025 Shulai Zhang Quan Chen 0002 Weihao Cui Han Zhao 0005 Chunyu Xue Zhen Zheng Wei Lin 0016 Minyi Guo Improving GPU Sharing Performance through Adaptive Bubbleless Spatial-Temporal Sharing. 573-588 2025 EuroSys https://doi.org/10.1145/3689031.3696070 conf/eurosys/2025 db/conf/eurosys/eurosys2025.html#ZhangCC0XZ0G25 Xiulong Yuan Hongtao Xu Wenting Shen Ang Wang Xiafei Qiu Jie Zhang 0135 Yuqiong Liu Bowen Yu 0002 Junyang Lin Mingzhen Li 0001 Weile Jia Yong Li 0045 Wei Lin 0016 Efficient Long Context Fine-tuning with Chunk Flow. 2025 ICML https://proceedings.mlr.press/v267/yuan25m.html https://openreview.net/forum?id=rzn2OgflOK conf/icml/2025 db/conf/icml/icml2025.html#YuanXSWQ0L0L0J025 Ziji Shi Le Jiang Ang Wang Jie Zhang 0135 Chencan Wu Yong Li 0045 Xiaokui Xiao Wei Lin 0016 Jialin Li 0001 TAPAS: Fast and Automatic Derivation of Tensor Parallel Strategies for Large Neural Networks. 804-815 2025 ICPP https://doi.org/10.1145/3754598.3754677 conf/icpp/2025 db/conf/icpp/icpp2025.html#ShiJWZW0X0025 Xinyi Zhang Hanyu Zhao Wencong Xiao Xianyan Jia Fei Xu Yong Li 0045 Wei Lin 0016 Fangming Liu Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling. 2025 MLSys https://openreview.net/forum?id=tuziIJjRj5 https://proceedings.mlsys.org/paper_files/paper/2025/hash/270339c997293ca2988c62f4308e389f-Abstract-Conference.html conf/mlsys/2025 db/conf/mlsys/mlsys2025.html#ZhangZXJX00L25 Jianbo Dong Kun Qian 0004 Pengcheng Zhang Zhilong Zheng Liang Chen 0001 Fei Feng Yichi Xu Yikai Zhu Gang Lu Xue Li 0024 Zhihui Ren Zhicheng Wang Bin Luo Peng Zhang Yang Liu 0245 Yanqing Chen Yu Guan 0005 Weicheng Wang Chaojie Yang Yang Zhang 0102 Man Yuan Hanyu Zhao Yong Li 0008 Zihan Zhao Shan Li Xianlong Zeng Zhiping Yao Binzhang Fu Ennan Zhai Wei Lin 0016 Chao Wang Dennis Cai Evolution of Aegis: Fault Diagnosis for AI Model Training Service in Production. 865-881 2025 NSDI https://www.usenix.org/conference/nsdi25/presentation/dong conf/nsdi/2025 db/conf/nsdi/nsdi2025.html#DongQZZCFXZLLRW25 Jie Sun 0017 Zuocheng Shi Li Su 0005 Wenting Shen Zeke Wang Yong Li 0045 Wenyuan Yu Wei Lin 0016 Fei Wu 0001 Bingsheng He Jingren Zhou 0001 Helios: Efficient Distributed Dynamic Graph Sampling for Online GNN Inference. 2-15 2025 PPoPP https://doi.org/10.1145/3710848.3710854 conf/ppopp/2025 db/conf/ppopp/ppopp2025.html#SunSSSW0YL0HZ25 Jie Lu Jiaqi Gao Fei Feng Zhiqiang He Menglei Zheng Kun Liu Jun He Binbin Liao Suwei Xu Ke Sun Yongjia Mo Qinghua Peng Jilie Luo Qingxu Li Gang Lu Zishu Wang Jianbo Dong Kunling He Sheng Cheng 0002 Jiamin Cao Hairong Jiao Pengcheng Zhang Shu Ma Lingjun Zhu Chao Shi Yangming Zhang Yiquan Chen Wei Wang 0030 Shuhong Zhu Xingru Li Qiang Wang 0022 Jiang Liu Chao Wang Wei Lin 0016 Ennan Zhai Jiesheng Wu Qiang Liu 0036 Binzhang Fu Dennis Cai Alibaba Stellar: A New Generation RDMA Network for Cloud AI. 453-466 2025 SIGCOMM https://doi.org/10.1145/3718958.3750539 conf/sigcomm/2025 db/conf/sigcomm/sigcomm2025.html#LuGFHZLHLXSMPLL25 Renjun Hu Yi Cheng Libin Meng Jiaxin Xia Yi Zong Xing Shi Wei Lin 0016 Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons. 228-237 2025 WWW (Companion Volume) https://doi.org/10.1145/3701716.3715265 conf/www/2025c db/conf/www/www2025c.html#HuCMXZSL25 Yejing Wang Chi Zhang 0060 Xiangyu Zhao 0001 Qidong Liu 0002 Maolin Wang 0001 Xuetao Wei Zitao Liu 0001 Xing Shi Xudong Yang Ling Zhong Wei Lin 0016 Behavior Modeling Space Reconstruction for E-Commerce Search. 1683-1692 2025 WWW https://doi.org/10.1145/3696410.3714949 conf/www/2025 db/conf/www/www2025.html#WangZ000W0SYZL25

Daoyuan Chen Yilun Huang 0004 Xuchen Pan Nana Jiang Haibin Wang Ce Ge Yushuo Chen Wenhao Zhang Zhijian Ma Yilei Zhang Jun Huang 0007 Wei Lin 0016 Yaliang Li Bolin Ding Jingren Zhou 0001 Data-Juicer 2.0: Cloud-Scale Adaptive Data Processing for Foundation Models. 2025 January abs/2501.14755 CoRR https://doi.org/10.48550/arXiv.2501.14755 db/journals/corr/corr2501.html#abs-2501-14755 streams/journals/corr

Yejing Wang Chi Zhang 0060 Xiangyu Zhao 0001 Qidong Liu 0002 Maolin Wang 0001 Xuewei Tao Zitao Liu 0001 Xing Shi Xudong Yang Ling Zhong Wei Lin 0016 Behavior Modeling Space Reconstruction for E-Commerce Search. 2025 January abs/2501.18216 CoRR https://doi.org/10.48550/arXiv.2501.18216 db/journals/corr/corr2501.html#abs-2501-18216 streams/journals/corr

Xiulong Yuan Hongtao Xu Wenting Shen Ang Wang Xiafei Qiu Jie Zhang 0135 Yuqiong Liu Bowen Yu 0002 Junyang Lin Mingzhen Li 0001 Weile Jia Yong Li 0045 Wei Lin 0016 Efficient Long Context Fine-tuning with Chunk Flow. 2025 March abs/2503.02356 CoRR https://doi.org/10.48550/arXiv.2503.02356 db/journals/corr/corr2503.html#abs-2503-02356 streams/journals/corr

Yuyang Xu Renjun Hu Haochao Ying Jian Wu 0001 Xing Shi Wei Lin 0016 Large language models could be rote learners. 2025 April abs/2504.08300 CoRR https://doi.org/10.48550/arXiv.2504.08300 db/journals/corr/corr2504.html#abs-2504-08300 streams/journals/corr

Shenggan Cheng Yuanxin Wei Lansong Diao Yong Liu 0020 Bujiao Chen Lianghua Huang Yu Liu 0023 Wenyuan Yu Jiangsu Du Wei Lin 0016 Yang You 0001 SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation. 2025 May abs/2505.19151 CoRR https://doi.org/10.48550/arXiv.2505.19151 db/journals/corr/corr2505.html#abs-2505-19151 streams/journals/corr

Yu Guan 0005 Zhiyu Yin Haoyu Chen Sheng Cheng 0002 Chaojie Yang Kun Qian 0004 Tianyin Xu Yang Zhang 0102 Hanyu Zhao Yong Li 0008 Wei Lin 0016 Dennis Cai Ennan Zhai PerfTracker: Online Performance Troubleshooting for Large-scale Model Training in Production. 2025 June abs/2506.08528 CoRR https://doi.org/10.48550/arXiv.2506.08528 db/journals/corr/corr2506.html#abs-2506-08528 streams/journals/corr

Yuyang Xu Yi Cheng Haochao Ying Zhuoyun Du Renjun Hu Xing Shi Wei Lin 0016 Jian Wu 0001 SSPO: Self-traced Step-wise Preference Optimization for Process Supervision and Reasoning Compression. 2025 August abs/2508.12604 CoRR https://doi.org/10.48550/arXiv.2508.12604 db/journals/corr/corr2508.html#abs-2508-12604 streams/journals/corr

Yuanxin Wei Lansong Diao Bujiao Chen Shenggan Cheng Zhengping Qian Wenyuan Yu Nong Xiao 0001 Wei Lin 0016 Jiangsu Du MixCache: Mixture-of-Cache for Video Diffusion Transformer Acceleration. 2025 August abs/2508.12691 CoRR https://doi.org/10.48550/arXiv.2508.12691 db/journals/corr/corr2508.html#abs-2508-12691 streams/journals/corr

Jiandong Mu Mengdi Wang 0001 Feiwen Zhu Jun Yang 0052 Wei Lin 0016 Wei Zhang 0012 Boosting the Convergence of Reinforcement Learning-Based Auto-Pruning Using Historical Data. 548-561 2024 February 43 IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2 https://doi.org/10.1109/TCAD.2023.3319594 db/journals/tcad/tcad43.html#MuWZYLZ24

Jiabei Liu Weiming Zhuang Yuanyuan Liu 0004 Yonggang Wen 0001 Jun Huang 0007 Wei Lin 0016 Personalized Federated Mutual Learning for Unsupervised Camera-Aware Person Re-Identification. 385:1-385:19 2024 December 20 ACM Trans. Multim. Comput. Commun. Appl. 12 https://doi.org/10.1145/3696453 db/journals/tomccap/tomccap20.html#LiuZLWHL24 streams/journals/tomccap

Jiaxing Qi Wencong Xiao Mingzhen Li 0001 Chaojie Yang Yong Li 0045 Wei Lin 0016 Hailong Yang 0002 Zhongzhi Luan Depei Qian 0002 ElasticBatch: A Learning-Augmented Elastic Scheduling System for Batch Inference on MIG. 1708-1720 2024 35 IEEE Trans. Parallel Distributed Syst. 10 https://doi.org/10.1109/TPDS.2024.3431189 db/journals/tpds/tpds35.html#QiXLYLLYLQ24

Yi Cheng Renjun Hu Haochao Ying Xing Shi Jian Wu 0001 Wei Lin 0016 Arithmetic Feature Interaction Is Necessary for Deep Tabular Learning. 11516-11524 2024 AAAI https://doi.org/10.1609/aaai.v38i10.29033 conf/aaai/2024 db/conf/aaai/aaai2024.html#ChengHYSW024 Zixiang Ding Guoqing Jiang Shuai Zhang Lin Guo Wei Lin 0016 How to Trade Off the Quantity and Capacity of Teacher Ensemble: Learning Categorical Distribution to Stochastically Employ a Teacher for Distillation. 17915-17923 2024 AAAI https://doi.org/10.1609/aaai.v38i16.29746 conf/aaai/2024 db/conf/aaai/aaai2024.html#DingJZG024 Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Zongyan Cao Siyu Wang 0006 Wei Lin 0016 HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. 524-541 2024 EuroSys https://doi.org/10.1145/3627703.3629580 conf/eurosys/2024 db/conf/eurosys/eurosys2024.html#ZhangD0CW024 Jiatong Li 0002 Renjun Hu Kunzhe Huang Yan Zhuang 0001 Qi Liu 0003 Mengxiao Zhu 0001 Xing Shi Wei Lin 0016 PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations. 2024 NeurIPS http://papers.nips.cc/paper_files/paper/2024/hash/149578235c90954e4f10e40fa181918f-Abstract-Datasets_and_Benchmarks_Track.html conf/nips/2024 db/conf/nips/neurips2024.html#0002HHZL0S024 Biao Sun 0002 Ziming Huang Hanyu Zhao Wencong Xiao Xinyi Zhang Yong Li 0045 Wei Lin 0016 Llumnix: Dynamic Scheduling for Large Language Model Serving. 173-191 2024 OSDI https://www.usenix.org/conference/osdi24/presentation/sun-biao conf/osdi/2024 db/conf/osdi/osdi2024.html#SunHZXZL024 Donglin Zhuang Zhen Zheng Haojun Xia Xiafei Qiu Junjie Bai Wei Lin 0016 Shuaiwen Leon Song MonoNN: Enabling a New Monolithic Optimization Space for Neural Network Inference Tasks on Modern GPU-Centric Architectures. 989-1005 2024 OSDI https://www.usenix.org/conference/osdi24/presentation/zhuang conf/osdi/2024 db/conf/osdi/osdi2024.html#ZhuangZXQB0S24

Bin Lin Tao Peng Chen Zhang Minmin Sun Lanbo Li Hanyu Zhao Wencong Xiao Qi Xu Xiafei Qiu Shen Li Zhigang Ji Yong Li 0045 Wei Lin 0016 Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache. 2024 abs/2401.02669 CoRR https://doi.org/10.48550/arXiv.2401.02669 db/journals/corr/corr2401.html#abs-2401-02669

Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Zongyan Cao Siyu Wang 0006 Wei Lin 0016 HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. 2024 abs/2401.05965 CoRR https://doi.org/10.48550/arXiv.2401.05965 db/journals/corr/corr2401.html#abs-2401-05965

Yi Cheng Renjun Hu Haochao Ying Xing Shi Jian Wu 0001 Wei Lin 0016 Arithmetic Feature Interaction Is Necessary for Deep Tabular Learning. 2024 abs/2402.02334 CoRR https://doi.org/10.48550/arXiv.2402.02334 db/journals/corr/corr2402.html#abs-2402-02334

Xiang Li 0067 Zhenyu Li Chen Shi Yong Xu 0007 Qing Du Mingkui Tan Jun Huang 0007 Wei Lin 0016 AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework. 2024 abs/2403.12582 CoRR https://doi.org/10.48550/arXiv.2403.12582 db/journals/corr/corr2403.html#abs-2403-12582

Jiatong Li 0002 Renjun Hu Kunzhe Huang Yan Zhuang 0001 Qi Liu 0003 Mengxiao Zhu 0001 Xing Shi Wei Lin 0016 PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations. 2024 abs/2405.19740 CoRR https://doi.org/10.48550/arXiv.2405.19740 db/journals/corr/corr2405.html#abs-2405-19740

Biao Sun 0002 Ziming Huang Hanyu Zhao Wencong Xiao Xinyi Zhang Yong Li 0045 Wei Lin 0016 Llumnix: Dynamic Scheduling for Large Language Model Serving. 2024 abs/2406.03243 CoRR https://doi.org/10.48550/arXiv.2406.03243 db/journals/corr/corr2406.html#abs-2406-03243

Xiufeng Shu Ruidong Han Xiang Li 0067 Wei Lin 0016 Adaptive Utilization of Cross-scenario Information for Multi-scenario Recommendation. 2024 abs/2407.19727 CoRR https://doi.org/10.48550/arXiv.2407.19727 db/journals/corr/corr2407.html#abs-2407-19727 streams/journals/corr

Xinyi Zhang Hanyu Zhao Wencong Xiao Xianyan Jia Fei Xu Yong Li 0045 Wei Lin 0016 Fangming Liu Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling. 2024 abs/2408.08586 CoRR https://doi.org/10.48550/arXiv.2408.08586 db/journals/corr/corr2408.html#abs-2408-08586 streams/journals/corr

Xiulong Yuan Xu Yan Wenting Shen Xiafei Qiu Ang Wang Jie Zhang 0135 Yong Li 0045 Wei Lin 0016 BladeDISC++: Memory Optimizations Based On Symbolic Shape. 2024 abs/2412.16985 CoRR https://doi.org/10.48550/arXiv.2412.16985 db/journals/corr/corr2412.html#abs-2412-16985 streams/journals/corr

Hanyu Zhao Zhi Yang 0001 Yu Cheng Chao Tian 0001 Shiru Ren Wencong Xiao Man Yuan Langshi Chen Kaibo Liu Yang Zhang 0102 Yong Li 0045 Wei Lin 0016 GoldMiner: Elastic Scaling of Training Data Pre-Processing Pipelines for Deep Learning. 193:1-193:25 2023 1 Proc. ACM Manag. Data 2 https://doi.org/10.1145/3589773 https://www.wikidata.org/entity/Q130864280 db/journals/pacmmod/pacmmod1.html#Zhao0CTRXYCLZLL23

Zhen Zheng Zaifeng Pan Dalin Wang Kai Zhu Wenyi Zhao Tianyou Guo Xiafei Qiu Minmin Sun Junjie Bai Feng Zhang 0007 Xiaoyong Du 0001 Jidong Zhai Wei Lin 0016 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach. 206:1-206:29 2023 September 1 Proc. ACM Manag. Data 3 https://doi.org/10.1145/3617327 https://www.wikidata.org/entity/Q130811420 db/journals/pacmmod/pacmmod1.html#ZhengPWZZGQSBZDZL23

Haojun Xia Zhen Zheng Yuchao Li Donglin Zhuang Zhongzhu Zhou Xiafei Qiu Yong Li 0045 Wei Lin 0016 Shuaiwen Leon Song Flash-LLM: Enabling Low-Cost and Highly-Efficient Large Generative Model Inference With Unstructured Sparsity. 211-224 2023 17 Proc. VLDB Endow. 2 https://www.vldb.org/pvldb/vol17/p211-xia.pdf https://doi.org/10.14778/3626292.3626303 db/journals/pvldb/pvldb17.html#XiaZLZZQL0S23

Shiwei Zhang 0002 Xiaodong Yi 0001 Lansong Diao Chuan Wu 0001 Siyu Wang 0006 Wei Lin 0016 Expediting Distributed DNN Training With Device Topology-Aware Graph Deployment. 1281-1293 2023 April 34 IEEE Trans. Parallel Distributed Syst. 4 https://doi.org/10.1109/TPDS.2023.3243261 db/journals/tpds/tpds34.html#ZhangYDWWL23

Zaifeng Pan Zhen Zheng Feng Zhang 0007 Ruofan Wu Hao Liang 0003 Dalin Wang Xiafei Qiu Junjie Bai Wei Lin 0016 Xiaoyong Du 0001 RECom: A Compiler Approach to Accelerating Recommendation Model Inference with Massive Embedding Columns. 268-286 2023 ASPLOS (4) https://doi.org/10.1145/3623278.3624761 https://www.wikidata.org/entity/Q130822147 conf/asplos/2023-4 db/conf/asplos/asplos2023-4.html#PanZ0WLWQB0023 Yangjie Zhou 0001 Jingwen Leng Yaoxu Song Shuwen Lu Mian Wang Chao Li 0009 Minyi Guo Wenting Shen Yong Li 0045 Wei Lin 0016 Xiangwen Liu Hanqing Wu uGrapher: High-Performance Graph Operator Computation via Unified Abstraction for Graph Neural Networks. 878-891 2023 ASPLOS (2) https://doi.org/10.1145/3575693.3575723 https://www.wikidata.org/entity/Q130936756 conf/asplos/2023-2 db/conf/asplos/asplos2023-2.html#0001LSLWLGSLLLW23 Ziyue Hua Wei Lin 0016 Luyao Ren Zongyang Li Lu Zhang 0023 Wenpin Jiao Tao Xie 0001 GDsmith: Detecting Bugs in Cypher Graph Database Engines. 163-174 2023 ISSTA https://doi.org/10.1145/3597926.3598046 https://www.wikidata.org/entity/Q130810148 conf/issta/2023 db/conf/issta/issta2023.html#HuaLRLZJ023 Mingzhen Li 0001 Wencong Xiao Hailong Yang 0002 Biao Sun 0002 Hanyu Zhao Shiru Ren Zhongzhi Luan Xianyan Jia Yi Liu 0013 Yong Li 0045 Wei Lin 0016 Depei Qian 0002 EasyScale: Elastic Training with Consistent Accuracy and Improved Utilization on GPUs. 55:1-55:14 2023 SC https://doi.org/10.1145/3581784.3607054 https://www.wikidata.org/entity/Q130937620 conf/sc/2023 db/conf/sc/sc2023.html#LiXYSZRLJLLLQ23 Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Zongyan Cao Siyu Wang 0006 Wei Lin 0016 HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. 2023 November https://doi.org/10.5281/zenodo.10089121 Zenodo streams/repo/zenodo data/10/ZhangDWCWL23b Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Zongyan Cao Siyu Wang 0006 Wei Lin 0016 HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. 2023 November https://doi.org/10.5281/zenodo.10089643 Zenodo streams/repo/zenodo data/10/ZhangDWCWL23b

Ziji Shi Le Jiang Ang Wang Jie Zhang 0135 Xianyan Jia Yong Li 0045 Chencan Wu Jialin Li 0001 Wei Lin 0016 TAP: Accelerating Large-Scale DNN Training Through Tensor Automatic Parallelisation. 2023 abs/2302.00247 CoRR https://doi.org/10.48550/arXiv.2302.00247 db/journals/corr/corr2302.html#abs-2302-00247

Shiwei Zhang 0002 Xiaodong Yi 0001 Lansong Diao Chuan Wu 0001 Siyu Wang 0006 Wei Lin 0016 Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment. 2023 abs/2302.06126 CoRR https://doi.org/10.48550/arXiv.2302.06126 db/journals/corr/corr2302.html#abs-2302-06126

Shiwei Zhang 0002 Lansong Diao Siyu Wang 0006 Zongyan Cao Yiliang Gu Chang Si Ziji Shi Zhen Zheng Chuan Wu 0001 Wei Lin 0016 Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform. 2023 abs/2302.08141 CoRR https://doi.org/10.48550/arXiv.2302.08141 db/journals/corr/corr2302.html#abs-2302-08141

Siyu Wang 0006 Zongyan Cao Chang Si Lansong Diao Jiamang Wang Wei Lin 0016 Ada-Grouper: Accelerating Pipeline Parallelism in Preempted Network by Adaptive Group-Scheduling for Micro-Batches. 2023 abs/2303.01675 CoRR https://doi.org/10.48550/arXiv.2303.01675 db/journals/corr/corr2303.html#abs-2303-01675

Di Jin 0001 Luzhi Wang Yizhen Zheng Guojie Song Fei Jiang 0009 Xiang Li 0067 Wei Lin 0016 Shirui Pan Dual Intent Enhanced Graph Neural Network for Session-based New Item Recommendation. 2023 abs/2305.05848 CoRR https://doi.org/10.48550/arXiv.2305.05848 db/journals/corr/corr2305.html#abs-2305-05848

Yuting Zhang 0010 Yiqing Wu Ran Le Yongchun Zhu Fuzhen Zhuang Ruidong Han Xiang Li 0067 Wei Lin 0016 Zhulin An Yongjun Xu 0001 Modeling Dual Period-Varying Preferences for Takeaway Recommendation. 2023 abs/2306.04370 CoRR https://doi.org/10.48550/arXiv.2306.04370 db/journals/corr/corr2306.html#abs-2306-04370

Bin Yin 0004 Junjie Xie Yu Qin Zixiang Ding Zhichao Feng Xiang Li 0067 Wei Lin 0016 Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLM. 2023 abs/2308.03333 CoRR https://doi.org/10.48550/arXiv.2308.03333 db/journals/corr/corr2308.html#abs-2308-03333

Haojun Xia Zhen Zheng Yuchao Li Donglin Zhuang Zhongzhu Zhou Xiafei Qiu Yong Li 0045 Wei Lin 0016 Shuaiwen Leon Song Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity. 2023 abs/2309.10285 CoRR https://doi.org/10.48550/arXiv.2309.10285 db/journals/corr/corr2309.html#abs-2309-10285

Yun Liang 0001 Liqiang Lu Yicheng Jin Jiaming Xie Ruirui Huang Jiansong Zhang 0001 Wei Lin 0016 An Efficient Hardware Design for Accelerating Sparse CNNs With NAS-Based Models. 597-613 2022 41 IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 3 https://doi.org/10.1109/TCAD.2021.3066563 db/journals/tcad/tcad41.html#LiangLJXHZL22

Xiaodong Yi 0001 Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Zhen Zheng Shiqing Fan Siyu Wang 0006 Jun Yang 0052 Wei Lin 0016 Optimizing DNN Compilation for Distributed Training With Joint OP and Tensor Fusion. 4694-4706 2022 33 IEEE Trans. Parallel Distributed Syst. 12 https://doi.org/10.1109/TPDS.2022.3201531 https://www.wikidata.org/entity/Q114083923 db/journals/tpds/tpds33.html#YiZDWZFWYL22

Zhen Zheng Xuanda Yang Pengzhan Zhao Guoping Long Kai Zhu Feiwen Zhu Wenyi Zhao Xiaoyong Liu Jun Yang 0052 Jidong Zhai Shuaiwen Leon Song Wei Lin 0016 AStitch: enabling a new multi-dimensional optimization space for memory-intensive ML training and inference on modern SIMT architectures. 359-373 2022 ASPLOS https://doi.org/10.1145/3503222.3507723 https://www.wikidata.org/entity/Q130981713 conf/asplos/2022 db/conf/asplos/asplos2022.html#ZhengYZLZZZLYZS22 Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Siyu Wang 0006 Wei Lin 0016 Accelerating large-scale distributed neural network training with SPMD parallelism. 403-418 2022 SoCC https://doi.org/10.1145/3542929.3563487 https://www.wikidata.org/entity/Q130845470 conf/cloud/2022 db/conf/cloud/socc2022.html#ZhangD0W022 Chengyu Wang 0001 Minghui Qiu Taolin Zhang 0001 Tingting Liu Lei Li 0043 Jianing Wang 0002 Ming Wang Jun Huang 0007 Wei Lin 0016 EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing. 22-29 2022 EMNLP (Demos) https://doi.org/10.18653/v1/2022.emnlp-demos.3 https://aclanthology.org/2022.emnlp-demos.3 conf/emnlp/2022-d db/conf/emnlp/emnlp2022-d.html#WangQZLLWWHL22 Yuanxing Zhang Langshi Chen Siran Yang Man Yuan Huimin Yi Jie Zhang 0135 Jiamang Wang Jianbo Dong Yunlong Xu Yue Song Yong Li 0045 Di Zhang 0026 Wei Lin 0016 Lin Qu Bo Zheng 0007 PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems. 3453-3466 2022 ICDE https://doi.org/10.1109/ICDE53745.2022.00324 conf/icde/2022 db/conf/icde/icde2022.html#ZhangCYYYZWDXSL22 Ziyue Luo Xiaodong Yi 0001 Guoping Long Shiqing Fan Chuan Wu 0001 Jun Yang 0052 Wei Lin 0016 Efficient Pipeline Planning for Expedited Distributed DNN Training. 340-349 2022 INFOCOM https://doi.org/10.1109/INFOCOM48880.2022.9796787 conf/infocom/2022 db/conf/infocom/infocom2022.html#LuoYLFWYL22 Wei Lin 0016 Lu Zhang 0023 Haotian Zhang Kailai Shao Mingming Zhang Tao Xie 0001 TaintSQL: Dynamically Tracking Fine-Grained Implicit Flows for SQL Statements. 1-12 2022 ISSRE https://doi.org/10.1109/ISSRE55969.2022.00012 conf/issre/2022 db/conf/issre/issre2022.html#Lin0ZSZ022 Jiabei Liu Weiming Zhuang Yonggang Wen 0001 Jun Huang 0007 Wei Lin 0016 Optimizing Federated Unsupervised Person Re-identification via Camera-aware Clustering. 1-6 2022 MMSP https://doi.org/10.1109/MMSP55362.2022.9949249 conf/mmsp/2022 db/conf/mmsp/mmsp2022.html#LiuZWHL22 Qizhen Weng 0001 Wencong Xiao Yinghao Yu Wei Wang 0030 Cheng Wang Jian He 0004 Yong Li 0045 Liping Zhang 0013 Wei Lin 0016 Yu Ding MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters. 945-960 2022 NSDI https://www.usenix.org/conference/nsdi22/presentation/weng conf/nsdi/2022 db/conf/nsdi/nsdi2022.html#WengXYWWHLZLD22 Xianyan Jia Le Jiang Ang Wang Wencong Xiao Ziji Shi Jie Zhang 0135 Xinyuan Li Langshi Chen Yong Li 0045 Zhen Zheng Xiaoyong Liu Wei Lin 0016 Whale: Efficient Giant Model Training over Heterogeneous GPUs. 673-688 2022 USENIX ATC https://www.usenix.org/conference/atc22/presentation/jia-xianyan conf/usenix/2022 db/conf/usenix/usenix2022.html#JiaJWXS0LCLZL022

Yuanxing Zhang Langshi Chen Siran Yang Man Yuan Huimin Yi Jie Zhang 0135 Jiamang Wang Jianbo Dong Yunlong Xu Yue Song Yong Li 0045 Di Zhang 0026 Wei Lin 0016 Lin Qu Bo Zheng 0007 PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems. 2022 abs/2204.04903 CoRR https://doi.org/10.48550/arXiv.2204.04903 db/journals/corr/corr2204.html#abs-2204-04903

Ziyue Luo Xiaodong Yi 0001 Guoping Long Shiqing Fan Chuan Wu 0001 Jun Yang 0052 Wei Lin 0016 Efficient Pipeline Planning for Expedited Distributed DNN Training. 2022 abs/2204.10562 CoRR https://doi.org/10.48550/arXiv.2204.10562 db/journals/corr/corr2204.html#abs-2204-10562

Chengyu Wang 0001 Minghui Qiu Taolin Zhang 0001 Tingting Liu Lei Li 0043 Jianing Wang 0002 Ming Wang Jun Huang 0007 Wei Lin 0016 EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing. 2022 abs/2205.00258 CoRR https://doi.org/10.48550/arXiv.2205.00258 db/journals/corr/corr2205.html#abs-2205-00258

Wei Lin 0016 Ziyue Hua Luyao Ren Zongyang Li Lu Zhang 0023 Tao Xie 0001 GDsmith: Detecting Bugs in Graph Database Engines. 2022 abs/2206.08530 CoRR https://doi.org/10.48550/arXiv.2206.08530 db/journals/corr/corr2206.html#abs-2206-08530

Mingzhen Li 0001 Wencong Xiao Biao Sun 0002 Hanyu Zhao Hailong Yang 0002 Shiru Ren Zhongzhi Luan Xianyan Jia Yi Liu 0013 Yong Li 0045 Depei Qian 0002 Wei Lin 0016 EasyScale: Accuracy-consistent Elastic Training for Deep Learning. 2022 abs/2208.14228 CoRR https://doi.org/10.48550/arXiv.2208.14228 db/journals/corr/corr2208.html#abs-2208-14228

Xiaodong Yi 0001 Shiwei Zhang 0002 Lansong Diao Chuan Wu 0001 Zhen Zheng Shiqing Fan Siyu Wang 0006 Jun Yang 0052 Wei Lin 0016 Optimizing DNN Compilation for Distributed Training with Joint OP and Tensor Fusion. 2022 abs/2209.12769 CoRR https://doi.org/10.48550/arXiv.2209.12769 db/journals/corr/corr2209.html#abs-2209-12769

Yingda Chen Jiamang Wang Yifeng Lu Ying Han Zhiqiang Lv Xuebin Min Hua Cai Wei Zhang 0012 Haochuan Fan Chao Li 0009 Tao Guan Wei Lin 0016 Yangqing Jia Jingren Zhou 0001 Fangorn: Adaptive Execution Framework for Heterogeneous Workloads on Shared Clusters. 2972-2985 2021 14 Proc. VLDB Endow. 12 http://www.vldb.org/pvldb/vol14/p2972-chen.pdf https://doi.org/10.14778/3476311.3476376 db/journals/pvldb/pvldb14.html#ChenWLHLMCZFLG021

Yanghua Peng Yixin Bao Yangrui Chen Chuan Wu 0001 Chen Meng Wei Lin 0016 DL2: A Deep Learning-Driven Scheduler for Deep Learning Clusters. 1947-1960 2021 32 IEEE Trans. Parallel Distributed Syst. 8 https://doi.org/10.1109/TPDS.2021.3052895 db/journals/tpds/tpds32.html#PengBCWML21

Bencheng Yan Pengjie Wang 0002 Jinquan Liu Wei Lin 0016 Kuang-Chih Lee Jian Xu 0015 Bo Zheng 0007 Binary Code based Hash Embedding for Web-scale Applications. 3563-3567 2021 CIKM https://doi.org/10.1145/3459637.3482065 https://www.wikidata.org/entity/Q130848860 conf/cikm/2021 db/conf/cikm/cikm2021.html#YanWLLLXZ21 Bencheng Yan Pengjie Wang 0002 Kai Zhang 0001 Wei Lin 0016 Kuang-Chih Lee Jian Xu 0015 Bo Zheng 0007 Learning Effective and Efficient Embedding via an Adaptively-Masked Twins-based Layer. 3568-3572 2021 CIKM https://doi.org/10.1145/3459637.3482130 conf/cikm/2021 db/conf/cikm/cikm2021.html#YanWZLLXZ21 Minghui Qiu Peng Li 0056 Chengyu Wang 0001 Haojie Pan Ang Wang Cen Chen 0001 Xianyan Jia Yaliang Li Jun Huang 0007 Deng Cai 0001 Wei Lin 0016 EasyTransfer: A Simple and Scalable Deep Transfer Learning Platform for NLP Applications. 4075-4084 2021 CIKM https://doi.org/10.1145/3459637.3481911 conf/cikm/2021 db/conf/cikm/cikm2021.html#QiuLWPWCJLH0021 Kai Zhu Wenyi Zhao Zhen Zheng Tianyou Guo Pengzhan Zhao Junjie Bai Jun Yang 0052 Xiaoyong Liu Lansong Diao Wei Lin 0016 DISC: A Dynamic Shape Compiler for Machine Learning Workloads. 89-95 2021 EuroMLSys@EuroSys https://doi.org/10.1145/3437984.3458838 https://www.wikidata.org/entity/Q130846007 conf/eurosys/2021ml db/conf/eurosys/euromlsys2021.html#ZhuZZGZBYLDL21 Chengyu Wang 0001 Haojie Pan Yuan Liu Kehan Chen Minghui Qiu Wei Zhou Jun Huang 0007 Haiqing Chen Wei Lin 0016 Deng Cai 0001 MeLL: Large-scale Extensible User Intent Classification for Dialogue Systems with Meta Lifelong Learning. 3649-3659 2021 KDD https://doi.org/10.1145/3447548.3467107 conf/kdd/2021 db/conf/kdd/kdd2021.html#0001PLCQZHCL021 Yuexiang Xie Zhen Wang 0036 Yaliang Li Bolin Ding Nezihe Merve Gürel Ce Zhang 0001 Minlie Huang Wei Lin 0016 Jingren Zhou 0001 FIVES: Feature Interaction Via Edge Search for Large-Scale Tabular Data. 3795-3805 2021 KDD https://doi.org/10.1145/3447548.3467066 conf/kdd/2021 db/conf/kdd/kdd2021.html#XieWLDGZHLZ21 Shiqing Fan Yi Rong Chen Meng Zongyan Cao Siyu Wang 0006 Zhen Zheng Chuan Wu 0001 Guoping Long Jun Yang 0052 Lixue Xia Lansong Diao Xiaoyong Liu Wei Lin 0016 DAPPLE: a pipelined data parallel approach for training large models. 431-445 2021 PPoPP https://doi.org/10.1145/3437801.3441593 https://www.wikidata.org/entity/Q130991216 conf/ppopp/2021 db/conf/ppopp/ppopp2021.html#FanRMCWZWLYXDLL21 Xu Ma Pengjie Wang 0002 Hui Zhao Shaoguo Liu Chuhan Zhao Wei Lin 0016 Kuang-Chih Lee Jian Xu 0015 Bo Zheng 0007 Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach. 2036-2040 2021 SIGIR https://doi.org/10.1145/3404835.3462979 conf/sigir/2021 db/conf/sigir/sigir2021.html#MaWZLZLLXZ21 Feng Li 0067 Bencheng Yan Qingqing Long Pengjie Wang 0002 Wei Lin 0016 Jian Xu 0015 Bo Zheng 0007 Explicit Semantic Cross Feature Learning via Pre-trained Graph Neural Networks for CTR Prediction. 2161-2165 2021 SIGIR https://doi.org/10.1145/3404835.3463015 conf/sigir/2021 db/conf/sigir/sigir2021.html#LiYLWLXZ21

Junyang Lin Rui Men An Yang Chang Zhou 0005 Ming Ding 0004 Yichang Zhang Peng Wang 0028 Ang Wang Le Jiang Xianyan Jia Jie Zhang 0135 Jianwei Zhang 0012 Xu Zou 0001 Zhikang Li Xiaodong Deng Jie Liu 0002 Jinbao Xue Huiling Zhou Jianxin Ma Jin Yu Yong Li 0045 Wei Lin 0016 Jingren Zhou 0001 Jie Tang 0001 Hongxia Yang M6: A Chinese Multimodal Pretrainer. 2021 abs/2103.00823 CoRR https://arxiv.org/abs/2103.00823 db/journals/corr/corr2103.html#abs-2103-00823

Kai Zhu Wenyi Zhao Zhen Zheng Tianyou Guo Pengzhan Zhao Junjie Bai Jun Yang 0052 Xiaoyong Liu Lansong Diao Wei Lin 0016 DISC: A Dynamic Shape Compiler for Machine Learning Workloads. 2021 abs/2103.05288 CoRR https://arxiv.org/abs/2103.05288 db/journals/corr/corr2103.html#abs-2103-05288

Xu Ma Pengjie Wang 0002 Hui Zhao Shaoguo Liu Chuhan Zhao Wei Lin 0016 Kuang-Chih Lee Jian Xu 0015 Bo Zheng 0007 Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach. 2021 abs/2105.07706 CoRR https://arxiv.org/abs/2105.07706 db/journals/corr/corr2105.html#abs-2105-07706

Feng Li 0067 Bencheng Yan Qingqing Long Pengjie Wang 0002 Wei Lin 0016 Jian Xu 0015 Bo Zheng 0007 Explicit Semantic Cross Feature Learning via Pre-trained Graph Neural Networks for CTR Prediction. 2021 abs/2105.07752 CoRR https://arxiv.org/abs/2105.07752 db/journals/corr/corr2105.html#abs-2105-07752

An Yang Junyang Lin Rui Men Chang Zhou 0005 Le Jiang Xianyan Jia Ang Wang Jie Zhang 0135 Jiamang Wang Yong Li 0045 Di Zhang 0026 Wei Lin 0016 Lin Qu Jingren Zhou 0001 Hongxia Yang Exploring Sparse Expert Models and Beyond. 2021 abs/2105.15082 CoRR https://arxiv.org/abs/2105.15082 db/journals/corr/corr2105.html#abs-2105-15082

Jiandong Mu Mengdi Wang 0001 Feiwen Zhu Jun Yang 0052 Wei Lin 0016 Wei Zhang 0012 Boosting the Convergence of Reinforcement Learning-based Auto-pruning Using Historical Data. 2021 abs/2107.08815 CoRR https://arxiv.org/abs/2107.08815 db/journals/corr/corr2107.html#abs-2107-08815

Bencheng Yan Pengjie Wang 0002 Kai Zhang 0001 Wei Lin 0016 Kuang-Chih Lee Jian Xu 0015 Bo Zheng 0007 Learning Effective and Efficient Embedding via an Adaptively-Masked Twins-based Layer. 2021 abs/2108.11513 CoRR https://arxiv.org/abs/2108.11513 db/journals/corr/corr2108.html#abs-2108-11513

Bencheng Yan Pengjie Wang 0002 Jinquan Liu Wei Lin 0016 Kuang-Chih Lee Jian Xu 0015 Bo Zheng 0007 Binary Code based Hash Embedding for Web-scale Applications. 2021 abs/2109.02471 CoRR https://arxiv.org/abs/2109.02471 db/journals/corr/corr2109.html#abs-2109-02471

Junyang Lin An Yang Jinze Bai Chang Zhou 0005 Le Jiang Xianyan Jia Ang Wang Jie Zhang 0135 Yong Li 0045 Wei Lin 0016 Jingren Zhou 0001 Hongxia Yang M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining. 2021 abs/2110.03888 CoRR https://arxiv.org/abs/2110.03888 db/journals/corr/corr2110.html#abs-2110-03888

Xiaodong Yi 0001 Shiwei Zhang 0002 Ziyue Luo Guoping Long Lansong Diao Chuan Wu 0001 Zhen Zheng Jun Yang 0052 Wei Lin 0016 Optimizing distributed training deployment in heterogeneous GPU clusters. 93-107 2020 CoNEXT https://doi.org/10.1145/3386367.3432728 https://www.wikidata.org/entity/Q130869721 conf/conext/2020 db/conf/conext/conext2020.html#0001ZLLDWZYL20 Shuai Wang 0028 Dan Li 0001 Jiansong Zhang 0001 Wei Lin 0016 CEFS: compute-efficient flow scheduling for iterative synchronous applications. 136-148 2020 CoNEXT https://doi.org/10.1145/3386367.3431307 conf/conext/2020 db/conf/conext/conext2020.html#WangLZL20 Qiangpeng Yang Jun Huang 0007 Wei Lin 0016 SwapText: Image Based Texts Transfer in Scenes. 14688-14697 2020 CVPR https://openaccess.thecvf.com/content_CVPR_2020/html/Yang_SwapText_Image_Based_Texts_Transfer_in_Scenes_CVPR_2020_paper.html https://doi.org/10.1109/CVPR42600.2020.01471 conf/cvpr/2020 db/conf/cvpr/cvpr2020.html#YangHL20 Jiandong Mu Mengdi Wang 0001 Lanbo Li Jun Yang 0052 Wei Lin 0016 Wei Zhang 0012 A History-Based Auto-Tuning Framework for Fast and High-Performance DNN Design on GPU. 1-6 2020 DAC https://doi.org/10.1109/DAC18072.2020.9218700 conf/dac/2020 db/conf/dac/dac2020.html#MuWLYLZ20 Daoyuan Chen Yaliang Li Minghui Qiu Zhen Wang 0036 Bofang Li Bolin Ding Hongbo Deng Jun Huang 0007 Wei Lin 0016 Jingren Zhou 0001 AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search. 2463-2469 2020 IJCAI https://doi.org/10.24963/ijcai.2020/341 conf/ijcai/2020 db/conf/ijcai/ijcai2020.html#ChenLQWLDDHLZ20 Xiaodong Yi 0001 Ziyue Luo Chen Meng Mengdi Wang 0001 Guoping Long Chuan Wu 0001 Jun Yang 0052 Wei Lin 0016 Fast Training of Deep Learning Models over Multiple GPUs. 105-118 2020 Middleware https://doi.org/10.1145/3423211.3425675 conf/middleware/2020 db/conf/middleware/middleware2020.html#0001LMWLWYL20 Mengli Cheng Minghui Qiu Xing Shi Jun Huang 0007 Wei Lin 0016 One-shot Text Field labeling using Attention and Belief Propagation for Structure Information Extraction. 340-348 2020 ACM Multimedia https://doi.org/10.1145/3394171.3413511 conf/mm/2020 db/conf/mm/mm2020.html#ChengQSH020 Wencong Xiao Shiru Ren Yong Li 0045 Yang Zhang 0102 Pengyang Hou Zhi Li Yihui Feng Wei Lin 0016 Yangqing Jia AntMan: Dynamic Scaling on GPU Clusters for Deep Learning. 533-548 2020 OSDI https://www.usenix.org/conference/osdi20/presentation/xiao conf/osdi/2020 db/conf/osdi/osdi2020.html#XiaoRLZHLFLJ20

Daoyuan Chen Yaliang Li Minghui Qiu Zhen Wang 0036 Bofang Li Bolin Ding Hongbo Deng Jun Huang 0007 Wei Lin 0016 Jingren Zhou 0001 AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search. 2020 abs/2001.04246 CoRR https://arxiv.org/abs/2001.04246 db/journals/corr/corr2001.html#abs-2001-04246

Qiangpeng Yang Hongsheng Jin Jun Huang 0007 Wei Lin 0016 SwapText: Image Based Texts Transfer in Scenes. 2020 abs/2003.08152 CoRR https://arxiv.org/abs/2003.08152 db/journals/corr/corr2003.html#abs-2003-08152

Shiqing Fan Yi Rong Chen Meng Zongyan Cao Siyu Wang 0006 Zhen Zheng Chuan Wu 0001 Guoping Long Jun Yang 0052 Lixue Xia Lansong Diao Xiaoyong Liu Wei Lin 0016 DAPPLE: A Pipelined Data Parallel Approach for Training Large Models. 2020 abs/2007.01045 CoRR https://arxiv.org/abs/2007.01045 db/journals/corr/corr2007.html#abs-2007-01045

Siyu Wang 0006 Yi Rong Shiqing Fan Zhen Zheng Lansong Diao Guoping Long Jun Yang 0052 Xiaoyong Liu Wei Lin 0016 Auto-MAP: A DQN Framework for Exploring Distributed Execution Plans for DNN Workloads. 2020 abs/2007.04069 CoRR https://arxiv.org/abs/2007.04069 db/journals/corr/corr2007.html#abs-2007-04069

Yuexiang Xie Zhen Wang 0036 Yaliang Li Bolin Ding Nezihe Merve Gürel Ce Zhang 0001 Minlie Huang Wei Lin 0016 Jingren Zhou 0001 Interactive Feature Generation via Learning Adjacency Tensor of Feature Graph. 2020 abs/2007.14573 CoRR https://arxiv.org/abs/2007.14573 db/journals/corr/corr2007.html#abs-2007-14573

Mengli Cheng Minghui Qiu Xing Shi Jun Huang 0007 Wei Lin 0016 One-shot Text Field Labeling using Attention and Belief Propagation for Structure Information Extraction. 2020 abs/2009.04153 CoRR https://arxiv.org/abs/2009.04153 db/journals/corr/corr2009.html#abs-2009-04153

Zhen Zheng Pengzhan Zhao Guoping Long Feiwen Zhu Kai Zhu Wenyi Zhao Lansong Diao Jun Yang 0052 Wei Lin 0016 FusionStitching: Boosting Memory Intensive Computations for Deep Learning Workloads. 2020 abs/2009.10924 CoRR https://arxiv.org/abs/2009.10924 db/journals/corr/corr2009.html#abs-2009-10924

Yiwu Yao Yuchao Li Chengyu Wang 0001 Tianhang Yu Houjiang Chen Xiaotang Jiang Jun Yang 0052 Jun Huang 0007 Wei Lin 0016 Hui Shu Chengfei Lv INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices. 2020 abs/2010.14841 CoRR https://arxiv.org/abs/2010.14841 db/journals/corr/corr2010.html#abs-2010-14841

Ang Wang Xianyan Jia Le Jiang Jie Zhang 0135 Yong Li 0045 Wei Lin 0016 Whale: A Unified Distributed Training Framework. 2020 abs/2011.09208 CoRR https://arxiv.org/abs/2011.09208 db/journals/corr/corr2011.html#abs-2011-09208

Minghui Qiu Peng Li 0056 Hanjie Pan Chengyu Wang 0001 Ang Wang Cen Chen 0001 Yaliang Li Dehong Gao Jun Huang 0007 Yong Li 0045 Jun Yang 0052 Deng Cai 0001 Wei Lin 0016 EasyTransfer - A Simple and Scalable Deep Transfer Learning Platform for NLP Applications. 2020 abs/2011.09463 CoRR https://arxiv.org/abs/2011.09463 db/journals/corr/corr2011.html#abs-2011-09463

Chen Xing Wencong Xiao Yong Li 0045 Wei Lin 0016 Focusing More on Conflicts with Mis-Predictions Helps Language Pre-Training. 2020 abs/2012.08789 CoRR https://arxiv.org/abs/2012.08789 db/journals/corr/corr2012.html#abs-2012-08789

Rong Zhu Kun Zhao Hongxia Yang Wei Lin 0016 Chang Zhou 0005 Baole Ai Yong Li 0045 Jingren Zhou 0001 AliGraph: A Comprehensive Graph Neural Network Platform. 2094-2105 2019 12 Proc. VLDB Endow. 12 http://www.vldb.org/pvldb/vol12/p2094-zhu.pdf https://doi.org/10.14778/3352063.3352127 db/journals/pvldb/pvldb12.html#ZhuZYLZALZ19

Lixue Xia Lansong Diao Zhao Jiang Hao Liang 0003 Kai Chen 0008 Li Ding Shunli Dou Zibin Su Meng Sun Jiansong Zhang 0001 Wei Lin 0016 PAI-FCNN: FPGA Based Inference System for Complex CNN Models. 107-114 2019 ASAP https://doi.org/10.1109/ASAP.2019.00-21 conf/asap/2019 db/conf/asap/asap2019.html#XiaDJL0DDSSZL19 Liqiang Lu Jiaming Xie Ruirui Huang Jiansong Zhang 0001 Wei Lin 0016 Yun Liang 0001 An Efficient Hardware Accelerator for Sparse Convolutional Neural Networks on FPGAs. 17-25 2019 FCCM https://doi.org/10.1109/FCCM.2019.00013 conf/fccm/2019 db/conf/fccm/fccm2019.html#LuXHZL019 Lansong Diao Zhao Jiang Hao Liang 0003 Chang'an Ye Kai Chen 0008 Li Ding Shunli Dou Meng Sun Lixue Xia Jiansong Zhang 0001 Wei Lin 0016 PAI-FCNN: FPGA Based CNN Inference System. 184 2019 FPGA https://doi.org/10.1145/3289602.3293957 https://www.wikidata.org/entity/Q130866258 conf/fpga/2019 db/conf/fpga/fpga2019.html#DiaoJLY0DDSXZL19 Liqiang Lu Yun Liang 0001 Ruirui Huang Wei Lin 0016 Xiaoyuan Cui Jiansong Zhang 0001 Speedy: An Accelerator for Sparse Convolutional Neural Networks on FPGAs. 187 2019 FPGA https://doi.org/10.1145/3289602.3293970 https://www.wikidata.org/entity/Q130862987 conf/fpga/2019 db/conf/fpga/fpga2019.html#Lu0HLCZ19 Jiansong Zhang 0001 Lixue Xia Zhao Jiang Hao Liang 0003 Jiaoyan Chen Shouda Liu Wei Lin 0016 Yuan Xie 0001 Ouroboros: An Inference Engine for Deep Learning Based TTS on Embedded Devices. 1-28 2019 Hot Chips Symposium https://doi.org/10.1109/HOTCHIPS.2019.8875664 conf/hotchips/2019 db/conf/hotchips/hotchips2019.html#ZhangXJLCLLX19 Qiangpeng Yang Hongsheng Jin Mengli Cheng Wenmeng Zhou Jun Huang 0007 Wei Lin 0016 Scene Text Recognition with Auto-Aligned Feature Generator. 1426-1431 2019 ICDM https://doi.org/10.1109/ICDM.2019.00185 conf/icdm/2019 db/conf/icdm/icdm2019.html#YangJCZHL19 Mengdi Wang 0001 Chen Meng Guoping Long Chuan Wu 0001 Jun Yang 0052 Wei Lin 0016 Yangqing Jia Characterizing Deep Learning Training Workloads on Alibaba-PAI. 189-202 2019 IISWC https://doi.org/10.1109/IISWC47752.2019.9042047 conf/iiswc/2019 db/conf/iiswc/iiswc2019.html#WangMLWYLJ19

Rong Zhu Kun Zhao Hongxia Yang Wei Lin 0016 Chang Zhou 0005 Baole Ai Yong Li 0045 Jingren Zhou 0001 AliGraph: A Comprehensive Graph Neural Network Platform. 2019 abs/1902.08730 CoRR http://arxiv.org/abs/1902.08730 db/journals/corr/corr1902.html#abs-1902-08730

Yanghua Peng Yixin Bao Yangrui Chen Chuan Wu 0001 Chen Meng Wei Lin 0016 DL2: A Deep Learning-driven Scheduler for Deep Learning Clusters. 2019 abs/1909.06040 CoRR http://arxiv.org/abs/1909.06040 db/journals/corr/corr1909.html#abs-1909-06040

Mengdi Wang 0001 Chen Meng Guoping Long Chuan Wu 0001 Jun Yang 0052 Wei Lin 0016 Yangqing Jia Characterizing Deep Learning Training Workloads on Alibaba-PAI. 2019 abs/1910.05930 CoRR http://arxiv.org/abs/1910.05930 db/journals/corr/corr1910.html#abs-1910-05930

Guoping Long Jun Yang 0052 Wei Lin 0016 FusionStitching: Boosting Execution Efficiency of Memory Intensive Computations for DL Workloads. 2019 abs/1911.11576 CoRR http://arxiv.org/abs/1911.11576 db/journals/corr/corr1911.html#abs-1911-11576

Minghui Qiu Liu Yang 0005 Feng Ji Wei Zhou Jun Huang 0007 Haiqing Chen W. Bruce Croft Wei Lin 0016 Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce. 208-213 2018 ACL (2) https://aclanthology.org/P18-2034/ https://doi.org/10.18653/v1/P18-2034 conf/acl/2018-2 db/conf/acl/acl2018-2.html#QiuYJZHCCL18 Qing Zhang Mengru Zhang Mengdi Wang 0001 Wanchen Sui Chen Meng Jun Yang 0052 Weidan Kong Xiaoyuan Cui Wei Lin 0016 Efficient Deep Learning Inference Based on Model Compression. 1695-1702 2018 CVPR Workshops http://openaccess.thecvf.com/content_cvpr_2018_workshops/w33/html/Zhang_Efficient_Deep_Learning_CVPR_2018_paper.html https://doi.org/10.1109/CVPRW.2018.00221 https://doi.ieeecomputersociety.org/10.1109/CVPRW.2018.00221 conf/cvpr/2018w db/conf/cvpr/cvprw2018.html#ZhangZWSMYKCL18 Qiangpeng Yang Mengli Cheng Wenmeng Zhou Yan Chen Minghui Qiu Wei Lin 0016 IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detection. 1071-1077 2018 IJCAI https://doi.org/10.24963/ijcai.2018/149 conf/ijcai/2018 db/conf/ijcai/ijcai2018.html#YangCZCQL18

Qiangpeng Yang Mengli Cheng Wenmeng Zhou Yan Chen Minghui Qiu Wei Lin 0016 Wei Chu IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detection. 2018 abs/1805.01167 CoRR http://arxiv.org/abs/1805.01167 db/journals/corr/corr1805.html#abs-1805-01167

Minghui Qiu Liu Yang 0005 Feng Ji Weipeng Zhao Wei Zhou Jun Huang 0007 Haiqing Chen W. Bruce Croft Wei Lin 0016 Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce. 2018 abs/1806.05434 CoRR http://arxiv.org/abs/1806.05434 db/journals/corr/corr1806.html#abs-1806-05434

Guoping Long Jun Yang 0052 Kai Zhu Wei Lin 0016 FusionStitching: Deep Fusion and Code Generation for Tensorflow Computations on GPUs. 2018 abs/1811.05213 CoRR http://arxiv.org/abs/1811.05213 db/journals/corr/corr1811.html#abs-1811-05213

Mengdi Wang 0001 Qing Zhang Jun Yang 0052 Xiaoyuan Cui Wei Lin 0016 Graph-Adaptive Pruning for Efficient Inference of Convolutional Neural Networks. 2018 abs/1811.08589 CoRR http://arxiv.org/abs/1811.08589 db/journals/corr/corr1811.html#abs-1811-08589

Wei Lin 0016 Haochuan Fan Zhengping Qian Junwei Xu Sen Yang Jingren Zhou 0001 Lidong Zhou StreamScope: Continuous Reliable Distributed Processing of Big Data Streams. 439-453 2016 NSDI https://www.usenix.org/conference/nsdi16/technical-sessions/presentation/lin conf/nsdi/2016 db/conf/nsdi/nsdi2016.html#LinFQXYZZ16

Xuepeng Fan Zhenyu Guo Hai Jin 0001 Xiaofei Liao Jiaxing Zhang Hucheng Zhou Sean McDirmid Wei Lin 0016 Jingren Zhou 0001 Lidong Zhou Spotting Code Optimizations in Data-Parallel Pipelines through PeriSCOPE. 1718-1731 2015 26 IEEE Trans. Parallel Distributed Syst. 6 https://doi.org/10.1109/TPDS.2014.2326416 http://doi.ieeecomputersociety.org/10.1109/TPDS.2014.2326416 https://www.wikidata.org/entity/Q114628428 db/journals/tpds/tpds26.html#FanGJLZZMLZZ15

Tian Xiao Jiaxing Zhang Hucheng Zhou Zhenyu Guo Sean McDirmid Wei Lin 0016 Wenguang Chen Lidong Zhou Nondeterminism in MapReduce considered harmful? an empirical study on non-commutative aggregators in MapReduce programs. 44-53 2014 ICSE Companion https://doi.org/10.1145/2591062.2591177 conf/icse/2014c db/conf/icse/icse2014c.html#XiaoZZGMLCZ14 Tian Xiao Zhenyu Guo Hucheng Zhou Jiaxing Zhang Xu Zhao 0004 Chencheng Ye 0001 Xi Wang 0005 Wei Lin 0016 Wenguang Chen Lidong Zhou Cybertron: pushing the limit on I/O reduction in data-parallel programs. 895-908 2014 OOPSLA https://doi.org/10.1145/2660193.2660204 https://doi.org/10.1145/2714064.2660204 conf/oopsla/2014 db/conf/oopsla/oopsla2014.html#XiaoGZZZYWLCZ14 Eric Boutin Jaliya Ekanayake Wei Lin 0016 Bing Shi Jingren Zhou 0001 Zhengping Qian Ming Wu 0007 Lidong Zhou Apollo: Scalable and Coordinated Scheduling for Cloud-Scale Computing. 285-300 2014 OSDI https://www.usenix.org/conference/osdi14/technical-sessions/presentation/boutin conf/osdi/2014 db/conf/osdi/osdi2014.html#BoutinELSZQWZ14 Sihan Li Hucheng Zhou Haoxiang Lin Tian Xiao Haibo Lin Wei Lin 0016 Tao Xie 0001 A characteristic study on failures of production distributed data-parallel programs. 963-972 2013 ICSE https://doi.org/10.1109/ICSE.2013.6606646 https://doi.ieeecomputersociety.org/10.1109/ICSE.2013.6606646 http://dl.acm.org/citation.cfm?id=2486921 conf/icse/2013 db/conf/icse/icse2013.html#LiZLXLLX13 Jiaxing Zhang Hucheng Zhou Rishan Chen Xuepeng Fan Zhenyu Guo Haoxiang Lin Jack Li 0001 Wei Lin 0016 Jingren Zhou 0001 Lidong Zhou Optimizing Data Shuffling in Data-Parallel Computation by Understanding User-Defined Functions. 295-308 2012 NSDI https://www.usenix.org/conference/nsdi12/technical-sessions/presentation/zhang conf/nsdi/2012 db/conf/nsdi/nsdi2012.html#ZhangZCFGLLLZZ12 Zhenyu Guo Xuepeng Fan Rishan Chen Jiaxing Zhang Hucheng Zhou Sean McDirmid Chang Liu 0021 Wei Lin 0016 Jingren Zhou 0001 Lidong Zhou Spotting Code Optimizations in Data-Parallel Pipelines through PeriSCOPE. 121-133 2012 OSDI https://www.usenix.org/conference/osdi12/technical-sessions/presentation/guo conf/osdi/2012 db/conf/osdi/osdi2012.html#GuoFCZZMLLZZ12 Jingren Zhou 0001 Nicolas Bruno Wei Lin 0016 Advanced partitioning techniques for massively distributed computation. 13-24 2012 SIGMOD Conference https://doi.org/10.1145/2213836.2213839 conf/sigmod/2012 db/conf/sigmod/sigmod2012.html#ZhouBL12 Bingsheng He Mao Yang 0004 Zhenyu Guo Rishan Chen Bing Su Wei Lin 0016 Lidong Zhou Comet: batched stream processing for data intensive distributed computing. 63-74 2010 SoCC https://doi.org/10.1145/1807128.1807139 conf/cloud/2010 db/conf/cloud/socc2010.html#HeYGCSLZ10 Bingsheng He Mao Yang 0004 Zhenyu Guo Rishan Chen Wei Lin 0016 Bing Su Hongyi Wang Lidong Zhou Wave Computing in the Cloud. 2009 HotOS http://www.usenix.org/events/hotos09/tech/full_papers/he/he.pdf conf/hotos/2009 db/conf/hotos/hotos2009.html#HeYGCLSWZ09 Baole Ai Zhulin An Jinze Bai Junjie Bai Yixin Bao Eric Boutin Nicolas Bruno Deng Cai 0001 Dennis Cai Hua Cai Jiamin Cao Zongyan Cao Bujiao Chen Cen Chen 0001 Daoyuan Chen Haiqing Chen Haoyu Chen Houjiang Chen Jiaoyan Chen Kai Chen 0008 Kehan Chen Langshi Chen Liang Chen 0001 Quan Chen 0001 Quan Chen 0002 Rishan Chen Wenguang Chen Yan Chen Yangrui Chen Yanqing Chen Yingda Chen Yiquan Chen Yushuo Chen Mengli Cheng Sheng Cheng 0002 Shenggan Cheng Yi Cheng Yu Cheng Wei Chu W. Bruce Croft Weihao Cui Xiaoyuan Cui Hongbo Deng Xiaodong Deng Lansong Diao Bolin Ding Li Ding Ming Ding 0004 Yu Ding Zixiang Ding Jianbo Dong Shunli Dou Jiangsu Du Qing Du Xiaoyong Du 0001 Zhuoyun Du Jaliya Ekanayake Haochuan Fan Shiqing Fan Xuepeng Fan Fei Feng Yihui Feng Zhichao Feng Binzhang Fu Dehong Gao Jiaqi Gao Ce Ge Yiliang Gu Tao Guan Yu Guan 0005 Lin Guo Minyi Guo Tianyou Guo Zhenyu Guo Nezihe Merve Gürel Ruidong Han Ying Han Bingsheng He Jian He 0004 Jun He Kunling He Zhiqiang He Pengyang Hou Renjun Hu Ziyue Hua Jun Huang 0007 Kunzhe Huang Lianghua Huang Minlie Huang Ruirui Huang Yilun Huang 0004 Ziming Huang Feng Ji Zhigang Ji Weile Jia Xianyan Jia Yangqing Jia Fei Jiang 0009 Guoqing Jiang Le Jiang Nana Jiang Xiaotang Jiang Zhao Jiang Hairong Jiao Wenpin Jiao Di Jin 0001 Hai Jin 0001 Hongsheng Jin Yicheng Jin Weidan Kong Ran Le Kuang-chih LeeKuang-Chih Lee Jingwen Leng Bofang Li Chao Li 0009 Dan Li 0001 Feng Li 0067 Jack Li 0001 Jialin Li 0001 Jiatong Li 0002 Lanbo Li Lei Li 0043 Mingzhen Li 0001 Peng Li 0056 Qingxu Li Shan Li Shen Li Sihan Li Xiang Li 0067 Xingru Li Xinyuan Li Xue Li 0024 Yaliang Li Yong Li 0008 Yong Li 0045 Yuchao Li Zhenyu Li Zhi Li Zhikang Li Zongyang Li Hao Liang 0003 Yun Liang 0001 Binbin Liao Xiaofei Liao Bin Lin Haibo Lin Haoxiang Lin Junyang Lin Shengjie Lin Chang Liu 0021 Fangming Liu Jiabei Liu Jiang Liu Jie Liu 0002 Jinquan Liu Kaibo Liu Kun Liu Ning Liu 0007 Qi Liu 0003 Qiang Liu 0036 Qidong Liu 0002 Shaoguo Liu Shouda Liu Tingting Liu Xiangwen Liu Xiaoyong Liu Yang Liu 0245 Yi Liu 0013 Yong Liu 0020 Yu Liu 0023 Yuan Liu Yuanyuan Liu 0004 Yuqiong Liu Zihan Liu 0002 Ziming Liu Zitao Liu 0001 Guoping Long Qingqing Long Gang Lu Jie Lu Liqiang Lu Shuwen Lu Yifeng Lu Zhongzhi Luan Bin Luo Jilie Luo Ziyue Luo Chengfei Lv Zhiqiang Lv Jianxin Ma Shu Ma Xu Ma Zhijian Ma Sean McDirmid Rui Men Chen Meng Libin Meng Zisheng Meng Xuebin Min Yongjia Mo Jiandong Mu Hanjie Pan Haojie Pan Shirui Pan Xuchen Pan Zaifeng Pan Qinghua Peng Tao Peng Yanghua Peng Jiaxing Qi Depei Qian 0002 Kun Qian 0004 Zhengping Qian Yu Qin Minghui Qiu Xiafei Qiu Lin Qu Luyao Ren Shiru Ren Zhihui Ren Yi Rong Kailai Shao Wenting Shen Bing Shi Chao Shi Chen Shi Xing Shi Ziji Shi Zuocheng Shi Hui Shu Xiufeng Shu Chang Si Guojie Song Shuaiwen SongShuaiwen Leon Song Yaoxu Song Yue Song Bing Su Li Su 0005 Zibin Su Wanchen Sui Biao Sun 0002 Jie Sun 0017 Ke Sun Meng Sun Minmin Sun Mingkui Tan Jie Tang 0001 Xuewei Tao Chao Tian 0001 Ang Wang Chao Wang Cheng Wang Chengyu Wang 0001 Dalin Wang Haibin Wang Hongyi Wang Jiamang Wang Jianing Wang 0002 Luzhi Wang Maolin Wang 0001 Mengdi Wang 0001 Mian Wang Ming Wang Peng Wang 0028 Pengjie Wang 0002 Qiang Wang 0022 Shuai Wang 0028 Siyu Wang 0006 Wei Wang 0030 Weicheng Wang Xi Wang 0005 Yejing Wang Zeke Wang Zhen Wang 0036 Zhicheng Wang Zishu Wang Xuetao Wei Yuanxin Wei Yonggang Wen 0001 Qizhen Weng 0001 Chencan Wu Chuan Wu 0001 Fei Wu 0001 Hanqing Wu Hao Wu 0077 Jian Wu 0001 Jiesheng Wu Ming Wu 0007 Ruofan Wu Yiqing Wu Haojun Xia Jiaxin Xia Lixue Xia Nong Xiao 0001 Tian Xiao Wencong Xiao Xiaokui Xiao Jiaming Xie Junjie Xie Tao Xie 0001 Yuan Xie 0001 Yuexiang Xie Chen Xing Fei Xu Hongtao Xu Jian Xu 0015 Junwei Xu Qi Xu Suwei Xu Tianyin Xu Yichi Xu Yong Xu 0007 Yongjun Xu 0001 Yunlong Xu Yuyang Xu Chunyu Xue Jinbao Xue Bencheng Yan Xu Yan An Yang Chaojie Yang Hailong Yang 0002 Hongxia Yang Jun Yang 0052 Liu Yang 0005 Mao Yang 0004 Qiangpeng Yang Sen Yang Siran Yang Xuanda Yang Xudong Yang Zhi Yang 0001 Yiwu Yao Zhiping Yao Chang'an Ye Chencheng Ye 0001 Huimin Yi Xiaodong Yi 0001 Bin Yin 0004 Zhiyu Yin Haochao Ying Yang You 0001 Bowen Yu 0002 Jin Yu Tianhang Yu Wenyuan Yu Yinghao Yu Man Yuan Xiulong Yuan Deze Zeng Xianlong Zeng Ennan Zhai Jidong Zhai Ce Zhang 0001 Chen Zhang Chi Zhang 0060 Di Zhang 0026 Feng Zhang 0007 Haotian Zhang Jiansong Zhang 0001 Jianwei Zhang 0012 Jiaxing Zhang Jie Zhang 0135 Kai Zhang 0001 Liping Zhang 0013 Lu Zhang 0023 Mengru Zhang Mingming Zhang Peng Zhang Pengcheng Zhang Qing Zhang Shiwei Zhang 0002 Shuai Zhang Shulai Zhang Taolin Zhang 0001 Wei Zhang 0012 Wenhao Zhang Xinyi Zhang Yang Zhang 0102 Yangming Zhang Yichang Zhang Yilei Zhang Yuanxing Zhang Yuting Zhang 0010 Zhendong Zhang 0004 Chuhan Zhao Han Zhao 0005 Hanyu Zhao Hui Zhao Kun Zhao Pengzhan Zhao Weipeng Zhao Wenyi Zhao Xiangyu Zhao 0001 Xu Zhao 0004 Xuanlei Zhao Zihan Zhao Bo Zheng 0007 Menglei Zheng Yizhen Zheng Zhen Zheng Zhilong Zheng Ling Zhong Chang Zhou 0005 Hucheng Zhou Huiling Zhou Jingren Zhou 0001 Lidong Zhou Wei Zhou Wenmeng Zhou Yangjie Zhou 0001 Zhongzhu Zhou Feiwen Zhu Kai Zhu Lingjun Zhu Mengxiao Zhu 0001 Rong Zhu Shuhong Zhu Yikai Zhu Yongchun Zhu Donglin Zhuang Fuzhen Zhuang Weiming Zhuang Yan Zhuang 0001 Yi Zong Xu Zou 0001