FedMT: Multitask Federated Learning With Competitive GPU Resource Sharing.

Minjia Zhang

Yongbo Yu Fuxun Yu Zirui Xu Di Wang 0003 Minjia Zhang Ang Li 0005 Chenchen Liu Zhi Tian Xiang Chen 0010 FedMT: Multitask Federated Learning With Competitive GPU Resource Sharing. 2026 March 1276-1289 45 IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 3 https://doi.org/10.1109/TCAD.2025.3600367 db/journals/tcad/tcad45.html#YuYXWZLLTC26 streams/journals/tcad

Shuzheng Si Haozhe Zhao Cheng Gao Yuzhuo Bai Zhitong Wang Bofei Gao Kangyang Luo Wenhao Li 0003 Yufei Huang 0008 Gang Chen 0039 Fanchao Qi Minjia Zhang Baobao Chang Maosong Sun 0001 Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Learning. 33001-33009 2026 AAAI https://doi.org/10.1609/aaai.v40i39.40582 conf/aaai/2026 db/conf/aaai/aaai2026.html#SiZGBWGLLHCQZCS26 Xinyu Lian Masahiro Tanaka Olatunji Ruwase Minjia Zhang SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips. 249-264 2026 ASPLOS (1) https://doi.org/10.1145/3760250.3762217 conf/asplos/2026-1 db/conf/asplos/asplos2026-1.html#LianTRZ26

Zhixiang Liang Beichen Huang Zheng Wang Minjia Zhang Hidden States as Early Signals: Step-level Trace Evaluation and Pruning for Efficient Test-Time Scaling. 2026 January abs/2601.09093 CoRR https://doi.org/10.48550/arXiv.2601.09093 db/journals/corr/corr2601.html#abs-2601-09093 streams/journals/corr

Jiahuan Yu Mingtao Hu Zichao Lin Minjia Zhang SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips. 2026 January abs/2601.20309 CoRR https://doi.org/10.48550/arXiv.2601.20309 db/journals/corr/corr2601.html#abs-2601-20309 streams/journals/corr

Hongbo Zheng Afshin Bozorgpour Dorit Merhof Minjia Zhang Gated Differential Linear Attention: A Linear-Time Decoder for High-Fidelity Medical Segmentation. 2026 March abs/2603.02727 CoRR https://doi.org/10.48550/arXiv.2603.02727 db/journals/corr/corr2603.html#abs-2603-02727 streams/journals/corr

Ahan Gupta Zhihao Wang Neel Dani Masahiro Tanaka Olatunji Ruwase Minjia Zhang AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism. 2026 April abs/2604.27089 CoRR https://doi.org/10.48550/arXiv.2604.27089 db/journals/corr/corr2604.html#abs-2604-27089 streams/journals/corr

Shuzheng Si Haozhe Zhao Yu Lei Qingyi Wang Dingwei Chen Zhitong Wang Zhenhailong Wang Kangyang Luo Zheng Wang Gang Chen 0039 Fanchao Qi Minjia Zhang Maosong Sun 0001 From Context to Skills: Can Language Models Learn from Context Skillfully? 2026 April abs/2604.27660 CoRR https://doi.org/10.48550/arXiv.2604.27660 db/journals/corr/corr2604.html#abs-2604-27660 streams/journals/corr

Yixiang Yao Yuhang Yao 0003 Xinyi Fan Jiechao Gao Jie Wang Minjia Zhang Srivatsan Ravi Carlee Joe-Wong Trustworthy Agent Network: Trust in Agent Networks Must Be Baked In, Not Bolted On. 2026 497 2026 IACR Cryptol. ePrint Arch. https://eprint.iacr.org/2026/497 db/journals/iacr/iacr2026.html#YaoYFGWZRJ26 streams/journals/iacr

Jingyi Xi Chenghao Mo Ben Karsin Artem M. Chirkin Mingqin Li Minjia Zhang VecFlow: A High-Performance Vector Data Management System for Filtered-Search on GPUs. 271:1-271:27 2025 3 Proc. ACM Manag. Data 4 https://doi.org/10.1145/3749189 db/journals/pacmmod/pacmmod3.html#XiMKCLZ25

Fengxiang Bie Yibo Yang Zhongzhu Zhou Adam Ghanem Minjia Zhang Zhewei Yao Xiaoxia Wu Connor Holmes Pareesa Ameneh Golnari David A. Clifton Yuxiong He Dacheng Tao Shuaiwen Leon Song RenAIssance: A Survey Into AI Text-to-Image Generation in the Era of Large Model. 2212-2231 2025 March 47 IEEE Trans. Pattern Anal. Mach. Intell. 3 https://doi.org/10.1109/TPAMI.2024.3522305 db/journals/pami/pami47.html#BieYZGZYWHGCHTS25 streams/journals/pami

Syed Zawad Xiaolong Ma Jun Yi Cheng Li 0001 Minjia Zhang Lei Yang 0001 Feng Yan 0001 Yuxiong He FedCust: Offloading hyperparameter customization for federated learning. 102450 2025 167 Perform. Evaluation https://doi.org/10.1016/j.peva.2024.102450 db/journals/pe/pe167.html#ZawadMYLZYYH25 streams/journals/pe

Akshat Sharma Hangliang Ding Jianping Li Neel Dani Minjia Zhang MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference. 18506-18523 2025 ACL (Findings) https://doi.org/10.18653/v1/2025.findings-acl.952 https://aclanthology.org/2025.findings-acl.952/ conf/acl/2025f db/conf/acl/acl2025f.html#SharmaDLDZ25 Xiao Wang Mengjue Tan Qiao Jin 0001 Guangzhi Xiong Yu Hu Aidong Zhang 0001 Zhiyong Lu Minjia Zhang MedCite: Can Language Models Generate Verifiable Text for Medicine? 18891-18913 2025 ACL (Findings) https://doi.org/10.18653/v1/2025.findings-acl.967 https://aclanthology.org/2025.findings-acl.967/ conf/acl/2025f db/conf/acl/acl2025f.html#WangT0XHZLZ25 Alireza Namazi Haiying Shen Tanmoy Sen Minjia Zhang Degree-Based Scheduling and Memory Management for Large-Scale Exact Online GNN Inference. 1-10 2025 IEEE Big Data https://doi.org/10.1109/BigData66926.2025.11402115 conf/bigdataconf/2025 db/conf/bigdataconf/bigdataconf2025.html#NamaziSSZ25 Mingyuan Wu Jize Jiang Haozhen Zheng Meitang Li Zhaoheng Li Beitong Tian Bo Chen 0025 Yongjoo Park Minjia Zhang ChengXiang Zhai Klara Nahrstedt Cache-of-Thought: Master-Apprentice Framework for Cost-Effective Vision Language Model Reasoning. 1895-1909 2025 EMNLP https://doi.org/10.18653/v1/2025.emnlp-main.97 conf/emnlp/2025 db/conf/emnlp/emnlp2025.html#WuJZLLTCPZZN25 streams/conf/emnlp Haozhe Zhao Shuzheng Si Liang Chen 0024 Yichi Zhang 0010 Maosong Sun 0001 Baobao Chang Minjia Zhang Looking Beyond Text: Reducing Language Bias in Large Vision-Language Models via Multimodal Dual-Attention and Soft-Image Guidance. 19666-19690 2025 EMNLP https://doi.org/10.18653/v1/2025.emnlp-main.995 conf/emnlp/2025 db/conf/emnlp/emnlp2025.html#ZhaoSCZSCZ25 streams/conf/emnlp Shuangyan Yang Minjia Zhang Dong Li Buffalo: Enabling Large-Scale GNN Training via Memory-Efficient Bucketization. 1066-1081 2025 HPCA https://doi.org/10.1109/HPCA61900.2025.00083 conf/hpca/2025 db/conf/hpca/hpca2025.html#YangZL25 Zihan Liu 0002 Xinhao Luo Junxian Guo Wentao Ni Yangjie Zhou 0001 Yue Guan 0003 Cong Guo 0003 Weihao Cui Yu Feng 0007 Minyi Guo Yuhao Zhu 0001 Minjia Zhang Chen Jin Jingwen Leng VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference. 1496-1509 2025 HPCA https://doi.org/10.1109/HPCA61900.2025.00112 conf/hpca/2025 db/conf/hpca/hpca2025.html#0002LGN000C0G0Z25 Yiming Gong Zhen Zhu Minjia Zhang InstantEdit: Text-Guided Few-Step Image Editing with Piecewise Rectified Flow. 2025 ICCV 16808-16817 conf/iccv/2025 https://doi.org/10.1109/ICCV51701.2025.01561 db/conf/iccv/iccv2025.html#GongZZ25 streams/conf/iccv Xinyu Lian Yinfang Chen Runxiang Cheng Jie Huang 0009 Parth Thakkar Minjia Zhang Tianyin Xu Large Language Models as Configuration Validators. 1704-1716 2025 ICSE https://doi.org/10.1109/ICSE55347.2025.00017 conf/icse/2025 db/conf/icse/icse2025.html#LianCC0TZX25 Jinghan Huang 0001 Hyungyo Kim Nachuan Wang Jaeyoung Kang 0004 Hrishi Shah Eun Kyung Lee Minjia Zhang Fan Lai 0001 Nam Sung Kim NetZIP: Algorithm/Hardware Co-design of In-network Lossless Compression for Distributed Large Model Training. 609-625 2025 MICRO https://doi.org/10.1145/3725843.3756079 conf/micro/2025 db/conf/micro/micro2025.html#0001KW0SLZLK25 Beichen Huang Yueming Yuan Zelei Shao Minjia Zhang MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators. 2025 MLSys https://openreview.net/forum?id=NXVXiJmhe1 https://proceedings.mlsys.org/paper_files/paper/2025/hash/9032e5c9ec394ce768a2fa9bdc56af6c-Abstract-Conference.html conf/mlsys/2025 db/conf/mlsys/mlsys2025.html#HuangYSZ25 Boyuan Tian Qizhe Gao Siran Xianyu Xiaotong Cui Minjia Zhang FlexGaussian: Flexible and Cost-Effective Training-Free Compression for 3D Gaussian Splatting. 7287-7296 2025 ACM Multimedia https://doi.org/10.1145/3746027.3754744 conf/mm/2025 db/conf/mm/mm2025.html#TianGXCZ25 Yueming Yuan Ahan Gupta Jianping Li Sajal Dash Feiyi Wang Minjia Zhang X-MoE: Enabling Scalable Training for Emerging Mixture-of-Experts Architectures on HPC Platforms. 1315-1331 2025 SC https://doi.org/10.1145/3712285.3759886 conf/sc/2025 db/conf/sc/sc2025.html#YuanGLDWZ25 Zhiwei Ren Junbo Li Minjia Zhang Di Wang 0003 Xiaoran Fan Longfei Shangguan Toward Sensor-In-the-Loop LLM Agent: Benchmarks and Implications. 254-267 2025 SenSys https://doi.org/10.1145/3715014.3722082 conf/sensys/2025 db/conf/sensys/sensys2025.html#RenLZ0FS25 Xinyu Lian Sam Ade Jacobs Lev Kurilenko Masahiro Tanaka Stas Bekman Olatunji Ruwase Minjia Zhang Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelism. 1519-1534 2025 USENIX ATC https://www.usenix.org/conference/atc25/presentation/lian conf/usenix/2025 db/conf/usenix/usenix2025.html#LianJKTBRZ25 Yueming Yuan Ahan Gupta Jianping Li Sajal Dash Feiyi Wang Minjia Zhang X-MoE: Enabling Scalable Training for Emerging Mixture-of-Experts Architectures on HPC Platforms. Zenodo 2025 August https://doi.org/10.5281/zenodo.16896606 streams/repo/zenodo

Guangzhi Xiong Qiao Jin 0001 Xiao Wang Yin Fang Haolin Liu Yifan Yang 0006 Fangyuan Chen 0002 Zhixing Song Dengyu Wang Minjia Zhang Zhiyong Lu Aidong Zhang 0001 RAG-Gym: Optimizing Reasoning and Search Agents with Process Supervision. 2025 February abs/2502.13957 CoRR https://doi.org/10.48550/arXiv.2502.13957 db/journals/corr/corr2502.html#abs-2502-13957 streams/journals/corr

Mingyuan Wu Jize Jiang Haozhen Zheng Meitang Li Zhaoheng Li Beitong Tian Bo Chen 0025 Yongjoo Park Minjia Zhang Chengxiang Zhai Klara Nahrstedt Cache-of-Thought: Master-Apprentice Framework for Cost-Effective Vision Language Model Inference. 2025 February abs/2502.20587 CoRR https://doi.org/10.48550/arXiv.2502.20587 db/journals/corr/corr2502.html#abs-2502-20587 streams/journals/corr

Zihan Liu 0002 Xinhao Luo Junxian Guo Wentao Ni Yangjie Zhou 0001 Yue Guan 0003 Cong Guo 0003 Weihao Cui Yu Feng 0007 Minyi Guo Yuhao Zhu 0001 Minjia Zhang Jingwen Leng Chen Jin VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference. 2025 March abs/2503.02236 CoRR https://doi.org/10.48550/arXiv.2503.02236 db/journals/corr/corr2503.html#abs-2503-02236 streams/journals/corr

Beichen Huang Yueming Yuan Zelei Shao Minjia Zhang MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators. 2025 April abs/2504.02658 CoRR https://doi.org/10.48550/arXiv.2504.02658 db/journals/corr/corr2504.html#abs-2504-02658 streams/journals/corr

Mingyuan Wu Jingcheng Yang Jize Jiang Meitang Li Kaizhuo Yan Hanchao Yu Minjia Zhang Chengxiang Zhai Klara Nahrstedt VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use. 2025 May abs/2505.19255 CoRR https://doi.org/10.48550/arXiv.2505.19255 db/journals/corr/corr2505.html#abs-2505-19255 streams/journals/corr

Jingyi Xi Chenghao Mo Benjamin Karsin Artem M. Chirkin Mingqin Li Minjia Zhang VecFlow: A High-Performance Vector Data Management System for Filtered-Search on GPUs. 2025 June abs/2506.00812 CoRR https://doi.org/10.48550/arXiv.2506.00812 db/journals/corr/corr2506.html#abs-2506-00812 streams/journals/corr

Xiao Wang Mengjue Tan Qiao Jin 0001 Guangzhi Xiong Yu Hu Aidong Zhang 0001 Zhiyong Lu Minjia Zhang MedCite: Can Language Models Generate Verifiable Text for Medicine? 2025 June abs/2506.06605 CoRR https://doi.org/10.48550/arXiv.2506.06605 db/journals/corr/corr2506.html#abs-2506-06605 streams/journals/corr

Mingyuan Wu Meitang Li Jingcheng Yang Jize Jiang Kaizhuo Yan Zhaoheng Li Minjia Zhang Klara Nahrstedt Aha Moment Revisited: Are VLMs Truly Capable of Self Verification in Inference-time Scaling? 2025 June abs/2506.17417 CoRR https://doi.org/10.48550/arXiv.2506.17417 db/journals/corr/corr2506.html#abs-2506-17417 streams/journals/corr

Hoa La Ahan Gupta Alex Morehead Jianlin Cheng Minjia Zhang MegaFold: System-Level Optimizations for Accelerating Protein Structure Prediction Models. 2025 June abs/2506.20686 CoRR https://doi.org/10.48550/arXiv.2506.20686 db/journals/corr/corr2506.html#abs-2506-20686 streams/journals/corr

Boyuan Tian Qizhe Gao Siran Xianyu Xiaotong Cui Minjia Zhang FlexGaussian: Flexible and Cost-Effective Training-Free Compression for 3D Gaussian Splatting. 2025 July abs/2507.06671 CoRR https://doi.org/10.48550/arXiv.2507.06671 db/journals/corr/corr2507.html#abs-2507-06671 streams/journals/corr

Yiming Gong Zhen Zhu Minjia Zhang InstantEdit: Text-Guided Few-Step Image Editing with Piecewise Rectified Flow. 2025 August abs/2508.06033 CoRR https://doi.org/10.48550/arXiv.2508.06033 db/journals/corr/corr2508.html#abs-2508-06033 streams/journals/corr

Yueming Yuan Ahan Gupta Jianping Li Sajal Dash Feiyi Wang Minjia Zhang X-MoE: Enabling Scalable Training for Emerging Mixture-of-Experts Architectures on HPC Platforms. 2025 August abs/2508.13337 CoRR https://doi.org/10.48550/arXiv.2508.13337 db/journals/corr/corr2508.html#abs-2508-13337 streams/journals/corr

Jiahuan Yu Aryan Taneja Junfeng Lin Minjia Zhang VoltanaLLM: Feedback-Driven Frequency Control and State-Space Routing for Energy-Efficient LLM Serving. 2025 September abs/2509.04827 CoRR https://doi.org/10.48550/arXiv.2509.04827 db/journals/corr/corr2509.html#abs-2509-04827 streams/journals/corr

Xinyu Lian Masahiro Tanaka Olatunji Ruwase Minjia Zhang SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips. 2025 September abs/2509.21271 CoRR https://doi.org/10.48550/arXiv.2509.21271 db/journals/corr/corr2509.html#abs-2509-21271 streams/journals/corr

Ziyan Wang Zheng Wang Jie Fu Xingwei Qu Qi Cheng Shengpu Tang Minjia Zhang Xiaoming Huo Slow-Fast Policy Optimization: Reposition-Before-Update for LLM Reasoning. 2025 October abs/2510.04072 CoRR https://doi.org/10.48550/arXiv.2510.04072 db/journals/corr/corr2510.html#abs-2510-04072 streams/journals/corr

Shuzheng Si Haozhe Zhao Kangyang Luo Gang Chen 0039 Fanchao Qi Minjia Zhang Baobao Chang Maosong Sun 0001 A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks. 2025 October abs/2510.05608 CoRR https://doi.org/10.48550/arXiv.2510.05608 db/journals/corr/corr2510.html#abs-2510-05608 streams/journals/corr

Yushu Zhao Zheng Wang Minjia Zhang PuzzleMoE: Efficient Compression of Large Mixture-of-Experts Models via Sparse Expert Merging and Bit-packed inference. 2025 November abs/2511.04805 CoRR https://doi.org/10.48550/arXiv.2511.04805 db/journals/corr/corr2511.html#abs-2511-04805 streams/journals/corr

Zefan Cai Haoyi Qiu Tianyi Ma Haozhe Zhao Gengze Zhou Kung-Hsiang Huang Parisa Kordjamshidi Minjia Zhang Wen Xiao Jiuxiang Gu Nanyun Peng 0001 Junjie Hu 0001 MMGR: Multi-Modal Generative Reasoning. 2025 December abs/2512.14691 CoRR https://doi.org/10.48550/arXiv.2512.14691 db/journals/corr/corr2512.html#abs-2512-14691 streams/journals/corr

Shuzheng Si Qingyi Wang Haozhe Zhao Yuzhuo Bai Guanqiao Chen Kangyang Luo Gang Chen 0039 Fanchao Qi Minjia Zhang Baobao Chang Maosong Sun 0001 FaithLens: Detecting and Explaining Faithfulness Hallucination. 2025 December abs/2512.20182 CoRR https://doi.org/10.48550/arXiv.2512.20182 db/journals/corr/corr2512.html#abs-2512-20182 streams/journals/corr

Yongye Su Yinqi Sun Minjia Zhang Jianguo Wang 0001 Vexless: A Serverless Vector Data Management System Using Cloud Functions. 187 2024 2 Proc. ACM Manag. Data 3 https://doi.org/10.1145/3654990 db/journals/pacmmod/pacmmod2.html#SuSZ024

Conglong Li Zhewei Yao Xiaoxia Wu Minjia Zhang Connor Holmes Cheng Li 0001 Yuxiong He DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing. 18490-18498 2024 AAAI https://doi.org/10.1609/aaai.v38i16.29810 conf/aaai/2024 db/conf/aaai/aaai2024.html#LiYWZH0H24 Suyu Ge Yunan Zhang 0001 Liyuan Liu Minjia Zhang Jiawei Han 0001 Jianfeng Gao 0001 Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs. 2024 ICLR https://openreview.net/forum?id=uNrFpDPMyo conf/iclr/2024 db/conf/iclr/iclr2024.html#Ge0LZ0024 Sam Ade Jacobs Masahiro Tanaka Chengming Zhang 0006 Minjia Zhang Reza Yazdani Aminabadi Shuaiwen Leon Song Samyam Rajbhandari Yuxiong He System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. 1206-1208 2024 IPDPS (Workshops) https://doi.org/10.1109/IPDPSW63119.2024.00208 conf/ipps/2024w db/conf/ipps/ipdps2024w.html#JacobsT0ZASRH24 Haozhe Zhao Xiaojian (Shawn) Ma Liang Chen 0024 Shuzheng Si Rujie Wu Kaikai An Peiyu Yu Minjia Zhang Qing Li 0003 Baobao Chang UltraEdit: Instruction-based Fine-Grained Image Editing at Scale. 2024 NeurIPS http://papers.nips.cc/paper_files/paper/2024/hash/05a30a0fc9e6bacdd3abd4ca8508a9e6-Abstract-Datasets_and_Benchmarks_Track.html conf/nips/2024 db/conf/nips/neurips2024.html#ZhaoMCSWAYZLC24 Jiangfei Duan Ziang Song Xupeng Miao Xiaoli Xi Dahua Lin Harry Xu 0001 Minjia Zhang Zhihao Jia Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances. 2024 NSDI https://www.usenix.org/conference/nsdi24/presentation/duan conf/nsdi/2024 db/conf/nsdi/nsdi2024.html#DuanSMXL0ZJ24 Sam Ade Jacobs Masahiro Tanaka Chengming Zhang 0006 Minjia Zhang Reza Yazdani Aminadabi Shuaiwen Leon Song Samyam Rajbhandari Yuxiong He System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. 121-130 2024 PODC https://doi.org/10.1145/3662158.3662806 https://www.wikidata.org/entity/Q130851015 conf/podc/2024 db/conf/podc/podc2024.html#JacobsT0ZASRH24

Yao Lu 0028 Song Bian 0002 Lequn Chen 0001 Yongjun He 0004 Yulong Hui Matthew Lentz Beibin Li Fei Liu Jialin Li 0001 Qi Liu Rui Liu Xiaoxuan Liu Lin Ma 0006 Kexin Rong 0001 Jianguo Wang 0001 Yingjun Wu Yongji Wu Huanchen Zhang Minjia Zhang Qizhen Zhang 0001 Tianyi Zhou 0001 Danyang Zhuo Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native. 2024 abs/2401.12230 CoRR https://doi.org/10.48550/arXiv.2401.12230 db/journals/corr/corr2401.html#abs-2401-12230

Jiangfei Duan Ziang Song Xupeng Miao Xiaoli Xi Dahua Lin Harry Xu 0001 Minjia Zhang Zhihao Jia Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances. 2024 abs/2403.14097 CoRR https://doi.org/10.48550/arXiv.2403.14097 db/journals/corr/corr2403.html#abs-2403-14097

Xinyu Lian Sam Ade Jacobs Lev Kurilenko Masahiro Tanaka Stas Bekman Olatunji Ruwase Minjia Zhang Universal Checkpointing: Efficient and Flexible Checkpointing for Large Scale Distributed Training. 2024 abs/2406.18820 CoRR https://doi.org/10.48550/arXiv.2406.18820 db/journals/corr/corr2406.html#abs-2406-18820 streams/journals/corr

Haozhe Zhao Xiaojian Ma 0001 Liang Chen 0024 Shuzheng Si Rujie Wu Kaikai An Peiyu Yu Minjia Zhang Qing Li 0003 Baobao Chang UltraEdit: Instruction-based Fine-Grained Image Editing at Scale. 2024 abs/2407.05282 CoRR https://doi.org/10.48550/arXiv.2407.05282 db/journals/corr/corr2407.html#abs-2407-05282 streams/journals/corr

Zheng Wang Boxiao Jin Zhongzhi Yu Minjia Zhang Model Tells You Where to Merge: Adaptive KV Cache Merging for LLMs on Long-Context Tasks. 2024 abs/2407.08454 CoRR https://doi.org/10.48550/arXiv.2407.08454 db/journals/corr/corr2407.html#abs-2407-08454 streams/journals/corr

Guangzhi Xiong Qiao Jin 0001 Xiao Wang Minjia Zhang Zhiyong Lu Aidong Zhang 0001 Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questions. 2024 abs/2408.00727 CoRR https://doi.org/10.48550/arXiv.2408.00727 db/journals/corr/corr2408.html#abs-2408-00727 streams/journals/corr

Jason Vega Junsheng Huang Gaokai Zhang Hangoo Kang Minjia Zhang Gagandeep Singh 0001 Stochastic Monkeys at Play: Random Augmentations Cheaply Break LLM Safety Alignment. 2024 abs/2411.02785 CoRR https://doi.org/10.48550/arXiv.2411.02785 db/journals/corr/corr2411.html#abs-2411-02785 streams/journals/corr

Deming Chen Alaa Youssef Ruchi Pendse André Schleife Bryan K. Clark Hendrik F. Hamann Jingrui He Teodoro Laino Lav R. Varshney Yuxiong Wang Avirup Sil Reyhaneh Jabbarvand Tianyin Xu Volodymyr V. Kindratenko Carlos H. A. Costa Sarita V. Adve Charith Mendis Minjia Zhang Santiago Núñez-Corrales Raghu K. Ganti Mudhakar Srivatsa Nam Sung Kim Josep Torrellas Jian Huang 0006 Seetharami R. Seelam Klara Nahrstedt Tarek F. Abdelzaher Tamar Eilam Huimin Zhao Matteo Manica Ravishankar K. Iyer Martin Hirzel Vikram S. Adve Darko Marinov Hubertus Franke Hanghang Tong Elizabeth A. Ainsworth Han Zhao 0002 Deepak Vasisht Minh Do Fábio Oliveira Giovanni Pacifici Ruchir Puri Priya Nagpurkar Transforming the Hybrid Cloud for Emerging AI Workloads. 2024 abs/2411.13239 CoRR https://doi.org/10.48550/arXiv.2411.13239 db/journals/corr/corr2411.html#abs-2411-13239 streams/journals/corr

Akshat Sharma Hangliang Ding Jianping Li Neel Dani Minjia Zhang MiniKV: Pushing the Limits of LLM Inference via 2-Bit Layer-Discriminative KV Cache. 2024 abs/2411.18077 CoRR https://doi.org/10.48550/arXiv.2411.18077 db/journals/corr/corr2411.html#abs-2411-18077 streams/journals/corr

Liang Chen 0024 Zekun Wang Shuhuai Ren Lei Li 0039 Haozhe Zhao Yunshui Li Zefan Cai Hongcheng Guo Lei Zhang 0201 Yizhe Xiong Yichi Zhang 0010 Ruoyu Wu Qingxiu Dong Ge Zhang 0009 Jian Yang 0003 Lingwei Meng Shujie Hu Yulong Chen 0001 Junyang Lin Shuai Bai Andreas Vlachos 0001 Xu Tan 0003 Minjia Zhang Wen Xiao Aaron Yee Tianyu Liu 0001 Baobao Chang Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey. 2024 abs/2412.18619 CoRR https://doi.org/10.48550/arXiv.2412.18619 db/journals/corr/corr2412.html#abs-2412-18619 streams/journals/corr

Minjia Zhang Jie Ren 0015 Zhen Peng Ruoming Jin Dong Li 0001 Bin Ren iQAN: Fast and Accurate Vector Search with Efficient Intra-Query Parallelism on Multi-Core Architectures. 22-38 2023 47 IEEE Data Eng. Bull. 3 http://sites.computer.org/debull/A23sept/p22.pdf db/journals/debu/debu46.html#Zhang0PJLR23

Reza Yazdani Aminabadi Olatunji Ruwase Minjia Zhang Yuxiong He José-María Arnau Antonio González 0001 SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks. 30:1-30:23 2023 March 22 ACM Trans. Embed. Comput. Syst. 2 https://doi.org/10.1145/3552513 https://www.wikidata.org/entity/Q131023910 db/journals/tecs/tecs22.html#AminabadiRZHAG23

Shuangyan Yang Minjia Zhang Wenqian Dong Dong Li 0001 Betty: Enabling Large-Scale GNN Training with Batch-Level Graph Partitioning. 103-117 2023 ASPLOS (2) https://doi.org/10.1145/3575693.3575725 conf/asplos/2023-2 db/conf/asplos/asplos2023-2.html#YangZD023 Minjia Zhang Uma-Naresh Niranjan Yuxiong He Revisiting the Efficiency-Accuracy Tradeoff in Adapting Transformer Models via Adversarial Fine-Tuning. 3026-3033 2023 ECAI https://doi.org/10.3233/FAIA230619 conf/ecai/2023 db/conf/ecai/ecai2023.html#ZhangNH23 Yucheng Lu 0003 Conglong Li Minjia Zhang Christopher De Sa Yuxiong He Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam. 2023 ICLR https://openreview.net/forum?id=-CefY2EOupj conf/iclr/2023 db/conf/iclr/iclr2023.html#LuLZSH23 Xinyue Ma Suyeon Jeong Minjia Zhang Di Wang 0003 Jonghyun Choi Myeongjae Jeon Cost-effective On-device Continual Learning over Memory Hierarchy with Miro. 83:1-83:15 2023 MobiCom https://doi.org/10.1145/3570361.3613297 https://www.wikidata.org/entity/Q130960503 conf/mobicom/2023 db/conf/mobicom/mobicom2023.html#MaJZWCJ23 John Thorpe Pengzhan Zhao Jonathan Eyolfson Yifan Qiao 0002 Zhihao Jia Minjia Zhang Ravi Netravali Guoqing Harry Xu Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs. 497-513 2023 NSDI https://www.usenix.org/conference/nsdi23/presentation/thorpe conf/nsdi/2023 db/conf/nsdi/nsdi2023.html#ThorpeZEQJZNX23 Zhen Peng Minjia Zhang Kai Li Ruoming Jin Bin Ren iQAN: Fast and Accurate Vector Search with Efficient Intra-Query Parallelism on Multi-Core Architectures. 313-328 2023 PPoPP https://doi.org/10.1145/3572848.3577527 conf/ppopp/2023 db/conf/ppopp/ppopp2023.html#PengZLJR23

Min Zhang Fuxun Yu Yongbo Yu Minjia Zhang Ang Li 0005 Xiang Chen 0010 FedHC: A Scalable Federated Learning Framework for Heterogeneous and Resource-Constrained Clients. 2023 abs/2305.15668 CoRR https://doi.org/10.48550/arXiv.2305.15668 db/journals/corr/corr2305.html#abs-2305-15668

Zhewei Yao Reza Yazdani Aminabadi Olatunji Ruwase Samyam Rajbhandari Xiaoxia Wu Ammar Ahmad Awan Jeff Rasley Minjia Zhang Conglong Li Connor Holmes Zhongzhu Zhou Michael Wyatt Molly Smith Lev Kurilenko Heyang Qin Masahiro Tanaka Shuai Che Shuaiwen Leon Song Yuxiong He DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales. 2023 abs/2308.01320 CoRR https://doi.org/10.48550/arXiv.2308.01320 db/journals/corr/corr2308.html#abs-2308-01320

Xinyue Ma Suyeon Jeong Minjia Zhang Di Wang 0003 Jonghyun Choi Myeongjae Jeon Cost-effective On-device Continual Learning over Memory Hierarchy with Miro. 2023 abs/2308.06053 CoRR https://doi.org/10.48550/arXiv.2308.06053 db/journals/corr/corr2308.html#abs-2308-06053

Fengxiang Bie Yibo Yang Zhongzhu Zhou Adam Ghanem Minjia Zhang Zhewei Yao Xiaoxia Wu Connor Holmes Pareesa Ameneh Golnari David A. Clifton Yuxiong He Dacheng Tao Shuaiwen Leon Song RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model. 2023 abs/2309.00810 CoRR https://doi.org/10.48550/arXiv.2309.00810 db/journals/corr/corr2309.html#abs-2309-00810

Zhewei Yao Xiaoxia Wu Conglong Li Minjia Zhang Heyang Qin Olatunji Ruwase Ammar Ahmad Awan Samyam Rajbhandari Yuxiong He DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention. 2023 abs/2309.14327 CoRR https://doi.org/10.48550/arXiv.2309.14327 db/journals/corr/corr2309.html#abs-2309-14327

Sam Ade Jacobs Masahiro Tanaka Chengming Zhang 0006 Minjia Zhang Shuaiwen Leon Song Samyam Rajbhandari Yuxiong He DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. 2023 abs/2309.14509 CoRR https://doi.org/10.48550/arXiv.2309.14509 db/journals/corr/corr2309.html#abs-2309-14509

Suyu Ge Yunan Zhang 0001 Liyuan Liu Minjia Zhang Jiawei Han 0001 Jianfeng Gao 0001 Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs. 2023 abs/2310.01801 CoRR https://doi.org/10.48550/arXiv.2310.01801 db/journals/corr/corr2310.html#abs-2310-01801

Shuaiwen Leon Song Bonnie Kruft Minjia Zhang Conglong Li Shiyang Chen 0004 Chengming Zhang 0006 Masahiro Tanaka Xiaoxia Wu Jeff Rasley Ammar Ahmad Awan Connor Holmes Martin Cai Adam Ghanem Zhongzhu Zhou Yuxiong He Pete Luferenko Divya Kumar Jonathan A. Weyn Ruixiong Zhang Sylwester Klocek Volodymyr Vragov Mohammed AlQuraishi Gustaf Ahdritz Christina Floristean Cristina Negri Rao Kotamarthi Venkatram Vishwanath Arvind Ramanathan Sam Foreman Kyle Hippe Troy Arcomano Romit Maulik Maxim Zvyagin Alexander Brace Bin Zhang Cindy Orozco Bohorquez Austin Clyde Bharat Kale Danilo Perez-Rivera Heng Ma Carla M. Mann Michael W. Irvin J. Gregory Pauloski Logan T. Ward Valérie Hayot-Sasson Murali Emani Zhen Xie Diangen Lin Maulik Shukla Ian T. Foster James J. Davis 0002 Michael E. Papka Thomas S. Brettin Prasanna Balaprakash Gina Tourassi John Gounley Heidi A. Hanson Thomas E. Potok Massimiliano Lupo Pasini Kate Evans Dan Lu 0001 Dalton D. Lunga Junqi Yin Sajal Dash Feiyi Wang Mallikarjun Shankar Isaac Lyngaas Xiao Wang 0004 Guojing Cong Pei Zhang Ming Fan Siyan Liu Adolfy Hoisie Shinjae Yoo Yihui Ren 0001 William Tang 0002 Kyle Felker Alexey Svyatkovskiy Hang Liu 0001 Ashwin M. Aji Angela Dalton Michael J. Schulte Karl W. Schulz Yuntian Deng Weili Nie Josh Romero Christian Dallago Arash Vahdat Chaowei Xiao Thomas Gibbs Anima Anandkumar Rick Stevens DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. 2023 abs/2310.04610 CoRR https://doi.org/10.48550/arXiv.2310.04610 db/journals/corr/corr2310.html#abs-2310-04610

Minjia Zhang Uma-Naresh Niranjan Yuxiong He Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers. 11685-11693 2022 AAAI https://doi.org/10.1609/aaai.v36i10.21423 conf/aaai/2022 db/conf/aaai/aaai2022.html#ZhangNH22 Soobee Lee Minindu Weerakoon Jonghyun Choi Minjia Zhang Di Wang 0003 Myeongjae Jeon CarM: hierarchical episodic memory for continual learning. 1147-1152 2022 DAC https://doi.org/10.1145/3489517.3530587 conf/dac/2022 db/conf/dac/dac2022.html#LeeWCZ0J22 Samyam Rajbhandari Conglong Li Zhewei Yao Minjia Zhang Reza Yazdani Aminabadi Ammar Ahmad Awan Jeff Rasley Yuxiong He DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale. 18332-18346 2022 ICML https://proceedings.mlr.press/v162/rajbhandari22a.html conf/icml/2022 db/conf/icml/icml2022.html#RajbhandariLYZA22 Conglong Li Minjia Zhang Yuxiong He The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models. 2022 conf/nips/2022 NeurIPS http://papers.nips.cc/paper_files/paper/2022/hash/aac02401755a65904cf977a33136af4a-Abstract-Conference.html db/conf/nips/neurips2022.html#LiZH22 Xiaoxia Wu Zhewei Yao Minjia Zhang Conglong Li Yuxiong He XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient. 2022 conf/nips/2022 NeurIPS http://papers.nips.cc/paper_files/paper/2022/hash/1579d5d8edacd85ac1a86aea28bdf32d-Abstract-Conference.html db/conf/nips/neurips2022.html#WuYZLH22 Zhewei Yao Reza Yazdani Aminabadi Minjia Zhang Xiaoxia Wu Conglong Li Yuxiong He ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers. 2022 conf/nips/2022 NeurIPS http://papers.nips.cc/paper_files/paper/2022/hash/adf7fa39d65e2983d724ff7da57f00ac-Abstract-Conference.html db/conf/nips/neurips2022.html#YaoAZWLH22 Reza Yazdani Aminabadi Samyam Rajbhandari Ammar Ahmad Awan Cheng Li 0001 Du Li Elton Zheng Olatunji Ruwase Shaden Smith Minjia Zhang Jeff Rasley Yuxiong He DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale. 46:1-46:15 2022 SC https://doi.org/10.1109/SC41404.2022.00051 https://dl.acm.org/doi/10.5555/3571885.3571946 conf/sc/2022 db/conf/sc/sc2022.html#AminabadiRALLZRSZRH22 Minjia Zhang Wenhan Wang Yuxiong He GraSP: Optimizing Graph-based Nearest Neighbor Search with Subgraph Sampling and Pruning. 1395-1405 2022 WSDM https://doi.org/10.1145/3488560.3498425 conf/wsdm/2022 db/conf/wsdm/wsdm2022.html#ZhangWH22 Yongbo Yu Fuxun Yu Zirui Xu Di Wang 0003 Minjia Zhang Ang Li 0005 Shawn Bray Chenchen Liu Xiang Chen 0010 Powering Multi-Task Federated Learning with Competitive GPU Resource Sharing. 567-571 2022 WWW (Companion Volume) https://doi.org/10.1145/3487553.3524859 conf/www/2022c db/conf/www/www2022c.html#YuYXWZ0BL022

Samyam Rajbhandari Conglong Li Zhewei Yao Minjia Zhang Reza Yazdani Aminabadi Ammar Ahmad Awan Jeff Rasley Yuxiong He DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale. 2022 abs/2201.05596 CoRR https://arxiv.org/abs/2201.05596 db/journals/corr/corr2201.html#abs-2201-05596

Minjia Zhang Uma-Naresh Niranjan Yuxiong He ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise. 2022 abs/2201.12469 CoRR https://arxiv.org/abs/2201.12469 db/journals/corr/corr2201.html#abs-2201-12469

Zhen Peng Minjia Zhang Kai Li Ruoming Jin Bin Ren Speed-ANN: Low-Latency and High-Accuracy Nearest Neighbor Search via Intra-Query Parallelism. 2022 abs/2201.13007 CoRR https://arxiv.org/abs/2201.13007 db/journals/corr/corr2201.html#abs-2201-13007

Yucheng Lu 0003 Conglong Li Minjia Zhang Christopher De Sa Yuxiong He Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam. 2022 abs/2202.06009 CoRR https://arxiv.org/abs/2202.06009 db/journals/corr/corr2202.html#abs-2202-06009

Fuxun Yu Di Wang 0003 Longfei Shangguan Minjia Zhang Chenchen Liu Xiang Chen 0010 A Survey of Multi-Tenant Deep Learning Inference on GPU. 2022 abs/2203.09040 CoRR https://doi.org/10.48550/arXiv.2203.09040 db/journals/corr/corr2203.html#abs-2203-09040

John Thorpe Pengzhan Zhao Jonathan Eyolfson Yifan Qiao 0002 Zhihao Jia Minjia Zhang Ravi Netravali Guoqing Harry Xu Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs. 2022 abs/2204.12013 CoRR https://doi.org/10.48550/arXiv.2204.12013 db/journals/corr/corr2204.html#abs-2204-12013

Xiaoxia Wu Zhewei Yao Minjia Zhang Conglong Li Yuxiong He Extreme Compression for Pre-trained Transformers Made Simple and Efficient. 2022 abs/2206.01859 CoRR https://doi.org/10.48550/arXiv.2206.01859 db/journals/corr/corr2206.html#abs-2206-01859

Zhewei Yao Reza Yazdani Aminabadi Minjia Zhang Xiaoxia Wu Conglong Li Yuxiong He ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers. 2022 abs/2206.01861 CoRR https://doi.org/10.48550/arXiv.2206.01861 db/journals/corr/corr2206.html#abs-2206-01861

Connor Holmes Minjia Zhang Yuxiong He Bo Wu 0002 Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding. 2022 abs/2206.15014 CoRR https://doi.org/10.48550/arXiv.2206.15014 db/journals/corr/corr2206.html#abs-2206-15014

Reza Yazdani Aminabadi Samyam Rajbhandari Minjia Zhang Ammar Ahmad Awan Cheng Li 0001 Du Li Elton Zheng Jeff Rasley Shaden Smith Olatunji Ruwase Yuxiong He DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale. 2022 abs/2207.00032 CoRR https://doi.org/10.48550/arXiv.2207.00032 db/journals/corr/corr2207.html#abs-2207-00032

Zhewei Yao Xiaoxia Wu Conglong Li Connor Holmes Minjia Zhang Cheng Li 0001 Yuxiong He Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers. 2022 abs/2211.11586 CoRR https://doi.org/10.48550/arXiv.2211.11586 db/journals/corr/corr2211.html#abs-2211-11586

Conglong Li Zhewei Yao Xiaoxia Wu Minjia Zhang Connor Holmes Cheng Li 0001 Yuxiong He DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing. 2022 abs/2212.03597 CoRR https://doi.org/10.48550/arXiv.2212.03597 db/journals/corr/corr2212.html#abs-2212-03597

Jie Ren 0015 Jiaolin Luo Kai Wu 0006 Minjia Zhang Hyeran Jeon Dong Li 0001 Sentinel: Efficient Tensor Migration and Allocation on Heterogeneous Memory Systems for Deep Learning. 598-611 2021 HPCA https://doi.org/10.1109/HPCA51647.2021.00057 conf/hpca/2021 db/conf/hpca/hpca2021.html#RenLWZJL21 Minjia Zhang Menghao Li Chi Wang 0001 Mingqin Li DynaTune: Dynamic Tensor Program Optimization in Deep Neural Network Compilation. 2021 ICLR https://openreview.net/forum?id=GTGb3M_KcUl conf/iclr/2021 db/conf/iclr/iclr2021.html#ZhangLWL21 Junfeng Zhao 0005 Minjia Zhang Hongji Yang Vertical Scaling of Resource for OpenMP Application. 839-849 2021 ICSOC https://doi.org/10.1007/978-3-030-91431-8_61 conf/icsoc/2021 db/conf/icsoc/icsoc2021.html#ZhaoZY21 Minjia Zhang Zehua Hu Mingqin Li DUET: A Compiler-Runtime Subgraph Scheduling Approach for Tensor Programs on a Coupled CPU-GPU Architecture. 151-161 2021 IPDPS https://doi.org/10.1109/IPDPS49936.2021.00024 conf/ipps/2021 db/conf/ipps/ipdps2021.html#ZhangHL21 Connor Holmes Minjia Zhang Yuxiong He Bo Wu 0002 NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM. 1818-1830 2021 NeurIPS https://proceedings.neurips.cc/paper/2021/hash/0e4f5cc9f4f3f7f1651a6b9f9214e5b1-Abstract.html conf/nips/2021 db/conf/nips/neurips2021.html#HolmesZHW21 Jie Ren 0015 Samyam Rajbhandari Reza Yazdani Aminabadi Olatunji Ruwase Shuangyan Yang Minjia Zhang Dong Li 0001 Yuxiong He ZeRO-Offload: Democratizing Billion-Scale Model Training. 551-564 2021 USENIX ATC https://www.usenix.org/conference/atc21/presentation/ren-jie conf/usenix/2021 db/conf/usenix/usenix2021.html#0015RARYZ0H21 Minjia Zhang DL Inference and Training Optimization Towards Speed and Scale. 192 2021 WWW (Companion Volume) https://doi.org/10.1145/3442442.3452297 conf/www/2021c db/conf/www/www2021c.html#Zhang21

Jie Ren 0015 Samyam Rajbhandari Reza Yazdani Aminabadi Olatunji Ruwase Shuangyan Yang Minjia Zhang Dong Li 0001 Yuxiong He ZeRO-Offload: Democratizing Billion-Scale Model Training. 2021 abs/2101.06840 CoRR https://arxiv.org/abs/2101.06840 db/journals/corr/corr2101.html#abs-2101-06840

Dantong Zhu Minjia Zhang Understanding and Generalizing Monotonic Proximity Graphs for Approximate Nearest Neighbor Search. 2021 abs/2107.13052 CoRR https://arxiv.org/abs/2107.13052 db/journals/corr/corr2107.html#abs-2107-13052

Conglong Li Minjia Zhang Yuxiong He Curriculum Learning: A Regularization Method for Efficient and Stable Billion-Scale GPT Model Pre-Training. 2021 abs/2108.06084 CoRR https://arxiv.org/abs/2108.06084 db/journals/corr/corr2108.html#abs-2108-06084

Soobee Lee Minindu Weerakoon Jonghyun Choi Minjia Zhang Di Wang 0003 Myeongjae Jeon Carousel Memory: Rethinking the Design of Episodic Memory for Continual Learning. 2021 abs/2110.07276 CoRR https://arxiv.org/abs/2110.07276 db/journals/corr/corr2110.html#abs-2110-07276

Connor Holmes Minjia Zhang Yuxiong He Bo Wu 0002 NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM. 2021 abs/2110.15766 CoRR https://arxiv.org/abs/2110.15766 db/journals/corr/corr2110.html#abs-2110-15766

Fuxun Yu Di Wang 0003 Longfei Shangguan Minjia Zhang Xulong Tang Chenchen Liu Xiang Chen 0010 A Survey of Large-Scale Deep Learning Serving System Optimization: Challenges and Opportunities. 2021 abs/2111.14247 CoRR https://arxiv.org/abs/2111.14247 db/journals/corr/corr2111.html#abs-2111-14247

Jie Ren 0015 Minjia Zhang Dong Li 0001 HM-ANN: Efficient Billion-Point Nearest Neighbor Search on Heterogeneous Memory. 2020 NeurIPS https://proceedings.neurips.cc/paper/2020/hash/788d986905533aba051261497ecffcbb-Abstract.html conf/nips/2020 db/conf/nips/neurips2020.html#0015ZL20 Menghao Li Minjia Zhang Chi Wang 0001 Mingqin Li AdaTune: Adaptive Tensor Program Compilation Made Efficient. 2020 NeurIPS https://proceedings.neurips.cc/paper/2020/hash/a9b7ba70783b617e9998dc4dd82eb3c5-Abstract.html conf/nips/2020 db/conf/nips/neurips2020.html#LiZWL20 Minjia Zhang Yuxiong He Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping. 2020 NeurIPS https://proceedings.neurips.cc/paper/2020/hash/a1140a3d0df1c81e24ae954d935e8926-Abstract.html conf/nips/2020 db/conf/nips/neurips2020.html#ZhangH20 Conglong Li Minjia Zhang David G. Andersen Yuxiong He Improving Approximate Nearest Neighbor Search through Learned Adaptive Early Termination. 2539-2554 2020 SIGMOD Conference https://doi.org/10.1145/3318464.3380600 conf/sigmod/2020 db/conf/sigmod/sigmod2020.html#LiZAH20

Minjia Zhang Yuxiong He Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping. 2020 abs/2010.13369 CoRR https://arxiv.org/abs/2010.13369 db/journals/corr/corr2010.html#abs-2010-13369

Minjia Zhang Yuxiong He GRIP: Multi-Store Capacity-Optimized High-Performance Nearest Neighbor Search for Vector Search Engine. 1673-1682 2019 CIKM https://doi.org/10.1145/3357384.3357938 https://www.wikidata.org/entity/Q130957494 conf/cikm/2019 db/conf/cikm/cikm2019.html#ZhangH19 Minjia Zhang Samyam Rajbhandari Wenhan Wang Elton Zheng Olatunji Ruwase Jeff Rasley Jason Li Junhua Wang Yuxiong He Accelerating Large Scale Deep Learning Inference through DeepCPU at Microsoft. 5-7 2019 OpML https://www.usenix.org/conference/opml19/presentation/zhang-minjia conf/opml/2019 db/conf/opml/opml2019.html#ZhangRWZRRLWH19 Junfeng Zhao 0005 Minjia Zhang Hongji Yang Code Refactoring from OpenMP to MapReduce Model for Big Data Processing. 930-935 2019 SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI https://doi.org/10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00186 conf/uic/2019 db/conf/uic/uic2019.html#ZhaoZY19

Jie Ren 0015 Jiaolin Luo Kai Wu 0006 Minjia Zhang Dong Li 0001 Sentinel: Runtime Data Management on Heterogeneous Main MemorySystems for Deep Learning. 2019 abs/1909.05182 CoRR http://arxiv.org/abs/1909.05182 db/journals/corr/corr1909.html#abs-1909-05182

Reza Yazdani Olatunji Ruwase Minjia Zhang Yuxiong He José-María Arnau Antonio González 0001 LSTM-Sharp: An Adaptable, Energy-Efficient Hardware Accelerator for Long Short-Term Memory. 2019 abs/1911.01258 CoRR http://arxiv.org/abs/1911.01258 db/journals/corr/corr1911.html#abs-1911-01258

Wei Wen 0003 Yuxiong He Samyam Rajbhandari Minjia Zhang Wenhan Wang Fang Liu Bin Hu Yiran Chen 0001 Hai Li 0001 Learning Intrinsic Sparse Structures within Long Short-Term Memory. 2018 ICLR (Poster) https://openreview.net/forum?id=rk6cfpRjZ conf/iclr/2018 db/conf/iclr/iclr2018.html#WenHRZWLHC018 Junfeng Zhao 0005 Minjia Zhang Refactoring OpenMP Code Based on MapReduce Model. 1040-1041 2018 ISPA/IUCC/BDCloud/SocialCom/SustainCom https://doi.org/10.1109/BDCloud.2018.00153 conf/ispa/2018 db/conf/ispa/ispa2018.html#ZhaoZ18 Minjia Zhang Wenhan Wang Xiaodong Liu 0003 Jianfeng Gao 0001 Yuxiong He Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models. 6311-6322 2018 NeurIPS https://proceedings.neurips.cc/paper/2018/hash/366f0bc7bd1d4bf414073cabbadfdfcd-Abstract.html http://papers.nips.cc/paper/7868-navigating-with-graph-representations-for-fast-and-scalable-decoding-of-neural-language-models conf/nips/2018 db/conf/nips/nips2018.html#ZhangWLGH18 Minjia Zhang Samyam Rajbhandari Wenhan Wang Yuxiong He DeepCPU: Serving RNN-based Deep Learning Models 10x Faster. 951-965 2018 USENIX ATC https://www.usenix.org/conference/atc18/presentation/zhang-minjia conf/usenix/2018 db/conf/usenix/usenix2018.html#ZhangRWH18

Minjia Zhang Xiaodong Liu 0003 Wenhan Wang Jianfeng Gao 0001 Yuxiong He Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models. 2018 abs/1806.04189 CoRR http://arxiv.org/abs/1806.04189 db/journals/corr/corr1806.html#abs-1806-04189

Minjia Zhang Yuxiong He Zoom: SSD-based Vector Search for Optimizing Accuracy, Latency and Memory. 2018 abs/1809.04067 CoRR http://arxiv.org/abs/1809.04067 db/journals/corr/corr1809.html#abs-1809-04067

Man Cao Minjia Zhang Aritra Sengupta Swarnendu Biswas Michael D. Bond Hybridizing and Relaxing Dependence Tracking for Efficient Parallel Runtime Support. 9:1-9:42 2017 4 ACM Trans. Parallel Comput. 2 https://doi.org/10.1145/3108138 db/journals/topc/topc4.html#CaoZSBB17

Swarnendu Biswas Man Cao Minjia Zhang Michael D. Bond Benjamin P. Wood Lightweight data race detection for production runs. 11-21 2017 CC http://dl.acm.org/citation.cfm?id=3033020 conf/cc/2017 db/conf/cc/cc2017.html#BiswasCZBW17 Minjia Zhang Swarnendu Biswas Michael D. Bond Avoiding consistency exceptions under strong memory models. 115-127 2017 ISMM https://doi.org/10.1145/3092255.3092271 https://doi.org/10.1145/3156685.3092271 https://www.wikidata.org/entity/Q130978844 conf/iwmm/2017 db/conf/iwmm/ismm2017.html#ZhangBB17 Minjia Zhang Swarnendu Biswas Michael D. Bond POSTER: On the Problem of Consistency Exceptions in the Context of Strong Memory Models. 459-460 2017 PPoPP https://doi.org/10.1145/3018743.3019024 https://doi.org/10.1145/3155284.3019024 conf/ppopp/2017 db/conf/ppopp/ppopp2017.html#ZhangBB17 Minjia Zhang Swarnendu Biswas Michael D. Bond Relaxed dependence tracking for parallel runtime support. 45-55 2016 CC https://doi.org/10.1145/2892208.2892229 conf/cc/2016 db/conf/cc/cc2016.html#ZhangBB16 Man Cao Minjia Zhang Aritra Sengupta Michael D. Bond Drinking from both glasses: combining pessimistic and optimistic tracking of cross-thread dependences. 20:1-20:13 2016 PPoPP https://doi.org/10.1145/2851141.2851143 https://doi.org/10.1145/3016078.2851143 conf/ppopp/2016 db/conf/ppopp/ppopp2016.html#CaoZSB16 Aritra Sengupta Swarnendu Biswas Minjia Zhang Michael D. Bond Milind Kulkarni 0001 Hybrid Static: Dynamic Analysis for Statically Bounded Region Serializability. 561-575 2015 ASPLOS https://doi.org/10.1145/2694344.2694379 https://doi.org/10.1145/2775054.2694379 https://doi.org/10.1145/2786763.2694379 conf/asplos/2015 db/conf/asplos/asplos2015.html#SenguptaBZBK15 Minjia Zhang SIRe: an efficient snapshot isolation-based memory model for detecting and tolerating region conflicts. 87-88 2015 SPLASH (Companion Volume) https://doi.org/10.1145/2814189.2815371 conf/oopsla/2015c db/conf/oopsla/splash2015c.html#Zhang15 Swarnendu Biswas Minjia Zhang Michael D. Bond Brandon Lucia Valor: efficient, software-only region conflict exceptions. 241-259 2015 OOPSLA https://doi.org/10.1145/2814270.2814292 https://doi.org/10.1145/2858965.2814292 conf/oopsla/2015 db/conf/oopsla/oopsla2015.html#BiswasZBL15 Minjia Zhang Jipeng Huang Man Cao Michael D. Bond Low-overhead software transactional memory with progress guarantees and strong semantics. 97-108 2015 PPoPP https://doi.org/10.1145/2688500.2688510 https://doi.org/10.1145/2858788.2688510 conf/ppopp/2015 db/conf/ppopp/ppopp2015.html#ZhangHCB15 Michael D. Bond Milind Kulkarni 0001 Man Cao Minjia Zhang Meisam Fathi Salmi Swarnendu Biswas Aritra Sengupta Jipeng Huang OCTET: capturing and controlling cross-thread dependences efficiently. 693-712 2013 OOPSLA https://doi.org/10.1145/2509136.2509519 https://doi.org/10.1145/2544173.2509519 conf/oopsla/2013 db/conf/oopsla/oopsla2013.html#BondKCZSBSH13 Jithin Jose Hari Subramoni Miao Luo Minjia Zhang Jian Huang 0006 Md. Wasi-ur-Rahman Nusrat S. Islam Xiangyong Ouyang Hao Wang 0002 Sayantan Sur Dhabaleswar K. Panda 0001 Memcached Design on High Performance RDMA Capable Interconnects. 743-752 2011 ICPP https://doi.org/10.1109/ICPP.2011.37 https://doi.ieeecomputersociety.org/10.1109/ICPP.2011.37 conf/icpp/2011 db/conf/icpp/icpp2011.html#JoseSLZHWIOWSP11 Minjia Zhang Hai Jin 0001 Xuanhua Shi Song Wu 0001 VirtCFT: A Transparent VM-Level Fault-Tolerant System for Virtual Clusters. 147-154 2010 ICPADS https://doi.org/10.1109/ICPADS.2010.125 https://doi.ieeecomputersociety.org/10.1109/ICPADS.2010.125 conf/icpads/2010 db/conf/icpads/icpads2010.html#ZhangJSW10 Tarek F. Abdelzaher Sarita V. Adve Vikram S. Adve Gustaf Ahdritz Elizabeth A. Ainsworth Ashwin M. Aji Mohammed AlQuraishi Reza Yazdani Aminadabi Kaikai An Anima Anandkumar David G. Andersen Troy Arcomano José-María Arnau Ammar Ahmad Awan Shuai Bai Yuzhuo Bai Prasanna Balaprakash Reyhaneh Jabbarvand BehrouzReyhaneh Jabbarvand Stas Bekman Song Bian 0002 Fengxiang Bie Swarnendu Biswas Cindy Orozco Bohorquez Michael D. Bond Afshin Bozorgpour Alex BraceAlexander Brace Shawn Bray Thomas S. Brettin Martin Cai Zefan Cai Man Cao Baobao Chang Shuai Che Bo Chen 0025 Deming Chen Dingwei Chen Fangyuan Chen 0002 Gang Chen 0039 Guanqiao Chen Lequn Chen 0001 Liang Chen 0024 Shiyang Chen 0004 Xiang Chen 0010 Yinfang Chen Yiran Chen 0001 Yulong Chen 0001 Jianlin Cheng Qi Cheng Runxiang Cheng Artem M. Chirkin Jonghyun Choi Bryan K. Clark David A. Clifton Austin Clyde Guojing Cong Carlos H. A. Costa Weihao Cui Xiaotong Cui Christian Dallago Angela Dalton Neel Dani Sajal Dash James J. Davis 0002 Yuntian Deng Hangliang Ding Minh Do Qingxiu Dong Wenqian Dong Jiangfei Duan Tamar Eilam Murali Emani Kate Evans Jon EyolfsonJonathan Eyolfson Ming Fan Xiaoran Fan Xinyi Fan Yin Fang Kyle Felker Yu Feng 0007 Christina Floristean Sam Foreman Ian T. Foster Hubertus Franke Jie Fu Raghu K. Ganti Bofei Gao Cheng Gao Jianfeng Gao 0001 Jiechao Gao Qizhe Gao Suyu Ge Adam Ghanem Thomas Gibbs Ameneh GolnariPareesa Ameneh Golnari Yiming Gong Antonio González 0001 John Gounley Jiuxiang Gu Yue Guan 0003 Cong Guo 0003 Hongcheng Guo Junxian Guo Minyi Guo Ahan Gupta Hendrik F. Hamann Jiawei Han 0001 Heidi A. Hanson Valérie Hayot-Sasson Jingrui He Yongjun He 0004 Yuxiong He Kyle Hippe Martin Hirzel Adolfy Hoisie Connor Holmes Bin Hu Junjie Hu 0001 Mingtao Hu Shujie Hu Yu Hu Zehua Hu Beichen Huang Jian Huang 0006 Jie Huang 0009 Jinghan Huang 0001 Jipeng Huang Junsheng Huang Kung-Hsiang Huang Yufei Huang 0008 Yulong Hui Xiaoming Huo Michael W. Irvin Nusrat S. Islam Ravishankar K. Iyer Sam Ade Jacobs Hyeran Jeon Myeongjae Jeon Suyeon Jeong Zhihao Jia Jize Jiang Boxiao Jin Chen Jin Hai Jin 0001 Qiao Jin 0001 Ruoming Jin Carlee Joe-Wong Jithin Jose Bharat Kale Hangoo Kang Jaeyoung Kang 0004 Benjamin KarsinBen Karsin Hyungyo Kim Nam Sung Kim Volodymyr V. Kindratenko Sylwester Klocek Parisa Kordjamshidi Rao Kotamarthi Bonnie Kruft Milind Kulkarni 0001 Divya Kumar Lev Kurilenko Hoa La Fan Lai 0001 Teodoro Laino Eunkyung LeeEun Kyung Lee Soobee Lee Yu Lei Jingwen Leng Matthew Lentz Ang Li 0005 Beibin Li Cheng Li 0001 Conglong Li Dong Li Dong Li 0001 Du Li Hai Li 0001 Jason Li Jialin Li 0001 Jianping Li Junbo Li Kai Li Lei Li 0039 Meitang Li Menghao Li Mingqin Li Qing Li 0003 Wenhao Li 0003 Yunshui Li Zhaoheng Li Xinyu Lian Zhixiang Liang Dahua Lin Diangen Lin Junfeng Lin Junyang Lin Zichao Lin Chenchen Liu Fang Liu Fei Liu Hang Liu 0001 Haolin Liu Liyuan Liu Qi Liu Rui Liu Siyan Liu Tianyu Liu 0001 Xiaodong Liu 0003 Xiaoxuan Liu Zihan Liu 0002 Dan Lu 0001 Yao Lu 0028 Yucheng Lu 0003 Zhiyong Lu Brandon Lucia Pete Luferenko Dalton D. Lunga Jiaolin Luo Kangyang Luo Miao Luo Xinhao Luo Isaac Lyngaas Heng Ma Lin Ma 0006 Tianyi Ma Xiaojian Ma 0001Xiaojian (Shawn) Ma Xiaolong Ma Xinyue Ma Matteo Manica Carla M. Mann Darko Marinov Romit Maulik Charith Mendis Lingwei Meng Dorit Merhof Xupeng Miao Chenghao Mo Alex Morehead Priya Nagpurkar Klara Nahrstedt Alireza Namazi Cristina Negri Ravi Netravali Wentao Ni Weili Nie U. N. NiranjanUma-Naresh Niranjan Santiago Núñez-Corrales Fábio Oliveira Xiangyong Ouyang Giovanni Pacifici Dhabaleswar K. Panda 0001 Michael E. Papka Yongjoo Park Massimiliano Lupo Pasini J. Gregory Pauloski Ruchi Pendse Nanyun Peng 0001 Zhen Peng Danilo Perez-Rivera Thomas E. Potok Ruchir Puri Fanchao Qi Yifan Qiao 0002 Heyang Qin Haoyi Qiu Xingwei Qu Samyam Rajbhandari Arvind Ramanathan Jeff Rasley Srivatsan Ravi Bin Ren Jie Ren 0015 Shuhuai Ren Yihui Ren 0001 Zhiwei Ren Josh Romero Kexin Rong 0001 Olatunji Ruwase Christopher De Sa Meisam Fathi Salmi André Schleife Michael J. Schulte Karl W. Schulz Seetharami R. Seelam Tanmoy Sen Aritra Sengupta Hrishi Shah Longfei Shangguan Mallikarjun Shankar Zelei Shao Akshat Sharma Haiying Shen Xuanhua Shi Maulik Shukla Shuzheng Si Avirup Sil Gagandeep Singh 0001 Molly Smith Shaden Smith Shuaiwen SongShuaiwen Leon Song Zhixing Song Ziang Song Mudhakar Srivatsa Rick L. StevensRick Stevens Yongye Su Hari Subramoni Maosong Sun 0001 Yinqi Sun Sayantan Sur Alexey Svyatkovskiy Mengjue Tan Xu Tan 0003 Masahiro Tanaka Aryan Taneja Shengpu Tang William Tang 0002 Xulong Tang Dacheng Tao Parth Thakkar John Thorpe Beitong Tian Boyuan Tian Zhi Tian Hanghang Tong Josep Torrellas Gina Tourassi Arash Vahdat Lav R. Varshney Deepak Vasisht Jason Vega Venkatram Vishwanath Andreas Vlachos 0001 Volodymyr Vragov Chi Wang 0001 Dengyu Wang Di Wang 0003 Feiyi Wang Hao Wang 0002 Jianguo Wang 0001 Jie Wang Junhua Wang Nachuan Wang Qingyi Wang Wenhan Wang Xiao Wang Xiao Wang 0004 Yuxiong Wang Zekun Wang Zheng Wang Zhenhailong Wang Zhihao Wang Zhitong Wang Ziyan Wang Logan T. Ward Md. Wasi-ur-Rahman Minindu Weerakoon Wei Wen 0003 Jonathan A. Weyn Benjamin P. Wood Bo Wu 0002 Kai Wu 0006 Mingyuan Wu Rujie Wu Ruoyu Wu Song Wu 0001 Xiaoxia Wu Yingjun Wu Yongji Wu Michael Wyatt Jingyi Xi Xiaoli Xi Siran Xianyu Chaowei Xiao Wen Xiao Zhen Xie Guangzhi Xiong Yizhe Xiong Guoqing Harry XuHarry Xu 0001 Tianyin Xu Zirui Xu Feng Yan 0001 Kaizhuo Yan Hongji Yang Jian Yang 0003 Jingcheng Yang Lei Yang 0001 Shuangyan Yang Yibo Yang Yifan Yang 0006 Yixiang Yao Yuhang Yao 0003 Zhewei Yao Reza YazdaniReza Yazdani Aminabadi Aaron Yee Jun Yi Junqi Yin Shinjae Yoo Alaa Youssef Fuxun Yu Hanchao Yu Jiahuan Yu Peiyu Yu Yongbo Yu Zhongzhi Yu Yueming Yuan Syed Zawad ChengXiang ZhaiChengxiang Zhai Aidong Zhang 0001 Bin Zhang Chengming Zhang 0006 Gaokai Zhang Ge Zhang 0009 Huanchen Zhang Lei Zhang 0201 Min Zhang Pei Zhang Qizhen Zhang 0001 Ruixiong Zhang Yichi Zhang 0010 Yunan Zhang 0001 Han Zhao 0002 Haozhe Zhao Huimin Zhao Junfeng Zhao 0005 Pengzhan Zhao Yushu Zhao Elton Zheng Haozhen Zheng Hongbo Zheng Gengze Zhou Tianyi Zhou 0001 Yangjie Zhou 0001 Zhongzhu Zhou Dantong Zhu Yuhao Zhu 0001 Zhen Zhu Danyang Zhuo Maxim Zvyagin