Hardware Modeling and Efficient Architectural Exploration for Machine Learning Accelerators

Tianqi Tang 0001 Meta, USA University of California at Santa Barbara, Santa Barbara, CA, USA https://tianqitang.github.io/ https://scholar.google.com/citations?user=o6qLxn0AAAAJ https://twitter.com/tianqi_tang https://orcid.org/0000-0001-8255-985X https://ieeexplore.ieee.org/author/37085483226 Tianqi Tang Tianqi Tang 0002 University of Technology Sydney, NSW, Australia https://orcid.org/0000-0001-7754-9673 Tianqi Tang 0003 Jilin University, College of Geoexploration Science and Technology, Changchun,China https://orcid.org/0000-0003-0915-2687 Tianqi Tang 0004 University of Southern California, Department of Quantitative and Computational Biology, Los Angeles, CA, USA https://orcid.org/0000-0002-3497-5549 Tianqi Tang 0001 Hardware Modeling and Efficient Architectural Exploration for Machine Learning Accelerators University of California, Santa Barbara, USA 2022 https://www.escholarship.org/uc/item/4xm3c34h https://www.escholarship.org/content/qt4xm3c34h/qt4xm3c34h.pdf Boyuan Feng Tianqi Tang 0001 Yuke Wang Zhaodong Chen 0001 Zheng Wang 0075 Shu Yang Yuan Xie 0001 Yufei Ding 0001 Faith: An Efficient Framework for Transformer Verification on GPUs. 167-182 2022 USENIX ATC https://www.usenix.org/conference/atc22/presentation/feng conf/usenix/2022 db/conf/usenix/usenix2022.html#Feng0WCWY0D22

Tianqi Tang 0001 Yuan Xie 0001 Cost-Aware Exploration for Chiplet-Based Architecture with Advanced Packaging Technologies. 2022 abs/2206.07308 CoRR https://doi.org/10.48550/arXiv.2206.07308 db/journals/corr/corr2206.html#abs-2206-07308

Boyuan Feng Tianqi Tang 0001 Yuke Wang Zhaodong Chen 0001 Zheng Wang 0075 Shu Yang Yuan Xie 0001 Yufei Ding 0001 Faith: An Efficient Framework for Transformer Verification on GPUs. 2022 abs/2209.12708 CoRR https://doi.org/10.48550/arXiv.2209.12708 db/journals/corr/corr2209.html#abs-2209-12708

Jilan Lin Cheng-Da Wen Xing Hu 0001 Tianqi Tang 0001 Ing-Chao Lin Yu Wang 0002 Yuan Xie 0001 Rescuing RRAM-Based Computing From Static and Dynamic Faults. 2049-2062 2021 40 IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 10 https://doi.org/10.1109/TCAD.2020.3037316 db/journals/tcad/tcad40.html#LinWHTLWX21

Tianqi Tang 0001 Sheng Li 0007 Lifeng Nai Norman P. Jouppi Yuan Xie 0001 NeuroMeter: An Integrated Power, Area, and Timing Modeling Framework for Machine Learning Accelerators Industry Track Paper. 841-853 2021 HPCA https://doi.org/10.1109/HPCA51647.2021.00075 conf/hpca/2021 db/conf/hpca/hpca2021.html#TangLNJX21

Yi Cai 0003 Tianqi Tang 0001 Lixue Xia Boxun Li Yu Wang 0002 Huazhong Yang Low Bit-Width Convolutional Neural Network on RRAM. 1414-1427 2020 39 IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 7 https://doi.org/10.1109/TCAD.2019.2917852 https://www.wikidata.org/entity/Q127799926 db/journals/tcad/tcad39.html#CaiTXLWY20

Lixue Xia Wenqin Huangfu Tianqi Tang 0001 Xiling Yin Krishnendu Chakrabarty Yuan Xie 0001 Yu Wang 0002 Huazhong Yang Stuck-at Fault Tolerance in RRAM Computing Systems. 102-115 2018 8 IEEE J. Emerg. Sel. Topics Circuits Syst. 1 https://doi.org/10.1109/JETCAS.2017.2776980 db/journals/esticas/esticas8.html#XiaHTYCXWY18

Lixue Xia Boxun Li Tianqi Tang 0001 Peng Gu Pai-Yu Chen Shimeng Yu Yu Cao 0001 Yu Wang 0002 Yuan Xie 0001 Huazhong Yang MNSIM: Simulation Platform for Memristor-Based Neuromorphic Computing System. 1009-1022 2018 37 IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 5 https://doi.org/10.1109/TCAD.2017.2729466 db/journals/tcad/tcad37.html#XiaLTGCYCWXY18

Huizi Mao Song Yao Tianqi Tang 0001 Boxun Li Jun Yao Yu Wang 0002 Towards Real-Time Object Detection on Embedded Systems. 417-431 2018 6 IEEE Trans. Emerg. Top. Comput. 3 https://doi.org/10.1109/TETC.2016.2593643 http://doi.ieeecomputersociety.org/10.1109/TETC.2016.2593643 db/journals/tetc/tetc6.html#MaoYTLYW18

Yi Cai 0003 Tianqi Tang 0001 Lixue Xia Ming Cheng Zhenhua Zhu 0002 Yu Wang 0002 Huazhong Yang Training low bitwidth convolutional neural network on RRAM. 117-122 2018 ASP-DAC https://doi.org/10.1109/ASPDAC.2018.8297292 http://dl.acm.org/citation.cfm?id=3201632 conf/aspdac/2018 db/conf/aspdac/aspdac2018.html#CaiTXCZWY18 Jincheng Yu Kaiyuan Guo Yiming Hu Xuefei Ning Jiantao Qiu Huizi Mao Song Yao Tianqi Tang 0001 Boxun Li Yu Wang 0002 Huazhong Yang Real-time object detection towards high power efficiency. 704-708 2018 DATE https://doi.org/10.23919/DATE.2018.8342100 conf/date/2018 db/conf/date/date2018.html#YuGHNQMYTLWY18 Tianqi Tang 0001 Lixue Xia Boxun Li Yu Wang 0002 Huazhong Yang Binary convolutional neural network on RRAM. 782-787 2017 ASP-DAC https://doi.org/10.1109/ASPDAC.2017.7858419 conf/aspdac/2017 db/conf/aspdac/aspdac2017.html#TangXL0Y17 Wenqin Huangfu Lixue Xia Ming Cheng Xiling Yin Tianqi Tang 0001 Boxun Li Krishnendu Chakrabarty Yuan Xie 0001 Yu Wang 0002 Huazhong Yang Computation-oriented fault-tolerance schemes for RRAM computing systems. 794-799 2017 ASP-DAC https://doi.org/10.1109/ASPDAC.2017.7858421 conf/aspdac/2017 db/conf/aspdac/aspdac2017.html#HuangfuXCYTLCXW17

Lixue Xia Peng Gu Boxun Li Tianqi Tang 0001 Xiling Yin Wenqin Huangfu Shimeng Yu Yu Cao 0001 Yu Wang 0002 Huazhong Yang Technological Exploration of RRAM Crossbar Array for Matrix-Vector Multiplication. 3-19 2016 31 J. Comput. Sci. Technol. 1 https://doi.org/10.1007/s11390-016-1608-8 db/journals/jcst/jcst31.html#XiaGLTYHYCWY16

Yu Wang 0002 Lixue Xia Ming Cheng Tianqi Tang 0001 Boxun Li Huazhong Yang RRAM based learning acceleration. 9:1-9:2 2016 CASES https://doi.org/10.1145/2968455.2981124 conf/cases/2016 db/conf/cases/cases2016.html#WangXCTLY16 Lixue Xia Tianqi Tang 0001 Wenqin Huangfu Ming Cheng Xiling Yin Boxun Li Yu Wang 0002 Huazhong Yang Switched by input: power efficient structure for RRAM-based convolutional neural network. 125:1-125:6 2016 DAC https://doi.org/10.1145/2897937.2898101 conf/dac/2016 db/conf/dac/dac2016.html#XiaTHCYLWY16 Lixue Xia Boxun Li Tianqi Tang 0001 Peng Gu Xiling Yin Wenqin Huangfu Pai-Yu Chen Shimeng Yu Yu Cao 0001 Yu Wang 0002 Yuan Xie 0001 Huazhong Yang MNSIM: Simulation platform for memristor-based neuromorphic computing system. 469-474 2016 DATE https://ieeexplore.ieee.org/document/7459356/ conf/date/2016 db/conf/date/date2016.html#XiaLTGYHCYCW0Y16 Jiantao Qiu Jie Wang 0022 Song Yao Kaiyuan Guo Boxun Li Erjin Zhou Jincheng Yu Tianqi Tang 0001 Ningyi Xu Sen Song Yu Wang 0002 Huazhong Yang Going Deeper with Embedded FPGA Platform for Convolutional Neural Network. 26-35 2016 FPGA https://doi.org/10.1145/2847263.2847265 https://www.wikidata.org/entity/Q130853839 conf/fpga/2016 db/conf/fpga/fpga2016.html#QiuWYGLZYTXSWY16 Yu Wang 0002 Lixue Xia Tianqi Tang 0001 Boxun Li Song Yao Ming Cheng Huazhong Yang Low power Convolutional Neural Networks on a chip. 129-132 2016 ISCAS https://doi.org/10.1109/ISCAS.2016.7527187 conf/iscas/2016 db/conf/iscas/iscas2016.html#WangXTLYCY16 Peng Gu Boxun Li Tianqi Tang 0001 Shimeng Yu Yu Cao 0001 Yu Wang 0002 Huazhong Yang Technological exploration of RRAM crossbar array for matrix-vector multiplication. 106-111 2015 ASP-DAC https://doi.org/10.1109/ASPDAC.2015.7058989 conf/aspdac/2015 db/conf/aspdac/aspdac2015.html#GuLTYCWY15 Tianqi Tang 0001 Lixue Xia Boxun Li Rong Luo Yiran Chen 0001 Yu Wang 0002 Huazhong Yang Spiking neural network with RRAM: can we use it for real-world application? 860-865 2015 DATE http://dl.acm.org/citation.cfm?id=2755948 https://ieeexplore.ieee.org/document/7092505/ conf/date/2015 db/conf/date/date2015.html#TangXLLCWY15 Yu Wang 0002 Tianqi Tang 0001 Lixue Xia Boxun Li Peng Gu Huazhong Yang Hai Li 0001 Yuan Xie 0001 Energy Efficient RRAM Spiking Neural Network for Real Time Classification. 189-194 2015 ACM Great Lakes Symposium on VLSI https://doi.org/10.1145/2742060.2743756 conf/glvlsi/2015 db/conf/glvlsi/glvlsi2015.html#WangTXLGYL015 Yung-Hsiang Lu Alan M. Kadin Alexander C. Berg Thomas M. Conte Erik P. DeBenedictis Rachit Garg Ganesh Gingade Bichlien Hoang Yongzhen Huang Boxun Li Jingyu Liu 0004 Wei Liu 0015 Huizi Mao Junran Peng Tianqi Tang 0001 Elie K. Track Jingqiu Wang Tao Wang 0004 Yu Wang 0002 Jun Yao Rebooting Computing and Low-Power Image Recognition Challenge. 927-932 2015 ICCAD https://doi.org/10.1109/ICCAD.2015.7372672 http://dl.acm.org/citation.cfm?id=2840950 conf/iccad/2015 db/conf/iccad/iccad2015.html#LuKBCDGGHHLLLMP15 Deming Zhang Lang Zeng Yuanzhuo Qu Youguang Zhang Mengxing Wang 0001 Weisheng Zhao 0001 Tianqi Tang 0001 Yu Wang 0002 Energy-efficient neuromorphic computation based on compound spin synapse with stochastic learning. 1538-1541 2015 ISCAS https://doi.org/10.1109/ISCAS.2015.7168939 conf/iscas/2015 db/conf/iscas/iscas2015.html#ZhangZQZWZTW15 Tianqi Tang 0001 Rong Luo Boxun Li Hai Li 0001 Yu Wang 0002 Huazhong Yang Energy efficient spiking neural network design with RRAM devices. 268-271 2014 ISIC https://doi.org/10.1109/ISICIR.2014.7029565 conf/isicir/2014 db/conf/isicir/isic2014.html#TangLLLWY14 Alexander C. Berg Yi Cai 0003 Yu Cao 0001 Krishnendu Chakrabarty Pai-Yu Chen Yiran Chen 0001 Zhaodong Chen 0001 Ming Cheng Thomas M. Conte Erik DeBenedictisErik P. DeBenedictis Yufei Ding 0001 Boyuan Feng Rachit Garg Ganesh Gingade Peng Gu Kaiyuan Guo Bichlien Hoang Xing Hu 0001 Yiming Hu Yongzhen Huang Wenqin Huangfu Norman P. Jouppi Alan M. Kadin Boxun Li Hai Li 0001 Sheng Li 0007 Ing-Chao Lin Jilan Lin Jingyu Liu 0004 Wei Liu 0015 Yung-Hsiang Lu Rong Luo Huizi Mao Lifeng Nai Xuefei Ning Junran Peng Jiantao Qiu Yuanzhuo Qu Sen Song Elie K. Track Jie Wang 0022 Jingqiu Wang Mengxing Wang 0001 Tao Wang 0004 Yu Wang 0002 Yuke Wang Zheng Wang 0075 Cheng-Da Wen Lixue Xia Yuan Xie 0001 Ningyi Xu Huazhong Yang Shu Yang Jun Yao Song Yao Xiling Yin Jincheng Yu Shimeng Yu Lang Zeng Deming Zhang Youguang Zhang Weisheng Zhao 0001 Erjin Zhou Zhenhua Zhu 0002