Performance Analysis of CNN Inference/Training with Convolution and Non-Convolution Operations on ASIC Accelerators.

Sean Kinzer

Hadi Esmaeilzadeh Soroush Ghodrati Andrew B. Kahng Sean Kinzer Susmita Dey Manasi Sachin S. Sapatnekar Zhiang Wang Performance Analysis of CNN Inference/Training with Convolution and Non-Convolution Operations on ASIC Accelerators. 1-34 2025 30 ACM Trans. Design Autom. Electr. Syst. 1 https://doi.org/10.1145/3696665 https://www.wikidata.org/entity/Q130949032 db/journals/todaes/todaes30.html#EsmaeilzadehGKKMSW25 streams/journals/todaes

Hadi Esmaeilzadeh Soroush Ghodrati Andrew B. Kahng Joon Kyung Kim Sean Kinzer Sayak Kundu Rohan Mahapatra Susmita Dey Manasi Sachin S. Sapatnekar Zhiang Wang Ziqing Zeng An Open-Source ML-Based Full-Stack Optimization Framework for Machine Learning Accelerators. 1-33 2024 29 ACM Trans. Design Autom. Electr. Syst. 4 https://doi.org/10.1145/3664652 https://www.wikidata.org/entity/Q130969575 db/journals/todaes/todaes29.html#EsmaeilzadehGKKKKMMSWZ24 streams/journals/todaes

Rohan Mahapatra Soroush Ghodrati Byung Hoon Ahn Sean Kinzer Shu-Ting Wang Hanyang Xu 0002 Lavanya Karthikeyan Hardik Sharma Amir Yazdanbakhsh Mohammad Alian Hadi Esmaeilzadeh In-Storage Domain-Specific Acceleration for Serverless Computing. 530-548 2024 ASPLOS (2) https://doi.org/10.1145/3620665.3640413 https://www.wikidata.org/entity/Q130872354 conf/asplos/2024-2 db/conf/asplos/asplos2024-2.html#MahapatraGAKWXK24 Soroush Ghodrati Sean Kinzer Hanyang Xu 0002 Rohan Mahapatra Yoonsung Kim Byung Hoon Ahn Dong Kai Wang Lavanya Karthikeyan Amir Yazdanbakhsh Jongse Park Nam Sung Kim Hadi Esmaeilzadeh Tandem Processor: Grappling with Emerging Operators in Neural Networks. 1165-1182 2024 ASPLOS (2) https://doi.org/10.1145/3620665.3640365 https://www.wikidata.org/entity/Q130878396 conf/asplos/2024-2 db/conf/asplos/asplos2024-2.html#GhodratiKXMKAWK24 Sean Kinzer Polymorphic Compilation for Cross-Domain Acceleration University of California, San Diego, USA 2023 https://www.escholarship.org/uc/item/1sp793td https://www.escholarship.org/content/qt1sp793td/qt1sp793td.pdf Dong Kai Wang Jiaqi Lou Naiyin Jin Edwin Mascarenhas Rohan Mahapatra Sean Kinzer Soroush Ghodrati Amir Yazdanbakhsh Hadi Esmaeilzadeh Nam Sung Kim MESA: Microarchitecture Extensions for Spatial Architecture Generation. 49:1-49:14 2023 ISCA https://doi.org/10.1145/3579371.3589084 conf/isca/2023 db/conf/isca/isca2023.html#WangLJMMKGYEK23

Rohan Mahapatra Soroush Ghodrati Byung Hoon Ahn Sean Kinzer Shu-Ting Wang Hanyang Xu 0002 Lavanya Karthikeyan Hardik Sharma Amir Yazdanbakhsh Mohammad Alian Hadi Esmaeilzadeh Domain-Specific Computational Storage for Serverless Computing. 2023 abs/2303.03483 CoRR https://doi.org/10.48550/arXiv.2303.03483 db/journals/corr/corr2303.html#abs-2303-03483

Hadi Esmaeilzadeh Soroush Ghodrati Andrew B. Kahng Sean Kinzer Susmita Dey Manasi Sachin S. Sapatnekar Zhiang Wang Performance Analysis of DNN Inference/Training with Convolution and non-Convolution Operations. 2023 abs/2306.16767 CoRR https://doi.org/10.48550/arXiv.2306.16767 db/journals/corr/corr2306.html#abs-2306-16767

Hadi Esmaeilzadeh Soroush Ghodrati Andrew B. Kahng Joon Kyung Kim Sean Kinzer Sayak Kundu Rohan Mahapatra Susmita Dey Manasi Sachin S. Sapatnekar Zhiang Wang Ziqing Zeng An Open-Source ML-Based Full-Stack Optimization Framework for Machine Learning Accelerators. 2023 abs/2308.12120 CoRR https://doi.org/10.48550/arXiv.2308.12120 db/journals/corr/corr2308.html#abs-2308-12120

Sean Kinzer Soroush Ghodrati Rohan Mahapatra Byung Hoon Ahn Edwin Mascarenhas Xiaolong Li Janarbek Matai Liang Zhang Hadi Esmaeilzadeh Restoring the Broken Covenant Between Compilers and Deep Learning Accelerators. 2023 abs/2310.17912 CoRR https://doi.org/10.48550/arXiv.2310.17912 db/journals/corr/corr2310.html#abs-2310-17912

Joon Kyung Kim Byung Hoon Ahn Sean Kinzer Soroush Ghodrati Rohan Mahapatra Brahmendra Reddy Yatham Shu-Ting Wang Dohee Kim Parisa Sarikhani Babak Mahmoudi Divya Mahajan 0001 Jongse Park Hadi Esmaeilzadeh Yin-Yang: Programming Abstractions for Cross-Domain Multi-Acceleration. 89-98 2022 42 IEEE Micro 5 https://doi.org/10.1109/MM.2022.3189416 https://www.wikidata.org/entity/Q114085584 db/journals/micro/micro42.html#KimAKGMYWKSMMPE22

Byung Hoon Ahn Sean Kinzer Hadi Esmaeilzadeh Glimpse: mathematical embedding of hardware specification for neural compilation. 1165-1170 2022 DAC https://doi.org/10.1145/3489517.3530590 conf/dac/2022 db/conf/dac/dac2022.html#AhnKE22 Hadi Esmaeilzadeh Soroush Ghodrati Andrew B. Kahng Joon Kyung Kim Sean Kinzer Sayak Kundu Rohan Mahapatra Susmita Dey Manasi Sachin S. Sapatnekar Zhiang Wang Ziqing Zeng Physically Accurate Learning-based Performance Prediction of Hardware-accelerated ML Algorithms. 119-126 2022 MLCAD https://doi.org/10.1145/3551901.3556489 https://doi.org/10.1109/MLCAD55463.2022.9900090 conf/mlcad/2022 db/conf/mlcad/mlcad2022.html#EsmaeilzadehGKK22 Sean Kinzer Joon Kyung Kim Soroush Ghodrati Brahmendra Reddy Yatham Alric Althoff Divya Mahajan 0001 Sorin Lerner Hadi Esmaeilzadeh A Computational Stack for Cross-Domain Acceleration. 54-70 2021 HPCA https://doi.org/10.1109/HPCA51647.2021.00015 conf/hpca/2021 db/conf/hpca/hpca2021.html#KinzerKGYAMLE21 Hadi Esmaeilzadeh Soroush Ghodrati Jie Gu 0003 Shiyu Guo Andrew B. Kahng Joon Kyung Kim Sean Kinzer Rohan Mahapatra Susmita Dey Manasi Edwin Mascarenhas Sachin S. Sapatnekar Ravi Varadarajan Zhiang Wang Hanyang Xu 0002 Brahmendra Reddy Yatham Ziqing Zeng VeriGOOD-ML: An Open-Source Flow for Automated ML Hardware Synthesis. 1-7 2021 ICCAD https://doi.org/10.1109/ICCAD51958.2021.9643449 conf/iccad/2021 db/conf/iccad/iccad2021.html#EsmaeilzadehG0G21 Soroush Ghodrati Hardik Sharma Sean Kinzer Amir Yazdanbakhsh Jongse Park Nam Sung Kim Doug Burger Hadi Esmaeilzadeh Mixed-Signal Charge-Domain Acceleration of Deep Neural Networks through Interleaved Bit-Partitioned Arithmetic. 399-411 2020 PACT https://doi.org/10.1145/3410463.3414634 conf/IEEEpact/2020 db/conf/IEEEpact/pact2020.html#GhodratiSKYPKBE20 Soroush Ghodrati Byung Hoon Ahn Joon Kyung Kim Sean Kinzer Brahmendra Reddy Yatham Navateja Alla Hardik Sharma Mohammad Alian Eiman Ebrahimi Nam Sung Kim Cliff Young Hadi Esmaeilzadeh Planaria: Dynamic Architecture Fission for Spatial Multi-Tenant Acceleration of Deep Neural Networks. 681-697 2020 MICRO https://doi.org/10.1109/MICRO50266.2020.00062 conf/micro/2020 db/conf/micro/micro2020.html#GhodratiAKKYASA20

Soroush Ghodrati Hardik Sharma Sean Kinzer Amir Yazdanbakhsh Kambiz Samadi Nam Sung Kim Doug Burger Hadi Esmaeilzadeh Mixed-Signal Charge-Domain Acceleration of Deep Neural networks through Interleaved Bit-Partitioned Arithmetic. 2019 abs/1906.11915 CoRR http://arxiv.org/abs/1906.11915 db/journals/corr/corr1906.html#abs-1906-11915

Ahmed T. Elthakeb Prannoy Pilligundla Amir Yazdanbakhsh Sean Kinzer Hadi Esmaeilzadeh ReLeQ: A Reinforcement Learning Approach for Deep Quantization of Neural Networks. 2018 abs/1811.01704 CoRR http://arxiv.org/abs/1811.01704 db/journals/corr/corr1811.html#abs-1811-01704

Byung Hoon Ahn Mohammad Alian Navateja Alla Alric Althoff Doug Burger Eiman Ebrahimi Ahmed T. Elthakeb Hadi Esmaeilzadeh Soroush Ghodrati Jie Gu 0003 Shiyu Guo Naiyin Jin Andrew B. Kahng Lavanya Karthikeyan Dohee Kim Joon Kyung Kim Nam Sung Kim Yoonsung Kim Sayak Kundu Sorin Lerner Xiaolong Li Jiaqi Lou Divya Mahajan 0001 Rohan Mahapatra Babak Mahmoudi Susmita Dey Manasi Edwin Mascarenhas Janarbek Matai Jongse Park Prannoy Pilligundla Kambiz Samadi Sachin S. Sapatnekar Parisa Sarikhani Hardik Sharma Ravi Varadarajan Dong Kai Wang Shu-Ting Wang Zhiang Wang Hanyang Xu 0002 Brahmendra Reddy Yatham Amir Yazdanbakhsh Cliff Young Ziqing Zeng Liang Zhang