Quaternion Extreme Learning Machine Based on Real Augmented Representation.

Dehao Chen

Huisheng Zhang Zaiqiang Wang Dehao Chen Shuai Zhu Dongpo Xu Quaternion Extreme Learning Machine Based on Real Augmented Representation. 175-179 2023 30 IEEE Signal Process. Lett. https://doi.org/10.1109/LSP.2023.3246396 db/journals/spl/spl30.html#ZhangWCZX23

Shibo Wang Jinliang Wei Amit Sabne Andy Davis Berkin Ilbeyi Blake Hechtman Dehao Chen Karthik Srinivasa Murthy Marcello Maggioni Qiao Zhang Sameer Kumar Tongfei Guo Yuanzhong Xu Zongwei Zhou Overlap Communication with Dependent Computation via Decomposition in Large Deep Learning Models. 93-106 2023 ASPLOS (1) https://doi.org/10.1145/3567955.3567959 conf/asplos/2023-1 db/conf/asplos/asplos2023-1.html#WangWSDIHCMMZKG23 Lei Ren Dehao Chen Zexin Miao Huisheng Zhang News Recommendation Model Based on Long-Term and Short-Term Interests. 183-189 2022 ICBDT https://doi.org/10.1145/3565291.3565321 conf/icbdt/2022 db/conf/icbdt/icbdt2022.html#RenCMZ22

Romal Thoppilan Daniel De Freitas Jamie Hall Noam Shazeer Apoorv Kulshreshtha Heng-Tze Cheng Alicia Jin Taylor Bos Leslie Baker Yu Du YaGuang Li Hongrae Lee Huaixiu Steven Zheng Amin Ghafouri Marcelo Menegali Yanping Huang Maxim Krikun Dmitry Lepikhin James Qin Dehao Chen Yuanzhong Xu Zhifeng Chen Adam Roberts Maarten Bosma Yanqi Zhou Chung-Ching Chang Igor Krivokon Will Rusch Marc Pickett Kathleen S. Meier-Hellstern Meredith Ringel Morris Tulsee Doshi Renelito Delos Santos Toju Duke Johnny Soraker Ben Zevenbergen Vinodkumar Prabhakaran Mark Diaz Ben Hutchinson Kristen Olson Alejandra Molina Erin Hoffman-John Josh Lee Lora Aroyo Ravi Rajakumar Alena Butryna Matthew Lamm Viktoriya Kuzmina Joe Fenton Aaron Cohen Rachel Bernstein Ray Kurzweil Blaise Agüera y Arcas Claire Cui Marian Croak Ed H. Chi Quoc Le 0001 LaMDA: Language Models for Dialog Applications. 2022 abs/2201.08239 CoRR https://arxiv.org/abs/2201.08239 db/journals/corr/corr2201.html#abs-2201-08239

Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang Maxim Krikun Noam Shazeer Zhifeng Chen GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. 2021 ICLR https://openreview.net/forum?id=qrwe7XHTmYb conf/iclr/2021 db/conf/iclr/iclr2021.html#LepikhinLXCFHKS21 Sameer Kumar Yu Emma Wang Cliff Young James Bradbury Naveen Kumar Dehao Chen Andy Swing Exploring the Limits of Concurrency in ML Training on Google TPUS. 2021 MLSys https://proceedings.mlsys.org/paper_files/paper/2021/hash/c0d16b623be8b439d9c075eb5a97efd1-Abstract.html conf/mlsys/2021 db/conf/mlsys/mlsys2021.html#KumarWYBKCS21

Yuanzhong Xu HyoukJoong Lee Dehao Chen Blake A. Hechtman Yanping Huang Rahul Joshi Maxim Krikun Dmitry Lepikhin Andy Ly Marcello Maggioni Ruoming Pang Noam Shazeer Shibo Wang Tao Wang Yonghui Wu Zhifeng Chen GSPMD: General and Scalable Parallelization for ML Computation Graphs. 2021 abs/2105.04663 CoRR https://arxiv.org/abs/2105.04663 db/journals/corr/corr2105.html#abs-2105-04663

Peter Mattson Christine Cheng Gregory F. Diamos Cody Coleman Paulius Micikevicius David A. Patterson 0001 Hanlin Tang Gu-Yeon Wei Peter Bailis Victor Bittorf David Brooks 0001 Dehao Chen Debo Dutta Udit Gupta 0001 Kim M. Hazelwood Andy Hock Xinyuan Huang Daniel Kang 0001 David Kanter Naveen Kumar Jeffery Liao Deepak Narayanan Tayo Oguntebi Gennady Pekhimenko Lillian Pentecost Vijay Janapa Reddi Taylor Robie Tom St. John Carole-Jean Wu Lingjie Xu Cliff Young Matei Zaharia MLPerf Training Benchmark. 2020 MLSys https://proceedings.mlsys.org/paper_files/paper/2020/hash/411e39b117e885341f25efb8912945f7-Abstract.html conf/mlsys/2020 db/conf/mlsys/mlsys2020.html#MattsonCDCMPTWB20

Yuanzhong Xu HyoukJoong Lee Dehao Chen Hongjun Choi Blake A. Hechtman Shibo Wang Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training. 2020 abs/2004.13336 CoRR https://arxiv.org/abs/2004.13336 db/journals/corr/corr2004.html#abs-2004-13336

Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang Maxim Krikun Noam Shazeer Zhifeng Chen GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. 2020 abs/2006.16668 CoRR https://arxiv.org/abs/2006.16668 db/journals/corr/corr2006.html#abs-2006-16668

Sameer Kumar James Bradbury Cliff Young Yu Emma Wang Anselm Levskaya Blake A. Hechtman Dehao Chen HyoukJoong Lee Mehmet Deveci Naveen Kumar Pankaj Kanwar Shibo Wang Skye Wanderman-Milne Steve Lacy Tao Wang Tayo Oguntebi Yazhou Zu Yuanzhong Xu Andy Swing Exploring the limits of Concurrency in ML Training on Google TPUs. 2020 abs/2011.03641 CoRR https://arxiv.org/abs/2011.03641 db/journals/corr/corr2011.html#abs-2011-03641

Yanping Huang Youlong Cheng Ankur Bapna Orhan Firat Dehao Chen Mia Xu Chen HyoukJoong Lee Jiquan Ngiam Quoc V. Le Yonghui Wu Zhifeng Chen GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism. 103-112 2019 NeurIPS https://proceedings.neurips.cc/paper/2019/hash/093f65e080a295f8076b1c5722a46aa2-Abstract.html http://papers.nips.cc/paper/8305-gpipe-efficient-training-of-giant-neural-networks-using-pipeline-parallelism conf/nips/2019 db/conf/nips/nips2019.html#HuangCBFCCLNLWC19

Jonathan Shen Patrick Nguyen Yonghui Wu Zhifeng Chen Mia Xu Chen Ye Jia Anjuli Kannan Tara N. Sainath Yuan Cao 0007 Chung-Cheng Chiu Yanzhang He Jan Chorowski Smit Hinsu Stella Laurenzo James Qin Orhan Firat Wolfgang Macherey Suyog Gupta Ankur Bapna Shuyuan Zhang 0002 Ruoming Pang Ron J. Weiss Rohit Prabhavalkar Qiao Liang 0001 Benoit Jacob Bowen Liang HyoukJoong Lee Ciprian Chelba Sébastien Jean Bo Li 0028 Melvin Johnson Rohan Anil Rajat Tibrewal Xiaobing Liu Akiko Eriguchi Navdeep Jaitly Naveen Ari Colin Cherry Parisa Haghani Otavio Good Youlong Cheng Raziel Alvarez Isaac Caswell Wei-Ning Hsu Zongheng Yang Kuan-Chieh Wang Ekaterina Gonina Katrin Tomanek Ben Vanik Zelin Wu Llion Jones Mike Schuster Yanping Huang Dehao Chen Kazuki Irie George F. Foster John Richardson Klaus Macherey Antoine Bruguier Heiga Zen Colin Raffel Shankar Kumar Kanishka Rao David Rybach Matthew Murray Vijayaditya Peddinti Maxim Krikun Michiel Bacchiani Thomas B. Jablin Robert Suderman Ian Williams Benjamin Lee Deepti Bhatia Justin Carlson Semih Yavuz Yu Zhang 0033 Ian McGraw Max Galkin Qi Ge Golan Pundak Chad Whipkey Todd Wang Uri Alon 0002 Dmitry Lepikhin Ye Tian 0022 Sara Sabour William Chan Shubham Toshniwal Baohua Liao Michael Nirschl Pat Rondon Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. 2019 abs/1902.08295 CoRR http://arxiv.org/abs/1902.08295 db/journals/corr/corr1902.html#abs-1902-08295

Sameer Kumar Victor Bitorff Dehao Chen Chiachen Chou Blake A. Hechtman HyoukJoong Lee Naveen Kumar Peter Mattson Shibo Wang Tao Wang Yuanzhong Xu Zongwei Zhou Scale MLPerf-0.6 models on Google TPU-v3 Pods. 2019 abs/1909.09756 CoRR http://arxiv.org/abs/1909.09756 db/journals/corr/corr1909.html#abs-1909-09756

Peter Mattson Christine Cheng Cody Coleman Greg Diamos Paulius Micikevicius David A. Patterson 0001 Hanlin Tang Gu-Yeon Wei Peter Bailis Victor Bittorf David Brooks 0001 Dehao Chen Debojyoti Dutta Udit Gupta 0001 Kim M. Hazelwood Andrew Hock Xinyuan Huang Bill Jia Daniel Kang 0001 David Kanter Naveen Kumar Jeffery Liao Guokai Ma Deepak Narayanan Tayo Oguntebi Gennady Pekhimenko Lillian Pentecost Vijay Janapa Reddi Taylor Robie Tom St. John Carole-Jean Wu Lingjie Xu Cliff Young Matei Zaharia MLPerf Training Benchmark. 2019 abs/1910.01500 CoRR http://arxiv.org/abs/1910.01500 db/journals/corr/corr1910.html#abs-1910-01500

Yanping Huang Yonglong Cheng Dehao Chen HyoukJoong Lee Jiquan Ngiam Quoc V. Le Zhifeng Chen GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism. 2018 abs/1811.06965 CoRR http://arxiv.org/abs/1811.06965 db/journals/corr/corr1811.html#abs-1811-06965

Chris Ying Sameer Kumar Dehao Chen Tao Wang Youlong Cheng Image Classification at Supercomputer Scale. 2018 abs/1811.06992 CoRR http://arxiv.org/abs/1811.06992 db/journals/corr/corr1811.html#abs-1811-06992

Dehao Chen Xinliang David Li Tipp Moseley AutoFDO: automatic feedback-directed optimization for warehouse-scale applications. 12-23 2016 CGO https://doi.org/10.1145/2854038.2854044 https://ieeexplore.ieee.org/document/7559528/ conf/cgo/2016 db/conf/cgo/cgo2016.html#ChenLM16

Baptiste Wicht Roberto A. Vitillo Dehao Chen David Levinthal Hardware Counted Profile-Guided Optimization. 2014 abs/1411.6361 CoRR http://arxiv.org/abs/1411.6361 db/journals/corr/corr1411.html#WichtVCL14

Dehao Chen Neil Vachharajani Robert Hundt Xinliang D. Li Stéphane Eranian Wenguang Chen Weimin Zheng Taming Hardware Event Samples for Precise and Versatile Feedback Directed Optimizations. 376-389 2013 62 IEEE Trans. Computers 2 https://doi.org/10.1109/TC.2011.233 http://doi.ieeecomputersociety.org/10.1109/TC.2011.233 db/journals/tc/tc62.html#ChenVHLECZ13

Dehao Chen Wenguang Chen Weimin Zheng CUDA-Zero: a framework for porting shared memory GPU applications to multi-GPUs. 663-676 2012 55 Sci. China Inf. Sci. 3 https://doi.org/10.1007/s11432-011-4497-z db/journals/chinaf/chinaf55.html#ChenCZ12

Chun-Tao Hong Dehao Chen Yubei Chen Wen-Guang Chen Wei-Min Zheng Haibo Lin Providing Source Code Level Portability Between CPU and GPU with MapCG. 42-56 2012 27 J. Comput. Sci. Technol. 1 https://doi.org/10.1007/s11390-012-1205-4 https://www.wikidata.org/entity/Q110512375 db/journals/jcst/jcst27.html#HongCCCZL12

Chuntao Hong Dehao Chen Wenguang Chen Weimin Zheng Haibo Lin MapCG: writing parallel program portable between CPU and GPU. 217-226 2010 PACT https://doi.org/10.1145/1854273.1854303 https://ieeexplore.ieee.org/document/7851522/ https://www.wikidata.org/entity/Q131129534 conf/IEEEpact/2010 db/conf/IEEEpact/pact2010.html#HongCCZL10 Dehao Chen Neil Vachharajani Robert Hundt Shih-wei Liao Vinodha Ramasamy Paul Yuan Wenguang Chen Weimin Zheng Taming hardware event samples for FDO compilation. 42-52 2010 CGO https://doi.org/10.1145/1772954.1772963 conf/cgo/2010 db/conf/cgo/cgo2010.html#ChenVHLRYCZ10 Dehao Chen Chunrong Lai Wei Hu 0002 Wenguang Chen Yimin Zhang 0002 Weimin Zheng Tree partition based parallel frequent pattern mining on shared memory systems. 2006 conf/ipps/2006 IPDPS https://doi.org/10.1109/IPDPS.2006.1639620 https://doi.ieeecomputersociety.org/10.1109/IPDPS.2006.1639620 db/conf/ipps/ipdps2006.html#ChenLHCZZ06 Uri Alon 0002 Raziel Alvarez Rohan Anil Blaise Agüera y Arcas Naveen Ari Lora Aroyo Michiel Bacchiani Peter Bailis Leslie Baker Ankur Bapna Rachel Bernstein Deepti Bhatia Victor Bitorff Victor Bittorf Taylor Bos Maarten Bosma James Bradbury David Brooks 0001 Antoine Bruguier Alena Butryna Yuan Cao 0007 Justin Carlson Isaac Caswell William Chan Chung-Ching Chang Ciprian Chelba Mia Xu Chen Wen-Guang Chen Wenguang Chen Yubei Chen Zhifeng Chen Christine Cheng Heng-Tze Cheng Yonglong Cheng Youlong Cheng Colin Cherry Ed H. Chi Chung-Cheng Chiu Hongjun Choi Jan Chorowski Chiachen Chou Aaron Cohen Cody Coleman Marian Croak Claire Cui Andy Davis Mehmet Deveci Gregory Frederick DiamosGregory F. DiamosGreg Diamos Mark Diaz Tulsee Doshi Yu Du Toju Duke Debojyoti DuttaDebo Dutta Stéphane Eranian Akiko Eriguchi Joe Fenton Orhan Firat George F. Foster Daniel De Freitas Max Galkin Qi Ge Amin Ghafouri Ekaterina Gonina Otavio Good Tongfei Guo Suyog Gupta Udit Gupta 0001 Parisa Haghani Jamie Hall Kim M. Hazelwood Yanzhang He Blake Hechtman Blake A. Hechtman Smit Hinsu Andrew Hock Andy Hock Erin Hoffman-John Chun-Tao Hong Chuntao Hong Wei-Ning Hsu Wei Hu 0002 Xinyuan Huang Yanping Huang Robert Hundt Ben Hutchinson Berkin Ilbeyi Kazuki Irie Thomas B. Jablin Benoit Jacob Navdeep Jaitly Sébastien Jean Bill Jia Ye Jia Alicia Jin Tom St. John Melvin Johnson Llion Jones Rahul Joshi Daniel Kang 0001 Anjuli Kannan David Kanter Pankaj Kanwar Maxim Krikun Igor Krivokon Apoorv Kulshreshtha Naveen Kumar Sameer Kumar Shankar Kumar Raymond KurzweilRay Kurzweil Viktoriya Kuzmina Steve Lacy Chunrong Lai Matthew Lamm Stella Laurenzo Quoc V. LeQuoc Le 0001 Benjamin Lee Hongrae Lee HyoukJoong Lee Josh Lee Dmitry Lepikhin David Levinthal Anselm Levskaya Bo Li 0028 Xinliang D. Li Xinliang David Li YaGuang Li Bowen Liang Qiao Liang 0001 Baohua Liao Jeffery Liao Shih-Wei LiaoShih-wei Liao Haibo Lin Xiaobing Liu Andy Ly Guokai Ma Klaus Macherey Wolfgang Macherey Marcello Maggioni Peter Mattson Ian McGraw Kathy Meier-HellsternKathleen S. Meier-Hellstern Marcelo Menegali Zexin Miao Paulius Micikevicius Alejandra Molina Meredith Ringel Morris Tipp Moseley Matthew Murray Karthik Srinivasa Murthy Deepak Narayanan Jiquan Ngiam Patrick Nguyen Michael Nirschl Tayo Oguntebi Kristen Olson Ruoming Pang David A. Patterson 0001 Vijayaditya Peddinti Gennady Pekhimenko Lillian Pentecost Marc Pickett Vinodkumar Prabhakaran Rohit Prabhavalkar Golan Pundak James Qin Colin Raffel Ravi Rajakumar Vinodha Ramasamy Kanishka Rao Vijay Janapa Reddi Lei Ren John Richardson Adam Roberts Taylor Robie Pat Rondon Will Rusch David Rybach Amit Sabne Sara Sabour Tara N. Sainath Renelito Delos Santos Mike Schuster Noam Shazeer Jonathan Shen Johnny Soraker Robert Suderman Andy Swing Hanlin Tang Romal Thoppilan Ye Tian 0022 Rajat Tibrewal Katrin Tomanek Shubham Toshniwal Neil Vachharajani Ben Vanik Roberto A. Vitillo Skye Wanderman-Milne Kuan-Chieh Wang Shibo Wang Tao Wang Todd Wang Yu Emma Wang Zaiqiang Wang Gu-Yeon Wei Jinliang Wei Ron J. Weiss Chad Whipkey Baptiste Wicht Ian Williams Carole-Jean Wu Yonghui Wu Zelin Wu Dongpo Xu Lingjie Xu Yuanzhong Xu Zongheng Yang Semih Yavuz Chris Ying Cliff Young Paul Yuan Matei Zaharia Heiga Zen Bendert ZevenbergenBen Zevenbergen Huisheng Zhang Qiao Zhang Shuyuan Zhang 0002 Yimin Zhang 0002 Yu Zhang 0033 Huaixiu Steven Zheng Weimin ZhengWei-Min Zheng Yanqi Zhou Zongwei Zhou Shuai Zhu Yazhou Zu