Language Models Struggle to Use Representations Learned In-Context.

Tal Linzen https://tallinzen.net/ https://scholar.google.com/citations?user=5mJDXjoAAAAJ https://openreview.net/profile?id=~Tal_Linzen1 https://twitter.com/tallinzen New York University, NY, USA

Michael A. Lepori Tal Linzen Ann Yuan Katja Filippova Language Models Struggle to Use Representations Learned In-Context. 2026 February abs/2602.04212 CoRR https://doi.org/10.48550/arXiv.2602.04212 db/journals/corr/corr2602.html#abs-2602-04212 streams/journals/corr

Dario Paape Tal Linzen Shravan Vasishth Deconstructing sentence disambiguation by joint latent modeling of reading paradigms: LLM surprisal is not enough. 2026 February abs/2602.04489 CoRR https://doi.org/10.48550/arXiv.2602.04489 db/journals/corr/corr2602.html#abs-2602-04489 streams/journals/corr

Leshem Choshen Ryan Cotterell Mustafa Omer Gul Jaap Jumelet Tal Linzen Aaron Mueller Suchir Salhan Raj Sanjay Shah Alex Warstadt Ethan Gotlieb Wilcox BabyLM Turns 4 and Goes Multilingual: Call for Papers for the 2026 BabyLM Workshop. 2026 February abs/2602.20092 CoRR https://doi.org/10.48550/arXiv.2602.20092 db/journals/corr/corr2602.html#abs-2602-20092 streams/journals/corr

Jackson Petty Jaulie Goe Tal Linzen Evaluating In-Context Translation with Synchronous Context-Free Grammar Transduction. 2026 April abs/2604.07320 CoRR https://doi.org/10.48550/arXiv.2604.07320 db/journals/corr/corr2604.html#abs-2604-07320 streams/journals/corr

Michael Y. Hu Apurva Gandhi Kyunghyun Cho Tal Linzen Pratyusha Sharma Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time. 2026 May abs/2605.15220 CoRR https://doi.org/10.48550/arXiv.2605.15220 db/journals/corr/corr2605.html#abs-2605-15220 streams/journals/corr

William Timkey Brian Dillon Tal Linzen Why are language models less surprised than humans? Testing the Parse Multiplicity Mismatch Hypothesis. 2026 May abs/2605.15440 CoRR https://doi.org/10.48550/arXiv.2605.15440 db/journals/corr/corr2605.html#abs-2605-15440 streams/journals/corr

Qihan Wang Nicholas Tomlin Michael Hu Brian Dillon Tal Linzen Simulating Human Memory with Language Models. 2026 May abs/2605.25680 CoRR https://doi.org/10.48550/arXiv.2605.25680 db/journals/corr/corr2605.html#abs-2605-25680 streams/journals/corr

Shashwat Singh 0001 Tal Linzen Shauli Ravfogel Can LLMs Introspect? A Reality Check. 2026 May abs/2605.26242 CoRR https://doi.org/10.48550/arXiv.2605.26242 db/journals/corr/corr2605.html#abs-2605-26242 streams/journals/corr

Jackson Petty Sjoerd van Steenkiste Tal Linzen How Does Code Pretraining Affect Language Model Task Performance? 2025 2025 Trans. Mach. Learn. Res. https://openreview.net/forum?id=pxxmUKKgel db/journals/tmlr/tmlr2025.html#PettySL25

Michael Y. Hu Jackson Petty Chuan Shi William Merrill Tal Linzen Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases. 9691-9709 2025 ACL (1) https://doi.org/10.18653/v1/2025.acl-long.478 https://aclanthology.org/2025.acl-long.478/ conf/acl/2025-1 db/conf/acl/acl2025-1.html#HuPSML25 Qihan Wang Shidong Pan Tal Linzen Emily Black Multilingual Prompting for Improving LLM Generation Diversity. 6367-6389 2025 EMNLP https://doi.org/10.18653/v1/2025.emnlp-main.324 conf/emnlp/2025 db/conf/emnlp/emnlp2025.html#WangPLB25 streams/conf/emnlp Wentao Wang Guangyuan Jiang Tal Linzen Brenden M. Lake Rapid Word Learning Through Meta In-Context Learning. 32038-32073 2025 EMNLP https://doi.org/10.18653/v1/2025.emnlp-main.1631 conf/emnlp/2025 db/conf/emnlp/emnlp2025.html#WangJLL25 streams/conf/emnlp Lindia Tjuatja Graham Neubig Tal Linzen Sophie Hao What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Length. 2173-2186 2025 NAACL (Long Papers) https://doi.org/10.18653/v1/2025.naacl-long.109 https://aclanthology.org/2025.naacl-long.109/ conf/naacl/2025-1 db/conf/naacl/naacl2025-1.html#TjuatjaNLH25 streams/conf/naacl

Lucas Charpentier Leshem Choshen Ryan Cotterell Mustafa Omer Gul Michael Y. Hu Jaap Jumelet Tal Linzen Jing Liu Aaron Mueller Candace Ross Raj Sanjay Shah Alex Warstadt Ethan Wilcox Adina Williams BabyLM Turns 3: Call for papers for the 2025 BabyLM workshop. 2025 February abs/2502.10645 CoRR https://doi.org/10.48550/arXiv.2502.10645 db/journals/corr/corr2502.html#abs-2502-10645 streams/journals/corr

Wentao Wang Guangyuan Jiang Tal Linzen Brenden M. Lake Rapid Word Learning Through Meta In-Context Learning. 2025 February abs/2502.14791 CoRR https://doi.org/10.48550/arXiv.2502.14791 db/journals/corr/corr2502.html#abs-2502-14791 streams/journals/corr

Michael Y. Hu Jackson Petty Chuan Shi William Merrill Tal Linzen Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases. 2025 February abs/2502.19249 CoRR https://doi.org/10.48550/arXiv.2502.19249 db/journals/corr/corr2502.html#abs-2502-19249 streams/journals/corr

Linlu Qiu Fei Sha Kelsey R. Allen Yoon Kim Tal Linzen Sjoerd van Steenkiste Bayesian Teaching Enables Probabilistic Reasoning in Large Language Models. 2025 March abs/2503.17523 CoRR https://doi.org/10.48550/arXiv.2503.17523 db/journals/corr/corr2503.html#abs-2503-17523 streams/journals/corr

Alex Warstadt Aaron Mueller Leshem Choshen Ethan Wilcox Chengxu Zhuang Juan Ciro Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora. 2025 April abs/2504.08165 CoRR https://doi.org/10.48550/arXiv.2504.08165 db/journals/corr/corr2504.html#abs-2504-08165 streams/journals/corr

Qihan Wang Shidong Pan Tal Linzen Emily Black Multilingual Prompting for Improving LLM Generation Diversity. 2025 May abs/2505.15229 CoRR https://doi.org/10.48550/arXiv.2505.15229 db/journals/corr/corr2505.html#abs-2505-15229 streams/journals/corr

Jackson Petty Michael Y. Hu Wentao Wang Shauli Ravfogel William Merrill Tal Linzen RELIC: Evaluating Compositional Instruction Following via Language Recognition. 2025 June abs/2506.05205 CoRR https://doi.org/10.48550/arXiv.2506.05205 db/journals/corr/corr2506.html#abs-2506-05205 streams/journals/corr

Carter Blum Katja Filippova Ann Yuan Asma Ghandeharioun Julian Zimmert Fred Zhang Jessica Hoffmann Tal Linzen Martin Wattenberg Lucas Dixon Mor Geva Beyond the Rosetta Stone: Unification Forces in Generalization Dynamics. 2025 August abs/2508.11017 CoRR https://doi.org/10.48550/arXiv.2508.11017 db/journals/corr/corr2508.html#abs-2508-11017 streams/journals/corr

Byung-Doh Oh Tal Linzen To model human linguistic prediction, make LLMs less superhuman. 2025 October abs/2510.05141 CoRR https://doi.org/10.48550/arXiv.2510.05141 db/journals/corr/corr2510.html#abs-2510-05141 streams/journals/corr

Shauli Ravfogel Gilad Yehudai Tal Linzen Joan Bruna Alberto Bietti Emergence of Linear Truth Encodings in Language Models. 2025 October abs/2510.15804 CoRR https://doi.org/10.48550/arXiv.2510.15804 db/journals/corr/corr2510.html#abs-2510-15804 streams/journals/corr

Matthew Mandelkern Tal Linzen Do Language Models' Words Refer? 1191-1200 2024 50 Comput. Linguistics 3 https://doi.org/10.1162/coli_a_00522 db/journals/coling/coling50.html#MandelkernL24 streams/journals/coling

William Merrill Zhaofeng Wu Norihito Naka Yoon Kim Tal Linzen Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment. 2752-2773 2024 ACL (Findings) https://doi.org/10.18653/v1/2024.findings-acl.161 https://aclanthology.org/2024.findings-acl.161 conf/acl/2024f db/conf/acl/acl2024f.html#MerrillWNKL24 Alex Warstadt Aaron Mueller Leshem Choshen Ethan Gotlieb Wilcox Chengxu Zhuang Adina Williams Ryan Cotterell Tal Linzen Insights from the first BabyLM Challenge: Training sample-efficient language models on a developmentally plausible corpus. 2024 CogSci https://escholarship.org/uc/item/4cp7t0nm conf/cogsci/2024 db/conf/cogsci/cogsci2024.html#WarstadtMCWZWCL24 Aaron Mueller Albert Webson Jackson Petty Tal Linzen In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax. 4761-4779 2024 NAACL-HLT https://doi.org/10.18653/v1/2024.naacl-long.267 conf/naacl/2024 db/conf/naacl/naacl2024.html#MuellerWPL24 Jackson Petty Sjoerd van Steenkiste Ishita Dasgupta 0001 Fei Sha Dan Garrette Tal Linzen The Impact of Depth on Compositional Generalization in Transformer Language Models. 7239-7252 2024 NAACL-HLT https://doi.org/10.18653/v1/2024.naacl-long.402 conf/naacl/2024 db/conf/naacl/naacl2024.html#PettyS0SGL24 Tiwalayo Eisape Michael Henry Tessler Ishita Dasgupta 0001 Fei Sha Sjoerd van Steenkiste Tal Linzen A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models. 8425-8444 2024 NAACL-HLT https://doi.org/10.18653/v1/2024.naacl-long.466 conf/naacl/2024 db/conf/naacl/naacl2024.html#EisapeT0SSL24

William Merrill Zhaofeng Wu Norihito Naka Yoon Kim Tal Linzen Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment. 2024 abs/2402.13956 CoRR https://doi.org/10.48550/arXiv.2402.13956 db/journals/corr/corr2402.html#abs-2402-13956

Grusha Prasad Tal Linzen SPAWNing Structural Priming Predictions from a Cognitively Motivated Parser. 2024 abs/2403.07202 CoRR https://doi.org/10.48550/arXiv.2403.07202 db/journals/corr/corr2403.html#abs-2403-07202

Leshem Choshen Ryan Cotterell Michael Y. Hu Tal Linzen Aaron Mueller Candace Ross Alex Warstadt Ethan Wilcox Adina Williams Chengxu Zhuang [Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus. 2024 abs/2404.06214 CoRR https://doi.org/10.48550/arXiv.2404.06214 db/journals/corr/corr2404.html#abs-2404-06214

Cara Su-Yi Leong Tal Linzen Testing learning hypotheses using neural networks by manipulating learning data. 2024 abs/2407.04593 CoRR https://doi.org/10.48550/arXiv.2407.04593 db/journals/corr/corr2407.html#abs-2407-04593 streams/journals/corr

Jackson Petty Sjoerd van Steenkiste Tal Linzen How Does Code Pretraining Affect Language Model Task Performance? 2024 abs/2409.04556 CoRR https://doi.org/10.48550/arXiv.2409.04556 db/journals/corr/corr2409.html#abs-2409-04556 streams/journals/corr

Lindia Tjuatja Graham Neubig Tal Linzen Sophie Hao What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Length. 2024 abs/2411.02528 CoRR https://doi.org/10.48550/arXiv.2411.02528 db/journals/corr/corr2411.html#abs-2411-02528 streams/journals/corr

Michael Y. Hu Aaron Mueller Candace Ross Adina Williams Tal Linzen Chengxu Zhuang Ryan Cotterell Leshem Choshen Alex Warstadt Ethan Gotlieb Wilcox Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora. 2024 abs/2412.05149 CoRR https://doi.org/10.48550/arXiv.2412.05149 db/journals/corr/corr2412.html#abs-2412-05149 streams/journals/corr

R. Thomas McCoy Paul Smolensky Tal Linzen Jianfeng Gao 0001 Asli Celikyilmaz How Much Do Language Models Copy From Their Training Data? Evaluating Linguistic Novelty in Text Generation Using RAVEN. 652-670 2023 11 Trans. Assoc. Comput. Linguistics https://doi.org/10.1162/tacl_a_00567 db/journals/tacl/tacl11.html#McCoySL0C23

Aarohi Srivastava Abhinav Rastogi Abhishek Rao Abu Awal Md Shoeb Abubakar Abid Adam Fisch Adam R. Brown Adam Santoro Aditya Gupta 0001 Adrià Garriga-Alonso Agnieszka Kluska Aitor Lewkowycz Akshat Agarwal Alethea Power Alex Ray Alex Warstadt Alexander W. Kocurek Ali Safaya Ali Tazarv Alice Xiang Alicia Parrish Allen Nie Aman Hussain Amanda Askell Amanda Dsouza Ambrose Slone Ameet Rahane Anantharaman S. Iyer Anders Andreassen Andrea Madotto Andrea Santilli Andreas Stuhlmüller Andrew M. Dai Andrew La Andrew K. Lampinen Andy Zou Angela Jiang Angelica Chen Anh Vuong Animesh Gupta Anna Gottardi Antonio Norelli Anu Venkatesh Arash Gholamidavoodi Arfa Tabassum Arul Menezes Arun Kirubarajan Asher Mullokandov Ashish Sabharwal Austin Herrick Avia Efrat Aykut Erdem Ayla Karakas B. Ryan Roberts Bao Sheng Loe Barret Zoph Bartlomiej Bojanowski Batuhan Özyurt Behnam Hedayatnia Behnam Neyshabur Benjamin Inden Benno Stein 0001 Berk Ekmekci Bill Yuchen Lin Blake Howald Bryan Orinion Cameron Diao Cameron Dour Catherine Stinson Cedrick Argueta Cèsar Ferri Ramírez Chandan Singh Charles Rathkopf Chenlin Meng Chitta Baral Chiyu Wu Chris Callison-Burch Chris Waites Christian Voigt Christopher D. Manning Christopher Potts Cindy Ramirez Clara E. Rivera Clemencia Siro Colin Raffel Courtney Ashcraft Cristina Garbacea Damien Sileo Dan Garrette Dan Hendrycks Dan Kilman Dan Roth 0001 Daniel Freeman Daniel Khashabi Daniel Levy 0002 Daniel Moseguí González Danielle Perszyk Danny Hernandez Danqi Chen 0001 Daphne Ippolito Dar Gilboa David Dohan David Drakard David Jurgens Debajyoti Datta Deep Ganguli Denis Emelin Denis Kleyko Deniz Yuret Derek Chen Derek Tam Dieuwke Hupkes Diganta Misra Dilyar Buzan Dimitri Coelho Mollo Diyi Yang Dong-Ho Lee Dylan Schrader Ekaterina Shutova Ekin Dogus Cubuk Elad Segal Eleanor Hagerman Elizabeth Barnes Elizabeth Donoway Ellie Pavlick Emanuele Rodolà Emma Lam Eric Chu Eric Tang Erkut Erdem Ernie Chang Ethan A. Chi Ethan Dyer Ethan J. Jerzak Ethan Kim Eunice Engefu Manyasi Evgenii Zheltonozhskii Fanyue Xia Fatemeh Siar Fernando Martínez-Plumed Francesca Happé François Chollet Frieda Rong Gaurav Mishra Genta Indra Winata Gerard de Melo Germán Kruszewski Giambattista Parascandolo Giorgio Mariani Gloria Wang Gonzalo Jaimovitch-López Gregor Betz Guy Gur-Ari Hana Galijasevic Hannah Kim 0010 Hannah Rashkin Hannaneh Hajishirzi Harsh Mehta Hayden Bogar Henry Shevlin Hinrich Schütze Hiromu Yakura Hongming Zhang 0009 Hugh Mee Wong Ian Ng Isaac Noble Jaap Jumelet Jack Geissinger Jackson Kernion Jacob Hilton Jaehoon Lee 0001 Jaime Fernández Fisac James B. Simon James Koppel James Zheng James Zou 0001 Jan Kocon Jana Thompson Janelle Wingfield Jared Kaplan Jarema Radom Jascha Sohl-Dickstein Jason Phang Jason Wei Jason Yosinski Jekaterina Novikova Jelle Bosscher Jennifer Marsh Jeremy Kim Jeroen Taal Jesse H. Engel Jesujoba Alabi Jiacheng Xu Jiaming Song Jillian Tang Joan Waweru John Burden John Miller 0001 John U. Balis Jonathan Batchelder Jonathan Berant Jörg Frohberg Jos Rozen José Hernández-Orallo Joseph Boudeman Joseph Guerr Joseph Jones Joshua B. Tenenbaum Joshua S. Rule Joyce Chua Kamil Kanclerz Karen Livescu Karl Krauth Karthik Gopalakrishnan 0001 Katerina Ignatyeva Katja Markert Kaustubh D. Dhole Kevin Gimpel Kevin Omondi Kory W. Mathewson Kristen Chiafullo Ksenia Shkaruta Kumar Shridhar Kyle McDonell Kyle Richardson 0001 Laria Reynolds Leo Gao Li Zhang 0039 Liam Dugan Lianhui Qin Lidia Contreras Ochando Louis-Philippe Morency Luca Moschella Lucas Lam Lucy Noble Ludwig Schmidt Luheng He Luis Oliveros Colón Luke Metz Lütfi Kerem Senel Maarten Bosma Maarten Sap Maartje ter Hoeve Maheen Farooqi Manaal Faruqui Mantas Mazeika Marco Baturan Marco Marelli Marco Maru María José Ramírez-Quintana Marie Tolkiehn Mario Giulianelli Martha Lewis Martin Potthast Matthew L. Leavitt Matthias Hagen Mátyás Schubert Medina Baitemirova Melody Arnaud Melvin McElrath Michael A. Yee Michael Cohen Michael Gu Michael I. Ivanitskiy Michael Starritt Michael Strube 0001 Michal Swedrowski Michele Bevilacqua Michihiro Yasunaga Mihir Kale Mike Cain Mimee Xu Mirac Suzgun Mitch Walker Mo Tiwari Mohit Bansal Moin Aminnaseri Mor Geva Mozhdeh Gheini Mukund Varma T. Nanyun Peng 0001 Nathan A. Chi Nayeon Lee Neta Gur-Ari Krakover Nicholas Cameron 0001 Nicholas Roberts Nick Doiron Nicole Martinez Nikita Nangia Niklas Deckers Niklas Muennighoff Nitish Shirish Keskar Niveditha Iyer Noah Constant Noah Fiedel Nuan Wen Oliver Zhang Omar Agha Omar Elbaghdadi Omer Levy Owain Evans Pablo Antonio Moreno Casares Parth Doshi Pascale Fung Paul Pu Liang Paul Vicol Pegah Alipoormolabashi Peiyuan Liao Percy Liang Peter Chang Peter Eckersley Phu Mon Htut Pinyu Hwang Piotr Milkowski Piyush Patil Pouya Pezeshkpour Priti Oli Qiaozhu Mei Qing Lyu 0001 Qinlang Chen 0001 Rabin Banjade Rachel Etta Rudolph Raefer Gabriel Rahel Habacker Ramon Risco Raphaël Millière Rhythm Garg Richard Barnes 0002 Rif A. Saurous Riku Arakawa Robbe Raymaekers Robert Frank 0001 Rohan Sikand Roman Novak Roman Sitelew Ronan LeBras Rosanne Liu Rowan Jacobs Rui Zhang 0037 Ruslan Salakhutdinov Ryan Chi Ryan Lee Ryan Stovall Ryan Teehan Rylan Yang Sahib Singh Saif M. Mohammad Sajant Anand Sam Dillavou Sam Shleifer Sam Wiseman Samuel Gruetter Samuel R. Bowman Samuel S. Schoenholz Sanghyun Han Sanjeev Kwatra Sarah A. Rous Sarik Ghazarian Sayan Ghosh 0004 Sean Casey Sebastian Bischoff 0001 Sebastian Gehrmann Sebastian Schuster 0001 Sepideh Sadeghi Shadi Hamdan Sharon Zhou Shashank Srivastava Sherry Shi Shikhar Singh Shima Asaadi Shixiang Shane Gu Shubh Pachchigar Shubham Toshniwal Shyam Upadhyay Shyamolima (Shammie) Debnath Siamak Shakeri Simon Thormeyer Simone Melzi Siva Reddy Sneha Priscilla Makini Soo-Hwan Lee Spencer Torene Sriharsha Hatwar Stanislas Dehaene Stefan Divic Stefano Ermon Stella Biderman Stephanie Lin Stephen Prasad Steven T. Piantadosi Stuart M. Shieber Summer Misherghi Svetlana Kiritchenko Swaroop Mishra Tal Linzen Tal Schuster Tao Li 0039 Tao Yu 0009 Tariq Ali Tatsu Hashimoto Te-Lin Wu Théo Desbordes Theodore Rothschild Thomas Phan Tianle Wang 0009 Tiberius Nkinyili Timo Schick Timofei Kornev Titus Tunduny Tobias Gerstenberg Trenton Chang Trishala Neeraj Tushar Khot Tyler Shultz Uri Shaham 0002 Vedant Misra Vera Demberg Victoria Nyamai Vikas Raunak Vinay V. Ramasesh Vinay Uday Prabhu Vishakh Padmakumar Vivek Srikumar William Fedus William Saunders William Zhang 0004 Wout Vossen Xiang Ren 0001 Xiaoyu Tong Xinran Zhao Xinyi Wu Xudong Shen Yadollah Yaghoobzadeh Yair Lakretz Yangqiu Song Yasaman Bahri Yejin Choi 0001 Yichi Yang Yiding Hao Yifu Chen Yonatan Belinkov Yu Hou Yufang Hou 0001 Yuntao Bai Zachary Seid Zhuoye Zhao Zijian Wang 0002 Zijie J. Wang Zirui Wang Ziyi Wu Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. 2023 2023 Trans. Mach. Learn. Res. https://openreview.net/forum?id=uyTL5Bvosj db/journals/tmlr/tmlr2023.html#SrivastavaRRSAF23

Aditya Yedetore Tal Linzen Robert Frank 0001 R. Thomas McCoy How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech. 9370-9393 2023 ACL (1) https://doi.org/10.18653/v1/2023.acl-long.521 https://aclanthology.org/2023.acl-long.521 conf/acl/2023-1 db/conf/acl/acl2023-1.html#YedetoreL0M23 Aaron Mueller Tal Linzen How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases. 11237-11252 2023 ACL (1) https://doi.org/10.18653/v1/2023.acl-long.629 https://aclanthology.org/2023.acl-long.629 conf/acl/2023-1 db/conf/acl/acl2023-1.html#MuellerL23 Bingzhi Li Lucia Donatelli Alexander Koller Tal Linzen Yuekun Yao Najoung Kim SLOG: A Structural Generalization Benchmark for Semantic Parsing. 3213-3232 2023 EMNLP https://doi.org/10.18653/v1/2023.emnlp-main.194 https://aclanthology.org/2023.emnlp-main.194 conf/emnlp/2023 db/conf/emnlp/emnlp2023.html#LiDKLYK23 Sophie Hao Tal Linzen Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number. 4531-4539 2023 EMNLP (Findings) https://doi.org/10.18653/v1/2023.findings-emnlp.300 https://aclanthology.org/2023.findings-emnlp.300 conf/emnlp/2023f db/conf/emnlp/emnlp2023f.html#HaoL23 William Timkey Tal Linzen A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing. 8705-8720 2023 EMNLP (Findings) https://doi.org/10.18653/v1/2023.findings-emnlp.582 https://aclanthology.org/2023.findings-emnlp.582 conf/emnlp/2023f db/conf/emnlp/emnlp2023f.html#TimkeyL23

Aaron Mueller Tal Linzen How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases. 2023 abs/2305.19905 CoRR https://doi.org/10.48550/arXiv.2305.19905 db/journals/corr/corr2305.html#abs-2305-19905

Cara Su-Yi Leong Tal Linzen Language Models Can Learn Exceptions to Syntactic Rules. 2023 abs/2306.05969 CoRR https://doi.org/10.48550/arXiv.2306.05969 db/journals/corr/corr2306.html#abs-2306-05969

Matthew Mandelkern Tal Linzen Do Language Models Refer? 2023 abs/2308.05576 CoRR https://doi.org/10.48550/arXiv.2308.05576 db/journals/corr/corr2308.html#abs-2308-05576

Bingzhi Li Lucia Donatelli Alexander Koller Tal Linzen Yuekun Yao Najoung Kim SLOG: A Structural Generalization Benchmark for Semantic Parsing. 2023 abs/2310.15040 CoRR https://doi.org/10.48550/arXiv.2310.15040 db/journals/corr/corr2310.html#abs-2310-15040

Sophie Hao Tal Linzen Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number. 2023 abs/2310.15151 CoRR https://doi.org/10.48550/arXiv.2310.15151 db/journals/corr/corr2310.html#abs-2310-15151

William Timkey Tal Linzen A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing. 2023 abs/2310.16142 CoRR https://doi.org/10.48550/arXiv.2310.16142 db/journals/corr/corr2310.html#abs-2310-16142

Jackson Petty Sjoerd van Steenkiste Ishita Dasgupta 0001 Fei Sha Dan Garrette Tal Linzen The Impact of Depth and Width on Transformer Language Model Generalization. 2023 abs/2310.19956 CoRR https://doi.org/10.48550/arXiv.2310.19956 db/journals/corr/corr2310.html#abs-2310-19956

Tiwalayo Eisape Michael Henry Tessler Ishita Dasgupta 0001 Fei Sha Sjoerd van Steenkiste Tal Linzen A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models. 2023 abs/2311.00445 CoRR https://doi.org/10.48550/arXiv.2311.00445 db/journals/corr/corr2311.html#abs-2311-00445

Aaron Mueller Albert Webson Jackson Petty Tal Linzen In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax. 2023 abs/2311.07811 CoRR https://doi.org/10.48550/arXiv.2311.07811 db/journals/corr/corr2311.html#abs-2311-07811

Nouha Dziri Hannah Rashkin Tal Linzen David Reitter Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark. 1066-1083 2022 10 Trans. Assoc. Comput. Linguistics https://doi.org/10.1162/tacl_a_00506 db/journals/tacl/tacl10.html#DziriRLR22

Aaron Mueller Robert Frank 0001 Tal Linzen Luheng Wang Sebastian Schuster 0001 Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models. 1352-1368 2022 ACL (Findings) https://doi.org/10.18653/v1/2022.findings-acl.106 https://aclanthology.org/2022.findings-acl.106 conf/acl/2022f db/conf/acl/acl2022f.html#Mueller0LWS22 Anastasia Kobzeva Suhas Arehalli Tal Linzen Dave Kush LSTMs Can Learn Basic Wh- and Relative Clause Dependencies in Norwegian. 2022 CogSci https://escholarship.org/uc/item/012683gb conf/cogsci/2022 db/conf/cogsci/cogsci2022.html#KobzevaALK22 Aaron Mueller Yu Xia Tal Linzen Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models. 95-109 2022 CoNLL https://doi.org/10.18653/v1/2022.conll-1.8 https://aclanthology.org/2022.conll-1.8 conf/conll/2022 db/conf/conll/conll2022.html#MuellerXL22 William Merrill Alex Warstadt Tal Linzen Entailment Semantics Can Be Extracted from an Ideal Language Model. 176-193 2022 CoNLL https://doi.org/10.18653/v1/2022.conll-1.13 https://aclanthology.org/2022.conll-1.13 conf/conll/2022 db/conf/conll/conll2022.html#MerrillWL22 Suhas Arehalli Brian Dillon Tal Linzen Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities. 301-313 2022 CoNLL https://doi.org/10.18653/v1/2022.conll-1.20 https://aclanthology.org/2022.conll-1.20 conf/conll/2022 db/conf/conll/conll2022.html#ArehalliDL22 Kristijan Armeni Christopher J. Honey Tal Linzen Characterizing Verbatim Short-Term Memory in Neural Language Models. 405-424 2022 CoNLL https://doi.org/10.18653/v1/2022.conll-1.28 https://aclanthology.org/2022.conll-1.28 conf/conll/2022 db/conf/conll/conll2022.html#ArmeniHL22 Thibault Sellam Steve Yadlowsky Ian Tenney Jason Wei Naomi Saphra Alexander D'Amour Tal Linzen Jasmijn Bastings Iulia Raluca Turc Jacob Eisenstein Dipanjan Das 0001 Ellie Pavlick The MultiBERTs: BERT Reproductions for Robustness Analysis. 2022 ICLR https://openreview.net/forum?id=K0E_F0gFDgA conf/iclr/2022 db/conf/iclr/iclr2022.html#SellamYTWSDLBTE22 Sebastian Schuster 0001 Tal Linzen When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it. 969-982 2022 NAACL-HLT https://doi.org/10.18653/v1/2022.naacl-main.71 https://aclanthology.org/2022.naacl-main.71 conf/naacl/2022 db/conf/naacl/naacl2022.html#SchusterL22 Linlu Qiu Peter Shaw 0004 Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova Improving Compositional Generalization with Latent Structure and Data Augmentation. 4341-4362 2022 NAACL-HLT https://doi.org/10.18653/v1/2022.naacl-main.323 https://aclanthology.org/2022.naacl-main.323 conf/naacl/2022 db/conf/naacl/naacl2022.html#QiuSPNLST22

Aaron Mueller Robert Frank 0001 Tal Linzen Luheng Wang Sebastian Schuster 0001 Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models. 2022 abs/2203.09397 CoRR https://doi.org/10.48550/arXiv.2203.09397 db/journals/corr/corr2203.html#abs-2203-09397

Sebastian Schuster 0001 Tal Linzen When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it. 2022 abs/2205.03472 CoRR https://doi.org/10.48550/arXiv.2205.03472 db/journals/corr/corr2205.html#abs-2205-03472

Aarohi Srivastava Abhinav Rastogi Abhishek Rao Abu Awal Md Shoeb Abubakar Abid Adam Fisch Adam R. Brown Adam Santoro Aditya Gupta 0001 Adrià Garriga-Alonso Agnieszka Kluska Aitor Lewkowycz Akshat Agarwal Alethea Power Alex Ray Alex Warstadt Alexander W. Kocurek Ali Safaya Ali Tazarv Alice Xiang Alicia Parrish Allen Nie Aman Hussain Amanda Askell Amanda Dsouza Ambrose Slone Ameet Rahane Anantharaman S. Iyer Anders Andreassen Andrea Madotto Andrea Santilli Andreas Stuhlmüller Andrew M. Dai Andrew La Andrew K. Lampinen Andy Zou Angela Jiang Angelica Chen Anh Vuong Animesh Gupta Anna Gottardi Antonio Norelli Anu Venkatesh Arash Gholamidavoodi Arfa Tabassum Arul Menezes Arun Kirubarajan Asher Mullokandov Ashish Sabharwal Austin Herrick Avia Efrat Aykut Erdem Ayla Karakas B. Ryan Roberts Bao Sheng Loe Barret Zoph Bartlomiej Bojanowski Batuhan Özyurt Behnam Hedayatnia Behnam Neyshabur Benjamin Inden Benno Stein 0001 Berk Ekmekci Bill Yuchen Lin Blake Howald Bryan Orinion Cameron Diao Cameron Dour Catherine Stinson Cedrick Argueta Cèsar Ferri Ramírez Chandan Singh Charles Rathkopf Chenlin Meng Chitta Baral Chiyu Wu Chris Callison-Burch Chris Waites Christian Voigt Christopher D. Manning Christopher Potts Cindy Ramirez Clara E. Rivera Clemencia Siro Colin Raffel Courtney Ashcraft Cristina Garbacea Damien Sileo Dan Garrette Dan Hendrycks Dan Kilman Dan Roth 0001 Daniel Freeman Daniel Khashabi Daniel Levy 0002 Daniel Moseguí González Danielle Perszyk Danny Hernandez Danqi Chen 0001 Daphne Ippolito Dar Gilboa David Dohan David Drakard David Jurgens Debajyoti Datta Deep Ganguli Denis Emelin Denis Kleyko Deniz Yuret Derek Chen Derek Tam Dieuwke Hupkes Diganta Misra Dilyar Buzan Dimitri Coelho Mollo Diyi Yang Dong-Ho Lee Dylan Schrader Ekaterina Shutova Ekin Dogus Cubuk Elad Segal Eleanor Hagerman Elizabeth Barnes Elizabeth Donoway Ellie Pavlick Emanuele Rodolà Emma Lam Eric Chu Eric Tang Erkut Erdem Ernie Chang Ethan A. Chi Ethan Dyer Ethan J. Jerzak Ethan Kim Eunice Engefu Manyasi Evgenii Zheltonozhskii Fanyue Xia Fatemeh Siar Fernando Martínez-Plumed Francesca Happé François Chollet Frieda Rong Gaurav Mishra Genta Indra Winata Gerard de Melo Germán Kruszewski Giambattista Parascandolo Giorgio Mariani Gloria Wang Gonzalo Jaimovitch-López Gregor Betz Guy Gur-Ari Hana Galijasevic Hannah Kim 0010 Hannah Rashkin Hannaneh Hajishirzi Harsh Mehta Hayden Bogar Henry Shevlin Hinrich Schütze Hiromu Yakura Hongming Zhang 0009 Hugh Mee Wong Ian Ng Isaac Noble Jaap Jumelet Jack Geissinger Jackson Kernion Jacob Hilton Jaehoon Lee 0001 Jaime Fernández Fisac James B. Simon James Koppel James Zheng James Zou 0001 Jan Kocon Jana Thompson Janelle Wingfield Jared Kaplan Jarema Radom Jascha Sohl-Dickstein Jason Phang Jason Wei Jason Yosinski Jekaterina Novikova Jelle Bosscher Jennifer Marsh Jeremy Kim Jeroen Taal Jesse H. Engel Jesujoba Alabi Jiacheng Xu Jiaming Song Jillian Tang Joan Waweru John Burden John Miller 0001 John U. Balis Jonathan Batchelder Jonathan Berant Jörg Frohberg Jos Rozen José Hernández-Orallo Joseph Boudeman Joseph Guerr Joseph Jones Joshua B. Tenenbaum Joshua S. Rule Joyce Chua Kamil Kanclerz Karen Livescu Karl Krauth Karthik Gopalakrishnan 0001 Katerina Ignatyeva Katja Markert Kaustubh D. Dhole Kevin Gimpel Kevin Omondi Kory W. Mathewson Kristen Chiafullo Ksenia Shkaruta Kumar Shridhar Kyle McDonell Kyle Richardson 0001 Laria Reynolds Leo Gao Li Zhang 0039 Liam Dugan Lianhui Qin Lidia Contreras Ochando Louis-Philippe Morency Luca Moschella Lucas Lam Lucy Noble Ludwig Schmidt Luheng He Luis Oliveros Colón Luke Metz Lütfi Kerem Senel Maarten Bosma Maarten Sap Maartje ter Hoeve Maheen Farooqi Manaal Faruqui Mantas Mazeika Marco Baturan Marco Marelli Marco Maru María José Ramírez-Quintana Marie Tolkiehn Mario Giulianelli Martha Lewis Martin Potthast Matthew L. Leavitt Matthias Hagen Mátyás Schubert Medina Baitemirova Melody Arnaud Melvin McElrath Michael A. Yee Michael Cohen Michael Gu Michael I. Ivanitskiy Michael Starritt Michael Strube 0001 Michal Swedrowski Michele Bevilacqua Michihiro Yasunaga Mihir Kale Mike Cain Mimee Xu Mirac Suzgun Mitch Walker Mo Tiwari Mohit Bansal Moin Aminnaseri Mor Geva Mozhdeh Gheini Mukund Varma T. Nanyun Peng 0001 Nathan A. Chi Nayeon Lee Neta Gur-Ari Krakover Nicholas Cameron 0001 Nicholas Roberts Nick Doiron Nicole Martinez Nikita Nangia Niklas Deckers Niklas Muennighoff Nitish Shirish Keskar Niveditha Iyer Noah Constant Noah Fiedel Nuan Wen Oliver Zhang Omar Agha Omar Elbaghdadi Omer Levy Owain Evans Pablo Antonio Moreno Casares Parth Doshi Pascale Fung Paul Pu Liang Paul Vicol Pegah Alipoormolabashi Peiyuan Liao Percy Liang Peter Chang Peter Eckersley Phu Mon Htut Pinyu Hwang Piotr Milkowski Piyush Patil Pouya Pezeshkpour Priti Oli Qiaozhu Mei Qing Lyu 0001 Qinlang Chen 0001 Rabin Banjade Rachel Etta Rudolph Raefer Gabriel Rahel Habacker Ramon Risco Raphaël Millière Rhythm Garg Richard Barnes 0002 Rif A. Saurous Riku Arakawa Robbe Raymaekers Robert Frank 0001 Rohan Sikand Roman Novak Roman Sitelew Ronan LeBras Rosanne Liu Rowan Jacobs Rui Zhang 0037 Ruslan Salakhutdinov Ryan Chi Ryan Lee Ryan Stovall Ryan Teehan Rylan Yang Sahib Singh Saif M. Mohammad Sajant Anand Sam Dillavou Sam Shleifer Sam Wiseman Samuel Gruetter Samuel R. Bowman Samuel S. Schoenholz Sanghyun Han Sanjeev Kwatra Sarah A. Rous Sarik Ghazarian Sayan Ghosh 0004 Sean Casey Sebastian Bischoff 0001 Sebastian Gehrmann Sebastian Schuster 0001 Sepideh Sadeghi Shadi Hamdan Sharon Zhou Shashank Srivastava Sherry Shi Shikhar Singh Shima Asaadi Shixiang Shane Gu Shubh Pachchigar Shubham Toshniwal Shyam Upadhyay Shyamolima (Shammie) Debnath Siamak Shakeri Simon Thormeyer Simone Melzi Siva Reddy Sneha Priscilla Makini Soo-Hwan Lee Spencer Torene Sriharsha Hatwar Stanislas Dehaene Stefan Divic Stefano Ermon Stella Biderman Stephanie Lin Stephen Prasad Steven T. Piantadosi Stuart M. Shieber Summer Misherghi Svetlana Kiritchenko Swaroop Mishra Tal Linzen Tal Schuster Tao Li 0039 Tao Yu 0009 Tariq Ali Tatsu Hashimoto Te-Lin Wu Théo Desbordes Theodore Rothschild Thomas Phan Tianle Wang 0009 Tiberius Nkinyili Timo Schick Timofei Kornev Titus Tunduny Tobias Gerstenberg Trenton Chang Trishala Neeraj Tushar Khot Tyler Shultz Uri Shaham 0002 Vedant Misra Vera Demberg Victoria Nyamai Vikas Raunak Vinay V. Ramasesh Vinay Uday Prabhu Vishakh Padmakumar Vivek Srikumar William Fedus William Saunders William Zhang 0004 Wout Vossen Xiang Ren 0001 Xiaoyu Tong Xinran Zhao Xinyi Wu Xudong Shen Yadollah Yaghoobzadeh Yair Lakretz Yangqiu Song Yasaman Bahri Yejin Choi 0001 Yichi Yang Yiding Hao Yifu Chen Yonatan Belinkov Yu Hou Yufang Hou 0001 Yuntao Bai Zachary Seid Zhuoye Zhao Zijian Wang 0002 Zijie J. Wang Zirui Wang Ziyi Wu Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. 2022 abs/2206.04615 CoRR https://doi.org/10.48550/arXiv.2206.04615 https://www.wikidata.org/entity/Q112325337 db/journals/corr/corr2206.html#abs-2206-04615

William Merrill Alex Warstadt Tal Linzen Entailment Semantics Can Be Extracted from an Ideal Language Model. 2022 abs/2209.12407 CoRR https://doi.org/10.48550/arXiv.2209.12407 db/journals/corr/corr2209.html#abs-2209-12407

Suhas Arehalli Brian Dillon Tal Linzen Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities. 2022 abs/2210.12187 CoRR https://doi.org/10.48550/arXiv.2210.12187 db/journals/corr/corr2210.html#abs-2210-12187

Kristijan Armeni Christopher J. Honey Tal Linzen Characterizing Verbatim Short-Term Memory in Neural Language Models. 2022 abs/2210.13569 CoRR https://doi.org/10.48550/arXiv.2210.13569 db/journals/corr/corr2210.html#abs-2210-13569

Aaron Mueller Yu Xia Tal Linzen Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models. 2022 abs/2210.14328 CoRR https://doi.org/10.48550/arXiv.2210.14328 db/journals/corr/corr2210.html#abs-2210-14328

Najoung Kim Tal Linzen Paul Smolensky Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models. 2022 abs/2212.10769 CoRR https://doi.org/10.48550/arXiv.2212.10769 db/journals/corr/corr2212.html#abs-2212-10769

Marten van Schijndel Tal Linzen Single-Stage Prediction Models Do Not Explain the Magnitude of Syntactic Disambiguation Difficulty. 2021 45 Cogn. Sci. 6 https://doi.org/10.1111/cogs.12988 db/journals/cogsci/cogsci45.html#SchijndelL21

Matthew Finlayson Aaron Mueller Sebastian Gehrmann Stuart M. Shieber Tal Linzen Yonatan Belinkov Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models. 1828-1843 2021 ACL/IJCNLP (1) https://doi.org/10.18653/v1/2021.acl-long.144 https://aclanthology.org/2021.acl-long.144 conf/acl/2021-1 db/conf/acl/acl2021-1.html#FinlaysonMGSLB20 Laura Aina Tal Linzen The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation. 42-57 2021 BlackboxNLP@EMNLP https://doi.org/10.18653/v1/2021.blackboxnlp-1.4 https://aclanthology.org/2021.blackboxnlp-1.4 conf/blackboxnlp/2021 db/conf/blackboxnlp/blackboxnlp2021.html#AinaL21 Shauli Ravfogel Grusha Prasad Tal Linzen Yoav Goldberg Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction. 194-209 2021 CoNLL https://doi.org/10.18653/v1/2021.conll-1.15 conf/conll/2021 db/conf/conll/conll2021.html#RavfogelPLG21 Alicia Parrish Sebastian Schuster 0001 Alex Warstadt Omar Agha Soo-Hwan Lee Zhuoye Zhao Samuel R. Bowman Tal Linzen NOPE: A Corpus of Naturally-Occurring Presuppositions in English. 349-366 2021 CoNLL https://doi.org/10.18653/v1/2021.conll-1.28 conf/conll/2021 db/conf/conll/conll2021.html#ParrishSWALZBL21 Jason Wei Dan Garrette Tal Linzen Ellie Pavlick Frequency Effects on Syntactic Rule Learning in Transformers. 932-948 2021 EMNLP (1) https://doi.org/10.18653/v1/2021.emnlp-main.72 https://aclanthology.org/2021.emnlp-main.72 conf/emnlp/2021-1 db/conf/emnlp/emnlp2021-1.html#WeiGLP21 Alicia Parrish William Huang Omar Agha Soo-Hwan Lee Nikita Nangia Alex Warstadt Karmanya Aggarwal Emily Allaway Tal Linzen Samuel R. Bowman Does Putting a Linguist in the Loop Improve NLU Data Collection? 4886-4901 2021 EMNLP (Findings) https://doi.org/10.18653/v1/2021.findings-emnlp.421 https://aclanthology.org/2021.findings-emnlp.421 conf/emnlp/2021f db/conf/emnlp/emnlp2021f.html#ParrishHALNWAAL21 Charles Lovering Rohan Jha Tal Linzen Ellie Pavlick Predicting Inductive Biases of Pre-Trained Models. 2021 ICLR https://openreview.net/forum?id=mNtmhaDkAr conf/iclr/2021 db/conf/iclr/iclr2021.html#LoveringJLP21

Alicia Parrish William Huang Omar Agha Soo-Hwan Lee Nikita Nangia Alex Warstadt Karmanya Aggarwal Emily Allaway Tal Linzen Samuel R. Bowman Does Putting a Linguist in the Loop Improve NLU Data Collection? 2021 abs/2104.07179 CoRR https://arxiv.org/abs/2104.07179 db/journals/corr/corr2104.html#abs-2104-07179

Nouha Dziri Hannah Rashkin Tal Linzen David Reitter Evaluating Groundedness in Dialogue Systems: The BEGIN Benchmark. 2021 abs/2105.00071 CoRR https://arxiv.org/abs/2105.00071 db/journals/corr/corr2105.html#abs-2105-00071

Shauli Ravfogel Grusha Prasad Tal Linzen Yoav Goldberg Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction. 2021 abs/2105.06965 CoRR https://arxiv.org/abs/2105.06965 db/journals/corr/corr2105.html#abs-2105-06965

Thibault Sellam Steve Yadlowsky Jason Wei Naomi Saphra Alexander D'Amour Tal Linzen Jasmijn Bastings Iulia Turc Jacob Eisenstein Dipanjan Das 0001 Ian Tenney Ellie Pavlick The MultiBERTs: BERT Reproductions for Robustness Analysis. 2021 abs/2106.16163 CoRR https://arxiv.org/abs/2106.16163 db/journals/corr/corr2106.html#abs-2106-16163

Alicia Parrish Sebastian Schuster 0001 Alex Warstadt Omar Agha Soo-Hwan Lee Zhuoye Zhao Samuel R. Bowman Tal Linzen NOPE: A Corpus of Naturally-Occurring Presuppositions in English. 2021 abs/2109.06987 CoRR https://arxiv.org/abs/2109.06987 db/journals/corr/corr2109.html#abs-2109-06987

Jason Wei Dan Garrette Tal Linzen Ellie Pavlick Frequency Effects on Syntactic Rule Learning in Transformers. 2021 abs/2109.07020 CoRR https://arxiv.org/abs/2109.07020 db/journals/corr/corr2109.html#abs-2109-07020

Laura Aina Tal Linzen The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation. 2021 abs/2109.07848 CoRR https://arxiv.org/abs/2109.07848 db/journals/corr/corr2109.html#abs-2109-07848

Wang Zhu 0001 Peter Shaw 0004 Tal Linzen Fei Sha Learning to Generalize Compositionally by Transferring Across Semantic Parsing Tasks. 2021 abs/2111.05013 CoRR https://arxiv.org/abs/2111.05013 db/journals/corr/corr2111.html#abs-2111-05013

R. Thomas McCoy Paul Smolensky Tal Linzen Jianfeng Gao 0001 Asli Celikyilmaz How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN. 2021 abs/2111.09509 CoRR https://arxiv.org/abs/2111.09509 db/journals/corr/corr2111.html#abs-2111-09509

Linlu Qiu Peter Shaw 0004 Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova Improving Compositional Generalization with Latent Structure and Data Augmentation. 2021 abs/2112.07610 CoRR https://arxiv.org/abs/2112.07610 db/journals/corr/corr2112.html#abs-2112-07610

R. Thomas McCoy Robert Frank 0001 Tal Linzen Does Syntax Need to Grow on Trees? Sources of Hierarchical Inductive Bias in Sequence-to-Sequence Networks. 125-140 2020 8 Trans. Assoc. Comput. Linguistics https://doi.org/10.1162/tacl_a_00304 db/journals/tacl/tacl8.html#McCoyFL20

Junghyun Min R. Thomas McCoy Dipanjan Das 0001 Emily Pitler Tal Linzen Syntactic Data Augmentation Increases Robustness to Inference Heuristics. 2339-2352 2020 ACL https://doi.org/10.18653/v1/2020.acl-main.212 https://aclanthology.org/2020.acl-main.212/ conf/acl/2020 db/conf/acl/acl2020.html#MinMDPL20 Michael A. Lepori Tal Linzen R. Thomas McCoy Representations of Syntax [MASK] Useful: Effects of Constituency and Dependency Structure in Recursive LSTMs. 3306-3316 2020 ACL https://doi.org/10.18653/v1/2020.acl-main.303 https://aclanthology.org/2020.acl-main.303/ conf/acl/2020 db/conf/acl/acl2020.html#LeporiLM20 Tal Linzen How Can We Accelerate Progress Towards Human-like Linguistic Generalization? 5210-5217 2020 ACL https://doi.org/10.18653/v1/2020.acl-main.465 https://aclanthology.org/2020.acl-main.465/ conf/acl/2020 db/conf/acl/acl2020.html#Linzen20 Aaron Mueller Garrett Nicolai Panayiota Petrou-Zeniou Natalia Talmina Tal Linzen Cross-Linguistic Syntactic Evaluation of Word Prediction Models. 5523-5539 2020 ACL https://doi.org/10.18653/v1/2020.acl-main.490 https://aclanthology.org/2020.acl-main.490/ conf/acl/2020 db/conf/acl/acl2020.html#MuellerNPTL20 R. Thomas McCoy Junghyun Min Tal Linzen BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance. 217-227 2020 BlackboxNLP@EMNLP https://doi.org/10.18653/v1/2020.blackboxnlp-1.21 conf/blackboxnlp/2020 db/conf/blackboxnlp/blackboxnlp2020.html#McCoyML20 Paul Soulos R. Thomas McCoy Tal Linzen Paul Smolensky Discovering the Compositional Structure of Vector Representations with Role Learning Networks. 238-254 2020 BlackboxNLP@EMNLP https://doi.org/10.18653/v1/2020.blackboxnlp-1.23 conf/blackboxnlp/2020 db/conf/blackboxnlp/blackboxnlp2020.html#SoulosMLS20 Suhas Arehalli Tal Linzen Neural Language Models Capture Some, But Not All Agreement Attraction Effects. 2020 CogSci https://escholarship.org/uc/item/7782c9vz conf/cogsci/2020 db/conf/cogsci/cogsci2020.html#ArehalliL20 Richard Thomas McCoy Erin Grant Paul Smolensky Tom Griffiths 0001 Tal Linzen Universal linguistic inductive biases via meta-learning. 2020 CogSci https://escholarship.org/uc/item/93m7w30j conf/cogsci/2020 db/conf/cogsci/cogsci2020.html#McCoyGSGL20 Najoung Kim Tal Linzen COGS: A Compositional Generalization Challenge Based on Semantic Interpretation. 9087-9105 2020 EMNLP (1) https://doi.org/10.18653/v1/2020.emnlp-main.731 https://aclanthology.org/2020.emnlp-main.731/ conf/emnlp/2020-1 db/conf/emnlp/emnlp2020-1.html#KimL20 Raquel Fernández Tal Linzen Proceedings of the 24th Conference on Computational Natural Language Learning, CoNLL 2020, Online, November 19-20, 2020 CoNLL Association for Computational Linguistics 2020 978-1-952148-63-7 https://doi.org/10.18653/v1/2020.conll-1.0 https://aclanthology.org/volumes/2020.conll-1/ https://aclanthology.org/2020.conll-1.0/ db/conf/conll/conll2020.html

R. Thomas McCoy Robert Frank 0001 Tal Linzen Does syntax need to grow on trees? Sources of hierarchical inductive bias in sequence-to-sequence networks. 2020 abs/2001.03632 CoRR https://arxiv.org/abs/2001.03632 db/journals/corr/corr2001.html#abs-2001-03632

Tal Linzen Marco Baroni Syntactic Structure from Deep Learning. 2020 abs/2004.10827 CoRR https://arxiv.org/abs/2004.10827 db/journals/corr/corr2004.html#abs-2004-10827

Junghyun Min R. Thomas McCoy Dipanjan Das 0001 Emily Pitler Tal Linzen Syntactic Data Augmentation Increases Robustness to Inference Heuristics. 2020 abs/2004.11999 CoRR https://arxiv.org/abs/2004.11999 db/journals/corr/corr2004.html#abs-2004-11999

Michael A. Lepori Tal Linzen R. Thomas McCoy Representations of Syntax [MASK] Useful: Effects of Constituency and Dependency Structure in Recursive LSTMs. 2020 abs/2005.00019 CoRR https://arxiv.org/abs/2005.00019 db/journals/corr/corr2005.html#abs-2005-00019

Aaron Mueller Garrett Nicolai Panayiota Petrou-Zeniou Natalia Talmina Tal Linzen Cross-Linguistic Syntactic Evaluation of Word Prediction Models. 2020 abs/2005.00187 CoRR https://arxiv.org/abs/2005.00187 db/journals/corr/corr2005.html#abs-2005-00187

Tal Linzen How Can We Accelerate Progress Towards Human-like Linguistic Generalization? 2020 abs/2005.00955 CoRR https://arxiv.org/abs/2005.00955 db/journals/corr/corr2005.html#abs-2005-00955

R. Thomas McCoy Erin Grant Paul Smolensky Thomas L. Griffiths 0001 Tal Linzen Universal linguistic inductive biases via meta-learning. 2020 abs/2006.16324 CoRR https://arxiv.org/abs/2006.16324 db/journals/corr/corr2006.html#abs-2006-16324

Najoung Kim Tal Linzen COGS: A Compositional Generalization Challenge Based on Semantic Interpretation. 2020 abs/2010.05465 CoRR https://arxiv.org/abs/2010.05465 db/journals/corr/corr2010.html#abs-2010-05465

Afra Alishahi Grzegorz Chrupala Tal Linzen Analyzing and interpreting neural networks for NLP: A report on the first BlackboxNLP workshop. 543-557 2019 25 Nat. Lang. Eng. 4 https://doi.org/10.1017/S135132491900024X https://www.wikidata.org/entity/Q114857968 db/journals/nle/nle25.html#AlishahiCL19

Tom McCoy 0001 Ellie Pavlick Tal Linzen Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference. 3428-3448 2019 ACL (1) https://doi.org/10.18653/v1/p19-1334 https://aclanthology.org/P19-1334/ https://www.wikidata.org/entity/Q109283441 conf/acl/2019-1 db/conf/acl/acl2019-1.html#McCoyPL19 Brenden M. Lake Tal Linzen Marco Baroni Human few-shot learning of compositional instructions. 611-617 2019 CogSci https://escholarship.org/uc/item/5vr9p4ks conf/cogsci/2019 db/conf/cogsci/cogsci2019.html#LakeLB19 Grusha Prasad Tal Linzen How much harder are hard garden-path sentences than easy ones? 3339 2019 CogSci https://escholarship.org/uc/item/1627b4h6 conf/cogsci/2019 db/conf/cogsci/cogsci2019.html#PrasadL19 Grusha Prasad Marten van Schijndel Tal Linzen Using Priming to Uncover the Organization of Syntactic Representations in Neural Language Models. 66-76 2019 CoNLL https://doi.org/10.18653/v1/K19-1007 conf/conll/2019 db/conf/conll/conll2019.html#PrasadSL19 Marten van Schijndel Aaron Mueller Tal Linzen Quantity doesn't buy quality syntax with neural language models. 5830-5836 2019 EMNLP/IJCNLP (1) https://doi.org/10.18653/v1/D19-1592 conf/emnlp/2019-1 db/conf/emnlp/emnlp2019-1.html#SchijndelML19 R. Thomas McCoy Tal Linzen Ewan Dunbar Paul Smolensky RNNs implicitly implement tensor-product representations. 2019 ICLR (Poster) https://openreview.net/forum?id=BJx0sjC5FX conf/iclr/2019 db/conf/iclr/iclr2019.html#McCoyLDS19 Shauli Ravfogel Yoav Goldberg Tal Linzen Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages. 3532-3542 2019 NAACL-HLT (1) https://doi.org/10.18653/v1/n19-1356 https://aclanthology.org/N19-1356/ conf/naacl/2019-1 db/conf/naacl/naacl2019-1.html#RavfogelGL19 Najoung Kim Roma Patel Adam Poliak Patrick Xia 0002 Alex Wang Tom McCoy 0001 Ian Tenney Alexis Ross Tal Linzen Benjamin Van Durme Samuel R. Bowman Ellie Pavlick Probing What Different NLP Tasks Teach Machines about Function Word Comprehension. 235-249 2019 *SEM@NAACL-HLT https://doi.org/10.18653/v1/s19-1026 https://aclanthology.org/S19-1026/ conf/starsem/2019 db/conf/starsem/starsem2019.html#KimPPXWMTRLDBP19 Tal Linzen Grzegorz Chrupala Yonatan Belinkov Dieuwke Hupkes Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@ACL 2019, Florence, Italy, August 1, 2019 BlackboxNLP@ACL Association for Computational Linguistics 2019 978-1-950737-30-7 https://aclanthology.org/volumes/W19-48/ https://aclanthology.org/W19-4800/ db/conf/blackboxnlp/blackboxnlp2019.html

Brenden M. Lake Tal Linzen Marco Baroni Human few-shot learning of compositional instructions. 2019 abs/1901.04587 CoRR http://arxiv.org/abs/1901.04587 db/journals/corr/corr1901.html#abs-1901-04587

R. Thomas McCoy Ellie Pavlick Tal Linzen Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference. 2019 abs/1902.01007 CoRR http://arxiv.org/abs/1902.01007 db/journals/corr/corr1902.html#abs-1902-01007

Shauli Ravfogel Yoav Goldberg Tal Linzen Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages. 2019 abs/1903.06400 CoRR http://arxiv.org/abs/1903.06400 db/journals/corr/corr1903.html#abs-1903-06400

Afra Alishahi Grzegorz Chrupala Tal Linzen Analyzing and Interpreting Neural Networks for NLP: A Report on the First BlackboxNLP Workshop. 2019 abs/1904.04063 CoRR http://arxiv.org/abs/1904.04063 db/journals/corr/corr1904.html#abs-1904-04063

Najoung Kim Roma Patel Adam Poliak Alex Wang Patrick Xia 0002 R. Thomas McCoy Ian Tenney Alexis Ross Tal Linzen Benjamin Van Durme Samuel R. Bowman Ellie Pavlick Probing What Different NLP Tasks Teach Machines about Function Word Comprehension. 2019 abs/1904.11544 CoRR http://arxiv.org/abs/1904.11544 db/journals/corr/corr1904.html#abs-1904-11544

Marten van Schijndel Aaron Mueller Tal Linzen Quantity doesn't buy quality syntax with neural language models. 2019 abs/1909.00111 CoRR http://arxiv.org/abs/1909.00111 db/journals/corr/corr1909.html#abs-1909-00111

Grusha Prasad Marten van Schijndel Tal Linzen Using Priming to Uncover the Organization of Syntactic Representations in Neural Language Models. 2019 abs/1909.10579 CoRR http://arxiv.org/abs/1909.10579 db/journals/corr/corr1909.html#abs-1909-10579

Paul Soulos Tom McCoy 0001 Tal Linzen Paul Smolensky Discovering the Compositional Structure of Vector Representations with Role Learning Networks. 2019 abs/1910.09113 CoRR http://arxiv.org/abs/1910.09113 db/journals/corr/corr1910.html#abs-1910-09113

R. Thomas McCoy Junghyun Min Tal Linzen BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance. 2019 abs/1911.02969 CoRR http://arxiv.org/abs/1911.02969 db/journals/corr/corr1911.html#abs-1911-02969

Laura Gwilliams David Poeppel Alec Marantz Tal Linzen Phonological (un)certainty weights lexical activation. 29-34 2018 CMCL https://doi.org/10.18653/v1/w18-0104 https://aclanthology.org/W18-0104/ conf/acl-cmcl/2018 db/conf/acl-cmcl/acl-cmcl2018.html#GwilliamsPML18 Tal Linzen Brian Leonard Distinct patterns of syntactic agreement errors in recurrent networks and humans. 2018 CogSci https://escholarship.org/uc/item/0623d3bt conf/cogsci/2018 db/conf/cogsci/cogsci2018.html#LinzenL18 Richard Thomas McCoy Robert Frank 0001 Tal Linzen Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networks. 2018 CogSci https://escholarship.org/uc/item/12w6n3xn conf/cogsci/2018 db/conf/cogsci/cogsci2018.html#McCoyFL18 Marten van Schijndel Tal Linzen Modeling garden path effects without explicit hierarchical syntax. 2018 CogSci https://escholarship.org/uc/item/7mg5442r conf/cogsci/2018 db/conf/cogsci/cogsci2018.html#SchijndelL18 Rebecca Marvin Tal Linzen Targeted Syntactic Evaluation of Language Models. 1192-1202 2018 EMNLP https://doi.org/10.18653/v1/d18-1151 https://aclanthology.org/D18-1151/ https://orkg.org/orkg/resource/R196163 conf/emnlp/2018 db/conf/emnlp/emnlp2018.html#MarvinL18 Marten van Schijndel Tal Linzen A Neural Model of Adaptation in Reading. 4704-4710 2018 EMNLP https://doi.org/10.18653/v1/d18-1499 https://aclanthology.org/D18-1499/ conf/emnlp/2018 db/conf/emnlp/emnlp2018.html#SchijndelL18 Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni Colorless Green Recurrent Networks Dream Hierarchically. 1195-1205 2018 NAACL-HLT https://doi.org/10.18653/v1/n18-1108 https://aclanthology.org/N18-1108/ https://www.wikidata.org/entity/Q61726901 https://orkg.org/resource/R196925 conf/naacl/2018-1 db/conf/naacl/naacl2018-1.html#GulordavaBGLB18 Asad B. Sayeed Cassandra Jacobs Tal Linzen Marten van Schijndel Proceedings of the 8th Workshop on Cognitive Modeling and Computational Linguistics, CMCL 2018, Salt Lake City, Utah, USA, January 7, 2018 CMCL Association for Computational Linguistics 2018 978-1-948087-10-0 https://aclanthology.org/volumes/W18-01/ https://aclanthology.org/W18-0100/ db/conf/acl-cmcl/acl-cmcl2018.html Tal Linzen Grzegorz Chrupala Afra Alishahi Proceedings of the Workshop: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@EMNLP 2018, Brussels, Belgium, November 1, 2018 BlackboxNLP@EMNLP Association for Computational Linguistics 2018 978-1-948087-71-1 https://aclanthology.org/volumes/W18-54/ https://aclanthology.org/W18-5400/ db/conf/emnlp/blackbox2018.html

R. Thomas McCoy Robert Frank 0001 Tal Linzen Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networks. 2018 abs/1802.09091 CoRR http://arxiv.org/abs/1802.09091 db/journals/corr/corr1802.html#abs-1802-09091

Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni Colorless green recurrent networks dream hierarchically. 2018 abs/1803.11138 CoRR http://arxiv.org/abs/1803.11138 db/journals/corr/corr1803.html#abs-1803-11138

Tal Linzen Brian Leonard Distinct patterns of syntactic agreement errors in recurrent networks and humans. 2018 abs/1807.06882 CoRR http://arxiv.org/abs/1807.06882 db/journals/corr/corr1807.html#abs-1807-06882

Rebecca Marvin Tal Linzen Targeted Syntactic Evaluation of Language Models. 2018 abs/1808.09031 CoRR http://arxiv.org/abs/1808.09031 db/journals/corr/corr1808.html#abs-1808-09031

Marten van Schijndel Tal Linzen A Neural Model of Adaptation in Reading. 2018 abs/1808.09930 CoRR http://arxiv.org/abs/1808.09930 db/journals/corr/corr1808.html#abs-1808-09930

Tal Linzen What can linguistics and deep learning contribute to each other? 2018 abs/1809.04179 CoRR http://arxiv.org/abs/1809.04179 db/journals/corr/corr1809.html#abs-1809-04179

Marten van Schijndel Tal Linzen Can Entropy Explain Successor Surprisal Effects in Reading? 2018 abs/1810.11481 CoRR http://arxiv.org/abs/1810.11481 db/journals/corr/corr1810.html#abs-1810-11481

R. Thomas McCoy Tal Linzen Non-entailed subsequences as a challenge for natural language inference. 2018 abs/1811.12112 CoRR http://arxiv.org/abs/1811.12112 db/journals/corr/corr1811.html#abs-1811-12112

R. Thomas McCoy Tal Linzen Ewan Dunbar Paul Smolensky RNNs Implicitly Implement Tensor Product Representations. 2018 abs/1812.08718 CoRR http://arxiv.org/abs/1812.08718 db/journals/corr/corr1812.html#abs-1812-08718

Tal Linzen Noam Siegelman Louisa Bogaerts Prediction and uncertainty in an artificial language. 2017 CogSci https://escholarship.org/uc/item/5dv7f9sw conf/cogsci/2017 db/conf/cogsci/cogsci2017.html#LinzenSB17 Émile Enguehard Yoav Goldberg Tal Linzen Exploring the Syntactic Abilities of RNNs with Multi-task Learning. 3-14 2017 CoNLL https://doi.org/10.18653/v1/K17-1003 conf/conll/2017 db/conf/conll/conll2017.html#EnguehardGL17 Gaël Le Godais Tal Linzen Emmanuel Dupoux Comparing Character-level Neural Language Models Using a Lexical Decision Task. 125-130 2017 EACL (2) https://doi.org/10.18653/v1/e17-2020 https://aclanthology.org/E17-2020/ conf/eacl/2017-2 db/conf/eacl/eacl2017-2.html#DupouxLG17 Ted Gibson Tal Linzen Asad B. Sayeed Marten van Schijndel William Schuler Proceedings of the 7th Workshop on Cognitive Modeling and Computational Linguistics, CMCL@EACL 2017, Valencia, Spain, April 3, 2017 CMCL@EACL Association for Computational Linguistics 2017 978-1-945626-38-8 https://aclanthology.org/volumes/W17-07/ https://aclanthology.org/W17-0700/ db/conf/acl-cmcl/acl-cmcl2017.html

Émile Enguehard Yoav Goldberg Tal Linzen Exploring the Syntactic Abilities of RNNs with Multi-task Learning. 2017 abs/1706.03542 CoRR http://arxiv.org/abs/1706.03542 db/journals/corr/corr1706.html#EnguehardGL17

Laura Gwilliams David Poeppel Alec Marantz Tal Linzen Phonological (un)certainty weights lexical activation. 2017 abs/1711.06729 CoRR http://arxiv.org/abs/1711.06729 db/journals/corr/corr1711.html#abs-1711-06729

Tal Linzen T. Florian Jaeger Uncertainty and Expectation in Sentence Processing: Evidence From Subcategorization Distributions. 1382-1411 2016 40 Cogn. Sci. 6 https://doi.org/10.1111/cogs.12274 https://www.wikidata.org/entity/Q52151061 db/journals/cogsci/cogsci40.html#LinzenJ16

Tal Linzen Emmanuel Dupoux Yoav Goldberg Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies. 521-535 2016 4 Trans. Assoc. Comput. Linguistics https://doi.org/10.1162/tacl_a_00115 https://orkg.org/orkg/resource/R196166 https://www.wikidata.org/entity/Q125915218 db/journals/tacl/tacl4.html#LinzenDG16

Tal Linzen Issues in evaluating semantic spaces using word analogies. 13-18 2016 RepEval@ACL https://doi.org/10.18653/v1/W16-2503 https://www.wikidata.org/entity/Q55375928 conf/repeval/2016 db/conf/repeval/repeval2016.html#Linzen16 Allyson Ettinger Tal Linzen Evaluating vector space models using human semantic priming results. 72-77 2016 RepEval@ACL https://doi.org/10.18653/v1/W16-2513 conf/repeval/2016 db/conf/repeval/repeval2016.html#EttingerL16 Tal Linzen Emmanuel Dupoux Benjamin Spector Quantificational features in distributional word representations. 2016 *SEM@ACL https://doi.org/10.18653/v1/s16-2001 https://aclanthology.org/S16-2001/ conf/starsem/2016 db/conf/starsem/starsem2016.html#LinzenDS16

Tal Linzen Issues in evaluating semantic spaces using word analogies. 2016 abs/1606.07736 CoRR http://arxiv.org/abs/1606.07736 db/journals/corr/corr1606.html#Linzen16

Tal Linzen Emmanuel Dupoux Yoav Goldberg Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies. 2016 abs/1611.01368 CoRR http://arxiv.org/abs/1611.01368 db/journals/corr/corr1611.html#LinzenDG16

Joseph Fruchter Tal Linzen Masha Westerlund Alec Marantz Lexical Preactivation in Basic Linguistic Phrases. 1912-1935 2015 27 J. Cogn. Neurosci. 10 https://doi.org/10.1162/jocn_a_00822 https://www.wikidata.org/entity/Q48184088 db/journals/jocn/jocn27.html#FruchterLWM15

Tal Linzen Timothy J. O'Donnell A model of rapid phonotactic generalization. 1126-1131 2015 EMNLP https://doi.org/10.18653/v1/d15-1134 https://aclanthology.org/D15-1134/ conf/emnlp/2015 db/conf/emnlp/emnlp2015.html#LinzenO15 Tal Linzen T. Florian Jaeger Investigating the role of entropy in sentence processing. 10-18 2014 CMCL@ACL https://doi.org/10.3115/v1/W14-2002 conf/acl-cmcl/2014 db/conf/acl-cmcl/acl-cmcl2014.html#LinzenJ14 Tal Linzen Gillian Gallagher The timecourse of phonotactic learning. 2014 CogSci https://escholarship.org/uc/item/67k9r162 conf/cogsci/2014 db/conf/cogsci/cogsci2014.html#LinzenG14 Abubakar Abid Akshat Agarwal Karmanya Aggarwal Omar Agha Laura Aina Jesujoba O. AlabiJesujoba Alabi Tariq Ali Pegah Alipoormolabashi Afra Alishahi Emily Allaway Kelsey R. Allen Moin Aminnaseri Sajant Anand Anders Andreassen Riku Arakawa Suhas Arehalli Cedrick Argueta Kristijan Armeni Melody Arnaud Shima Asaadi Courtney Ashcraft Amanda Askell Yasaman Bahri Yuntao Bai Medina Baitemirova John U. Balis Rabin Banjade Mohit Bansal Chitta Baral Elizabeth Barnes Richard Barnes 0002 Marco Baroni Jasmijn Bastings Jonathan Batchelder Marco Baturan Yonatan Belinkov Jonathan Berant Gregor Betz Michele Bevilacqua Stella Biderman Alberto Bietti Sebastian Bischoff 0001 Emily Black Carter Blum Louisa Bogaerts Hayden Bogar Bartlomiej Bojanowski Piotr Bojanowski Maarten Bosma Jelle Bosscher Joseph Boudeman Samuel R. Bowman Ronan Le Bras 0001Ronan LeBras Adam R. Brown Joan Bruna John Burden Dilyar Buzan Mike Cain Chris Callison-Burch Nicholas Cameron 0001 P. A. M. CasaresPablo Antonio Moreno Casares Sean Casey Asli Celikyilmaz Ernie Chang Peter Chang Trenton Chang Lucas Charpentier Angelica Chen Danqi Chen 0001 Derek Chen Qinlang Chen 0001 Yifu Chen Ethan A. Chi Nathan A. Chi Ryan Chi Kristen Chiafullo Kyunghyun Cho Yejin Choi 0001 François Chollet Leshem Choshen Grzegorz Chrupala Eric Chu Joyce Chua Juan Ciro Michael Cohen Luis Oliveros Colón Noah Constant Ryan Cotterell Ekin Dogus Cubuk Andrew M. Dai Alexander D'Amour Dipanjan Das 0001 Ishita Dasgupta 0001 Debajyoti Datta Shyamolima (Shammie) Debnath Niklas Deckers Stanislas Dehaene Vera Demberg Theo DesbordesThéo Desbordes Kaustubh D. Dhole Cameron Diao Sam Dillavou Brian Dillon Stefan Divic Lucas Dixon David Dohan Nick Doiron Lucia Donatelli Elizabeth Donoway Parth Doshi Cameron Dour David Drakard Amanda Dsouza Liam Dugan Ewan Dunbar Emmanuel Dupoux Benjamin Van Durme Ethan Dyer Nouha Dziri Peter Eckersley Avia Efrat Tiwalayo Eisape Jacob Eisenstein Berk Ekmekci Omar Elbaghdadi Denis Emelin Jesse H. Engel Émile Enguehard Aykut Erdem Erkut Erdem Stefano Ermon Allyson Ettinger Owain Evans Maheen Farooqi Manaal Faruqui William Fedus Raquel Fernández Cèsar FerriCèsar Ferri Ramírez Noah Fiedel Katja Filippova Matthew Finlayson Jaime Fernández Fisac Adam Fisch Robert Frank 0001 Daniel Freeman Jörg Frohberg Joseph Fruchter Pascale Fung Raefer Gabriel Hana Galijasevic Gillian Gallagher Apurva Gandhi Deep Ganguli Jianfeng Gao 0001 Leo Gao Cristina Garbacea Rhythm Garg Dan Garrette Adrià Garriga-Alonso Sebastian Gehrmann Jack Geissinger Tobias Gerstenberg Mor Geva Asma Ghandeharioun Sarik Ghazarian Mozhdeh Gheini Arash Gholamidavoodi Sayan Ghosh 0004 Ted Gibson Dar Gilboa Kevin Gimpel Mario Giulianelli Gaël Le Godais Jaulie Goe Yoav Goldberg Daniel Moseguí González Karthik Gopalakrishnan 0001 Anna Gottardi Erin Grant Edouard Grave Thomas L. Griffiths 0001Tom Griffiths 0001 Samuel Gruetter Michael Gu Shixiang GuShixiang Shane Gu Joseph Guerr Mustafa Omer Gul Kristina Gulordava Aditya Gupta 0001 Animesh Gupta Guy Gur-Ari Laura Gwilliams Rahel Habacker Matthias Hagen Eleanor Hagerman Hannaneh Hajishirzi Shadi Hamdan Sanghyun Han Sophie Hao Yiding Hao Francesca Happé Tatsu Hashimoto Sriharsha Hatwar Luheng He Behnam Hedayatnia Dan Hendrycks Danny Hernandez José Hernández-Orallo Austin Herrick Jacob Hilton Maartje ter Hoeve Jessica Hoffmann Christopher J. Honey Yu Hou Yufang Hou 0001 Blake Howald Phu Mon Htut Michael Hu Michael Y. Hu William Huang Dieuwke Hupkes Aman Hussain Pinyu Hwang Katerina Ignatyeva Benjamin Inden Daphne Ippolito Michael I. Ivanitskiy Anantharaman S. Iyer Niveditha Iyer Cassandra Jacobs Rowan Jacobs T. Florian Jaeger Gonzalo Jaimovitch-López Ethan J. Jerzak Rohan Jha Angela Jiang Guangyuan Jiang Joseph Jones Jaap Jumelet David Jurgens Mihir Kale Kamil Kanclerz Jared Kaplan Ayla Karakas Jackson Kernion Nitish Shirish Keskar Daniel Khashabi Tushar Khot Dan Kilman Ethan Kim Hannah Kim 0010 Jeremy Kim Najoung Kim Yoon Kim Svetlana Kiritchenko Arun Kirubarajan Denis Kleyko Agnieszka Kluska Anastasia Kobzeva Jan Kocon Alexander W. Kocurek Alexander Koller James Koppel Timofei Kornev Neta Gur-Ari Krakover Karl Krauth Germán Kruszewski Dave Kush Sanjeev Kwatra Andrew La Brenden M. Lake Yair Lakretz Emma Lam Lucas Lam Andrew K. Lampinen Matthew L. Leavitt Dong-Ho Lee Jaehoon Lee 0001 Nayeon Lee Ryan Lee Soo-Hwan Lee Brian Leonard Cara Su-Yi Leong Michael A. Lepori Daniel Levy 0002 Omer Levy Martha Lewis Aitor Lewkowycz Bingzhi Li Tao Li 0039 Paul Pu Liang Percy Liang Peiyuan Liao Bill Y. LinBill Yuchen Lin Stephanie Lin Jing Liu Rosanne Liu Karen Livescu Bao Sheng Loe Charles Lovering Qing Lyu 0001 Andrea Madotto Sneha Priscilla Makini Matthew Mandelkern Christopher D. Manning Eunice Engefu Manyasi Alec Marantz Marco Marelli Giorgio Mariani Katja Markert Jennifer Marsh Nicole Martinez Fernando Martínez-Plumed Marco Maru Rebecca Marvin Kory W. Mathewson Mantas Mazeika Tom McCoy 0001R. Thomas McCoyRichard Thomas McCoy Kyle McDonell Melvin McElrath Harsh Mehta Qiaozhu Mei Gerard de Melo Simone Melzi Arul Menezes Chenlin Meng William Merrill Luke Metz Piotr Milkowski John Miller 0001 Raphaël Millière Junghyun Min Summer Misherghi Gaurav Mishra Swaroop Mishra Diganta Misra Vedant Misra Saif M. Mohammad Dimitri Coelho Mollo Louis-Philippe Morency Luca Moschella Rafael Mosquera Aaron Mueller Niklas Muennighoff Asher Mullokandov Norihito Naka Nikita Nangia Trishala Neeraj Graham Neubig Behnam Neyshabur Ian Ng Garrett Nicolai Allen Nie Tiberius Nkinyili Isaac Noble Lucy Noble Antonio Norelli Roman Novak Jekaterina Novikova Pawel Krzysztof Nowak Victoria Nyamai Lidia Contreras Ochando Timothy J. O'Donnell Byung-Doh Oh Priti Oli Kevin Omondi Bryan Orinion Batuhan Özyurt Dario Paape Shubh Pachchigar Vishakh Padmakumar Shidong Pan Bhargavi Paranjape Giambattista Parascandolo Alicia Parrish Panupong Pasupat Roma Patel Piyush Patil Ellie Pavlick Nanyun Peng 0001 Danielle Perszyk Panayiota Petrou-Zeniou Jackson Petty Pouya Pezeshkpour Thomas Phan Jason Phang Steve PiantadosiSteven T. Piantadosi Emily Pitler David Poeppel Adam Poliak Martin Potthast Christopher Potts Alethea Power Vinay Uday Prabhu Grusha Prasad Stephen Prasad Lianhui Qin Linlu Qiu Jarema Radom Colin Raffel Ameet Rahane Vinay V. Ramasesh Cindy Ramirez María José Ramírez-Quintana Abhishek Rao Hannah Rashkin Abhinav Rastogi Charles Rathkopf Vikas Raunak Shauli Ravfogel Alex Ray Robbe Raymaekers Siva Reddy David Reitter Xiang Ren 0001 Laria Reynolds Kyle Richardson 0001 Ramon Risco Clara RiveraClara E. Rivera B. Ryan Roberts Nicholas Roberts Emanuele Rodolà Frieda Rong Alexis Ross Candace Ross Dan Roth 0001 Theodore Rothschild Sarah A. Rous Jos Rozen Rachel Etta Rudolph Joshua S. Rule Ashish Sabharwal Sepideh Sadeghi Ali Safaya Ruslan Salakhutdinov Suchir Salhan Andrea Santilli Adam Santoro Maarten Sap Naomi Saphra William Saunders Rif A. Saurous Asad B. Sayeed Timo Schick Marten van Schijndel Ludwig Schmidt Samuel S. Schoenholz Dylan Schrader Mátyás Schubert William Schuler Sebastian Schuster 0001 Tal Schuster Hinrich Schütze Elad Segal Zachary Seid Thibault Sellam Lutfi Kerem SenelLütfi Kerem Senel Fei Sha Raj Sanjay Shah Uri Shaham 0002 Siamak Shakeri Pratyusha Sharma Peter Shaw 0004 Xudong Shen Henry Shevlin Chuan Shi Sherry Shi Stuart M. Shieber Ksenia Shkaruta Sam Shleifer Abu Awal Md Shoeb Kumar Shridhar Tyler Shultz Ekaterina Shutova Fatemeh Siar Noam Siegelman Rohan Sikand Damien Sileo James B. Simon Chandan Singh Sahib Singh Shashwat Singh 0001 Shikhar Singh Clemencia Siro Roman Sitelew Ambrose Slone Paul Smolensky Jascha Sohl-Dickstein Jiaming Song Yangqiu Song Paul Soulos Benjamin Spector Vivek Srikumar Aarohi Srivastava Shashank Srivastava Michael Starritt Sjoerd van Steenkiste Benno Stein 0001 Catherine Stinson Ryan Stovall Michael Strube 0001 Andreas Stuhlmüller Mirac Suzgun Michal Swedrowski Mukund Varma T. Jeroen Taal Arfa Tabassum Natalia Talmina Derek Tam Eric Tang Jillian Tang Ali Tazarv Ryan Teehan Joshua B. Tenenbaum Ian Tenney Michael Henry Tessler Jana Thompson Simon Thormeyer William Timkey Mo Tiwari Lindia Tjuatja Marie Tolkiehn Nicholas Tomlin Xiaoyu Tong Spencer Torene Shubham Toshniwal Kristina Toutanova Titus Tunduny Iulia TurcIulia Raluca Turc Shyam Upadhyay Shravan Vasishth Anu Venkatesh Paul Vicol Christian Voigt Wout Vossen Anh Vuong Chris Waites Mitch Walker Alex Wang Gloria Wang Luheng Wang Qihan Wang Tianle Wang 0009 Wentao Wang Zijian Wang 0002 Zijie J. Wang Zirui Wang Alex Warstadt Martin Wattenberg Joan Waweru Albert Webson Jason Wei Nuan Wen Masha Westerlund Ethan WilcoxEthan Gotlieb Wilcox Adina Williams Genta Indra Winata Janelle Wingfield Sam Wiseman Hugh Mee Wong Chiyu Wu Te-Lin Wu Xinyi Wu Zhaofeng Wu Ziyi Wu Fanyue Xia Patrick Xia 0002 Yu Xia Alice Xiang Jiacheng Xu Mimee Xu Steve Yadlowsky Yadollah Yaghoobzadeh Hiromu Yakura Diyi Yang Rylan Yang Yichi Yang Yuekun Yao Michihiro Yasunaga Aditya Yedetore Michael A. Yee Gilad Yehudai Jason Yosinski Tao Yu 0009 Ann Yuan Deniz Yuret Fred Zhang Hongming Zhang 0009 Li Zhang 0039 Oliver Zhang Rui Zhang 0037 William Zhang 0004 Xinran Zhao Zhuoye Zhao Evgenii Zheltonozhskii James Zheng Sharon Zhou Wang Zhu 0001 Chengxu Zhuang Julian Zimmert Barret Zoph Andy Zou James Zou 0001