Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users.

Malachi Hamada Nishant Balepur Malachi Hamada Varsha Kishore Sergey Feldman Amanpreet Singh Pao Siangliulue Joseph Chee Chang Eunsol Choi Jordan Lee Boyd-Graber Aakanksha Naik Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users. 15910-15944 2026 ACL (1) https://aclanthology.org/2026.acl-long.723/ conf/acl/2026-1 db/conf/acl/acl2026-1.html#BalepurHKFSSCCB26

Jena D. Hwang Varsha Kishore Amanpreet Singh Dany Haddad Aakanksha Naik Malachi Hamada Jonathan Bragg Mike D'Arcy Daniel S. Weld Lucy Lu Wang Doug Downey Sergey Feldman Deep Research, Shallow Evaluation: A Case Study in Meta-Evaluation for Long-Form QA Benchmarks. 2026 March abs/2603.06942 CoRR https://doi.org/10.48550/arXiv.2603.06942 db/journals/corr/corr2603.html#abs-2603-06942 streams/journals/corr

Nishant Balepur Malachi Hamada Varsha Kishore Sergey Feldman Amanpreet Singh Pao Siangliulue Joseph Chee Chang Eunsol Choi Jordan Lee Boyd-Graber Aakanksha Naik Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users. 2026 March abs/2603.16120 CoRR https://doi.org/10.48550/arXiv.2603.16120 db/journals/corr/corr2603.html#abs-2603-16120 streams/journals/corr

Nishant Balepur Malachi Hamada Varsha Kishore Sergey Feldman Amanpreet Singh Pao Siangliulue Joseph Chee Chang Rachel Rudinger Eunsol Choi Jordan Lee Boyd-Graber Doug Downey Aakanksha Naik DRACULA: Hunting for the Actions Users Want Deep Research Agents to Execute. 2026 April abs/2604.23815 CoRR https://doi.org/10.48550/arXiv.2604.23815 db/journals/corr/corr2604.html#abs-2604-23815 streams/journals/corr

Jonathan Bragg Mike D'Arcy Nishant Balepur Dan Bareket Bhavana Dalvi Sergey Feldman Dany Haddad Jena D. Hwang Peter A. Jansen Varsha Kishore Bodhisattwa Prasad Majumder Aakanksha Naik Sigal Rahamimov Kyle Richardson 0001 Amanpreet Singh Harshit Surana Aryeh Tiktinsky Rosni Vasu Guy Wiener Chloe Anastasiades Stefan Candra Jason Dunkelberger Dan Emery Rob Evans Malachi Hamada Regan Huff Rodney Kinney Matt Latzke Jaron Lochner Ruben Lozano-Aguilera Cecile Nguyen Smita Rao Amber Tanaka Brooke Vlahos Peter Clark Doug Downey Yoav Goldberg Ashish Sabharwal Daniel S. Weld AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite. 2025 October abs/2510.21652 CoRR https://doi.org/10.48550/arXiv.2510.21652 db/journals/corr/corr2510.html#abs-2510-21652 streams/journals/corr

Chloe Anastasiades Nishant Balepur Dan Bareket Jordan L. Boyd-GraberJordan Lee Boyd-Graber Jonathan Bragg Stefan Candra Joseph Chee Chang Eunsol Choi Peter Clark Bhavana Dalvi Mike D'Arcy Doug Downey Jason Dunkelberger Dan Emery Rob Evans Sergey Feldman Yoav Goldberg Dany Haddad Regan Huff Jena D. Hwang Peter A. Jansen Rodney Kinney Varsha Kishore Matt Latzke Jaron Lochner Ruben Lozano-Aguilera Bodhisattwa Prasad Majumder Aakanksha Naik Cecile Nguyen Sigal Rahamimov Smita Rao Kyle Richardson 0001 Rachel Rudinger Ashish Sabharwal Pao Siangliulue Amanpreet Singh Harshit Surana Amber Tanaka Aryeh Tiktinsky Rosni Vasu Brooke Vlahos Lucy Lu Wang Daniel S. Weld Guy Wiener