{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T22:31:59Z","timestamp":1759962719559},"reference-count":22,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2012,12,13]],"date-time":"2012-12-13T00:00:00Z","timestamp":1355356800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Am Soc Inf Sci Tec"],"published-print":{"date-parts":[[2013,2]]},"abstract":"<jats:p>Peer review supports scientific conferences in selecting high\u2010quality papers for publication. Referees are expected to evaluate submissions equitably according to objective criteria (e.g., originality of the contribution, soundness of the theory, validity of the experiments). We argue that the submission date of papers is a subjective factor playing a role in the way they are evaluated. Indeed, program committee (<jats:styled-content style=\"fixed-case\">PC<\/jats:styled-content>) chairs and referees process submission lists that are usually sorted by paper<jats:styled-content style=\"fixed-case\">ID<\/jats:styled-content>s. This order conveys chronological information, as papers are numbered sequentially upon reception. We show that order effects lead to unconscious favoring of early\u2010submitted papers to the detriment of later\u2010submitted papers. Our point is supported by a study of 42 peer\u2010reviewed conferences in <jats:styled-content style=\"fixed-case\">C<\/jats:styled-content>omputer <jats:styled-content style=\"fixed-case\">S<\/jats:styled-content>cience showing a decrease in the number of bids placed on submissions with higher paper<jats:styled-content style=\"fixed-case\">ID<\/jats:styled-content>s. It is advised to counterbalance order effects during the bidding phase of peer review by promoting the submissions with fewer bids to potential referees. This manipulation intends to better share bids out among submissions in order to attract qualified referees for all submissions. This would secure reviews from confident referees, who are keen on voicing sharp opinions and recommendations (acceptance or rejection) about submissions. This work contributes to the integrity of peer review, which is mandatory to maintain public trust in science.<\/jats:p>","DOI":"10.1002\/asi.22747","type":"journal-article","created":{"date-parts":[[2012,12,13]],"date-time":"2012-12-13T21:40:26Z","timestamp":1355434826000},"page":"405-415","source":"Crossref","is-referenced-by-count":9,"title":["Capitalizing on order effects in the bids of peer\u2010reviewed conferences to secure reviews by expert referees"],"prefix":"10.1002","volume":"64","author":[{"given":"Guillaume","family":"Cabanac","sequence":"first","affiliation":[{"name":"Computer Science Department University of Toulouse  IRIT UMR 5505 CNRS Toulouse France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Preuss","sequence":"additional","affiliation":[{"name":"Department of Informatics and Media Brandenburg University of Applied Sciences  Brandenburg an der Havel Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2012,12,13]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1086\/266516"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1152\/advan.00104.2006"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.22634"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2004.08.005"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2006.01.009"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0749\u20105978(03)00080\u20103"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743546.1743569"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341545"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21565"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/mar.20270"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1839676.1839701"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1203354"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540\u20105915.1999.tb00910.x"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.638"},{"issue":"140","key":"e_1_2_8_16_1","first-page":"1","article-title":"A technique for the measurement of attitudes","volume":"22","author":"Likert R.","year":"1932","journal-title":"Archives of Psychology"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467\u20109280.2009.02453.x"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.2307\/2683468"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1086\/297848"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2006.09.006"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978\u20103\u2010540\u201069052\u20108_75"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1965724.1965728"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01553188"}],"container-title":["Journal of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fasi.22747","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.22747","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T12:20:32Z","timestamp":1697458832000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/asi.22747"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,12,13]]},"references-count":22,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2013,2]]}},"alternative-id":["10.1002\/asi.22747"],"URL":"https:\/\/doi.org\/10.1002\/asi.22747","archive":["Portico"],"relation":{},"ISSN":["1532-2882","1532-2890"],"issn-type":[{"value":"1532-2882","type":"print"},{"value":"1532-2890","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,12,13]]}}}