{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T07:17:30Z","timestamp":1768288650890,"version":"3.49.0"},"reference-count":64,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2019,7,10]],"date-time":"2019-07-10T00:00:00Z","timestamp":1562716800000},"content-version":"vor","delay-in-days":39,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"published-print":{"date-parts":[[2019,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The goal of visual analytics is to create a symbiosis between human and computer by leveraging their unique strengths. While this model has demonstrated immense success, we are yet to realize the full potential of such a human\u2010computer partnership. In a perfect collaborative mixed\u2010initiative system, the computer must possess skills for learning and anticipating the users' needs. Addressing this gap, we propose a framework for inferring attention from passive observations of the user's click, thereby allowing accurate predictions of future events. We demonstrate this technique with a crime map and found that users' clicks can appear in our prediction set 92% \u2010 97% of the time. Further analysis shows that we can achieve high prediction accuracy typically after three clicks. Altogether, we show that passive observations of interaction data can reveal valuable information that will allow the system to learn and anticipate future events.<\/jats:p>","DOI":"10.1111\/cgf.13670","type":"journal-article","created":{"date-parts":[[2019,7,10]],"date-time":"2019-07-10T15:04:02Z","timestamp":1562771042000},"page":"41-52","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":35,"title":["Follow The Clicks: Learning and Anticipating Mouse Interactions During Exploratory Data Analysis"],"prefix":"10.1111","volume":"38","author":[{"given":"Alvitta","family":"Ottley","sequence":"first","affiliation":[{"name":"Computer Science and Engineering, Washington University in St. Louis"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roman","family":"Garnett","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, Washington University in St. Louis"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ran","family":"Wan","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, Washington University in St. Louis"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2019,7,10]]},"reference":[{"key":"e_1_2_11_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/5254.796083"},{"key":"e_1_2_11_3_2","unstructured":"AferganD. PeckE. M. ChangR. JacobR. J.:Using passive input to adapt visualization systems to the individual. 10"},{"key":"e_1_2_11_4_2","doi-asserted-by":"crossref","unstructured":"BattleL. ChangR. StonebrakerM.: Dynamic prefetching of data tiles for interactive visualization. InProceedings of the 2016 International Conference on Management of Data(2016) ACM pp.1363\u20131375. 2","DOI":"10.1145\/2882903.2882919"},{"key":"e_1_2_11_5_2","doi-asserted-by":"crossref","unstructured":"BattleL. DuanP. MirandaZ. MukushevaD. ChangR. StonebrakerM.: Beagle: Automated extraction and interpretation of visualizations from the web. InProceedings of the 2018 CHI Conference on Human Factors in Computing Systems(2018) ACM p.594. 6","DOI":"10.1145\/3173574.3174168"},{"key":"e_1_2_11_6_2","unstructured":"BertinJ.:Semiology of graphics: diagrams networks maps. 3 4"},{"key":"e_1_2_11_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.89"},{"key":"e_1_2_11_8_2","doi-asserted-by":"crossref","unstructured":"BatemanS. MandrykR. L. StachT. GutwinC.: Target assistance for subtly balancing competitive play. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems(2011) ACM pp.2355\u20132364. 10","DOI":"10.1145\/1978942.1979287"},{"key":"e_1_2_11_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346575"},{"key":"e_1_2_11_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2006.30"},{"key":"e_1_2_11_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.195"},{"key":"e_1_2_11_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598468"},{"key":"e_1_2_11_13_2","volume-title":"Readings in information visualization: using vision to think","author":"Card S. K.","year":"1999"},{"key":"e_1_2_11_14_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781420088861.ch10"},{"key":"e_1_2_11_15_2","unstructured":"CowleyP. NowellL. ScholtzJ.: Glass box: An instrumented infrastructure for supporting human interaction with information. InSystem Sciences 2005. HICSS'05. Proceedings of the 38th Annual Hawaii International Conference on(2005) IEEE pp. 296c\u2013296c. 2"},{"key":"e_1_2_11_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-8806-4_48"},{"key":"e_1_2_11_17_2","doi-asserted-by":"crossref","unstructured":"CardS. K. RobertsonG. G. MackinlayJ. D.: The information visualizer an information workspace. InProceedings of the SIGCHI Conference on Human factors in computing systems(1991) ACM pp.181\u2013186. 10","DOI":"10.1145\/108844.108874"},{"key":"e_1_2_11_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598471"},{"key":"e_1_2_11_19_2","doi-asserted-by":"crossref","unstructured":"DixA. EllisG.: Starting simple: adding value to static visualisation through simple interaction. InProceedings of the working conference on Advanced visual interfaces(1998) ACM pp.124\u2013134. 3","DOI":"10.1145\/948496.948514"},{"key":"e_1_2_11_20_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511790492"},{"key":"e_1_2_11_21_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008935410038"},{"key":"e_1_2_11_22_2","first-page":"5","article-title":"Mastering the information age solving problems with visual analytics","volume":"2","author":"Ellis G.","year":"2010","journal-title":"Eurographics"},{"key":"e_1_2_11_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/643477.643478"},{"key":"e_1_2_11_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13405"},{"key":"e_1_2_11_25_2","doi-asserted-by":"crossref","unstructured":"FuE. Y. KwokT. C. WuE. Y. LeongH. V. NgaiG. ChanS. C.: Your mouse reveals your next activity: Towards predicting user intention from mouse interaction. InComputer Software and Applications Conference (COMPSAC) 2017 IEEE 41st Annual(2017) vol. 1 IEEE pp.869\u2013874. 2","DOI":"10.1109\/COMPSAC.2017.270"},{"key":"e_1_2_11_26_2","unstructured":"FengM. PeckE. HarrisonL.: Patterns and pace: Quantifying diverse exploration behavior with visualizations on the web.IEEE transactions on visualization and computer graphics(2018). 2"},{"key":"e_1_2_11_27_2","doi-asserted-by":"crossref","unstructured":"GrossmanT. BalakrishnanR.: The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. InProceedings of the SIGCHI conference on Human factors in computing systems(2005) ACM pp.281\u2013290. 10","DOI":"10.1145\/1054972.1055012"},{"key":"e_1_2_11_28_2","doi-asserted-by":"crossref","unstructured":"GarnettR. G\u00e4rtnerT. EllersiekT. GumondssonE. \u00d3skarssonP.: Predicting Unexpected Influxes of Players in EVE Online. InProceedings of the 2014 IEEE Conference on Computational Intelligence and Games(2014). 4","DOI":"10.1109\/CIG.2014.6932878"},{"key":"e_1_2_11_29_2","doi-asserted-by":"crossref","unstructured":"GreenT. M. RibarskyW. FisherB.: Visual analytics for complex concepts using a human cognition model. InVisual Analytics Science and Technology 2008. VAST'08. IEEE Symposium on(2008) IEEE pp.91\u201398. 1","DOI":"10.1109\/VAST.2008.4677361"},{"key":"e_1_2_11_30_2","doi-asserted-by":"crossref","unstructured":"GordonN. J. SalmondD. J. SmithA. F.: Novel approach to nonlinear\/non\u2010gaussian bayesian state estimation. InIEE Proceedings F (Radar and Signal Processing)(1993) vol. 140 IET pp.107\u2013113. 5","DOI":"10.1049\/ip-f-2.1993.0015"},{"key":"e_1_2_11_31_2","doi-asserted-by":"crossref","unstructured":"GajosK. WeldD. S.: Supple: automatically generating user interfaces. InProceedings of the Ninth International Conference on Intelligent User Interfaces(2004) ACM pp.93\u2013100. 10","DOI":"10.1145\/964442.964461"},{"key":"e_1_2_11_32_2","doi-asserted-by":"publisher","DOI":"10.1057\/ivs.2008.31"},{"key":"e_1_2_11_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/636772.636798"},{"key":"e_1_2_11_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.137"},{"key":"e_1_2_11_35_2","doi-asserted-by":"crossref","unstructured":"HorvitzE.: Principles of mixed\u2010initiative user interfaces. InProceedings of the SIGCHI conference on Human Factors in Computing Systems(1999) ACM pp.159\u2013166. 10","DOI":"10.1145\/302979.303030"},{"issue":"5","key":"e_1_2_11_36_2","first-page":"17","article-title":"Uncertainty, action, and interaction: In pursuit of mixed\u2010initiative computing","volume":"14","author":"Horvitz E.","year":"1999","journal-title":"IEEE Intelligent Systems"},{"issue":"2","key":"e_1_2_11_37_2","first-page":"3","article-title":"Reflections on challenges and promises of mixed\u2010initiative interaction","volume":"28","author":"Horvitz E. J.","year":"2007","journal-title":"AI Magazine"},{"key":"e_1_2_11_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(99)00163-7"},{"key":"e_1_2_11_39_2","doi-asserted-by":"publisher","DOI":"10.1038\/35058500"},{"key":"e_1_2_11_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.730558"},{"key":"e_1_2_11_41_2","volume-title":"Statistical methods for speech recognition","author":"Jelinek F.","year":"1997"},{"key":"e_1_2_11_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70956-5_7"},{"key":"e_1_2_11_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/360402.360406"},{"key":"e_1_2_11_44_2","doi-asserted-by":"crossref","unstructured":"KitturA. ChiE. H. SuhB.: Crowdsourcing user studies with mechanical turk. InProceedings of the SIGCHI conference on human factors in computing systems(2008) ACM pp.453\u2013456. 8","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_2_11_45_2","unstructured":"KochC. UllmanS.:Selecting One Among the Many: A Simple Network Implementing Shifts in Selective Visual Attention.Tech. rep. MASSACHUSETTS INST OF TECH CAMBRIDGE ARTIFICIAL INTELLIGENCE LAB 1984. 4 9"},{"key":"e_1_2_11_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-009-3833-5_5"},{"key":"e_1_2_11_47_2","doi-asserted-by":"crossref","unstructured":"KosaraR. ZiemkiewiczC.: Do mechanical turks dream of square pie charts? InProceedings of the 3rd BELIV'10 Workshop: Beyond time and errors: Novel evaluation methods for information visualization(2010) ACM pp.63\u201370. 8","DOI":"10.1145\/2110192.2110202"},{"key":"e_1_2_11_48_2","doi-asserted-by":"crossref","unstructured":"MengisJ. EpplerM. J.: Visualizing instead of overloading: Exploring the promise and problems of visual communication to reduce information overload.Information Overload: An International Challenge for Professional Engineers and Technical Communicators(2012) 203\u2013229. 1","DOI":"10.1002\/9781118360491.ch10"},{"key":"e_1_2_11_49_2","unstructured":"MillerR. B.: Response time in man\u2010computer conversational transactions. InAFIPS Fall Joint Computing Conference (1)(1968) pp.267\u2013277. 10"},{"key":"e_1_2_11_50_2","volume-title":"Foundations of statistical natural language processing","author":"Manning C. D.","year":"1999"},{"key":"e_1_2_11_51_2","doi-asserted-by":"crossref","unstructured":"NorthC. ChangR. EndertA. DouW. MayR. PikeB. FinkG.: Analytic provenance: process+ interaction+ insight. InCHI'11 Extended Abstracts on Human Factors in Computing Systems(2011) ACM pp.33\u201336. 2","DOI":"10.1145\/1979742.1979570"},{"key":"e_1_2_11_52_2","doi-asserted-by":"crossref","unstructured":"OttleyA. YangH. ChangR.: Personality as a predictor of user strategy: How locus of control affects search strategies on tree visualizations. InProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(2015) ACM pp.3251\u20133254. 8","DOI":"10.1145\/2702123.2702590"},{"key":"e_1_2_11_53_2","doi-asserted-by":"publisher","DOI":"10.1057\/ivs.2009.22"},{"key":"e_1_2_11_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467551"},{"key":"e_1_2_11_55_2","volume-title":"Fundamentals of speech recognition","author":"Rabiner L. R.","year":"1993"},{"key":"e_1_2_11_56_2","doi-asserted-by":"crossref","unstructured":"RamachandranA. WangL. ChaintreauA.: Dynamics and prediction of clicks on news from twitter. InProceedings of the 29th on Hypertext and Social Media(2018) ACM pp.210\u2013214. 2","DOI":"10.1145\/3209542.3209568"},{"key":"e_1_2_11_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/846183.846188"},{"key":"e_1_2_11_58_2","unstructured":"SnoekJ. LarochelleH. AdamsR. P.: Practical bayesian optimization of machine learning algorithms. InAdvances in neural information processing systems(2012) pp.2951\u20132959. 9"},{"key":"e_1_2_11_59_2","doi-asserted-by":"crossref","unstructured":"SoloveyE. T. LaloosesF. ChaunceyK. WeaverD. ParasiM. ScheutzM. SassaroliA. FantiniS. SchermerhornP. GirouardA. et al.: Sensing cognitive multitasking for a brain\u2010based adaptive user interface. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems(2011) ACM pp.383\u2013392. 10","DOI":"10.1145\/1978942.1978997"},{"key":"e_1_2_11_60_2","unstructured":"St. Louis Metropolitan Police Department:http:\/\/www.slmpd.org\/crime_mapping.shtml. Accessed November 13 2017. 7"},{"key":"e_1_2_11_61_2","first-page":"175","article-title":"A hidden markov model for predicting transmembrane helices in protein sequences","volume":"6","author":"Sonnhammer E. L.","year":"1998","journal-title":"Ismb"},{"key":"e_1_2_11_62_2","doi-asserted-by":"crossref","unstructured":"WallE. BlahaL. M. FranklinL. EndertA.: Warning bias may occur: A proposed approach to detecting cognitive bias in interactive visual analytics. InIEEE Conference on Visual Analytics Science and Technology (VAST)(2017). 2 3","DOI":"10.1109\/VAST.2017.8585669"},{"key":"e_1_2_11_63_2","unstructured":"WangL. X. RamachandranA. ChaintreauA.: Measuring click and share dynamics on social media: A reproducible and validated approach. InNews@ ICWSM(2016). 2"},{"key":"e_1_2_11_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70515"},{"key":"e_1_2_11_65_2","doi-asserted-by":"crossref","unstructured":"ZhouM. X. FeinerS. K.: Visual task characterization for automated visual discourse synthesis. InProceedings of the SIGCHI conference on Human factors in computing systems(1998) ACM Press\/Addison\u2010Wesley Publishing Co. pp.392\u2013399. 3","DOI":"10.1145\/274644.274698"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.13670","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/cgf.13670","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.13670","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,10]],"date-time":"2023-09-10T03:18:19Z","timestamp":1694315899000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.13670"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,6]]}},"alternative-id":["10.1111\/cgf.13670"],"URL":"https:\/\/doi.org\/10.1111\/cgf.13670","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"value":"0167-7055","type":"print"},{"value":"1467-8659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6]]},"assertion":[{"value":"2019-07-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}