{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T04:25:18Z","timestamp":1778300718268,"version":"3.51.4"},"reference-count":56,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,7,31]],"date-time":"2019-07-31T00:00:00Z","timestamp":1564531200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002428","name":"Austrian Science Fund","doi-asserted-by":"publisher","award":["P28363-24"],"award-info":[{"award-number":["P28363-24"]}],"id":[{"id":"10.13039\/501100002428","id-type":"DOI","asserted-by":"publisher"}]},{"name":"N\u00d6 Forschung und Bildung (NFB)","award":["SC16-032"],"award-info":[{"award-number":["SC16-032"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Uncertainty is a standard condition under which large parts of art-historical and curatorial knowledge creation and communication are operating. In contrast to standard levels of data quality in non-historical research domains, historical object and knowledge collections contain substantial amounts of uncertain, ambiguous, contested, or plainly missing data. Visualization approaches and interfaces to cultural collections have started to represent data quality and uncertainty metrics, yet all existing work is limited to representations for isolated metadata dimensions only. With this article, we advocate for a more systematic, synoptic and self-conscious approach to uncertainty visualization for cultural collections. We introduce omnipresent types of data uncertainty and discuss reasons for their frequent omission by interfaces for galleries, libraries, archives and museums. On this basis we argue for a coordinated counter strategy for uncertainty visualization in this field, which will also raise the efforts going into complex interface design and conceptualization. Building on the PolyCube framework for collection visualization, we showcase how multiple uncertainty representation techniques can be assessed and coordinated in a multi-perspective environment. As for an outlook, we reflect on both the strengths and limitations of making the actual wealth of data quality questions transparent with regard to different target and user groups.<\/jats:p>","DOI":"10.3390\/informatics6030029","type":"journal-article","created":{"date-parts":[[2019,7,31]],"date-time":"2019-07-31T11:37:07Z","timestamp":1564573027000},"page":"29","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Exhibiting Uncertainty: Visualizing Data Quality Indicators for Cultural Collections"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5170-2243","authenticated-orcid":false,"given":"Florian","family":"Windhager","sequence":"first","affiliation":[{"name":"danubeVISlab, Department for Knowledge and Communication Management, Danube University Krems, Dr.-Karl-Dorrek-Strasse 30, A-3500 Krems, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saminu","family":"Salisu","sequence":"additional","affiliation":[{"name":"danubeVISlab, Department for Knowledge and Communication Management, Danube University Krems, Dr.-Karl-Dorrek-Strasse 30, A-3500 Krems, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8402-5990","authenticated-orcid":false,"given":"Eva","family":"Mayr","sequence":"additional","affiliation":[{"name":"danubeVISlab, Department for Knowledge and Communication Management, Danube University Krems, Dr.-Karl-Dorrek-Strasse 30, A-3500 Krems, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gold, M.K. (2012). Debates in the Digital Humanities, University of Minnesota Press.","DOI":"10.5749\/minnesota\/9780816677948.001.0001"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gold, M.K., and Klein, L.F. (2019). Debates in the Digital Humanities 2019, University of Minnesota Press.","DOI":"10.5749\/j.ctvg251hk"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/01973762.2013.761106","article-title":"Is There a \u201cDigital\u201d Art History?","volume":"29","author":"Drucker","year":"2013","journal-title":"Vis. Resour."},{"key":"ref_4","unstructured":"Critical Inquiry (2019, July 26). Computational Literary Studies: A Critical Inquiry Online Forum. Available online: https:\/\/critinq.wordpress.com\/2019\/03\/31\/computational-literary-studies-a-critical-inquiry-online-forum\/."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sch\u00e4fer, M.T., and Van Es, K. (2017). The Datafied Society: Studying Culture through Data, Amsterdam University Press.","DOI":"10.5117\/9789462981362"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1111\/cgf.12873","article-title":"Visual text analysis in digital humanities","volume":"36","author":"Franzini","year":"2017","journal-title":"Comput. Graph. Forum"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Alharbi, M., and Laramee, R.S. (2018). SoS TextVis: A Survey of Surveys on Text Visualization, The Eurographics Association.","DOI":"10.3390\/computers8010017"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2311","DOI":"10.1109\/TVCG.2018.2830759","article-title":"Visualization of Cultural Heritage Collection Data: State of the Art and Future Challenges","volume":"25","author":"Windhager","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_9","unstructured":"Moretti, F. (2005). Graphs, Maps, Trees: Abstract Models for a Literary History, Verso Books."},{"key":"ref_10","first-page":"1","article-title":"Orchestrating Overviews. A Synoptic Approach to the Visualization of Cultural Collections","volume":"4","author":"Windhager","year":"2018","journal-title":"Open Libr. Humanit."},{"key":"ref_11","first-page":"47","article-title":"Practical issues in applying metadata schemas and controlled vocabularies to cultural heritage information","volume":"36","author":"Baca","year":"2003","journal-title":"Cat. Classif. Q."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Doerr, M. (2009). Ontologies for cultural heritage. Handbook on Ontologies, Springer.","DOI":"10.1007\/978-3-540-92673-3_21"},{"key":"ref_13","unstructured":"Ruecker, S., Radzikowska, M., and Sinclair, S. (2011). Visual Interface Design for Digital Cultural Heritage: A Guide to Rich-Prospect Browsing, Ashgate Publishing, Ltd."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kucher, K., and Kerren, A. (2015, January 14\u201317). Text visualization techniques: Taxonomy, visual survey, and community insights. Proceedings of the 2015 IEEE Pacific Visualization Symposium (PacificVis), Hangzhou, China.","DOI":"10.1109\/PACIFICVIS.2015.7156366"},{"key":"ref_15","unstructured":"Manovich, L. (2015). Data science and digital art history. Int. J. Digit. Art Hist."},{"key":"ref_16","first-page":"100","article-title":"Distant Viewing in Art History. A Case Study of Artistic Productivity","volume":"1","author":"Bender","year":"2015","journal-title":"Int. J. Digit. Art Hist."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Arnold, T., and Tilton, L. (2019). Distant viewing: Analyzing large visual corpora. Digit. Scholarsh. Humanit., fqz013.","DOI":"10.1093\/llc\/fqz013"},{"key":"ref_18","unstructured":"Van Hooland, S. (2006, January 13\u201315). From spectator to annotator: Possibilities offered by user-generated metadata for digital cultural heritage collections. Proceedings of the CILIP Conference on Immaculate Catalogues: Taxonomy, Metadata and Resource Discovery in the 21st Century, Norwich, UK."},{"key":"ref_19","unstructured":"Stange, J.E., and Kleymann, R. (2019). Towards Hermeneutic Visualization in Digital Literary Studies. Digi. Humanit. Q., under review."},{"key":"ref_20","unstructured":"Windhager, F., Salisu, S., and Mayr, E. (2019). Uncertainty of What for Whom\u2014And Does Anyone Care? Propositions for Cultural Collection Visualization, under review."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2526","DOI":"10.1109\/TVCG.2012.285","article-title":"Visualizing flow of uncertainty through analytical processes","volume":"18","author":"Wu","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1109\/TVCG.2015.2467591","article-title":"The Role of Uncertainty, Awareness, and Trust in Visual Analytics","volume":"22","author":"Sacha","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ther\u00f3n, R., Losada, A.G., Benito, A., and Santamar\u00eda, R. (2018, January 24\u201326). Toward supporting decision-making under uncertainty in digital humanities with progressive visualization. Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality, Salamanca, Spain.","DOI":"10.1145\/3284179.3284323"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Dill, J., Earnshaw, R., Kasik, D., Vince, J., and Wong, P.C. (2012). A Review of Uncertainty in Data Visualization. Expanding the Frontiers of Visual Analytics and Visualization, Springer.","DOI":"10.1007\/978-1-4471-2804-5"},{"key":"ref_25","first-page":"205","article-title":"Generous Interfaces for Digital Cultural Collections","volume":"9","author":"Whitelaw","year":"2015","journal-title":"Digit. Humanit. Q."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kr\u00e4utli, F., and Boyd Davis, S. (2013, January 29\u201331). Known Unknowns: Representing uncertainty in historical time. Proceedings of the Electronic Visualisation and the Arts (EVA) 2013, London, UK.","DOI":"10.14236\/ewic\/EVA2013.16"},{"key":"ref_27","unstructured":"Bludau, M.J., D\u00f6rk, M., and Heidmann, F. (2019, January 9\u201312). Relational Perspectives as Situated Visualizations of Art Collections. Proceedings of the ADHO Conference on Digital Humanities (DH), Utrecht, The Netherlands."},{"key":"ref_28","first-page":"39","article-title":"One View is not Enough. High-level Visualizations of a Large Cultural Collection","volume":"23","author":"Pietsch","year":"2017","journal-title":"Inf. Des. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1109\/TVCG.2015.2467752","article-title":"Visual Encodings of Temporal Uncertainty: A Comparative User Study","volume":"22","author":"Gschwandtner","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1080\/15230406.2016.1154804","article-title":"Domains of uncertainty visualization research: A visual summary approach","volume":"44","author":"Mason","year":"2017","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1559\/1523040054738936","article-title":"Visualizing geospatial information uncertainty: What we know and what we need to know","volume":"32","author":"MacEachren","year":"2005","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2496","DOI":"10.1109\/TVCG.2012.279","article-title":"Visual Semiotics & Uncertainty Visualization: An Empirical Study","volume":"18","author":"MacEachren","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_33","unstructured":"Kardos, J., Moore, A., and Benwell, G.L. (2003, January 1\u20132). The visualisation of uncertainty in spatially-referenced attribute data using trustworthy data structures. Proceedings of the 15th Annual Colloquium of the Spatial Information Research Centre (SIRC 2003: Land, Place and Space), Dunedin, New Zealand."},{"key":"ref_34","unstructured":"J\u00e4nicke, S., and Wrisley, D.J. (2013, January 16\u201319). Visualizing uncertainty: How to use the fuzzy data of 550 medieval texts. Proceedings of the ADHO Conference on Digital Humanities (DH), Lincoln, NE, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1179\/1743277414Y.0000000099","article-title":"How to assess visual communication of uncertainty? A systematic review of geospatial uncertainty visualisation user studies","volume":"51","author":"Kinkeldey","year":"2014","journal-title":"Cartogr. J."},{"key":"ref_36","unstructured":"Liem, J., Goudarouli, E., Hirschorn, S., Wood, J., and Perin, C. (2018, January 21\u201326). Conveying Uncertainty in Archived War Diaries with GeoBlobs. Proceedings of the IEEE VIS 2018 Electronic Conference, Berlin, Germany."},{"key":"ref_37","first-page":"286","article-title":"Representing the Presence of Absence in Cartography","volume":"109","author":"Robinson","year":"2019","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1111\/cgf.12722","article-title":"The State-of-the-Art of Set Visualization","volume":"35","author":"Alsallakh","year":"2016","journal-title":"Comput. Graph. Forum"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1057\/ivs.2010.3","article-title":"Disk diagram: An interactive visualization technique of fuzzy set operations for the analysis of fuzzy data","volume":"9","author":"Park","year":"2010","journal-title":"Inf. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1177\/1473871617698517","article-title":"Visualizing fuzzy sets using opacity-varying freeform diagrams","volume":"17","author":"Zhu","year":"2018","journal-title":"Inf. Vis."},{"key":"ref_41","unstructured":"Turkay, C., and Wan, T.R. (2016, January 15\u201316). TimeSets for Uncertainty Visualisation. Proceedings of the Computer Graphics and Visual Computing (CGVC), Bournemouth, UK."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1162\/LEON_a_01230","article-title":"Culturegraphy","volume":"50","author":"Albrecht","year":"2016","journal-title":"Leonardo"},{"key":"ref_43","unstructured":"Coburn, J. (2016). I Don\u2019t Know What I\u2019m Looking for: Better Understanding Public Usage and Behaviours with Tyne & Wear Archives & Museums Online Collections, Museums and the Web."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1109\/TVCG.2015.2424872","article-title":"Representing uncertainty in graph edges: An evaluation of paired visual variables","volume":"21","author":"Guo","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Schwank, J., Sch\u00f6ffel, S., St\u00e4rz, J., and Ebert, A. (2016, January 19\u201322). Visualizing uncertainty of edge attributes in node-link diagrams. Proceedings of the 2016 20th International Conference Information Visualisation (IV), Lisbon, Portugal.","DOI":"10.1109\/IV.2016.19"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1109\/TVCG.2016.2598919","article-title":"Probabilistic graph layout for uncertain network visualization","volume":"23","author":"Schulz","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_47","unstructured":"Berg-Fulton, T., Newbury, D., and Snyder, T. (2015). Art Tracks: Visualizing the stories and lifespan of an artwork. MW2015: Museums and the Web 2015, Archives & Museum Informatic."},{"key":"ref_48","first-page":"143","article-title":"Performative Materiality and Theoretical Approaches to Interface","volume":"7","author":"Drucker","year":"2013","journal-title":"Digit. Humanit. Q."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hullman, J., Resnick, P., and Adar, E. (2015). Hypothetical outcome plots outperform error bars and violin plots for inferences about reliability of variable ordering. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0142444"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Kay, M., Kola, T., Hullman, J.R., and Munson, S.A. (2016, January 7\u201312). When(Ish) is My Bus? User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858558"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Bonneau, G.P., Hege, H.C., Johnson, C.R., Oliveira, M.M., Potter, K., Rheingans, P., and Schultz, T. (2014). Overview and state-of-the-art of uncertainty visualization. Scientific Visualization, Springer.","DOI":"10.1007\/978-1-4471-6497-5_1"},{"key":"ref_52","unstructured":"Windhager, F., Filipov, V.A., Salisu, S., and Mayr, E. (2018, January 4). Visualizing uncertainty in cultural heritage collections. Proceedings of the EuroVis Workshop on Reproducibility, Verification, and Validation in Visualization, Brno, Czech Republic."},{"key":"ref_53","unstructured":"Madeiras Pereira, J., and Raidou, R.G. (2019). Shapes of Time: Visualizing Set Changes Over Time in Cultural Heritage Collections, The Eurographics Association. EuroVis 2019-Posters."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1093\/ahr\/122.2.400","article-title":"Historical Research in a Digital Age: Reflections from the Mapping the Republic of Letters Project","volume":"122","author":"Edelstein","year":"2017","journal-title":"Am. Hist. Rev."},{"key":"ref_55","unstructured":"Baldonado, M.Q.W., Woodruff, A., and Kuchinsky, A. (2000, January 24\u201326). Guidelines for Using Multiple Views in Information Visualization. Proceedings of the Working Conference on Advanced Visual Interfaces, Palermo, Italy."},{"key":"ref_56","unstructured":"Mayr, E., Federico, P., Miksch, S., Schreder, G., Smuc, M., and Windhager, F. (2016). Visualization of Cultural Heritage Data for Casual Users, IEEE VIS Workshop on Visualization for the Digital Humanities (vis4dh). Available online: https:\/\/publik.tuwien.ac.at\/files\/PubDat_250950.pdf."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/6\/3\/29\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:11:31Z","timestamp":1760188291000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/6\/3\/29"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,31]]},"references-count":56,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["informatics6030029"],"URL":"https:\/\/doi.org\/10.3390\/informatics6030029","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,31]]}}}