Visualization Ethics: A Case Study Approach

As information visualizations are increasingly used to engage citizens on social and political issues, it is worth thinking about the ethics of visualization. The digital humanities are well positioned to bring an interdisciplinary and critical perspective to such ethics. How can we approach ethically fraught historical visualizations? How can we think about the opportunities for using AI to quickly generate visualizations? In this short paper, we describe a case study approach that an interdisciplinary group of us have taken to understand the ethics and the teaching of visualization. In particular, we will briefly describe how we have used the development of six concrete cases as a way of thinking through the ethics of specific visualizations. We take this methodological approach, drawing on traditions of philosophy and acknowledging the pedagogical potential of case studies for teaching ethics. We close by discussing key ethical issues that emerged without trying to resolve them, outlining the problems that we believe (future) practitioners should reflect on.

The first historical case study contrasts two examples of early data visualization—the line graphs of British trade data included in William Playfair’s Commercial and Political Atlas (1786) and the Diagram of a Slave Ship (1789). The latter was created and circulated by a group of British antislavery activists–in order to explore questions about the ethics of visualizing people as data, and the violence that can accompany the reduction of lives to numbers. In the first example, there are no people depicted; instead, the data of the slave trade–and therefore its violence–is masked as financial data. In the second, enslaved people are directly represented on the chart. However, in neither case are enslaved people, formerly enslaved people, or their descendants involved in the creation of the chart. This prompts a second set of questions about the relationships between those doing the visualizing and those being visualized, with implications for how we approach community-based projects today. 

The second case explores what it means for data or designers to be “tainted” and the duties and responsibilities around such visualizations or the data they contain. Specifically, it deals with the legacy of the 20th century Topographische Anatomie des Menschen, often called the “Pernkopf Atlas” after its creator, Eduard Pernkopf (Czech et al 2021). The atlas is considered an inimitable work in anatomy, praised for its detail, accuracy, and artistic beauty. Yet, the work and its authors are entangled with the horrors of the Nazi regime, and the cadavers used of dubious and potentially horrific provenance.

From anatomy to physiognomy, and bridging the historical with current practice, the third case study looks at a visualization of composite or averaged faces of women across a large dataset of paintings, in a study investigating shifts in standards of beauty [Rosa and Suárez 2015]. The method itself is very similar to a process developed in the late 19th century by eugenicist Francis Galton for characterizing racial prototypes; it’s also found in computer science research (Turk and Pentland 1991) and in digital art, most famously Jason Salavon’s Amalgamation series ( ‘Jason Salavon’ n.d.). This raises questions over the degree to which such visualizations concretize, rather than merely historicize, the male gaze they attempt to describe. 

The next two cases describe the first-person experiences of two visualization designers, one placed in a newsroom and another in academia, both trying to communicate complex issues to the general public in clear and accessible ways. Climate change science has been challenged due to the inherent uncertainty of scientific modelling and the difficulty of comprehending how scientific knowledge gets built (Edwards 2013). The case study describes the design process of a data designer aiming to represent a 125-page report on how proven low-carbon solutions can be scaled up globally, and in that process coming into ethical debates with their editor-in-chief on the level of simplification expected by the newspaper’s audience. Similarly, modelling the epidemic data, such as that from the COVID-19 pandemic, is not an easy task due to the complexity of the data and their algorithms and the fact that these complexities could also cause the visualization outputs to be hard for the public to understand which could lead to misinterpretation and confusion or even deception. There are multiple ethical discussions and guidelines discussed on the web on what would be the best way of presenting such information to the public (Foard 2020, Hepworth 2020, Makulec 2020, TableauFit 2020, TableauFit 2020b). An example would be using the logarithmic graphs to represent the COVID-19 deaths although experiments have shown that the readers may not understand them fully ( LSE COVID-19 2020, Romano et al. 2020).

The final case study challenges our expectations that visualizations should faithfully represent data that have not been manipulated. What if we used visualizations to find or manipulate data? As Johanna Drucker has pointed out, “Visual expressions serve not merely as representations of existing knowledge, but as primary modes of knowledge production.” (Drucker 2020). We have inherited scientific traditions of visualization that emphasize representation and consider the manipulation of data as unethical cherry-picking. Consider the DIKW (Data Information Knowledge Wisdom) pyramid, itself a visualization of sorts (Frické 2009, Rowley 2007). It bears assumptions about the relations between data and knowledge that need to be confronted. We can do this by experimenting with humanities-inspired techniques that produce data or find data through sketching. Visualizations are not just the trace of information, they can be information, or a way of making it.

We argue that the critique of visualization needs to be multifaceted, understanding visualizations as outputs of scientific processes, cultural artifacts, entertainment, and even as perceptual objects for external cognition with their unique affordances and design criteria among others. We thus hope that through these case studies, designers can reflect on their relation to data visualizations, and detangle the ethical issues embedded in their design, understanding that even seemingly small design choices carry ethical implications. We aim to present this preliminary exercise on ethics and envision to further develop it as an educational activity for students and other visualization designers and practitioners.

Appendix A

Bibliography
  1. Czech, H., Druml, C., Weninger, W. J., & Müller, M. (2021): What Should Be Done with Pernkopf's Anatomical Illustrations?: A Commentary from the Medical University of Vienna. The Journal of Biocommunication, 45(1).
  2. Drucker, Johanna (2020): Visualization and Interpretation: Humanistic Approaches to Display. The MIT Press.
  3. Edwards, Paul N. (2013): A Vast Machine: Computer Models, Climate Data, and the Politics of Global Warming. The MIT Press.
  4. Foard, Anna (2020): ‘How to Slow the Spread of Misinformation’. Nightingale (blog). 26 March 2020. https://medium.com/nightingale/how-to-slow-the-spread-of-misinformation-f1acc3f91162. Accessed 29 May 2024.
  5. Frické, Martin (2009): ‘The Knowledge Pyramid: A Critique of the DIKW Hierarchy’. In Journal of Information Science 35 (2): 131–42.
  6. Hepworth, Katherine (2020): ‘Ethical Design Recommendations for COVID-19 Visualizations’. Nightingale (blog). 15 May 2020. https://medium.com/nightingale/ethical-design-recommendations-for-covid-19-visualizations-cb4a2677ae40. Accessed 29 May 2024.
  7. ‘Jason Salavon’. n.d. http://salavon.com/work/category/amalgamations/. Accessed 10 December 2023.
  8. Makulec, Amanda. (2020): ‘Ten Considerations Before You Create Another Chart about COVID-19’. Nightingale (blog). 27 April 2020. https://medium.com/nightingale/ten-considerations-before-you-create-another-chart-about-covid-19-27d3bd691be8. Accessed 29 May 2024.
  9. LSE COVID-19. (2020): ‘The Public Do Not Understand Logarithmic Graphs Used to Portray COVID-19 |LSE COVID-19’ 2020. Accessed 10 December 2023. https://blogs.lse.ac.uk/covid19/2020/05/19/the-public-doesnt-understand-logarithmic-graphs-often-used-to-portray-covid-19/.
  10. Romano, Alessandro, Chiara Sotis, Goran Dominioni, and Sebastián Guidi. (2020): ‘The Scale of COVID-19 Graphs Affects Understanding, Attitudes, and Policy Preferences’. In Health Economics 29 (11): 1482–94. https://doi.org/10.1002/hec.4143.
  11. Rosa, Javier de la, and Juan-Luis Suárez. (2015): ‘A Quantitative Approach to Beauty. Perceived Attractiveness of Human Faces in World Painting’. In International Journal for Digital Art History, no. 1 (June). https://doi.org/10.11588/dah.2015.1.21640.
  12. Rowley, Jennifer. (2007): ‘The Wisdom Hierarchy: Representations of the DIKW Hierarchy’. In Journal of Information Science 33 (2): 163–80. https://doi.org/10.1177/0165551506070706.
  13. TableauFit. (2020): ‘Ethics and What We Owe Each Other’. 2020. TableauFit. 17 March 2020. https://www.tableaufit.com/ethics-and-what-we-owe-each-other/. Accessed 29 May 2024.
  14. TableauFit. (2020b): ‘The Ethics of Visualizing during a Pandemic’. 30 March 2020. https://www.tableaufit.com/the-ethics-of-visualizing-during-a-pandemic/. Accessed 29 May 2024.
  15. Turk, Matthew, and Alex Pentland. (1991): ‘Eigenfaces for Recognition’. In Journal of Cognitive Neuroscience 3 (1): 71–86. https://doi.org/10.1162/jocn.1991.3.1.71.
Michael Correll (m.correll@northeastern.edu), Roux Institute, Northeastern University and Leonardo Impett (li222@cam.ac.uk), University of Cambridge and Lauren Frederica Klein (lauren.klein@emory.edu), Emory University and Georgia Panagiotidou (georgia.panagiotidou@kcl.ac.uk), King's College London, United Kingdom and Alfie Abdul-Rahman (alfie.abdulrahman@kcl.ac.uk), King's College London, United Kingdom and Geoffrey Rockwell (grockwel@ualberta.ca), University of Alberta