Work in Progress

Theorizing Deception: A Scoping Review of Theory in Research on Dark Patterns and Deceptive Design

Authors:

Weichen Joe Chang,

Andrew A. AdamsAuthors Info & Claims

CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Article No.: 321, Pages 1 - 7

https://doi.org/10.1145/3613905.3650997

Published: 11 May 2024 Publication History

Abstract

The issue of dark patterns and deceptive designs (DPs) in everyday interfaces and interactions continues to grow. DPs are manipulative and malicious elements within user interfaces that deceive users into making unintended choices. In parallel, research on DPs has significantly increased over the past two decades. As the field has matured, epistemological gaps have also become a salient and pressing concern. In this scoping review, we assessed the academic work so far—51 papers between 2014 to 2023—to identify the state of theory in DP research. We identified the key theories employed, examined how these theories have been referenced, and call for enhancing the incorporation of theory into DP research. We also propose broad theoretical foundations to establish a comprehensive and solid base for contextualizing and informing future DP research from a variety of theoretical scopes and lenses.

Supplemental Material

MP4 File

Talk Video

Transcript for: Talk Video

PDF File - Supplemental Material

We provide the following appendices as Supplementary Materials: ? Appendix A: Scoping Review Flow Diagram Describing our Identification and Screening Process ? Appendix B: Principles Used in Dark Patterns Research ? Appendix C: Models Used in Dark Patterns Research ? Appendix D: Framework Used in Dark Patterns Research ? Appendix E: Mechanisms Used in Dark Patterns Research

Download
439.15 KB

References

[1]

Gabriel Abend. 2008. The Meaning of ‘Theory’. Sociological Theory 26, 2 (2008), 173–199. https://doi.org/10.1111/j.1467-9558.2008.00324.x

[2]

Andrew A Adams. 2014. Facebook code: Social network sites platform affordances and privacy. Journal of Law, Information and Science 23, 1 (2014), 158–168.

[3]

Sanju Ahuja and Jyoti Kumar. 2022. Conceptualizations of user autonomy within the normative evaluation of dark patterns. Ethics and Information Technology 24 (12 2022). https://doi.org/10.1007/s10676-022-09672-9

Digital Library

[4]

Solomon E. Asch. 1951. Effects of group pressure upon the modification and distortion of judgments. In Groups, Leadership, and Men, H. Guetzkow (Ed.). Carnegie Press, New York, NY, US.

[5]

John A Bargh, Mark Chen, and Lara Burrows. 1996. Automaticity of social behavior: Direct effects of trait construct and stereotype activation on action.Journal of Personality and Social Psychology 71, 2 (1996), 230.

[6]

Anders Bergesen, John Gullaksen, Mikael Hanssen, Aleksander Karlsson, and Birgitte Swensson. 2021. Dark patterns in cookie consent notices — Norway’s 50 most visited websites.

[7]

Rod Bond and Peter B Smith. 1996. Culture and conformity: A meta-analysis of studies using Asch’s (1952b, 1956) line judgment task.Psychological Bulletin 119, 1 (1996), 111.

[8]

Kerstin Bongard-Blanchy, Arianna Rossi, Salvador Rivas, Sophie Doublet, Vincent Koenig, and Gabriele Lenzini. 2021. “I Am Definitely Manipulated, Even When I Am Aware of It. It’s Ridiculous!” - Dark Patterns from the End-User Perspective. In Proceedings of the 2021 ACM Designing Interactive Systems Conference (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 763–776. https://doi.org/10.1145/3461778.3462086

Digital Library

[9]

Harry Brignull. 2019. Deceptive patterns - home. https://www.deceptive.design/

[10]

Christoph Bösch, Benjamin Erb, Frank Kargl, Henning Kopp, and Stefan Pfattheicher. 2016. Tales from the Dark Side: Privacy Dark Strategies and Privacy Dark Patterns. Proceedings on Privacy Enhancing Technologies 2016 (07 2016), 237–254. https://doi.org/10.1515/popets-2016-0038

[11]

Ishita Chordia, Lena-Phuong Tran, Tala June Tayebi, Emily Parrish, Sheena Erete, Jason Yip, and Alexis Hiniker. 2023. Deceptive Design Patterns in Safety Technologies: A Case Study of the Citizen App. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg,Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 193, 18 pages. https://doi.org/10.1145/3544548.3581258

Digital Library

[12]

R.B. Cialdini. 2009. Influence: The Psychology of Persuasion. Harper Collins e-books, New York, NY, USA.

[13]

Refal Pradama Dahlan and Meredita Susanty. 2022. Finding Dark Patterns in Casual Mobile Games Using Heuristic Evaluation. PETIR 15, 2 (2022), 185–195. Issue 2. https://api.semanticscholar.org/CorpusID:254353531

[14]

Linda Di Geronimo, Larissa Braz, Enrico Fregnan, Fabio Palomba, and Alberto Bacchelli. 2020. UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User Perception. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376600

Digital Library

[15]

John Digman. 2003. Personality Structure: Emergence of the Five-Factor Model. Annual Review of Psychology 41 (11 2003), 417–440. https://doi.org/10.1146/annurev.ps.41.020190.002221

[16]

Bruno Dupont and Steven Malliet. 2021. Contextualizing Dark Patterns with the Ludeme Theory: A New Path for Digital Game Literacy?Acta Ludogica 4 (2021), 4–22. Issue 1. https://api.semanticscholar.org/CorpusID:266378823

[17]

Albert Ellis. 1991. The revised ABC’s of rational-emotive therapy (RET). Journal of Rational-Emotive and Cognitive-Behavior Therapy 9, 3 (1991), 139–172. https://doi.org/10.1007/bf01061227

[18]

B. J. Fogg. 2003. Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kaufmann Publishers, Massachusetts, US. https://books.google.co.jp/books?id=9nZHbxULMwgC

[19]

B. J. Fogg. 2009. A Behavior Model for Persuasive Design. In Proceedings of the 4th International Conference on Persuasive Technology (Claremont, California, USA) (Persuasive ’09). Association for Computing Machinery, New York, NY, USA, Article 40, 7 pages. https://doi.org/10.1145/1541948.1541999

Digital Library

[20]

Marian Friestad and Peter Wright. 1994. The Persuasion Knowledge Model: How People Cope with Persuasion Attempts. Journal of Consumer Research 21, 1 (06 1994), 1–31. https://doi.org/10.1086/209380 arXiv:https://academic.oup.com/jcr/article-pdf/21/1/1/50276032/jcr_21_1_1.pdf

[21]

Lewis Goldberg. 1991. An Alternative “Description of Personality”: The Big-Five Factor Structure. Journal of personality and social psychology 59 (01 1991), 1216–29. https://doi.org/10.1037//0022-3514.59.6.1216

[22]

Paul Grassl, Hanna Schraffenberger, Frederik Borgesius, and Moniek Buijzen. 2021. Dark and bright patterns in cookie consent requests. Journal of Digital Social Research 3, 1 (2021), 1–38. https://doi.org/10.31234/osf.io/gqs5h

[23]

Colin M. Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L. Toombs. 2018. The Dark (Patterns) Side of UX Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal, QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3174108

Digital Library

[24]

Colin M. Gray, Lorena Sanchez Chamorro, Ike Obi, and Ja-Nae Duane. 2023. Mapping the Landscape of Dark Patterns Scholarship: A Systematic Literature Review. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23 Companion). Association for Computing Machinery, New York, NY, USA, 188–193. https://doi.org/10.1145/3563703.3596635

Digital Library

[25]

Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 523–532. https://doi.org/10.1145/2598510.2598541

Digital Library

[26]

Shirley Gregor. 2006. The Nature of Theory in Information Systems. MIS Quarterly 30 (09 2006), 611–642. https://doi.org/10.2307/25148742

[27]

Johanna Gunawan, Amogh Pradeep, David Choffnes, Woodrow Hartzog, and Christo Wilson. 2021. A Comparative Study of Dark Patterns Across Web and Mobile Modalities. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 377 (oct 2021), 29 pages. https://doi.org/10.1145/3479521

Digital Library

[28]

Johanna Gunawan, Amogh Pradeep, David Choffnes, Woodrow Hartzog, and Christo Wilson. 2021. A Comparative Study of Dark Patterns Across Web and Mobile Modalities. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 377 (oct 2021), 29 pages. https://doi.org/10.1145/3479521

Digital Library

[29]

Brignull Harry. 2023. Deceptive Patterns: Exposing the Tricks Tech Companies Use to Control You.Testimonium Ltd, Eastbourne, England.

[30]

Thomas Hobbes. 1651. Hobbes’s Leviathan. Clarendon Press, Oxford, United Kingdom.

[31]

Hsiu-Fang Hsieh and Sarah Shannon. 2005. Three Approaches to Qualitative Content Analysis. Qualitative health research 15 (12 2005), 1277–88. https://doi.org/10.1177/1049732305276687

[32]

Tianyang Huang. 2023. Using SOR framework to explore the driving factors of older adults smartphone use behavior. Humanities and Social Sciences Communications 10 (10 2023). https://doi.org/10.1057/s41599-023-02221-9

[33]

Daniel Kahneman. 2011. Thinking, fast and slow. Farrar, Straus and Giroux, New York, NY, USA.

[34]

Daniel Kahneman, Jack L. Knetsch, and Richard H. Thaler. 1986. Fairness and The Assumptions of Economics. The Journal of Business 59 (10 1986), 285–300. https://doi.org/10.1086/296367

[35]

Daniel Kahneman and Amos Tversky. 1979. Prospect Theory: An Analysis of Decision under Risk. Econometrica 47, 2 (March 1979), 263–291. https://ideas.repec.org/a/ecm/emetrp/v47y1979i2p263-91.html

[36]

Kawon (Kathy) Kim, Woo Gon Kim, and Minwoo Lee. 2023. Impact of dark patterns on consumers’ perceived fairness and attitude: Moderating effects of types of dark patterns, social proof, and moral identity. Tourism Management 98 (2023), 104763. https://doi.org/10.1016/j.tourman.2023.104763

[37]

Agnieszka Kitkowska, Johan Högberg, and Erik Wästlund. 2022. Barriers to a Well-Functioning Digital Market: Exploring Dark Patterns and How to Overcome Them. In 55th Hawaii International Conference on System Sciences. ScholarSpace, Hawaii, US, 4697–4706. https://doi.org/10.24251/HICSS.2022.573

[38]

Joshua Kleinfeld. 2021. Why the mind matters in criminal law. Ariz. St. LJ 53 (2021), 539.

[39]

Cherie Lacey and Catherine Caudwell. 2019. Cuteness as a ‘Dark Pattern’ in Home Robots. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE Press, Daegu, Republic of Korea, 374–381. https://doi.org/10.1109/HRI.2019.8673274

[40]

David Laibson. 1997. Golden Eggs and Hyperbolic Discounting. The Quarterly Journal of Economics 112 (02 1997), 443–77. https://doi.org/10.1162/003355397555253

[41]

Lawrence Lessig. 2009. Code: and Other Laws of Cyberspace. Basic Books, New York, NY, US.

[42]

John Locke. 1689. Second Treatise of Government. Watchmaker Publishing, Oregon, US.

[43]

Yuwen Lu, Chao Zhang, Yuewen Yang, Yaxing Yao, and Toby Jia-Jun Li. 2023. From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX. arxiv:2310.17846 [cs.HC]

[44]

Jamie Luguri and Lior Jacob Strahilevitz. 2021. Shining a Light on Dark Patterns. Journal of Legal Analysis 13, 1 (03 2021), 43–109. https://doi.org/10.1093/jla/laaa006 arXiv:https://academic.oup.com/jla/article-pdf/13/1/43/36669915/laaa006.pdf

[45]

Janetta Lun, Stacey Sinclair, Erin Whitchurch, and Catherine Glenn. 2007. (Why) Do I Think What You Think? Epistemic Social Tuning and Implicit Prejudice. Journal of personality and social psychology 93 (12 2007), 957–72. https://doi.org/10.1037/0022-3514.93.6.957

[46]

Peter Machamer, Lindley Darden, and Carl F. Craver. 2000. Thinking about Mechanisms. Philosophy of Science 67, 1 (2000), 1–25. https://doi.org/10.1086/392759

[47]

Hugh P. McDonald. 2009. Principles: The Principles of Principles. The Pluralist 4, 3 (2009), 98–126. https://doi.org/10.1353/plu.0.0028

[48]

A. Mehrabian and J.A. Russell. 1974. An Approach to Environmental Psychology. M.I.T. Press, Massachusetts, US.

[49]

Janet Metcalfe and Walter Mischel. 1999. A Hot/Cool-System Analysis of Delay of Gratification: Dynamics of Willpower. Psychological review 106 (01 1999), 3–19. https://doi.org/10.1037/0033-295X.106.1.3

[50]

Susan Michie, Maartje van Stralen, and Robert West. 2011. The Behaviour Change Wheel: a new method for characterising and designing behaviour change interventions. Implementation science : IS 6 (04 2011), 42. https://doi.org/10.1186/1748-5908-6-42

[51]

Jakob Nielsen. 1994. Enhancing the Explanatory Power of Usability Heuristics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’94). Association for Computing Machinery, New York, NY, USA, 152–158. https://doi.org/10.1145/191666.191729

Digital Library

[52]

Per Nilsen. 2015. Making sense of implementation theories, models and frameworks. Implementation science : IS 10 (04 2015), 53. https://doi.org/10.1186/s13012-015-0242-0

[53]

Donald A. Norman. 2002. The Design of Everyday Things. Basic Books, Inc., USA.

Digital Library

[54]

OECD. 2022. Dark commercial patterns. Number 336 in OECD Digital Economy Papers. OECD Publishing, Paris, France. 96 pages. https://doi.org/10.1787/44f5e846-en

[55]

Sebnem Ozdemir. 2019. Digital nudges and dark patterns: The angels and the archfiends of digital communication. Digital Scholarship in the Humanities 35 (03 2019). https://doi.org/10.1093/llc/fqz014

[56]

Raymond Paternoster and Sally Simpson. 2017. A rational choice theory of corporate crime. In Routine Activity and Rational Choice, Ronald Victor Gemuseus Clarke and Marcus Felson (Eds.). Routledge, London, UK, 37–58.

[57]

John Rawls. 2005. Political Liberalism. Columbia University Press, New York, NY, US. Expanded edition from 1993 original.

[58]

Carla Sousa and Ana Oliveira. 2023. The Dark Side of Fun: Understanding Dark Patterns and Literacy Needs in Early Childhood Mobile Gaming, In Vol. 17 No. 1 (2023): Proceedings of the 17th European Conference on Games Based Learning. European Conference on Games Based Learning 17. https://doi.org/10.34190/ecgbl.17.1.1656

[59]

Frank Stajano and Paul Wilson. 2011. Understanding scam victims: Seven principles for systems security. Commun. ACM 54, 3 (2011), 70–75.

Digital Library

[60]

Ronald K. Stamper. 1993. A semiotic theory of information and information systems. In Proceedings of the Joint ICL/University of Newcastle Seminar on the Teaching of Computer Science, Part IX: Information. University of Newcastle, Newcastle, UK, 1-33 pages. https://api.semanticscholar.org/CorpusID:64006127

[61]

Robert I. Sutton and Barry M. Staw. 1995. What Theory is Not. Administrative Science Quarterly 40, 3 (1995), 371–384. http://www.jstor.org/stable/2393788

[62]

Richard H. Thaler. 2018. Nudge, not sludge. Science 361, 6401 (2018), 431–431. https://doi.org/10.1126/science.aau9241 arXiv:https://www.science.org/doi/pdf/10.1126/science.aau9241

[63]

Richard H. Thaler and Cass R. Sunstein. 2008. Nudge. Yale University Press, New Haven, CT and London.

[64]

Andrea C. Tricco, Erin Lillie, Wasifa Zarin, Kelly K. O’Brien, Heather Colquhoun, Danielle Levac, David Moher, Micah D.J. Peters, Tanya Horsley, Laura Weeks, Susanne Hempel, Elie A. Akl, Christine Chang, Jessie McGowan, Lesley Stewart, Lisa Hartling, Adrian Aldcroft, Michael G. Wilson, Chantelle Garritty, Simon Lewin, Christina M. Godfrey, Marilyn T. Macdonald, Etienne V. Langlois, Karla Soares-Weiser, Jo Moriarty, Tammy Clifford, Özge Tunçalp, and Sharon E. Straus. 2018. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Annals of Internal Medicine 169, 7 (2018), 467–473. https://doi.org/10.7326/M18-0850 arXiv:https://doi.org/10.7326/M18-0850PMID: 30178033.

[65]

Aimee van Wynsberghe and Scott Robbins. 2014. Ethicist as Designer: A Pragmatic Approach to Ethics in the Lab. Science and Engineering Ethics 20, 4 (2014), 947–961. https://doi.org/10.1007/s11948-013-9498-4

[66]

John G Wacker. 1998. A definition of theory: research guidelines for different theory-building research methods in operations management. Journal of Operations Management 16, 4 (1998), 361–385.

Digital Library

[67]

Qunfang Wu, Yisi Sang, Dakuo Wang, and Zhicong Lu. 2023. Malicious Selling Strategies in Livestream E-commerce: A Case Study of Alibaba’s Taobao and ByteDance’s TikTok. ACM Trans. Comput.-Hum. Interact. 30, 3, Article 35 (jun 2023), 29 pages. https://doi.org/10.1145/3577199

Digital Library

[68]

José Pablo Zagal, Staffan Björk, and Chris Lewis. 2013. Dark patterns in the design of games. In International Conference on Foundations of Digital Games., Crete, Greece. https://api.semanticscholar.org/CorpusID:17683705

Cited By

Schilling TBošnjak MGray CBarnes SSergeeva A(2024)Understanding Deceptive User Interface Designs: How They Unduly Influence Customers’ ChoicesZeitschrift für Psychologie10.1027/2151-2604/a000557232:4(293-296)Online publication date: Oct-2024
https://doi.org/10.1027/2151-2604/a000557

Index Terms

Theorizing Deception: A Scoping Review of Theory in Research on Dark Patterns and Deceptive Design

Recommendations

Mobilizing Research and Regulatory Action on Dark Patterns and Deceptive Design Practices
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Deceptive, manipulative, and coercive practices are deeply embedded in our digital experiences, impacting our ability to make informed choices and undermining our agency and autonomy. These design practices—collectively known as “dark patterns” or “...
Deceptive, Disruptive, No Big Deal: Japanese People React to Simulated Dark Commercial Patterns
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Dark patterns and deceptive designs (DPs) are user interface elements that trick people into taking actions that benefit the purveyor. Such designs are widely deployed, with special varieties found in certain nations like Japan that can be traced to ...
Dark Patterns and the Emerging Threats of Deceptive Design Practices
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Growth hacking, particularly within the spectre of surveillance capitalism, has led to the widespread use of deceptive, manipulative, and coercive design techniques in the last decade. These challenges exist at the intersection of many different ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

May 2024

4761 pages

ISBN:9798400703317

DOI:10.1145/3613905

Editors:
Florian Floyd Mueller
Monash University
,
Penny Kyburz
The Australian National University
,
Julie R. Williamson
University of Glasgow
,
Corina Sas
Lancaster University

Copyright © 2024 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

CHI '24

Sponsor:

CHI '24: CHI Conference on Human Factors in Computing Systems

May 11 - 16, 2024

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
430
Total Downloads

Downloads (Last 12 months)430
Downloads (Last 6 weeks)90

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schilling TBošnjak MGray CBarnes SSergeeva A(2024)Understanding Deceptive User Interface Designs: How They Unduly Influence Customers’ ChoicesZeitschrift für Psychologie10.1027/2151-2604/a000557232:4(293-296)Online publication date: Oct-2024
https://doi.org/10.1027/2151-2604/a000557

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents