Purcell, Zoe and Bonnefon, Jean-François (2022) Humans Feel Too Special for Machines to Score Their Morals. TSE Working Paper, n. 22-1387, Toulouse

There is a more recent version of this item available.
[thumbnail of wp_tse_1387.pdf]
Download (1MB) | Preview


Artificial Intelligence (AI) can be harnessed to create sophisticated social and moral scoring systems —enabling people and organizations to form judgements of others at scale. However, it also poses significant ethical challenges and is, subsequently, the subject of wide debate. As these technologies are developed and governing bodies face regulatory decisions, it is crucial that we understand the attraction or resistance that people have for AI moral scoring. Across four experiments, we show that the acceptability of moral scoring by AI is related to expectations about the quality of those scores, but that expectations about quality are compromised by people's tendency to see themselves as morally peculiar. We demonstrate that people overestimate the peculiarity of their moral profile, believe that AI will neglect this peculiarity, and resist for this reason the introduction of moral scoring by AI.

Item Type: Monograph (Working Paper)
Language: English
Date: November 2022
Place of Publication: Toulouse
Uncontrolled Keywords: Artificial Intelligence, social credit scoring, ethics, consumer psychology
JEL Classification: D91 - Intertemporal Consumer Choice; Life Cycle Models and Saving
Divisions: TSE-R (Toulouse)
Institution: Université Toulouse Capitole
Site: UT1
Date Deposited: 29 Nov 2022 13:08
Last Modified: 16 Apr 2024 09:35
OAI Identifier: oai:tse-fr.eu:127527
URI: https://publications.ut-capitole.fr/id/eprint/46461

Available Versions of this Item

View Item


Downloads per month over past year