Supporting Human Autonomy in AI Systems: A Framework for Ethical Enquiry
File(s)
Published version
Author(s)
Calvo, Rafael
Peters, Dorian
Vold, Karina
Ryan, Richard
Type
Chapter
Abstract
Autonomy has been central to moral and political philosophy for millennia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences are neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: (1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; (2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and (3) Autonomy-support must be analysed from at least six spheres of experience in order to appropriately capture contradictory and downstream effects.
Editor(s)
Burr, C
Floridi, L
Date Issued
2020-08-20
Citation
Ethics of Digital Well-Being: A Multidisciplinary Approach, 2020, pp.31-54
ISBN
978-3-030-50585-1
Publisher
Springer, Cham
Start Page
31
End Page
54
Journal / Book Title
Ethics of Digital Well-Being: A Multidisciplinary Approach
Philosophical Studies Series book series (PSSP, volume 140)
Format Extent
13
Copyright Statement
© The Author(s) 2020
License URL
Sponsor
The Leverhulme Trust
Leverhulme Trust
Identifier
https://link.springer.com/chapter/10.1007/978-3-030-50585-1_2
Grant Number
RG80277
Leverhulme Centre for the Future of Intelligence
Publication Status
Published online
Article Number
2
Date Publish Online
2020-08-20