Human Value Requirements in AI Systems: Empirical Analysis of Amazon Alexa

Shams, RA; Bano, M; Zowghi, D; Lu, Q; Whittle, J

Human Value Requirements in AI Systems: Empirical Analysis of Amazon Alexa

Shams, RA Bano, M

Zowghi, D

Lu, Q Whittle, J

Permalink

Publisher:: IEEE
Publication Type:: Conference Proceeding
Citation:: 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW), 2023, 00, pp. 138-145
Issue Date:: 2023-09-28

Closed Access

	Filename	Description	Size
	Human_Value_Requirements_in_AI_Systems_Empirical_Analysis_of_Amazon_Alexa.pdf	Published version	933.69 kB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Shams, RA
dc.contributor.author	Bano, M https://orcid.org/0000-0002-1447-9521
dc.contributor.author	Zowghi, D https://orcid.org/0000-0002-6051-0155
dc.contributor.author	Lu, Q
dc.contributor.author	Whittle, J
dc.contributor.editor	Schneider, K
dc.contributor.editor	Dalpiaz, F
dc.contributor.editor	Horkoff, J
dc.date	2023-09-04
dc.date.accessioned	2024-05-10T10:12:02Z
dc.date.available	2024-05-10T10:12:02Z
dc.date.issued	2023-09-28
dc.identifier.citation	2023 IEEE 31st International Requirements Engineering Conference Workshops (REW), 2023, 00, pp. 138-145
dc.identifier.isbn	9798350326918
dc.identifier.issn	2770-6826
dc.identifier.uri	http://hdl.handle.net/10453/178805
dc.description.abstract	The importance of incorporating human values e g transparency privacy social recognition tradition in the Requirements Engineering RE process is well acknowledged but there is a paucity of empirical research for integrating human values in RE This shortfall becomes more pronounced when designing Artificial Intelligence AI systems due to their significant societal impact Ignoring or violating human values in AI systems can lead to user dissatisfaction negative socio economic repercussions and in some instances societal harm However there is a lack of guidance on addressing human values within the RE process for specific contexts of AI system development In this paper we explore human value requirements from the end users feedback for an AI system We conduct an empirical analysis of the Amazon Alexa app as a case study examining 1003 users reviews to identify relevant human values and assess the extent to which these values are addressed or ignored in the app We identified 34 values of the end users of Amazon Alexa Among them only one value is addressed self discipline and 23 of them are ignored freedom equality obedience in the app The feedback provided mixed experiences both addressed and ignored on the rest of the ten values Through this analysis we have tailored an approach for identifying human values from a specific type of AI system We posit that this approach has the potential for utility across different AI systems and a broad range of contexts providing guidance for developing human value requirements for values based AI systems
dc.language	en
dc.publisher	IEEE
dc.relation.ispartof	2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)
dc.relation.ispartof	2023 IEEE 31st International Requirements Engineering Conference Workshops
dc.relation.ispartofseries	IEEE International Requirements Engineering Conference Workshops
dc.relation.isbasedon	10.1109/rew57809.2023.00030
dc.rights	info:eu-repo/semantics/closedAccess
dc.title	Human Value Requirements in AI Systems: Empirical Analysis of Amazon Alexa
dc.type	Conference Proceeding
utslib.citation.volume	00
utslib.location.activity	Hannover, Germany
pubs.organisational-group	University of Technology Sydney
pubs.organisational-group	University of Technology Sydney/DVC (Research)
pubs.organisational-group	University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	University of Technology Sydney/Strength - HCTD - Human Centred Technology Design
pubs.organisational-group	University of Technology Sydney/Strength - STEM Education Futures
pubs.organisational-group	University of Technology Sydney/Faculty of Engineering and Information Technology/School of Computer Science
pubs.organisational-group	University of Technology Sydney/DVC (Research)/Graduate Research School
utslib.copyright.status	closed_access	*
dc.date.updated	2024-05-10T10:12:00Z
pubs.finish-date	2023-09-05
pubs.publication-status	Published
pubs.start-date	2023-09-04
pubs.volume	00

Abstract:

The importance of incorporating human values e g transparency privacy social recognition tradition in the Requirements Engineering RE process is well acknowledged but there is a paucity of empirical research for integrating human values in RE This shortfall becomes more pronounced when designing Artificial Intelligence AI systems due to their significant societal impact Ignoring or violating human values in AI systems can lead to user dissatisfaction negative socio economic repercussions and in some instances societal harm However there is a lack of guidance on addressing human values within the RE process for specific contexts of AI system development In this paper we explore human value requirements from the end users feedback for an AI system We conduct an empirical analysis of the Amazon Alexa app as a case study examining 1003 users reviews to identify relevant human values and assess the extent to which these values are addressed or ignored in the app We identified 34 values of the end users of Amazon Alexa Among them only one value is addressed self discipline and 23 of them are ignored freedom equality obedience in the app The feedback provided mixed experiences both addressed and ignored on the rest of the ten values Through this analysis we have tailored an approach for identifying human values from a specific type of AI system We posit that this approach has the potential for utility across different AI systems and a broad range of contexts providing guidance for developing human value requirements for values based AI systems

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/178805