I Can't Believe That Happened!: Exploring Expressivity in Collaborative Storytelling with the Tabletop Robot Haru

Nichols, E; Szapiro, D; Vasylkiv, Y; Gomez, R

I Can't Believe That Happened!: Exploring Expressivity in Collaborative Storytelling with the Tabletop Robot Haru

Nichols, E Szapiro, D

Vasylkiv, Y Gomez, R

Permalink

Publisher:: Institute of Electrical and Electronics Engineers (IEEE)
Publication Type:: Conference Proceeding
Citation:: RO-MAN 2022 - 31st IEEE International Conference on Robot and Human Interactive Communication: Social, Asocial, and Antisocial Robots, 2022, 00, pp. 59-66
Issue Date:: 2022-01-01

Closed Access

	Filename	Description	Size
	I_Cant_Believe_That_Happened__Exploring_Expressivity_in_Collaborative_Storytelling_with_the_Tabletop_Robot_Haru.pdf	Published version	4.93 MB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Nichols, E
dc.contributor.author	Szapiro, D https://orcid.org/0000-0002-3763-5283
dc.contributor.author	Vasylkiv, Y
dc.contributor.author	Gomez, R
dc.date	2022-08-29
dc.date.accessioned	2023-02-28T05:12:03Z
dc.date.available	2023-02-28T05:12:03Z
dc.date.issued	2022-01-01
dc.identifier.citation	RO-MAN 2022 - 31st IEEE International Conference on Robot and Human Interactive Communication: Social, Asocial, and Antisocial Robots, 2022, 00, pp. 59-66
dc.identifier.isbn	9781728188591
dc.identifier.uri	http://hdl.handle.net/10453/166568
dc.description.abstract	Collaborative storytelling has long been a goal of social robotics, however, much of this research is limited in interactivity or assumes that story content is curated. In this paper, we present a working fully-automatic collaborative storytelling robot, which can collaborate with a person to create a unique, improvised story by using a large-scale neural language model to dynamically generate continuations to a story. Because effective storytelling requires engaging the emotions of participants, we explore several modalities of procedurally-generated expressivity: 1. an expressive text-to-speech voice with several delivery styles, 2. physical and verbal reactions performed by the robot, and 3. an external display used to show instructions and graphics during storytelling.To understand the issues associated with improvised collaborative storytelling with a social robot, we conduct an online survey and elicitation study with a group of online observers of collaborative storytelling gameplay, comparing several expressivity strategies in terms of storytelling-related characteristics, expressivity characteristics, and personality traits as measured by RoSAS. This evaluation showed that expressivity strategies using both emotive voice and performed reactions were perceived to be more competent storytellers and more strongly associated with positive personality traits.
dc.language	en
dc.publisher	Institute of Electrical and Electronics Engineers (IEEE)
dc.relation.ispartof	RO-MAN 2022 - 31st IEEE International Conference on Robot and Human Interactive Communication: Social, Asocial, and Antisocial Robots
dc.relation.ispartof	2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
dc.relation.isbasedon	10.1109/RO-MAN53752.2022.9900606
dc.rights	info:eu-repo/semantics/closedAccess
dc.title	I Can't Believe That Happened!: Exploring Expressivity in Collaborative Storytelling with the Tabletop Robot Haru
dc.type	Conference Proceeding
utslib.citation.volume	00
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Arts and Social Sciences
utslib.copyright.status	closed_access	*
dc.date.updated	2023-02-28T05:12:02Z
pubs.finish-date	2022-09-02
pubs.publication-status	Published
pubs.start-date	2022-08-29
pubs.volume	00

Abstract:

Collaborative storytelling has long been a goal of social robotics, however, much of this research is limited in interactivity or assumes that story content is curated. In this paper, we present a working fully-automatic collaborative storytelling robot, which can collaborate with a person to create a unique, improvised story by using a large-scale neural language model to dynamically generate continuations to a story. Because effective storytelling requires engaging the emotions of participants, we explore several modalities of procedurally-generated expressivity: 1. an expressive text-to-speech voice with several delivery styles, 2. physical and verbal reactions performed by the robot, and 3. an external display used to show instructions and graphics during storytelling.To understand the issues associated with improvised collaborative storytelling with a social robot, we conduct an online survey and elicitation study with a group of online observers of collaborative storytelling gameplay, comparing several expressivity strategies in terms of storytelling-related characteristics, expressivity characteristics, and personality traits as measured by RoSAS. This evaluation showed that expressivity strategies using both emotive voice and performed reactions were perceived to be more competent storytellers and more strongly associated with positive personality traits.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/166568