Towards Robot to Human Skill Coaching: A ML-powered IoT and HRI Platform for Martial Arts Training

Bourahmoune, K; Ishac, K; Carmichael, M

Towards Robot to Human Skill Coaching: A ML-powered IoT and HRI Platform for Martial Arts Training

Bourahmoune, K Ishac, K

Carmichael, M

Permalink

Publisher:: IEEE
Publication Type:: Conference Proceeding
Citation:: 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, 00, pp. 853-859
Issue Date:: 2024-01-01

Embargoed

	Filename	Description	Size
	Towards Robot to Human Skill Coaching A ML-powered IoT and HRI Platform for Martial Arts Training.pdf	Accepted version	4.46 MB		View/Open

Copyright Clearance Process

Recently Added
In Progress
Embargoed
Open Access

This item is currently unavailable due to the publisher's embargo.

The embargo period expires on 8 Aug 2026

Full metadata record

Field	Value	Language
dc.contributor.author	Bourahmoune, K
dc.contributor.author	Ishac, K https://orcid.org/0000-0001-6215-3297
dc.contributor.author	Carmichael, M https://orcid.org/0000-0001-8439-0074
dc.date	2024-05-13
dc.date.accessioned	2024-10-09T03:38:45Z
dc.date.available	2024-10-09T03:38:45Z
dc.date.issued	2024-01-01
dc.identifier.citation	2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, 00, pp. 853-859
dc.identifier.isbn	979-8-3503-8458-1
dc.identifier.issn	1050-4729
dc.identifier.uri	http://hdl.handle.net/10453/181318
dc.description.abstract	Advances in human sensing and machine learning are paving the way for new applications of robotics in sports and fitness making skill coaching smarter easier and more accessible Physical and social human robot interaction in particular has received special attention as a feedback mechanism for human performance augmentation A core challenge in deploying robots that interact physically with humans in dynamic environments such as sports relates to modeling human skills and designing appropriate interaction schemes We present the first ML based HRI platform for physical robot to human skill coaching in real time in Martial Arts which can be extended to various sports Our system comprises of the Sawyer robot our specially developed IoT katana and a skill training program for the Martial Art of Iaido We built and deployed in real time a ML based Iaido strike recognition model trained on expert and beginner data and achieved accuracies ranging between 94 8 and 99 97 We assessed the system s effectiveness in coaching skills through robot interaction in a sparring experiment and a survey involving 12 participants practicing key Iaido techniques with guided training from Sawyer Our results demonstrated improvement in all participants Iaido strike skill after training with Sawyer and they responded positively to robot assisted skill coaching
dc.language	en
dc.publisher	IEEE
dc.relation.ispartof	2024 IEEE International Conference on Robotics and Automation (ICRA)
dc.relation.ispartof	2024 IEEE International Conference on Robotics and Automation
dc.relation.isbasedon	10.1109/icra57147.2024.10610291
dc.rights	info:eu-repo/semantics/embargoedAccess
dc.title	Towards Robot to Human Skill Coaching: A ML-powered IoT and HRI Platform for Martial Arts Training
dc.type	Conference Proceeding
utslib.citation.volume	00
utslib.location.activity	Yokohama, Japan
pubs.organisational-group	University of Technology Sydney
pubs.organisational-group	University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	University of Technology Sydney/Faculty of Engineering and Information Technology/School of Mechanical and Mechatronic Engineering
pubs.organisational-group	University of Technology Sydney/UTS Groups
pubs.organisational-group	University of Technology Sydney/UTS Groups/Robotics Institute (RI)
pubs.organisational-group	University of Technology Sydney/UTS Groups/Centre for Advanced Manufacturing (CAM)
pubs.organisational-group	University of Technology Sydney/UTS Groups/Centre for Advanced Manufacturing (CAM)/Centre for Advanced Manufacturing (CAM) Associate Member
utslib.copyright.status	embargoed	*
utslib.copyright.embargo	2026-08-08T00:00:00+1000Z
dc.date.updated	2024-10-09T03:38:38Z
pubs.finish-date	2024-05-17
pubs.place-of-publication	Piscataway, USA
pubs.publication-status	Published
pubs.start-date	2024-05-13
pubs.volume	00
dc.location	Piscataway, USA

Abstract:

Advances in human sensing and machine learning are paving the way for new applications of robotics in sports and fitness making skill coaching smarter easier and more accessible Physical and social human robot interaction in particular has received special attention as a feedback mechanism for human performance augmentation A core challenge in deploying robots that interact physically with humans in dynamic environments such as sports relates to modeling human skills and designing appropriate interaction schemes We present the first ML based HRI platform for physical robot to human skill coaching in real time in Martial Arts which can be extended to various sports Our system comprises of the Sawyer robot our specially developed IoT katana and a skill training program for the Martial Art of Iaido We built and deployed in real time a ML based Iaido strike recognition model trained on expert and beginner data and achieved accuracies ranging between 94 8 and 99 97 We assessed the system s effectiveness in coaching skills through robot interaction in a sparring experiment and a survey involving 12 participants practicing key Iaido techniques with guided training from Sawyer Our results demonstrated improvement in all participants Iaido strike skill after training with Sawyer and they responded positively to robot assisted skill coaching

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/181318