Intuitive Virtual Reality based Control of a Real-world Mobile Manipulator

Publication Type:
Conference Proceeding
International Conference on Control, Automation, Robotics and Vision, 2020
Issue Date:
Filename Description Size
ACD40A42-56B0-40CA-A634-0949B5FC29C7 am.pdfAccepted version593.17 kB
Adobe PDF
Full metadata record
This paper presents an integration of Virtual Reality (VR) interfaces with the control system of a real-world mobile manipulator, ultimately facilitating a natural and intuitive method for human-robot interaction. VR’s ability to track movements in 3D space and translate performed motions provide an intuitive platform for users to explore and interact with the virtual environment. Coupled with intuitive controls, such as grabbing and pointing, the VR platform provides a compelling advantage that can be used to solve limitations of traditional remote robot teleoperation methods. This paper summarises the system implemented, which includes a simulation of the robot in Unity3d, as well as analyses critical results of accuracy and performance, from experiments with users of various experience levels. The method used for measuring accuracy with a simulated robot presented a utilitarian validation for contrasting the difference between 2D and VR 3D interfaces. Users’ performance and experience under various levels of control latency, which is a crucial factor in remote online robot control, were also measured.
Please use this identifier to cite or link to this item: