Robot Teleoperation via Virtual Reality: A Unity and ROS Approach

Abstract

© 2024 IEEE.This paper explores the integration of virtual reality (VR) with teleoperation systems to enhance human-robot interaction. With the rise of remote operations, traditional methods often rely on two-dimensional interfaces, making it challenging to control robots in complex three-dimensional environments. This research presents a VR teleoperation system using the Meta Quest 2 headset, enabling immersive control of a climbing robot with six degrees-of-freedom and magnetic adhesion. The system architecture integrates Unity for virtual simulation and the Robot Operating System (ROS) for real-time communication and control. A virtual environment allows the user to control the virtual robot model through the VR headset and controllers, with ROS serving as the communication bridge between the virtual and physical robots, enabling effective operations in various applications, including high-risk environments (A video is available at https://youtu.be/MiZDOV4IfLA).

Keywords