Modular software framework for upper-body telepresence and control with underactuated robotic hands via ROS 2 and YARP

Abstract

Integrating underactuated anthropomorphic hands into complex teleoperation and telepresence systems often requires bridging heterogeneous middleware ecosystems and developing robotic control modules. In this paper, we present a modular software framework that orchestrates upper-body teleoperation and control with underactuated hands and complementary vision systems. The architecture seamlessly coexists across ROS 2 and YARP, leveraging the rich ROS 2 ecosystem alongside established low-level YARP devices. As a core contribution, we introduce a generic control system featuring joint-coupling solvers and modular building blocks applicable to diverse robotic platforms. We integrate the low-cost Dextra underactuated hand and validate the architecture through both simulated (Gazebo) and real-world experiments on the TEO humanoid robot and ABB GoFa collaborative manipulators. Furthermore, we demonstrate the framework’s versatility beyond teleoperation by executing an automated Rubik’s cube solving task. All source code has been open-sourced to provide a foundation for future developments.

Publication
In 2026 International Conference on Control, Robotics and Cybernetics (CRC)
Accepted for IEEE CRC 2026 (Hefei, China, September 2026). The accepted manuscript is available as a PDF on this page; the DOI and official proceedings link will be added when they become available.
Qiang Li
Qiang Li
Professor and header of AG

My research interests include underwater robot, collaborative robots, humanoid robots.