We present a Cartesian control architecture for teleoperation that abstracts hardware details by leveraging the open-source middleware framework YARP and interoperating with the ROS 2 ecosystem and its community tools and packages. The goal is to provide a flexible and modular network of distributed reusable components that can act as building blocks of a more complex and complete teleoperation application. In this way, users of our framework can extend these utilities to match their own applications, robots and needs. This work has been validated on the TEO humanoid, the ABB CRB 15000-5 “GoFa” collaborative robot, and the ASIBOT and AMOR assistive manipulators, as well as their corresponding virtual models for the Gazebo and OpenRAVE simulators. A variety of low-cost devices have also been explored: 3Dconnexion’s SpaceMouse, Nintendo’s Wiimote controller, and the Leap Motion hand tracker. All source code is publicly available on GitHub.