Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation

Laha, Riddhiman; Becker, Marvin; Vorndamme, Jonathan; Vrabel, Juraj; Figueredo, Luis F.C.; Müller, Matthias A.; Haddadin, Sami

Abstract

Future robots operating in fast-changing anthropomorphic environments need to be reactive, safe, flexible, and intuitively use both arms (comparable to humans) to handle task-space constrained manipulation scenarios. Furthermore, dynamic environments pose additional challenges for motion planning due to a continual requirement for validation and refinement of plans. This work addresses the issues with vector-field-based motion generation strategies, which are often prone to local-minima problems. We aim to bridge the gap between reactive solutions, global planning, and constrained cooperative (two-arm) manipulation in partially known surroundings. To this end, we introduce novel planning and real-time control strategies leveraging the geometry of the task space that are inherently coupled for seamless operation in dynamic scenarios. Our integrated multiagent global planning and control scheme explores controllable sets in the previously introduced cooperative dual task space and flexibly controls them by exploiting the redundancy of the high degree-of-freedom (DOF) system. The planning and control framework is extensively validated in complex, cluttered, and nonstationary simulation scenarios where our framework is able to complete constrained tasks in a reliable manner, whereas existing solutions fail. We also perform additional real-world experiments with a two-armed 14 DOF torque-controlled KoBo robot. Our rigorous simulation studies and real-world experiments reinforce the claim that the framework is able to run robustly within the inner loop of modern collaborative robots with vision feedback.

Citation

Laha, R., Becker, M., Vorndamme, J., Vrabel, J., Figueredo, L. F., Müller, M. A., & Haddadin, S. (2024). Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation. IEEE Transactions on Robotics, 40, 864-885. https://doi.org/10.1109/TRO.2023.3341689

• Journal Article Type: Article
• Acceptance Date: Dec 14, 2023
• Online Publication Date: Dec 12, 2023
• Publication Date: 2024
• Deposit Date: Mar 21, 2025
• Publicly Available Date: Mar 25, 2025
• Journal: IEEE Transactions on Robotics
• Print ISSN: 1552-3098
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 40
• Pages: 864-885
• DOI: https://doi.org/10.1109/TRO.2023.3341689
• Public URL: https://nottingham-repository.worktribe.com/output/30667908
• Publisher URL: https://ieeexplore.ieee.org/document/10354340