Skip to content

Latest commit

 

History

History
539 lines (274 loc) · 26.7 KB

Comprehensive_readme.md

File metadata and controls

539 lines (274 loc) · 26.7 KB

awesome-bimanual-manipulation

This repository is mainly about robot bimanual manipulation / dual-arm manipulation. This is an ongoing project now, so keep an eye on it.

Related works are listed as follows:

Note that some works are just pre-printed articles.


Content

Survey

  1. Reinforcement Learning of Bimanual Robot Skills Springer 2020
  2. Dual arm manipulation—A survey 2012 | Note
  3. Two Arms are Better than One: A Behavior Based Control System for Assistive Bimanual Manipulation 2007

Workshop

2021 ICRA Workshop on Bimanual Manipulation: Learning, Planning and Control

  1. Bimanual Manipulation -Complex, Human-like and Efficient Manipulation

2022 ICRA Workshop on Bi-manual Manipulation: Addressing Real-world Challenges

Benchmark

  1. robosuite: A Modular Simulation Framework and Benchmark for Robot Learning arxiv 2020

    Yuke Zhu Josiah Wong Ajay Mandlekar Roberto Martın-Martın

    image-20220519220714569

  2. The KIT Bimanual Manipulation Dataset Humanoids 2020

    Franziska Krebs , Andre Meixner , Isabel Patzer and Tamim Asfour

    image-20220519214544394

  3. DQ robotics: A library for robot modeling and control RA-M 2020

  4. Surreal: Open-source reinforcement learning framework and robot manipulation benchmark CoRL 2018

    Linxi Fan, Yuke Zhu, Jiren Zhu, Zihua Liu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei

    image-20220519220407152

Methodology

Learning

Deep Learning

  1. Learning where to trust unreliable models in an unstructured world for deformable object manipulation Science Robotics 2021

    P. Mitrano, D. Mc Conachie, D. Berenson

    image-20220527213914315image-20220527213946860

  2. FabricFlowNet: Bimanual Cloth Manipulation with a Flow-based Policy CoRL 2021 | web

    Thomas Weng, Sujay Bajracharya, Yufei Wang, Khush Agrawal, and David Held

    image-20220519220642430

  3. In-air Knotting of Rope using Dual-Arm Robot based on Deep Learning 2021

    Kanata Suzuki, Momomi Kanamura, Yuki Suga, Hiroki Mori and Tetsuya Ogata

    image-20220519231005441
  4. Fast Object Learning and Dual-arm Coordination for Cluttered Stowing, Picking, and Packing ICRA 2018

    Max Schwarz, Christian Lenz, German Martın Garcıa, Seongyong Koo, Arul Selvam Periyasamy, Michael Schreiber, and Sven Behnke

    image-20220519220537825

Imitation Learning / Learning from Demonstration (LfD)

  1. Robot Cooking with Stir-fry: Bimanual Non-prehensile Manipulation of Semi-fluid Objects RA-L 2022

    Junjia Liu, Yiting Chen, Zhipeng Dong, Shixiong Wang, Sylvain Calinon, Miao Li, and Fei Chen

    image-20220520230009629

    image-20220519225802707

  2. Passive Bimanual Skills Learning From Demonstration With Motion Graph Attention Networks RA-L 2022

    Zhipeng Dong , Zhihao Li , Yunhui Yan , Sylvain Calinon , and Fei Chen

    image-20220519215501409

  3. Robot peels banana with goal-conditioned dual-action deep imitation learning arxiv 2022

    Heecheol Kim, Yoshiyuki Ohmura , Yasuo Kuniyoshi

    image-20220519215647692

  4. Transformer-based deep imitation learning for dual-arm robot manipulation IROS 2021

    Heecheol Kim, Yoshiyuki Ohmura, Yasuo Kuniyoshi

    image-20220519215727714
  5. Learning Object-Action Relations from Bimanual Human Demonstration Using Graph Networks RA-L 2020

    Christian R. G. Dreher, Mirko Wächter, and Tamim Asfour

    image-20220519215219989
  6. Deep Imitation Learning for Bimanual Robotic Manipulation NeurIPS 2020

    Fan Xie, Alexander Chowdhury, M. Clara De Paolis Kaluza, Linfeng Zhao, Lawson L.S. Wong, Rose Yu

    image-20220519220205859

  7. Guided Robot Skill Learning: A User-Study on Learning Probabilistic Movement Primitives with Non-Experts Humanoids 2020 (Dual panda)

    Moritz Knaust, Dorothea Koert

    image-20220519223510616

    image-20220519223553704

  8. Learning and Composing Primitive Skills for Dual-arm Manipulation arxiv 2019

    Èric Pairet, Paola Ardón, Michael Mistry, and Yvan Petillot

    image-20220519224213894

  9. Learning Task Priorities From Demonstrations T-RO 2019

    Joao Silverio, Sylvain Calinon, Leonel Rozo, and Darwin G. Caldwell

    image-20220519214907845
  10. Dimensionality reduction for dynamic movement primitives and application to bimanual manipulation of clothes T-RO 2018

    Adria Colome, and Carme Torras

    image-20220519214146044
  11. Bimanual Skill Learning with Pose and Joint Space Constraints Humanoids 2018

    Joao Silverio , Sylvain Calinon, Leonel Rozo and Darwin G. Caldwell

    image-20220519214020923
  12. Projected Force-Admittance Control for Compliant Bimanual Tasks Humanoids 2018

    Jianfeng Gao, You Zhou and Tamim Asfour

    image-20220519214410965
  13. Constraints extraction from asymmetrical bimanual tasks and their use in coordinated behavior RAS 2018

    Lucia Pais Ureche, Aude Billard

    image-20220519225447080

  14. Generalization of Task Model using Compliant Movement Primitives in a Bimanual Setting ROBIO 2017

    Aleksandar Batinica, Bojan Nemec, José Santos-Victor, Andrej Gams and Mirko Rakovic

    image-20220519214133473
  15. Compliant Movement Primitives in a Bimanual Setting Humanoids 2017

    Aleksandar Batinica, Bojan Nemec, Aleš Ude, Mirko Rakovic´and Andrej Gams

    image-20220519214253876
  16. [Coordinate Change Dynamic Movement Primitives – A Leader-Follower Approach](IEEE Xplore Full-Text PDF:) IROS 2016

    You Zhou, Martin Do, and Tamim Asfour

    image-20220606132437520

  17. Learning bimanual end-effector poses from demonstrations using task-parameterized dynamical systems IROS 2015

    Joao Silverio, Leonel Rozo, Sylvain Calinon, Darwin G. Caldwell

    image-20220519215949658

Reinforcement Learning

  1. Bi-Manual Manipulation and Attachment via Sim-to-Real Reinforcement Learning arxiv 2022

    Satoshi Kataoka, Seyed Kamyar Seyed Ghasemipour, Daniel Freeman, and Igor Mordatch

    image-20220519221112639
  2. DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual Manipulation arxiv 2021

    Minghao Zhang, Pingcheng Jian, Yi Wu, Huazhe Xu, Xiaolong Wang

    image-20220519221027134

  3. Efficient bimanual manipulation using learned task schemas ICRA 2020 | video

    Rohan Chitnis, Shubham Tulsiani, Saurabh Gupta, and Abhinav Gupta

    image-20220519214701249
  4. Reinforcement Learning of Bimanual Robot Skills Springer 2020

    Adrià Colomé, Carme Torras

    image-20220519220950452

  5. Bimanual Regrasping for Suture Needles using Reinforcement Learning for Rapid Motion Planning arxiv 2020

    Zih-Yun Chiu, Florian Richter, Emily K. Funk, Ryan K. Orosco, and Michael C. Yip

    image-20220519214505635
  6. Exploiting symmetries in reinforcement learning of bimanual robotic tasks RA-L 2019

    Fabio Amadio, Adria Colome, and Carme Torras

    image-20220519221412811
  7. Door Opening by joining Reinforcement Learning and Intelligent Control ICAR 2017

    Bojan Nemec, Leon Zlajpah, and Ales Ude

    image-20220519221330212
  8. Extracting bimanual synergies with reinforcement learning IROS 2017

    Kevin Sebastian Luck,and Heni Ben Amor

    image-20220519221226012
  9. Trajectory-model-based reinforcement learning: Application to bimanual humanoid motor learning with a closed-chain constraint Humanoids 2013

    Norikazu Sugimoto, and Jun Morimoto

    image-20220519221714966
  10. Reinforcement Learning of Clothing Assistance with a Dual-arm Robot RAS 2011

    Tomoya Tamei, Takamitsu Matsubara, Akshara Rai, Tomohiro Shibata

    image-20220519222054180

  11. Using dimensionality reduction to exploit constraints in reinforcement learning IROS 2010

    Sebastian Bitzer, Matthew Howard, Sethu Vijayakumar

    image-20220519221540107

Modelling

  1. Redundancy Resolution for Dual-Arm Robots Inspired by Human Asymmetric Bimanual Action: Formulation and Experiments ICRA 2015

    image-20220526130001143 image-20220526130020430

Planning and Control

  1. Keypoint-Based Planar Bimanual Shaping of Deformable Linear Objects Under Environmental Constraints With Hierarchical Action Framework RA-L 2022

    Shengzeng Huo, Anqing Duan, Chengxi Li, Peng Zhou, Wanyu Ma, Hesheng Wang, and David Navarro-Alarcon

    image-20220519222312921
  2. Coupled Multiple Dynamic Movement Primitives Generalization for Deformable Object Manipulation RA-L 2022

    Zhenxi Cui, Wanyu Ma, Jiewen Lai, Henry K. Chu, and Yi Guo

    image-20220519222811535
  3. Mixtures of Gaussian Processes for Robot Motion Planning Using Stochastic Trajectory Optimization T-SMC 2022

    Luka Petrovic, Ivan Markovic, and Ivan Petrovic

    image-20220519222429391

  4. Composite-Learning-Based Adaptive Neural Control for Dual-Arm Robots With Relative Motion TNNLS 2022

    Yiming Jiang, Yaonan Wang, Zhiqiang Miao, Jing Na, Zhijia Zhao, and Chenguang Yang

    image-20220519215022183

  5. Four-Arm Collaboration: Two Dual-Arm Robots Work Together to Manipulate Tethered Tools T-Mech 2021

    Daniel Sanchez, Weiwei Wan, and Kensuke Harada

    image-20220519222634988
  6. Bidirectional Human–Robot Bimanual Handover of Big Planar Object With Vertical Posture T-ASE 2021

    Wei He, Jiashu Li, Zichen Yan and Fei Chen

    image-20220519224058495

  7. Initial Results on Grasping and Lifting Physical Deformable Bags with a Bimanual Robot IROS 2021

    Daniel Seita, Justin Kerr, John Canny, Ken Goldberg

    image-20220519223949367

  8. Action Planning for Packing Long Linear Elastic Objects into Compact Boxes with Bimanual Robotic Manipulation arxiv 2021

    Wanyu Ma, Bin Zhang, Lijun Han, Shengzeng Huo, Hesheng Wang and David Navarro-Alarcon

    image-20220519223349387

  9. Wrapp-up: A dual-arm robot for intralogistics RA-M 2020

    Manolo Garabini, Danilo Caporale, Vinicio Tincani, Alessandro Palleschi, Chiara Gabellieri, Marco Gugliotta, Alessandro Settimi, Manuel G. Catalano, Giorgio Grioli, and Lucia Pallottino

    image-20220519223821131

  10. Pick-and-place in dynamic environments with a mobile dual-arm robot equipped with distributed distance sensors Humanoids 2020

    Sotiris Stavridis, Pietro Falco and Zoe Doulgeri

    image-20220519223725544

  11. Discrete Bimanual Manipulation for Wrench Balancing ICRA 2020

    Silvia Cruciani, Diogo Almeida, Danica Kragic, and Yiannis Karayiannidis

    image-20220519214730920

  12. Dual-arm robotic needle insertion with active tissue deformation for autonomous suturing RA-L 2019

    Fangxun Zhong, Yaqing Wang, Zerui Wang, and Yun-Hui Liu

    image-20220519224558395
  13. Admittance control for collaborative dual-arm manipulation ICAR 2019

    Sonny Tarbouriech, Benjamin Navarro, Philippe Fraisse, Andre Crosnier , Andrea Cherubini and Damien Salle

    image-20220519224517767

  14. Finite-Time Convergence Adaptive Fuzzy Control for Dual-Arm Robot With Unknown Kinematics and Dynamics TFS 2019

    Chenguang Yang, Yiming Jiang, Jing Na, Zhijun Li, Long Cheng, and Chun-Yi Su

    image-20220519224652973
  15. Autonomous Dual-Arm Manipulation of Familiar Objects Humanoids 2018

    Dmytro Pavlichenko, Diego Rodriguez, Max Schwarz, Christian Lenz, Arul Selvam Periyasamy and Sven Behnke

    image-20220519224754307

  16. A Certified-Complete Bimanual Manipulation Planner T-ASE 2018

    Puttichai Lertkultanon and Quang-Cuong Pham

    image-20220519224909963
  17. Anthropomorphic, Compliant and Lightweight Dual Arm System for Aerial Manipulation IROS 2017

    Alejandro Suarez, Pablo Ramon Soria, Guillermo Heredia, Begoña C. Arrue, Anibal Ollero

    image-20220519225032463
  18. Neural control of bimanual robots with guaranteed global stability and motion precision TII 2016

    Chenguang Yang, Yiming Jiang, Zhijun Li, Wei He and Chun-Yi Su

    image-20220519225159775

  19. Adaptive Neural Control for Dual-Arm Coordination of Humanoid Robot With Unknown Nonlinearities in Output Mechanism IEEE TRANSACTIONS ON CYBERNETICS 2015

    Zhi Liu, Ci Chen, Yun Zhang, and C. L. P. Chen

    image-20220519225111652
  20. Bimanual grasp planning Humanoids 2011

    Nikolaus Vahrenkamp, Markus Przybylski, Tamim Asfour and Rudiger Dillmann

    image-20220606131132118

    image-20220519225321319

Telemanipulation

  1. Cooperative Manipulation of Deformable Objects by Single-Leader-Dual-Follower Teleoperation T-IE 2022

  2. Bimanual Telemanipulation with Force and Haptic Feedback and Predictive Limit Avoidance ECMR 2021

  3. Online Recognition of Bimanual Coordination Provides Important Context for Movement Data in Bimanual Teleoperated Robots IROS 2021

  4. Single Master Bimanual Teleoperation System With Efficient Regulation T-RO 2020

  5. Relative Impedance-Based Internal Force Control for Bimanual Robot Teleoperation With Varying Time Delay T-IE 2020

  6. Shared Autonomous Interface for Reducing Physical Effort in Robot Teleoperation via Human Motion Mapping ICRA 2020

  7. Shared-Control-Based Bimanual Robot Manipulation Science Robotics 2019 | video

    Daniel Rakita, Bilge Mutlu, Michael Gleicher, Laura M. Hiatt

    image-20220519220107212

  8. An Intuitive, Affordances Oriented Telemanipulation Framework for a Dual Robot Arm Hand System: On the Execution of Bimanual Tasks IROS 2019

  9. A wearable, ultralight interface for bimanual teleoperation of a compliant, whole-body-controlled humanoid robot ICRA 2019

  10. Adaptive Robust Control for Bimanual Cooperative Contact Teleoperation with Relative Jacobian Matrix Journal of Intelligent & Robotic Systems 2019

    Zhenyu Lu, Panfeng Huang, Ruizhou Cheng, Zhengxiong Liu, Zhongjie Meng

    image-20220519224413508

  11. Human-Robot Interaction Through Fingertip Haptic Devices for Cooperative Manipulation Tasks RO-MAN 2019

  12. Physical Fatigue Analysis of Assistive Robot Teleoperation via Whole-body Motion Mapping IROS 2019

  13. Shared-Autonomy Control for Intuitive Bimanual Tele-manipulation Humanoids 2018 (Dual panda)

Devices

End-effector

  1. Bimanual Handling of Deformable Objects With Hybrid Adhesion RA-L 2022

    Amy Kyungwon Han, Amar Hajj-Ahmad, and Mark R. Cutkosky

    image-20220520231334081

    image-20220519231040576

Application

TODO: Reclassification

Fold clothes

  1. Benchmarking Bimanual Cloth Manipulation RA-L 2020

  2. Dynamic cloth manipulation with deep reinforcement learning ICRA 2020

  3. Dimensionality reduction for dynamic movement primitives and application to bimanual manipulation of clothes T-RO 2018

  4. Bimanual robotic cloth manipulation for laundry folding IROS 2011

Assembly

  1. A survey of dual-arm robotic issues on assembly tasks Robot Design, Dynamics and Control, 2019

  2. Dual arm robot in cooperation with humans for flexible assembly 2017

  3. Bimanual Folding Assembly: Switched Control and Contact Point Estimation Humanoids 2016

    Diogo Almeida, Francisco E. Vina, Yiannis Karayiannidis

    image-20220519214835246
  4. Robotized assembly process using Dual arm robot 2014

  5. Dual Arm Peg-in-Hole Assembly with a Programmed Compliant System URAI 2014

  6. Intuitive dual arm robot programming for assembly operations 2014

Bin Packing

  1. A Framework for Robotic Bin Packing with a Dual-Arm Configuration Advances in Mechanism and Machine Science 2018

Exoskeletons

  1. A Dual Arm Haptic Exoskeleton for Dynamical Coupled Manipulation AIM 2021
  2. Human-inspired control of dual-arm exoskeleton robots with force and impedance adaptation T-SMC 2020
  3. Coordination Control of a Dual-Arm Exoskeleton Robot Using Human Impedance Transfer Skills T-SMC 2019
  4. Asymmetric bimanual control of dual-arm exoskeletons for human-cooperative manipulations T-RO 2018

Bio-medical

  1. Anthropomorphic Dual-Arm Coordinated Control for a Single-Port Surgical Robot Based on Dual-Step Optimization T-MRB 2022

Related platforms/simulators/labs

Platforms

  1. PR2

    pr2

  2. ABB YuMi

    ABB YuMi

  3. Rethink Baxter and Sawyer (Of course it's not dual-arm)

    baxter-sawyer

Simulators

  1. iGibson

    iGibson is a very realistic 3D home scene simulator, which consists of 15 fully interactive scenes and 500+ object models. But it might not be fully suitable for the bimanual manipulation.

    igibson