daVinci Surgical Robot Robot Research System (dVRK)

The daVinci Research Kit (dVRK) robot has been provided by Intuitive Surgical. It consists of a surgeon's console for the surgeon to tele-operate the surgery and a patient side console where the actual surgery takes place. The surgeon's console consists of two Master Tool Manipulators (MTM), each having 8 DOF for dexterous and natural hand manipulation, and a foot-pedal tray. On the other side at the patient's end, there are two Patient Side Manipulators (PSM), which are controlled by the MTMs with coordinated foot-pedal movements. We are using custom hardware to develop an interface between the two consoles. The hardware consists of motor-controllers, couple with FPGA's and hooked with fire-wire interface to connect with a PC running the control loops. On the PC, the Surgical Assistant Workstation (SAW) framework is used to process the data and the control law in implemented in the framework itself.

We have developed working models of the dVRK components in simulation software including RViz, Gazebo and Open Rave. To control these models, we developed ROS interfaces with the SAW/Cisst Libraries. We are capable of controlling joint positions, joint velocities, joint torques and end effector transforms using ROS protocols, while at the same time retrieving the values of this parameters from the dVRK as well.

We have implemented several motion planning algorithms to guide the PSMs and MTMs around obstacles. In one demonstration we have made the robot plan motion around phantom livers and hearts bot in simulation and on real hardware. The control of the PSMs has been simplified from the traditional actuation through MTMs to a much easier and more convenient graphical user interface in ROS. A user can just drag and play around with the simulated MTM/PSM in RViz to make the actual PSM/MTM follow through. Additionally, we are implementing haptic feedback on the MTMs from the wrenches encountered at the PSMs. As part of this work we have been modeling the arm dynamics in Gazebo.

daVinci Robot Research System

This work is a collaborative project with Johns Hopkins University, Intuitive Surgical, and various other research sites now hosting the dVRK. Please see more about the community here:
http://research.intusurg.com/dvrkwiki/

Much of the software developed by the team is available open source, and may be found on GitHub:
https://github.com/jhu-dvrk

Related Publications

  1. Munawar A, Srishankar B, Fichera L, Fischer GS, A Parametric Grasping Methodology for Multi-Manual Interactions in Real-Time Dynamic Simulations, IEEE International Conference on Robotics and Automation - IROS 2020, Paris, France, May 2020. (Accepted) IEEE
  2. Gondokaryono RA, Agrawal A, Munawar A, Nycz CJ, Fischer GS, An Approach to Modeling Closed-Loop Kinematic Chain Mechanisms, applied to Simulations of the da Vinci Surgical System, Special Issue on Platforms for Robotics Research - Acta Polytechnica Hungarica, Vol 16, No 8, pp 29-48, Nov 2019. Journal ToC, PDF
  3. Munawar A, Gondokaryono R, Wang Y, Fischer GS, A Real-Time Dynamic Simulator and an Associated Front-End Representation Format for Simulating Complex Robots and Environments, IEEE/RSJ International Conference on Intelligent Robots and Systems - IROS 2019, Macau, China, Nov 2019. (Best Application paper Award Finalist) (In Press) IEEE
  4. Munawar A, Fischer GS, An Asynchronous Multi-Body Simulation Framework for Real-Time Dynamics, Haptics and Learning with Application to Surgical Robots, IEEE/RSJ International Conference on Intelligent Robots and Systems - IROS 2019, Macau, China, Nov 2019. (In Press) IEEE
  5. Wang Y, Gondokaryono RA, Munawar A, Fischer GS, A Convex Optimization-based Dynamic Model Identification Package for the da Vinci Research Kit, IEEE Robotics and Automation Letters (RA-L), Vol 4, No 4, Oct 2019. IEEE
  6. Munawar A, Fischer GS, Towards a haptic feedback framework for multi-DOF robotic laparoscopic surgery platforms, IEEE/RSJ International Conference on Intelligent Robots and Systems - IROS 2016, Deajeon, Korea, pp 1113-1118, Oct 2016. IEEE
  7. Munawar A, Fischer GS, A Surgical Robot Teleoperation Framework for Providing Haptic Feedback Incorporating Virtual Environment-Based Guidance, Frontiers in Robotics and AI, Vol 3, No 47, pp 1-15, Aug 2016. Frontiers
  8. Chen Z, Deguet A, Vozar S, Munawar A, Fischer GS, Kazanzides P, Interfacing the da Vinci Research Kit (dVRK) with the Robot Operating System (ROS), Workshop on Shared Frameworks for Medical Robotics Research, International Conference on Robotics and Automation - ICRA 2015, Seattle, WA, USA, May 2015. ICRA
  9. Zhang Z, Munawar A, Fischer GS, Implementation of a Motion Planning Framework for the daVinci Surgical System Research Kit (dVRK), Hamlyn Symposium on Medical Robotics - HSMR 2014, London, United Kingdom, July 2014. PDF
  10. Kazanzides P, Chen Z, Deguet A, Fischer GS, Taylor RH, DiMaio SP, An Open-Source Research Kit for the da Vinci Surgical System, International Conference on Robotics and Automation - ICRA 2014, May 2014. IEEE, PDF
  11. Chen Z, Deguet A, Taylor RH, DiMaio SP, Fischer GS, Kazanzides P, An Open-Source Hardware and Software Platform for Telesurgical Robotics Research, The MIDAS Journal - Systems and Architectures for Computer Assisted Interventions 2013, June 2013. MIDAS