Task 1.2: Intraoperative Sensing and Visualization
 

The second task in Thrust 1 is Task 1.2: Intraoperative Sensing and Visualization. Here, we are developing techniques for high-performance tracking of instruments in video images and surgical devices that integrate force-sensing and manipulation capabilities. Initial work on the video aspect has resulted in tracking technology undergoing commercial licensing, software for real-time video mosaicing under non-rigid deformation, and a demonstration of real-time tracking of deforming surfaces in stereo endoscope or microscope image sequences. Partial funding to support this work has been secured through Intuitive Surgical, and proposals for additional funding have been submitted to DoD and NSF. We have also initiated work on very compact, high-resolution ultrasound systems, and have a STTR grant with Intuitive Surgical for laparoscopic ultrasound. Force sensor development for microsurgery has also continued, following the original prototypes developed by Berkelman and Whitcomb. This work has now moved to CMU under the direction of Riviere. Thakor at JHU has developed a new method, based on laser speckle, for imaging blood flow in small vessels. For minimally invasive surgery, Okamuras group at JHU has developed force-sensing surgical instruments that can be integrated with the Telemanipulation testbed.

Thrust 1: Surgical Assistants

Strategy & Overview
Task 1.1
Task 1.2
Task 1.3
Task 1.4




Thrust 2: Surgical CAD/CAM

Strategy & Overview
Task 2.1
Task 2.2
Task 2.3
Task 2.4
Task 2.5





Thrust 0: Infrastructure

Strategy & Overview