A Portable Image Overlay Projection Device for Computer-Aided Open Liver Surgery

Image overlay projection is a form of augmented reality that allows surgeons to view underlying anatomical structures directly on the patient surface. It improves intuitiveness of computer-aided surgery by removing the need for sight diversion between the patient and a display screen and has been reported to assist in 3-D understanding of anatomical structures and the identification of target and critical structures. Challenges in the development of image overlay technologies for surgery remain in the projection setup. Calibration, patient registration, view direction, and projection obstruction remain unsolved limitations to image overlay techniques. In this paper, we propose a novel, portable, and handheld-navigated image overlay device based on miniature laser projection technology that allows images of 3-D patient-specific models to be projected directly onto the organ surface intraoperatively without the need for intrusive hardware around the surgical site. The device can be integrated into a navigation system, thereby exploiting existing patient registration and model generation solutions. The position of the device is tracked by the navigation system’s position sensor and used to project geometrically correct images from any position within the workspace of the navigation system. The projector was calibrated using modified camera calibration techniques and images for projection are rendered using a virtual camera defined by the projectors extrinsic parameters. Verification of the device’s projection accuracy concluded a mean projection error of 1.3 mm. Visibility testing of the projection performed on pig liver tissue found the device suitable for the display of anatomical structures on the organ surface. The feasibility of use within the surgical workflow was assessed during open liver surgery. We show that the device could be quickly and unobtrusively deployed within the sterile environment.

Fiberoptic system for recording dendritic calcium signals in layer 5 neocortical pyramidal cells in freely moving rats

Calcium influx into the dendritic tufts of layer 5 neocortical pyramidal neurons modifies a number of important cellular mechanisms. It can trigger local synaptic plasticity and switch the firing properties from regular to burst firing. Due to methodological limitations, our knowledge about Ca2+ spikes in the dendritic tuft stems mostly from in vitro experiments. However, it has been speculated that regenerative Ca2+ events in the distal dendrites correlate with distinct behavioral states. Therefore it would be most desirable to be able to record these Ca2+ events in vivo, preferably in the behaving animal. Here, we present a novel approach for recording Ca2+ signals in the dendrites of populations of layer 5 pyramidal neurons in vivo, which ensures that all recorded fluorescence changes are due to intracellular Ca2+ signals in the apical dendrites. The method has two main features: 1) bolus loading of layer 5 with a membrane-permeant Ca2+ dye resulting in specific loading of pyramidal cell dendrites in the upper layers and 2) a fiberoptic cable attached to a gradient index lens and a prism reflecting light horizontally at 90 degrees to the angle of the apical dendrites. We demonstrate that the in vivo signal-to-noise ratio recorded with this relatively inexpensive and easy-to-implement fiberoptic-based device is comparable to conventional camera-based imaging systems used in vitro. In addition, the device is flexible and lightweight and can be used for recording Ca2+ signals in the distal dendritic tuft of freely behaving animals.

Impact of a self-developed planning and self-constructed navigation system on skull base surgery: 10 years experience

CONCLUSION: Our self-developed planning and navigation system has proven its capacity for accurate surgery on the anterior and lateral skull base. With the incorporation of augmented reality, image-guided surgery will evolve into 'information-guided surgery'. OBJECTIVE: Microscopic or endoscopic skull base surgery is technically demanding and its outcome has a great impact on a patient's quality of life. The goal of the project was aimed at developing and evaluating enabling navigation surgery tools for simulation, planning, training, education, and performance. This clinically applied technological research was complemented by a series of patients (n=406) who were treated by anterior and lateral skull base procedures between 1997 and 2006. MATERIALS AND METHODS: Optical tracking technology was used for positional sensing of instruments. A newly designed dynamic reference base with specific registration techniques using fine needle pointer or ultrasound enables the surgeon to work with a target error of < 1 mm. An automatic registration assessment method, which provides the user with a color-coded fused representation of CT and MR images, indicates to the surgeon the location and extent of registration (in)accuracy. Integration of a small tracker camera mounted directly on the microscope permits an advantageous ergonomic way of working in the operating room. Additionally, guidance information (augmented reality) from multimodal datasets (CT, MRI, angiography) can be overlaid directly onto the surgical microscope view. The virtual simulator as a training tool in endonasal and otological skull base surgery provides an understanding of the anatomy as well as preoperative practice using real patient data. RESULTS: Using our navigation system, no major complications occurred in spite of the fact that the series included difficult skull base procedures. An improved quality in the surgical outcome was identified compared with our control group without navigation and compared with the literature. The surgical time consumption was reduced and more minimally invasive approaches were possible. According to the participants' questionnaires, the educational effect of the virtual simulator in our residency program received a high ranking.

Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

Gait analysis in normal and spinal contused mice using the TreadScan system

Advances in spinal cord injury (SCI) research are dependent on quality animal models, which in turn rely on sensitive outcome measures able to detect functional differences in animals following injury. To date, most measurements of dysfunction following SCI rely either on the subjective rating of observers or the slow throughput of manual gait assessment. The present study compares the gait of normal and contusion-injured mice using the TreadScan system. TreadScan utilizes a transparent treadmill belt and a high-speed camera to capture the footprints of animals and automatically analyze gait characteristics. Adult female C57Bl/6 mice were introduced to the treadmill prior to receiving either a standardized mild, moderate, or sham contusion spinal cord injury. TreadScan gait analyses were performed weekly for 10 weeks and compared with scores on the Basso Mouse Scale (BMS). Results indicate that this software successfully differentiates sham animals from injured animals on a number of gait characteristics, including hindlimb swing time, stride length, toe spread, and track width. Differences were found between mild and moderate contusion injuries, indicating a high degree of sensitivity within the system. Rear track width, a measure of the animal's hindlimb base of support, correlated strongly both with spared white matter percentage and with terminal BMS. TreadScan allows for an objective and rapid behavioral assessment of locomotor function following mild-moderate contusive SCI, where the majority of mice still exhibit hindlimb weight support and plantar paw placement during stepping.

The new CMOS Tracking Camera used at the Zimmerwald Observatory

During the last years the use of tracking cameras for SLR observations became less important due to the high accuracy of the predicted orbits. Upcoming new targets like satellites in eccentric orbits and space debris objects, however, require tracking cameras again. In 2013 the interline CCD camera was replaced at the Zimmerwald Observatory with a so called scientific CMOS camera. This technology promises a better performance for this application than all kinds of CCD cameras. After the comparison of the different technologies the focus will be on the integration in the Zimmerwald SLR system.