Image-guided surgical microscope with mounted minitracker

A new image-guided microscope using augmented reality overlays has been developed. Unlike other systems, the novelty of our design consists in mounting a precise mini and low-cost tracker directly on the microscope to track the motion of the surgical tools and the patient. Correctly scaled cut-views of the pre-operative computed tomography (CT) stack can be displayed on the overlay, orthogonal to the optical view or even including the direction of a clinical tool. Moreover, the system can manage three-dimensional models for tumours or bone structures and allows interaction with them using virtual tools, showing trajectories and distances. The mean error of the overlay was 0.7 mm. Clinical accuracy has shown results of 1.1-1.8 mm.

Comprehensive review and application of particle image velocimetry

For a fluid dynamics experimental flow measurement technique, particle image velocimetry (PIV) provides significant advantages over other measurement techniques in its field. In contrast to temperature and pressure based probe measurements or other laser diagnostic techniques including laser Doppler velocimetry (LDV) and phase Doppler particle analysis (PDPA), PIV is unique due to its whole field measurement capability, non-intrusive nature, and ability to collect a vast amount of experimental data in a short time frame providing both quantitative and qualitative insight. These properties make PIV a desirable measurement technique for studies encompassing a broad range of fluid dynamics applications. However, as an optical measurement technique, PIV also requires a substantial technical understanding and application experience to acquire consistent, reliable results. Both a technical understanding of particle image velocimetry and practical application experience are gained by applying a planar PIV system at Michigan Technological University’s Combustion Science Exploration Laboratory (CSEL) and Alternative Fuels Combustion Laboratory (AFCL). Here a PIV system was applied to non-reacting and reacting gaseous environments to make two component planar PIV as well as three component stereographic PIV flow field velocity measurements in conjunction with chemiluminescence imaging in the case of reacting flows. This thesis outlines near surface flow field characteristics in a tumble strip lined channel, three component velocity profiles of non-reacting and reacting swirled flow in a swirl stabilized lean condition premixed/prevaporized-fuel model gas turbine combustor operating on methane at 5-7 kW, and two component planar PIV measurements characterizing the AFCL’s 1.1 liter closed combustion chamber under dual fan driven turbulent mixing flow.

Calibration of a surgical microscope with automated zoom lenses using an active optical tracker

BACKGROUND: In this paper, we present a new method for the calibration of a microscope and its registration using an active optical tracker. METHODS: Practically, both operations are done simultaneously by moving an active optical marker within the field of view of the two devices. The IR LEDs composing the marker are first segmented from the microscope images. By knowing their corresponding three-dimensional (3D) position in the optical tracker reference system, it is possible to find the transformation matrix between the referential of the two devices. Registration and calibration parameters can be extracted directly from that transformation. In addition, since the zoom and focus can be modified by the surgeon during the operation, we propose a spline based method to update the camera model to the new setup. RESULTS: The proposed technique is currently being used in an augmented reality system for image-guided surgery in the fields of ear, nose and throat (ENT) and craniomaxillofacial surgeries. CONCLUSIONS: The results have proved to be accurate and the technique is a fast, dynamic and reliable way to calibrate and register the two devices in an OR environment.

Application of MFBD Algorithms to Image Reconstruction Under Anisoplanatic Conditions

All optical systems that operate in or through the atmosphere suffer from turbulence induced image blur. Both military and civilian surveillance, gun-sighting, and target identification systems are interested in terrestrial imaging over very long horizontal paths, but atmospheric turbulence can blur the resulting images beyond usefulness. My dissertation explores the performance of a multi-frame-blind-deconvolution technique applied under anisoplanatic conditions for both Gaussian and Poisson noise model assumptions. The technique is evaluated for use in reconstructing images of scenes corrupted by turbulence in long horizontal-path imaging scenarios and compared to other speckle imaging techniques. Performance is evaluated via the reconstruction of a common object from three sets of simulated turbulence degraded imagery representing low, moderate and severe turbulence conditions. Each set consisted of 1000 simulated, turbulence degraded images. The MSE performance of the estimator is evaluated as a function of the number of images, and the number of Zernike polynomial terms used to characterize the point spread function. I will compare the mean-square-error (MSE) performance of speckle imaging methods and a maximum-likelihood, multi-frame blind deconvolution (MFBD) method applied to long-path horizontal imaging scenarios. Both methods are used to reconstruct a scene from simulated imagery featuring anisoplanatic turbulence induced aberrations. This comparison is performed over three sets of 1000 simulated images each for low, moderate and severe turbulence-induced image degradation. The comparison shows that speckle-imaging techniques reduce the MSE 46 percent, 42 percent and 47 percent on average for low, moderate, and severe cases, respectively using 15 input frames under daytime conditions and moderate frame rates. Similarly, the MFBD method provides, 40 percent, 29 percent, and 36 percent improvements in MSE on average under the same conditions. The comparison is repeated under low light conditions (less than 100 photons per pixel) where improvements of 39 percent, 29 percent and 27 percent are available using speckle imaging methods and 25 input frames and 38 percent, 34 percent and 33 percent respectively for the MFBD method and 150 input frames. The MFBD estimator is applied to three sets of field data and the results presented. Finally, a combined Bispectrum-MFBD Hybrid estimator is proposed and investigated. This technique consistently provides a lower MSE and smaller variance in the estimate under all three simulated turbulence conditions.

High Resolution Image Correspondences for Video Post-Production

We present an algorithm for estimating dense image correspondences. Our versatile approach lends itself to various tasks typical for video post-processing, including image morphing, optical flow estimation, stereo rectification, disparity/depth reconstruction, and baseline adjustment. We incorporate recent advances in feature matching, energy minimization, stereo vision, and data clustering into our approach. At the core of our correspondence estimation we use Efficient Belief Propagation for energy minimization. While state-of-the-art algorithms only work on thumbnail-sized images, our novel feature downsampling scheme in combination with a simple, yet efficient data term compression, can cope with high-resolution data. The incorporation of SIFT (Scale-Invariant Feature Transform) features into data term computation further resolves matching ambiguities, making long-range correspondence estimation possible. We detect occluded areas by evaluating the correspondence symmetry, we further apply Geodesic matting to automatically determine plausible values in these regions.

Optical Indoor Positioning of Vehicles

Indoor positioning is the backbone of many advanced intra-logistic applications. As opposed to unified outdoor satellite positioning systems, there are many different technical approaches to indoor positioning. Depending on the application, there are different trade-offs between accuracy, range, and costs. In this paper we present a new concept for a 4-degree-of-freedom (4-DOF) positioning system to be used for vehicle tracing in a logistic facility. The system employs optical data transmission between active infrastructure and receiver devices. Compared to existing systems, these optical technologies promise to achieve better accuracy at lower costs. We will introduce the positioning algorithm and an experimental setup of the system.

Augmented environments for the targeting of hepatic lesions during image-guided robotic liver surgery

BACKGROUND Stereotactic navigation technology can enhance guidance during surgery and enable the precise reproduction of planned surgical strategies. Currently, specific systems (such as the CAS-One system) are available for instrument guidance in open liver surgery. This study aims to evaluate the implementation of such a system for the targeting of hepatic tumors during robotic liver surgery. MATERIAL AND METHODS Optical tracking references were attached to one of the robotic instruments and to the robotic endoscopic camera. After instrument and video calibration and patient-to-image registration, a virtual model of the tracked instrument and the available three-dimensional images of the liver were displayed directly within the robotic console, superimposed onto the endoscopic video image. An additional superimposed targeting viewer allowed for the visualization of the target tumor, relative to the tip of the instrument, for an assessment of the distance between the tumor and the tool for the realization of safe resection margins. RESULTS Two cirrhotic patients underwent robotic navigated atypical hepatic resections for hepatocellular carcinoma. The augmented endoscopic view allowed for the definition of an accurate resection margin around the tumor. The overlay of reconstructed three-dimensional models was also used during parenchymal transection for the identification of vascular and biliary structures. Operative times were 240 min in the first case and 300 min in the second. There were no intraoperative complications. CONCLUSIONS The da Vinci Surgical System provided an excellent platform for image-guided liver surgery with a stable optic and instrumentation. Robotic image guidance might improve the surgeon's orientation during the operation and increase accuracy in tumor resection. Further developments of this technological combination are needed to deal with organ deformation during surgery.

Retinal Laser Lesion Visibility in Simultaneous Ultra-High Axial Resolution Optical Coherence Tomography

Ex vivo porcine retina laser lesions applied with varying laser power (20 mW–2 W, 10 ms pulse, 196 lesions) are manually evaluated by microscopic and optical coherence tomography (OCT) visibility, as well as in histological sections immediately after the deposition of the laser energy. An optical coherence tomography system with 1.78 um axial resolution specifically developed to image thin retinal layers simultaneously to laser therapy is presented, and visibility thresholds of the laser lesions in OCT data and fundus imaging are compared. Optical coherence tomography scans are compared with histological sections to estimate the resolving power for small optical changes in the retinal layers, and real-time time-lapse scans during laser application are shown and analyzed quantitatively. Ultrahigh-resolution OCT inspection features a lesion visibility threshold 40–50 mW (17 reduction) lower than for visual inspection. With the new measurement system, 42 of the lesions that were invisible using state-of-the-art ophthalmoscopic methods could be detected.

Effect of irradiation distance on image contrast in epi-optoacoustic imaging of human volunteers

In combined clinical optoacoustic (OA) and ultrasound (US) imaging, epi-mode irradiation and detection integrated into one single probe offers flexible imaging of the human body. The imaging depth in epi-illumination is, however, strongly affected by clutter. As shown in previous phantom experiments, the location of irradiation plays an important role in clutter generation. We investigated the influence of the irradiation geometry on the local image contrast of clinical images, by varying the separation distance between the irradiated area and the acoustic imaging plane of a linear ultrasound transducer in an automated scanning setup. The results for different volunteers show that the image contrast can be enhanced on average by 25% and locally by more than a factor of two, when the irradiated area is slightly separated from the probe. Our findings have an important impact on the design of future optoacoustic probes for clinical application.

Automatic estimation of noise parameters in Fourier-domain optical coherence tomography cross sectional images using statistical information

We present an application and sample independent method for the automatic discrimination of noise and signal in optical coherence tomography Bscans. The proposed algorithm models the observed noise probabilistically and allows for a dynamic determination of image noise parameters and the choice of appropriate image rendering parameters. This overcomes the observer variability and the need for a priori information about the content of sample images, both of which are challenging to estimate systematically with current systems. As such, our approach has the advantage of automatically determining crucial parameters for evaluating rendered image quality in a systematic and task independent way. We tested our algorithm on data from four different biological and nonbiological samples (index finger, lemon slices, sticky tape, and detector cards) acquired with three different experimental spectral domain optical coherence tomography (OCT) measurement systems including a swept source OCT. The results are compared to parameters determined manually by four experienced OCT users. Overall, our algorithm works reliably regardless of which system and sample are used and estimates noise parameters in all cases within the confidence interval of those found by observers.

Enhanced-depth optical coherence tomography for imaging horizontal rectus muscles in Graves' orbitopathy.

PURPOSE Graves' orbitopathy (GO) is an extraocular eye disease with symptoms ranging from minor discomfort from dry eyes to strabismus and visual loss. One of the hallmarks of active GO is visible hyperemia at the insertion of the extraocular muscles. The aim of the present study was to evaluate the use of enhanced-depth imaging spectral domain anterior segment optical coherence tomography (EDI SD AS-OCT) for detecting pathological changes in horizontal recti muscles of patients with GO. METHODS Prospective cross sectional study of 27 eyes. Only women were included. EDI AS-OCT was used to measure the thickness of the tendons of the horizontal recti muscles in a predefined area in patients with GO and healthy controls. RESULTS EDI AS-OCT was able to image the tendons of the horizontal recti muscles in both healthy controls and patients suffering from GO. The mean thickness of the medial rectus muscle (MR) tendon was 256.4 μm [±17.13 μm standard deviation (SD)] in the GO group and, therefore, significantly thicker (p = 0.046) than in the healthy group which had a mean thickness of 214.7 μm (±5.516 μm SD). There was no significant difference in the mean thickness of the tendon of the lateral recti muscles (LRs) between these groups. CONCLUSION This is the first report showing that EDI AS-OCT is suitable to detect swelling at the insertion site of the MR muscle in GO. MR tendon thickness may be a useful parameter to monitor activity in these patients.

Streak detection algorithm for space debris detection on optical images.

Any image processing object detection algorithm somehow tries to integrate the object light (Recognition Step) and applies statistical criteria to distinguish objects of interest from other objects or from pure background (Decision Step). There are various possibilities how these two basic steps can be realized, as can be seen in the different proposed detection methods in the literature. An ideal detection algorithm should provide high recognition sensitiv ity with high decision accuracy and require a reasonable computation effort . In reality, a gain in sensitivity is usually only possible with a loss in decision accuracy and with a higher computational effort. So, automatic detection of faint streaks is still a challenge. This paper presents a detection algorithm using spatial filters simulating the geometrical form of possible streaks on a CCD image. This is realized by image convolution. The goal of this method is to generate a more or less perfect match between a streak and a filter by varying the length and orientation of the filters. The convolution answers are accepted or rejected according to an overall threshold given by the ackground statistics. This approach yields as a first result a huge amount of accepted answers due to filters partially covering streaks or remaining stars. To avoid this, a set of additional acceptance criteria has been included in the detection method. All criteria parameters are justified by background and streak statistics and they affect the detection sensitivity only marginally. Tests on images containing simulated streaks and on real images containing satellite streaks show a very promising sensitivity, reliability and running speed for this detection method. Since all method parameters are based on statistics, the true alarm, as well as the false alarm probability, are well controllable. Moreover, the proposed method does not pose any extraordinary demands on the computer hardware and on the image acquisition process.