Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

Calibration of a surgical microscope with automated zoom lenses using an active optical tracker

BACKGROUND: In this paper, we present a new method for the calibration of a microscope and its registration using an active optical tracker. METHODS: Practically, both operations are done simultaneously by moving an active optical marker within the field of view of the two devices. The IR LEDs composing the marker are first segmented from the microscope images. By knowing their corresponding three-dimensional (3D) position in the optical tracker reference system, it is possible to find the transformation matrix between the referential of the two devices. Registration and calibration parameters can be extracted directly from that transformation. In addition, since the zoom and focus can be modified by the surgeon during the operation, we propose a spline based method to update the camera model to the new setup. RESULTS: The proposed technique is currently being used in an augmented reality system for image-guided surgery in the fields of ear, nose and throat (ENT) and craniomaxillofacial surgeries. CONCLUSIONS: The results have proved to be accurate and the technique is a fast, dynamic and reliable way to calibrate and register the two devices in an OR environment.

Semi-automatic segmentation of fetal cardiac cavities: progress towards an automated fetal echocardiogram

OBJECTIVE: To develop a novel application of a tool for semi-automatic volume segmentation and adapt it for analysis of fetal cardiac cavities and vessels from heart volume datasets. METHODS: We studied retrospectively virtual cardiac volume cycles obtained with spatiotemporal image correlation (STIC) from six fetuses with postnatally confirmed diagnoses: four with normal hearts between 19 and 29 completed gestational weeks, one with d-transposition of the great arteries and one with hypoplastic left heart syndrome. The volumes were analyzed offline using a commercially available segmentation algorithm designed for ovarian folliculometry. Using this software, individual 'cavities' in a static volume are selected and assigned individual colors in cross-sections and in 3D-rendered views, and their dimensions (diameters and volumes) can be calculated. RESULTS: Individual segments of fetal cardiac cavities could be separated, adjacent segments merged and the resulting electronic casts studied in their spatial context. Volume measurements could also be performed. Exemplary images and interactive videoclips showing the segmented digital casts were generated. CONCLUSION: The approach presented here is an important step towards an automated fetal volume echocardiogram. It has the potential both to help in obtaining a correct structural diagnosis, and to generate exemplary visual displays of cardiac anatomy in normal and structurally abnormal cases for consultation and teaching.

Pupil phase apodization for achromatic imaging of extra-solar planets

Direct imaging of extra-solar planets in the visible and infrared region has generated great interest among scientists and the general public as well. However, this is a challenging problem. Diffculties of detecting a planet (faint source) are caused, mostly, by two factors: sidelobes caused by starlight diffraction from the edge of the pupil and the randomly scattered starlight caused by the phase errors from the imperfections in the optical system. While the latter diffculty can be corrected by high density active deformable mirrors with advanced phase sensing and control technology, the optimized strategy for suppressing the diffraction sidelobes is still an open question. In this thesis, I present a new approach to the sidelobe reduction problem: pupil phase apodization. It is based on a discovery that an anti-symmetric spatial phase modulation pattern imposed over a pupil or a relay plane causes diffracted starlight suppression sufficient for imaging of extra-solar planets. Numerical simulations with specific square pupil (side D) phase functions, such as ... demonstrate annulling in at least one quadrant of the diffraction plane to the contrast level of better than 10^12 with an inner working angle down to 3.5L/D (with a = 3 and e = 10^3). Furthermore, our computer experiments show that phase apodization remains effective throughout a broad spectrum (60% of the central wavelength) covering the entire visible light range. In addition to the specific phase functions that can yield deep sidelobe reduction on one quadrant, we also found that a modified Gerchberg-Saxton algorithm can help to find small sized (101 x 101 element) discrete phase functions if regional sidelobe reduction is desired. Our simulation shows that a 101x101 segmented but gapless active mirror can also generate a dark region with Inner Working Distance about 2.8L/D in one quadrant. Phase-only modulation has the additional appeal of potential implementation via active segmented or deformable mirrors, thereby combining compensation of random phase aberrations and diffraction halo removal in a single optical element.

DEVELOPMENT OF CONFOCAL IMAGING TECHNIQUES FOR PROBING INTERFACIAL DYNAMICS IN MICROSCALE, GAS-LIQUID, TWO-PHASE FLOW

Micro-scale, two-phase flow is found in a variety of devices such as Lab-on-a-chip, bio-chips, micro-heat exchangers, and fuel cells. Knowledge of the fluid behavior near the dynamic gas-liquid interface is required for developing accurate predictive models. Light is distorted near a curved gas-liquid interface preventing accurate measurement of interfacial shape and internal liquid velocities. This research focused on the development of experimental methods designed to isolate and probe dynamic liquid films and measure velocity fields near a moving gas-liquid interface. A high-speed, reflectance, swept-field confocal (RSFC) imaging system was developed for imaging near curved surfaces. Experimental studies of dynamic gas-liquid interface of micro-scale, two-phase flow were conducted in three phases. Dynamic liquid film thicknesses of segmented, two-phase flow were measured using the RSFC and compared to a classic film thickness deposition model. Flow fields near a steadily moving meniscus were measured using RSFC and particle tracking velocimetry. The RSFC provided high speed imaging near the menisci without distortion caused the gas-liquid interface. Finally, interfacial morphology for internal two-phase flow and droplet evaporation were measured using interferograms produced by the RSFC imaging technique. Each technique can be used independently or simultaneously when.

BYOD: Moving toward a More Mobile and Productive Workforce

In recent years there has been a personal and organizational trend toward mobility and the use of mobile technologies such as laptops, mobile phones and tablets. With this proliferation of devices, the desire to combine as many functions as possible into one device has also arisen. This concept is commonly called convergence. Generally, device convergence has been segmented between devices for work and devices for home use. Recently, however, the concept of Bring Your Own Device (BYOD) has emerged as organizations attempt to bridge the work/home divide in hopes of increasing employee productivity and reducing corporate technology costs. This paper examines BYOD projects at IBM, Cisco, Citrix, and Intel and then integrates this analysis with current literature to develop and present a BYOD Implementation Success model.

A Stereoscopic Volume Rendered Brain Atlas

The anatomy of the human brain is organized as a complex arrangement of interrelated structures in three dimensional space. To facilitate the understanding of both structure and function, we have created a volume rendered brain atlas (VRBA) with an intuitive interface that allows real-time stereoscopic rendering of brain anatomy. The VRBA incorporates 2-dimensional and 3-dimensional texture mapping to display segmented brain anatomy co-registered with a T1 MRI. The interface allows the user to remove and add any of the 62 brain structures, as well as control the display of the MRI dataset. The atlas also contains brief verbal and written descriptions of the different anatomical regions to correlate structure with function. A variety of stereoscopic projection methods are supported by the VRBA and provide an abstract, yet simple, way of visualizing brain anatomy and 3-dimensional relationships between different nuclei.

Advanced luminance control and black offset correction for multi-projector display systems

In order to display a homogeneous image using multiple projectors, differences in the projected intensities must be compensated. In this paper, we present novel approaches to combine and extend existing techniques for edge blending and luminance harmonization to achieve a detailed luminance control. Furthermore, we apply techniques for improving the contrast ratio of multi-segmented displays also to the black offset correction. We also present a simple scheme to involve the displayed context in the correction process to dynamically improve the contrast in brighter images. In addition, we present a metric to evaluate the different methods and their influence on the visual quality.

Monitoring the Time Course of Perception without Awareness: A Comparison of Mirror Masked Words and Nonwords

Mirror masked words are embedded into a context that makes them appear as senseless patterns or as strings of unfamiliar letters. Thus, mirror masked words can be shown for several hundreds of milliseconds without being recognised as words. We sought to further investigate effects of nonsconscious reading by monitoring event-related brain potentials (ERPs) while participants observed mirror masked letter strings. ERPs were recorded while participants observed mirror masked words and nonwords. Data of 15 participants was segmented into periods of quasi-stable field topography (microstates). Microstates for masked words and nonwords were compared using randomization tests, statistical parametric scalp maps and Low Resolution Electromagnetic Tomography (LORETA). ERPs to masked words and nonwords showed significant topographic differences between 136 and 256 ms, indicating that stimuli were nonconsciously discriminated. A LORETA model localised sources of activation discriminating between masked words and nonwords in left operculum, the right superior parietal lobe and right superior temporal gyrus indicating higher current density for nonwords than for words in these areas. ERPs of mirror masked stimuli can indicate unconscious discrimination even in cases where behavioural priming is unreliable. This approach might be useful for investigating differences in early, nonconscious stages of word perception.

Prestimulus EEG microstates influence visual event-related potential microstates in field maps with 47 channels

The influence of the immediate prestimulus EEG microstate (sub-second epoch of stable topography/map landscape) on the map landscape of visually evoked 47-channel event-related potential (ERP) microstates was examined using the frequent, non-target stimuli of a cognitive paradigm (12 volunteers). For the two most frequent prestimulus microstate classes (oriented left anterior-right posterior and right anterior-left posterior), ERP map series were selectively averaged. The post-stimulus ERP grand average map series was segmented into microstates; 10 were found. The centroid locations of positive and negative map areas were extracted as landscape descriptors. Significant differences (MANOVAs and t-tests) between the two prestimulus classes were found in four of the ten ERP microstates. The relative orientation of the two ERP microstate classes was the same as prestimulus in some ERP microstates, but reversed in others. — Thus, brain electric microstates at stimulus arrival influence the landscapes of the post-stimulus ERP maps and therefore, information processing; prestimulus microstate effects differed for different post-stimulus ERP microstates.

Brain electric microstates and momentary conscious mind states as building blocks of spontaneous thinking: I. Visual imagery and abstract thoughts

Prompted reports of recall of spontaneous, conscious experiences were collected in a no-input, no-task, no-response paradigm (30 random prompts to each of 13 healthy volunteers). The mentation reports were classified into visual imagery and abstract thought. Spontaneous 19-channel brain electric activity (EEG) was continuously recorded, viewed as series of momentary spatial distributions (maps) of the brain electric field and segmented into microstates, i.e. into time segments characterized by quasi-stable landscapes of potential distribution maps which showed varying durations in the sub-second range. Microstate segmentation used a data-driven strategy. Different microstates, i.e. different brain electric landscapes must have been generated by activity of different neural assemblies and therefore are hypothesized to constitute different functions. The two types of reported experiences were associated with significantly different microstates (mean duration 121 ms) immediately preceding the prompts; these microstates showed, across subjects, for abstract thought (compared to visual imagery) a shift of the electric gravity center to the left and a clockwise rotation of the field axis. Contrariwise, the microstates 2 s before the prompt did not differ between the two types of experiences. The results support the hypothesis that different microstates of the brain as recognized in its electric field implement different conscious, reportable mind states, i.e. different classes (types) of thoughts (mentations); thus, the microstates might be candidates for the `atoms of thought'.

Quantification of Popliteal Artery Deformation During Leg Flexion in Subjects With Peripheral Artery Disease: A Pilot Study

Purpose: To quantify the in vivo deformations of the popliteal artery during leg flexion in subjects with clinically relevant peripheral artery disease (PAD). Methods: Five patients (4 men; mean age 69 years, range 56–79) with varying calcification levels of the popliteal artery undergoing endovascular revascularization underwent 3-dimensional (3D) rotational angiography. Image acquisition was performed with the leg straight and with a flexion of 70°/20° in the knee/hip joints. The arterial centerline and the corresponding branches in both positions were segmented to create 3D reconstructions of the arterial trees. Axial deformation, twisting, and curvatures were quantified. Furthermore, the relationships between the calcification levels and the deformations were investigated. Results: An average shortening of 5.9%±2.5% and twist rate of 3.8±2.2°/cm in the popliteal artery were observed. Maximal curvatures in the straight and flexed positions were 0.12±0.04 cm−1 and 0.24±0.09 cm−1, respectively. As the severity of calcification increased, the maximal curvature in the straight position increased from 0.08 to 0.17 cm−1, while an increase from 0.17 to 0.39 cm−1 was observed for the flexed position. Axial elongations and arterial twisting were not affected by the calcification levels. Conclusion: The popliteal artery of patients with symptomatic PAD is exposed to significant deformations during flexion of the knee joint. The severity of calcification directly affects curvature, but not arterial length or twisting angles. This pilot study also showed the ability of rotational angiography to quantify the 3D deformations of the popliteal artery in patients with various levels of calcification.

In vitro accuracy evaluation of image-guided robot system for direct cochlear access

HYPOTHESIS A previously developed image-guided robot system can safely drill a tunnel from the lateral mastoid surface, through the facial recess, to the middle ear, as a viable alternative to conventional mastoidectomy for cochlear electrode insertion. BACKGROUND Direct cochlear access (DCA) provides a minimally invasive tunnel from the lateral surface of the mastoid through the facial recess to the middle ear for cochlear electrode insertion. A safe and effective tunnel drilled through the narrow facial recess requires a highly accurate image-guided surgical system. Previous attempts have relied on patient-specific templates and robotic systems to guide drilling tools. In this study, we report on improvements made to an image-guided surgical robot system developed specifically for this purpose and the resulting accuracy achieved in vitro. MATERIALS AND METHODS The proposed image-guided robotic DCA procedure was carried out bilaterally on 4 whole head cadaver specimens. Specimens were implanted with titanium fiducial markers and imaged with cone-beam CT. A preoperative plan was created using a custom software package wherein relevant anatomical structures of the facial recess were segmented, and a drill trajectory targeting the round window was defined. Patient-to-image registration was performed with the custom robot system to reference the preoperative plan, and the DCA tunnel was drilled in 3 stages with progressively longer drill bits. The position of the drilled tunnel was defined as a line fitted to a point cloud of the segmented tunnel using principle component analysis (PCA function in MatLab). The accuracy of the DCA was then assessed by coregistering preoperative and postoperative image data and measuring the deviation of the drilled tunnel from the plan. The final step of electrode insertion was also performed through the DCA tunnel after manual removal of the promontory through the external auditory canal. RESULTS Drilling error was defined as the lateral deviation of the tool in the plane perpendicular to the drill axis (excluding depth error). Errors of 0.08 ± 0.05 mm and 0.15 ± 0.08 mm were measured on the lateral mastoid surface and at the target on the round window, respectively (n =8). Full electrode insertion was possible for 7 cases. In 1 case, the electrode was partially inserted with 1 contact pair external to the cochlea. CONCLUSION The purpose-built robot system was able to perform a safe and reliable DCA for cochlear implantation. The workflow implemented in this study mimics the envisioned clinical procedure showing the feasibility of future clinical implementation.

Topographic bone thickness maps for Bonebridge implantations.

Bonebridge™ (BB) implantation relies on optimal anchoring of the bone-conduction implant in the temporal bone. Preoperative position planning has to account for the available bone thickness minimizing unwanted interference with underlying anatomical structures. This study describes the first clinical experience with a planning method based on topographic bone thickness maps (TBTM) for presigmoid BB implantations. The temporal bone was segmented enabling three-dimensional surface generation. Distances between the external and internal surface were color encoded and mapped to a TBTM. Suitable implant positions were planned with reference to the TBTM. Surgery was performed according to the standard procedure (n = 7). Computation of the TBTM and consecutive implant position planning took 70 min on average for a trained technician. Surgical time for implantations under passive TBTM image guidance was 60 min, on average. The sigmoid sinus (n = 5) and dura mater (n = 1) were exposed, as predicted with the TBTM. Feasibility of the TBTM method was shown for standard presigmoid BB implantations. The projection of three-dimensional bone thickness information into a single topographic map provides the surgeon with an intuitive display of the anatomical situation prior to implantation. Nevertheless, TBTM generation time has to be significantly reduced to simplify integration in clinical routine.

Insular and caudate lesions release abnormal yawning in stroke patients.

Abnormal yawning is an underappreciated phenomenon in patients with ischemic stroke. We aimed at identifying frequently affected core regions in the supratentorial brain of stroke patients with abnormal yawning and contributing to the anatomical network concept of yawning control. Ten patients with acute anterior circulation stroke and ≥3 yawns/15 min without obvious cause were analyzed. The NIH stroke scale (NIHSS), Glasgow Coma Scale (GCS), symptom onset, period with abnormal yawning, blood oxygen saturation, glucose, body temperature, blood pressure, heart rate, and modified Rankin scale (mRS) were assessed for all patients. MRI lesion maps were segmented on diffusion-weighted images, spatially normalized, and the extent of overlap between the different stroke patterns was determined. Correlations between the period with abnormal yawning and the apparent diffusion coefficient (ADC) in the overlapping regions, total stroke volume, NIHSS and mRS were performed. Periods in which patients presented with episodes of abnormal yawning lasted on average for 58 h. Average GCS, NIHSS, and mRS scores were 12.6, 11.6, and 3.5, respectively. Clinical parameters were within normal limits. Ischemic brain lesions overlapped in nine out of ten patients: in seven patients in the insula and in seven in the caudate nucleus. The decrease of the ADC within the lesions correlated with the period with abnormal yawing (r = -0.76, Bonferroni-corrected p = 0.02). The stroke lesion intensity of the common overlapping regions in the insula and the caudate nucleus correlates with the period with abnormal yawning. The insula might be the long sought-after brain region for serotonin-mediated yawning.