Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

Non-invasive assessment of tear film surface quality

The tear film plays an important role preserving the health of the ocular surface and maintaining the optimal refractive power of the cornea. Moreover dry eye syndrome is one of the most commonly reported eye health problems. This syndrome is caused by abnormalities in the properties of the tear film. Current clinical tools to assess the tear film properties have shown certain limitations. The traditional invasive methods for the assessment of tear film quality, which are used by most clinicians, have been criticized for the lack of reliability and/or repeatability. A range of non-invasive methods of tear assessment have been investigated, but also present limitations. Hence no “gold standard” test is currently available to assess the tear film integrity. Therefore, improving techniques for the assessment of the tear film quality is of clinical significance and the main motivation for the work described in this thesis. In this study the tear film surface quality (TFSQ) changes were investigated by means of high-speed videokeratoscopy (HSV). In this technique, a set of concentric rings formed in an illuminated cone or a bowl is projected on the anterior cornea and their reflection from the ocular surface imaged on a charge-coupled device (CCD). The reflection of the light is produced in the outer most layer of the cornea, the tear film. Hence, when the tear film is smooth the reflected image presents a well structure pattern. In contrast, when the tear film surface presents irregularities, the pattern also becomes irregular due to the light scatter and deviation of the reflected light. The videokeratoscope provides an estimate of the corneal topography associated with each Placido disk image. Topographical estimates, which have been used in the past to quantify tear film changes, may not always be suitable for the evaluation of all the dynamic phases of the tear film. However the Placido disk image itself, which contains the reflected pattern, may be more appropriate to assess the tear film dynamics. A set of novel routines have been purposely developed to quantify the changes of the reflected pattern and to extract a time series estimate of the TFSQ from the video recording. The routine extracts from each frame of the video recording a maximized area of analysis. In this area a metric of the TFSQ is calculated. Initially two metrics based on the Gabor filter and Gaussian gradient-based techniques, were used to quantify the consistency of the pattern’s local orientation as a metric of TFSQ. These metrics have helped to demonstrate the applicability of HSV to assess the tear film, and the influence of contact lens wear on TFSQ. The results suggest that the dynamic-area analysis method of HSV was able to distinguish and quantify the subtle, but systematic degradation of tear film surface quality in the inter-blink interval in contact lens wear. It was also able to clearly show a difference between bare eye and contact lens wearing conditions. Thus, the HSV method appears to be a useful technique for quantitatively investigating the effects of contact lens wear on the TFSQ. Subsequently a larger clinical study was conducted to perform a comparison between HSV and two other non-invasive techniques, lateral shearing interferometry (LSI) and dynamic wavefront sensing (DWS). Of these non-invasive techniques, the HSV appeared to be the most precise method for measuring TFSQ, by virtue of its lower coefficient of variation. While the LSI appears to be the most sensitive method for analyzing the tear build-up time (TBUT). The capability of each of the non-invasive methods to discriminate dry eye from normal subjects was also investigated. The receiver operating characteristic (ROC) curves were calculated to assess the ability of each method to predict dry eye syndrome. The LSI technique gave the best results under both natural blinking conditions and in suppressed blinking conditions, which was closely followed by HSV. The DWS did not perform as well as LSI or HSV. The main limitation of the HSV technique, which was identified during the former clinical study, was the lack of the sensitivity to quantify the build-up/formation phase of the tear film cycle. For that reason an extra metric based on image transformation and block processing was proposed. In this metric, the area of analysis was transformed from Cartesian to Polar coordinates, converting the concentric circles pattern into a quasi-straight lines image in which a block statistics value was extracted. This metric has shown better sensitivity under low pattern disturbance as well as has improved the performance of the ROC curves. Additionally a theoretical study, based on ray-tracing techniques and topographical models of the tear film, was proposed to fully comprehend the HSV measurement and the instrument’s potential limitations. Of special interested was the assessment of the instrument’s sensitivity under subtle topographic changes. The theoretical simulations have helped to provide some understanding on the tear film dynamics, for instance the model extracted for the build-up phase has helped to provide some insight into the dynamics during this initial phase. Finally some aspects of the mathematical modeling of TFSQ time series have been reported in this thesis. Over the years, different functions have been used to model the time series as well as to extract the key clinical parameters (i.e., timing). Unfortunately those techniques to model the tear film time series do not simultaneously consider the underlying physiological mechanism and the parameter extraction methods. A set of guidelines are proposed to meet both criteria. Special attention was given to a commonly used fit, the polynomial function, and considerations to select the appropriate model order to ensure the true derivative of the signal is accurately represented. The work described in this thesis has shown the potential of using high-speed videokeratoscopy to assess tear film surface quality. A set of novel image and signal processing techniques have been proposed to quantify different aspects of the tear film assessment, analysis and modeling. The dynamic-area HSV has shown good performance in a broad range of conditions (i.e., contact lens, normal and dry eye subjects). As a result, this technique could be a useful clinical tool to assess tear film surface quality in the future.

Imaging intracellular protein dynamics by spinning disk confocal microscopy

The palette of fluorescent proteins (FPs) has grown exponentially over the past decade, and as a result, live imaging of cells expressing fluorescently tagged proteins is becoming more and more mainstream. Spinning disk confocal (SDC) microscopy is a high-speed optical sectioning technique and a method of choice to observe and analyze intracellular FP dynamics at high spatial and temporal resolution. In an SDC system, a rapidly rotating pinhole disk generates thousands of points of light that scan the specimen simultaneously, which allows direct capture of the confocal image with low-noise scientific grade-cooled charge-coupled device cameras, and can achieve frame rates of up to 1000 frames per second. In this chapter, we describe important components of a state-of-the-art spinning disk system optimized for live cell microscopy and provide a rationale for specific design choices. We also give guidelines of how other imaging techniques such as total internal reflection microscopy or spatially controlled photoactivation can be coupled with SDC imaging and provide a short protocol on how to generate cell lines stably expressing fluorescently tagged proteins by lentivirus-mediated transduction.

Materials, Processing, and Testing of Flexible Image Sensor Arrays

Editors' note:Flexible, large-area display and sensor arrays are finding growing applications in multimedia and future smart homes. This article first analyzes and compares current flexible devices, then discusses the implementation, requirements, and testing of flexible sensor arrays.—Jiun-Lang Huang (National Taiwan University) and Kwang-Ting (Tim) Cheng (University of California, Santa Barbara)

Deformation field in indentation of a granular ensemble

An experimental study has been made of the flow field in indentation of a model granular material. A granular ensemble composed of spherical sand particles with average size of 0.4 mm is indented with a flat ended punch under plane-strain conditions. The region around the indenter is imaged in situ using a high-speed charge-coupled device (CCD) imaging system. By applying a hybrid image analysis technique to image sequences of the indentation, flow parameters such as velocity, velocity gradient, and strain rate are measured at high resolution. The measurements have enabled characterization of the main features of the flow such as dead material zones, velocity jumps, localization of deformation, and regions of highly rotational flow resembling vortices. Implications for validation of theoretical analyses and applications are discussed.

Luminescent Molecular Sensors for Assessment of Temperature Field in Machining

A new technique based on luminescent molecular sensors is utilized in these series of experiments for measurement of temperatures in material removal processes. 2-Dimensional machining of metals at low speeds and surface grinding configurations are used as the model experimental systems to understand the efficacy of this experimental technique. The experiments were conducted with a series of luminescent sensors and binder combinations for the temperature measurement. The luminescence of the sensor was measured through a charge-coupled device imaging camera, and intensive calibration exercises were performed on these sensors. Excellent agreement in the temperature fields measured through this new experimental approach and traditional infrared thermography is seen here. This technique offers the unique capability of allowing measurement of temperatures in the presence of a lubricant, akin to manufacturing conditions in situ. Extension of the technique to measure the temperature field at the tool-chip contact is described.

Visualization of molecule interaction between antigen and antibody - One of ellipsometric imaging applications

It is to investigate molecule interactions between antigen and antibody with ellipsometric imaging technique and demonstrate some features and possibilities offered by applications of the technique. Molecule interaction is an important interest for molecule biologist and immunologist. They have used some established methods such as immufluorcence, radioimmunoassay and surface plasma resonance, etc, to study the molecule interaction. At the same time, experimentalists hope to use some updated technique with more direct visual results. Ellipsometric imaging is non-destructive and exhibits a high sensitivity to phase transitions with thin layers. It is capable of imaging local variations in the optical properties such as thickness due to the presence of different surface concentration of molecule or different deposited molecules. If a molecular mono-layer (such as antigen) with bio-activity were deposited on a surface to form a sensing surface and then incubated in a solution with other molecules (such as antibody), a variation of the layer thickness when the molecules on the sensing surface reacted with the others in the solution could be observed with ellipsometric imaging. Every point on the surface was measured at the same time with a high sensitivity to distinguish the variation between mono-layer and molecular complexes. Ellipsometric imaging is based on conventional ellipsometry with charge coupled device (CCD) as detector and images are caught with computer with image processing technique. It has advantages of high sensitivity to thickness variation (resolution in the order of angstrom), big field of view (in square centimeter), high sampling speed (a picture taken within one second), and high lateral resolution (in the order of micrometer). Here it has just shown one application in study of antigen-antibody interaction, and it is possible to observe molecule interaction process with an in-situ technique.

I. A recirculating charged-couple device. II. The mercury selenide on N-silicon Schottky barrier

A recirculating charge-coupled device structure has been devised. Entrance and exit gates allow a signal to be admitted, recirculated a given number of times, and then examined. In this way a small device permits simulation of a very long shift register without passing the signal through input and output diffusions. An oscilloscope motion picture demonstrating degradation of an actual circulating signal has been made. The performance of the device in simulating degradation of a signal by a very long shift register is well fit by a simple model based on transfer inefficiency.

Electrical properties of the mercury selenide on n-type chemically-cleaned silicon Schottky barrier have been studied. Barrier heights measured were 0.96 volts for the photoresponse technique and 0.90 volts for the current-voltage technique. These are the highest barriers yet reported on n-type silicon.

Coma measurement using a PSM and transmission image sensor

As feature size decreases, especially with the use of resolution enhancement technique, requirements for the coma aberrations in the projection lenses of the lithographic tools have become extremely severe. So, fast and accurate in situ measurement of coma is necessary. In the present paper, we present a new method for characterizing the coma aberrations in the projection lens using a phase-shifting mask and a transmission image sensor. By measuring the image positions at multiple NA and partial coherence settings, we are able to extract the coma aberration. The simulation results show that the accuracy of coma measurement increases approximately 20% compared to the previous straightforward measurement technique. (c) 2005 Elsevier GmbH. All rights reserved.

A high accuracy image sensor for sinusoidal phase-modulating interferometry

We proposed a high accuracy image sensor technique for sinusoidal phase-modulating interferometer in the field of the surface profile measurements. It solved the problem of the CCD's pixel offset of the same column under two adjacent rows, eliminated the spectral leakage, and reduced the influence of external interference to the measurement accuracy. We measured the surface profile of a glass plate, and its repeatability precision was less than 8 nm and its relative error was 1.15 %. The results show that it can be used to measure surface profile with high accuracy and strong anti-interference ability. (C) 2007 Elsevier GmbH. All rights reserved.

激光束质量实时测量技术

提出一种新型光束质量实时测量技术, 该技术主要基于由平板反射镜组成的多平面成像系统, 一次性将激光束腰附近2倍瑞利距离内的多个光斑成像在同一个平面上, 用CCD相机获取这些光斑的光强分布图样。通过图像处理获知接收到的光斑的光强分布。采用远场发散角、焦点尺寸、桶中功率比和M2因子四种光束质量评价标准对激光光束质量进行评价。利用该方法实时测量了高能钕玻璃双板条激光器的输出光束。

Nanostructuring of materials for device and sensor applications

The recent developments in nanotechnology are reviewed, with particular emphasis on its application in microsystem technology where increased reliability is achieved by integrating the sensor and the readout electronics on the same substrate. New applications may be possible using integrated micromechanical clips to connect optic fibers and components in integrated silicon systems. Some of the key developments in enabling technologies are also described, including the control of thin film deposition, nanostructuring to tailor the properties of thin film, silicon micromachining to make sensors, and microclips for the low-cost assembly of integrated optical microsystems.