On the use of optical flow for scene change detection and description

We propose the use of optical flow information as a method for detecting and describing changes in the environment, from the perspective of a mobile camera. We analyze the characteristics of the optical flow signal and demonstrate how robust flow vectors can be generated and used for the detection of depth discontinuities and appearance changes at key locations. To successfully achieve this task, a full discussion on camera positioning, distortion compensation, noise filtering, and parameter estimation is presented. We then extract statistical attributes from the flow signal to describe the location of the scene changes. We also employ clustering and dominant shape of vectors to increase the descriptiveness. Once a database of nodes (where a node is a detected scene change) and their corresponding flow features is created, matching can be performed whenever nodes are encountered, such that topological localization can be achieved. We retrieve the most likely node according to the Mahalanobis and Chi-square distances between the current frame and the database. The results illustrate the applicability of the technique for detecting and describing scene changes in diverse lighting conditions, considering indoor and outdoor environments and different robot platforms.

Change in colour appearance of small defocused lights

Small long wavelength lights (≤ 1’ arc) change colour appearance with positive defocus, appearing yellow or white. I investigated influences of longitudinal chromatic aberration and monochromatic aberrations on colour appearance of small narrow band lights. Seven cyclopleged participants viewed a small light (1’ arc diameter, λmax range 510 - 628 nm) centred within a 4.6’ black annulus and surrounded by a uniform white field under photopic light levels. An optical trombone varied focus. Participants were required to vary the focus by moving the optical trombone in either positive or negative direction and report when they noticed a change in appearance of the defocused narrow band light. Longitudinal chromatic aberration was controlled using a Powell achromatizing lens and its doublet and triplet components that neutralized, doubled and reversed the eye’s chromatic aberration, respectively. Changes in colour appearance for a 628 nm light occurred without any lens at +0.5 ± 0.2D defocus and with the doublet at +0.6 ± 0.2 D. The achromatizing lens did not affect appearance and the phenomenon was evident with the triplet for negative defocus (-0.5 ± 0.3 D). Adaptive optics correction of astigmatism and higher order monochromatic aberration did not affect magnitude significantly. Colour changes occurred despite a range of participant L/M cone ratios. Direction of change in colour appearance was reversed for short compared to long wavelengths. We conclude that longitudinal chromatic aberrations, but not monochromatic aberrations, are involved in changing appearance of small lights with defocus. Additional neuronal mechanisms that may contribute to the colour changes are considered.

Effect of optical aberrations on the colour appearance of small lights

Purpose: Small red lights (one minute of arc or less) change colour appearance with positive defocus. We investigated the influence of longitudinal chromatic aberration and monochromatic aberrations on the colour appearance of small narrow band lights. Methods: Seven cyclopleged, trichromatic observers viewed a small light (one minute of arc, λmax = 510, 532, 550, 589, 620, 628 nm, approximately 19 per cent Weber contrast) centred within a black annulus (4.5 minutes of arc) and surrounded by a uniform white field (2,170 cd/m2). Pupil size was four millimetres. An optical trombone varied focus. Longitudinal chromatic aberration was controlled with a two component Powell achromatising lens that neutralises the eye’s chromatic aberration; a doublet that doubles and a triplet that reverses the eye’s chromatic aberration. Astigmatism and higher order monochromatic aberrations were corrected using adaptive optics. Results: Observers reported a change in appearance of the small red light (628 nm) without the Powell lens at +0.49 ± 0.21 D defocus and with the doublet at +0.62 ± 0.16 D. Appearance did not alter with the Powell lens, and five of seven observers reported the phenomenon with the triplet for negative defocus (-0.80 ± 0.47 D). Correction of aberrations did not significantly affect the magnitude at which the appearance of the red light changed (+0.44 ± 0.18 D without correction; +0.46 ± 0.16 D with correction). The change in colour appearance with defocus extended to other wavelengths (λmax = 510 to 620 nm), with directions of effects being reversed for short wavelengths relative to long wavelengths. Conclusions: Longitudinal chromatic aberrations but not monochromatic aberrations are involved in changing the appearance of small lights with defocus.

Human optical axial length and defocus

Purpose: To investigate the short term influence of imposed monocular defocus upon human optical axial length (the distance from anterior cornea to retinal pigment epithelium) and ocular biometrics. Methods: Twenty-eight young adult subjects (14 myopes and 14 emmetropes) had eye biometrics measured before and then 30 and 60 minutes after exposure to monocular (right eye) defocus. Four different monocular defocus conditions were tested, each on a separate day: control (no defocus), myopic (+3 D defocus), hyperopic (-3 D defocus) and diffuse (0.2 density Bangerter filter) defocus. The fellow eye was optimally corrected (no defocus). Results: Imposed defocus caused small but significant changes in optical axial length (p<0.0001). A significant increase in optical axial length (mean change +8 ± 14 μm, p=0.03) occurred following hyperopic defocus, and a significant reduction in optical axial length (mean change -13 ± 14 μm, p=0.0001) was found following myopic defocus. A small increase in optical axial length was observed following diffuse defocus (mean change +6 ± 13 μm, p=0.053). Choroidal thickness also exhibited some significant changes with certain defocus conditions. No significant difference was found between myopes and emmetropes in the changes in optical axial length or choroidal thickness with defocus. Conclusions: Significant changes in optical axial length occur in human subjects following 60 minutes of monocular defocus. The bi-directional optical axial length changes observed in response to defocus implies the human visual system is capable of detecting the presence and sign of defocus and altering optical axial length to move the retina towards the image plane.

Dynamics of pattern writing and erasure in photorefractive lithium niobate for data storage applications

The present rate of technological advance continues to place significant demands on data storage devices. The sheer amount of digital data being generated each year along with consumer expectations, fuels these demands. At present, most digital data is stored magnetically, in the form of hard disk drives or on magnetic tape. The increase in areal density (AD) of magnetic hard disk drives over the past 50 years has been of the order of 100 million times, and current devices are storing data at ADs of the order of hundreds of gigabits per square inch. However, it has been known for some time that the progress in this form of data storage is approaching fundamental limits. The main limitation relates to the lower size limit that an individual bit can have for stable storage. Various techniques for overcoming these fundamental limits are currently the focus of considerable research effort. Most attempt to improve current data storage methods, or modify these slightly for higher density storage. Alternatively, three dimensional optical data storage is a promising field for the information storage needs of the future, offering very high density, high speed memory. There are two ways in which data may be recorded in a three dimensional optical medium; either bit-by-bit (similar in principle to an optical disc medium such as CD or DVD) or by using pages of bit data. Bit-by-bit techniques for three dimensional storage offer high density but are inherently slow due to the serial nature of data access. Page-based techniques, where a two-dimensional page of data bits is written in one write operation, can offer significantly higher data rates, due to their parallel nature. Holographic Data Storage (HDS) is one such page-oriented optical memory technique. This field of research has been active for several decades, but with few commercial products presently available. Another page-oriented optical memory technique involves recording pages of data as phase masks in a photorefractive medium. A photorefractive material is one by which the refractive index can be modified by light of the appropriate wavelength and intensity, and this property can be used to store information in these materials. In phase mask storage, two dimensional pages of data are recorded into a photorefractive crystal, as refractive index changes in the medium. A low-intensity readout beam propagating through the medium will have its intensity profile modified by these refractive index changes and a CCD camera can be used to monitor the readout beam, and thus read the stored data. The main aim of this research was to investigate data storage using phase masks in the photorefractive crystal, lithium niobate (LiNbO3). Firstly the experimental methods for storing the two dimensional pages of data (a set of vertical stripes of varying lengths) in the medium are presented. The laser beam used for writing, whose intensity profile is modified by an amplitudemask which contains a pattern of the information to be stored, illuminates the lithium niobate crystal and the photorefractive effect causes the patterns to be stored as refractive index changes in the medium. These patterns are read out non-destructively using a low intensity probe beam and a CCD camera. A common complication of information storage in photorefractive crystals is the issue of destructive readout. This is a problem particularly for holographic data storage, where the readout beam should be at the same wavelength as the beam used for writing. Since the charge carriers in the medium are still sensitive to the read light field, the readout beam erases the stored information. A method to avoid this is by using thermal fixing. Here the photorefractive medium is heated to temperatures above 150�C; this process forms an ionic grating in the medium. This ionic grating is insensitive to the readout beam and therefore the information is not erased during readout. A non-contact method for determining temperature change in a lithium niobate crystal is presented in this thesis. The temperature-dependent birefringent properties of the medium cause intensity oscillations to be observed for a beam propagating through the medium during a change in temperature. It is shown that each oscillation corresponds to a particular temperature change, and by counting the number of oscillations observed, the temperature change of the medium can be deduced. The presented technique for measuring temperature change could easily be applied to a situation where thermal fixing of data in a photorefractive medium is required. Furthermore, by using an expanded beam and monitoring the intensity oscillations over a wide region, it is shown that the temperature in various locations of the crystal can be monitored simultaneously. This technique could be used to deduce temperature gradients in the medium. It is shown that the three dimensional nature of the recording medium causes interesting degradation effects to occur when the patterns are written for a longer-than-optimal time. This degradation results in the splitting of the vertical stripes in the data pattern, and for long writing exposure times this process can result in the complete deterioration of the information in the medium. It is shown in that simply by using incoherent illumination, the original pattern can be recovered from the degraded state. The reason for the recovery is that the refractive index changes causing the degradation are of a smaller magnitude since they are induced by the write field components scattered from the written structures. During incoherent erasure, the lower magnitude refractive index changes are neutralised first, allowing the original pattern to be recovered. The degradation process is shown to be reversed during the recovery process, and a simple relationship is found relating the time at which particular features appear during degradation and recovery. A further outcome of this work is that the minimum stripe width of 30 ìm is required for accurate storage and recovery of the information in the medium, any size smaller than this results in incomplete recovery. The degradation and recovery process could be applied to an application in image scrambling or cryptography for optical information storage. A two dimensional numerical model based on the finite-difference beam propagation method (FD-BPM) is presented and used to gain insight into the pattern storage process. The model shows that the degradation of the patterns is due to the complicated path taken by the write beam as it propagates through the crystal, and in particular the scattering of this beam from the induced refractive index structures in the medium. The model indicates that the highest quality pattern storage would be achieved with a thin 0.5 mm medium; however this type of medium would also remove the degradation property of the patterns and the subsequent recovery process. To overcome the simplistic treatment of the refractive index change in the FD-BPM model, a fully three dimensional photorefractive model developed by Devaux is presented. This model shows significant insight into the pattern storage, particularly for the degradation and recovery process, and confirms the theory that the recovery of the degraded patterns is possible since the refractive index changes responsible for the degradation are of a smaller magnitude. Finally, detailed analysis of the pattern formation and degradation dynamics for periodic patterns of various periodicities is presented. It is shown that stripe widths in the write beam of greater than 150 ìm result in the formation of different types of refractive index changes, compared with the stripes of smaller widths. As a result, it is shown that the pattern storage method discussed in this thesis has an upper feature size limit of 150 ìm, for accurate and reliable pattern storage.

Using optical coherence tomography to assess corneoscleral morphology after soft contact lens wear

Purpose. To evaluate the use of optical coherence tomography (OCT) to assess the effect of different soft contact lenses on corneoscleral morphology. Methods. Ten subjects had anterior segment OCT B-scans taken in the morning and again after six hours of soft contact lens wear. For each subject, three different contact lenses were used in the right eye on non-consecutive days, including a hydrogel sphere, a silicone hydrogel sphere and a silicone hydrogel toric. After image registration and layer segmentation, analyses were performed of the first hyper-reflective layer (HRL), the epithelial basement membrane (EBL) and the epithelial thickness (HRL to EBL). A root mean square difference (RMSD) of the layer profiles and the thickness change between the morning and afternoon measurements, was used to assess the effect of the contact lens on the corneoscleral morphology. Results. The soft contact lenses had a statistically significant effect on the morphology of the anterior segment layers (p <0.001). The average amounts of change for the three lenses (average RMSD values) for the corneal region were lower (3.93±1.95 µm for the HRL and 4.02±2.14 µm for the EBL) than those measured in the limbal/scleral region (11.24±6.21 µm for the HRL and 12.61±6.42 µm for the EBL). Similarly, averaged across the three lenses, the RMSD in epithelial thickness was lower in the cornea (2.84±0.84 µm) than the limbal/scleral (5.47±1.71 µm) region. Post-hoc analysis showed that ocular surface changes were significantly smaller with the silicone hydrogel sphere lens than both the silicone hydrogel toric (p<0.005) and hydrogel sphere (p<0.02) for the combined HRL and EBL data. Conclusions. In this preliminary study, we have shown that soft contact lenses can produce small but significant changes in the morphology of the limbal/scleral region and that OCT technology is useful in assessing these changes. The clinical significance of these changes is yet to be determined.

Optical and biomechanical factors, associated with near work and myopia

Near work may play an important role in the development of myopia in the younger population. The prevalence of myopia has also been found to be higher in occupations that involve substantial near work tasks, for example in microscopists and textile workers. When nearwork is performed, it typically involves accommodation, convergence and downward gaze. A number of previous studies have examined the effects of accommodation and convergence on changes in the optics and biometrics of the eye in primary gaze. However, little is known about the influence of accommodation on the eye in downward gaze. This thesis is primarily concerned with investigating the changes in the eye during near work in downward gaze under natural viewing conditions. To measure wavefront aberrations in downward gaze under natural viewing conditions, we modified a commercial Shack-Hartmann wavefront sensor by adding a relay lens system to allow on-axis ocular aberration measurements in primary gaze and downward gaze, with binocular fixation. Measurements with the modified wavefront sensor in primary and downward gaze were validated against a conventional aberrometer using both a model eye and in 9 human subjects. We then conducted an experiment to investigate changes in ocular aberrations associated with accommodation in downward gaze over 10 mins in groups of both myopes (n = 14) and emmetropes (n =12) using the modified Shack-Hartmann wavefront sensor. During the distance accommodation task, small but significant changes in refractive power (myopic shift) and higher order aberrations were observed in downward gaze compared to primary gaze. Accommodation caused greater changes in higher order aberrations (in particular coma and spherical aberration) in downward gaze than primary gaze, and there was evidence that the changes in certain aberrations with accommodation over time were different in downward gaze compared to primary gaze. There were no obvious systematic differences in higher order aberrations between refractive error groups during accommodation or downward gaze for fixed pupils. However, myopes exhibited a significantly greater change in higher order aberrations (in particular spherical aberration) than emmetropes for natural pupils after 10 mins of a near task (5 D accommodation) in downward gaze. These findings indicated that ocular aberrations change from primary to downward gaze, particularly with accommodation. To understand the mechanism underlying these changes in greater detail, we then extended this work to examine the characteristics of the corneal optics, internal optics, anterior biometrics and axial length of the eye during a near task, in downward gaze, over 10 mins. Twenty young adult subjects (10 emmetropes and 10 myopes) participated in this study. To measure corneal topography and ocular biometrics in downward gaze, a rotating Scheimpflug camera and an optical biometer were inclined on a custom built, height and tilt adjustable table. We found that both corneal optics and internal optics change with downward gaze, resulting in a myopic shift (~0.10 D) in the spherical power of the eye. The changes in corneal optics appear to be due to eyelid pressure on the anterior surface of the cornea, whereas the changes in the internal optics (an increase in axial length and a decrease in anterior chamber depth) may be associated with movement of the crystalline lens, under the action of gravity, and the influence of altered biomechanical forces from the extraocular muscles on the globe with downward gaze. Changes in axial length with accommodation were significantly greater in downward gaze than primary gaze (p < 0.05), indicating an increased effect of the mechanical forces from the ciliary muscle and extraocular muscles. A subsequent study was conducted to investigate the changes in anterior biometrics, axial length and choroidal thickness in nine cardinal gaze directions under the actions of the extraocular muscles. Ocular biometry measurements were obtained from 30 young adults (10 emmetropes, 10 low myopes and 10 moderate myopes) through a rotating prism with 15° deviation, along the foveal axis, using a non-contact optical biometer in each of nine different cardinal directions of gaze, over 5 mins. There was a significant influence of gaze angle and time on axial length (both p < 0.001), with the greatest axial elongation (+18 ± 8 μm) occurring with infero-nasal gaze (p < 0.001) and a slight decrease in axial length in superior gaze (−12 ± 17 μm) compared with primary gaze (p < 0.001). There was a significant correlation between refractive error (spherical equivalent refraction) and the mean change in axial length in the infero-nasal gaze direction (Pearson's R2 = 0.71, p < 0.001). To further investigate the relative effect of gravity and extraocular muscle force on the axial length, we measured axial length in 15° and 25° downward gaze with the biometer inclined on a tilting table that allowed gaze shifts to occur with either full head turn but no eye turn (reflects the effect of gravity), or full eye turn with no head turn (reflects the effect of extraocular muscle forces). We observed a significant axial elongation in 15° and 25° downward gaze in the full eye turn condition. However, axial length did not change significantly in downward gaze over 5 mins (p > 0.05) in the full head turn condition. The elongation of the axial length in downward gaze appears to be due to the influence of the extraocular muscles, since the effect was not present when head turn was used instead of eye turn. The findings of these experiments collectively show the dynamic characteristics of the optics and biometrics of the eye in downward gaze during a near task, over time. These were small but significant differences between myopic and emmetropic eyes in both the optical and biomechanical changes associated with shifts of gaze direction. These differences between myopes and emmetropes could arise as a consequence of excessive eye growth associated with myopia. However the potentially additive effects of repeated or long lasting near work activities employing infero-nasal gaze could also act to promote elongation of the eye due to optical and/or biomechanical stimuli.

Imaging intracellular protein dynamics by spinning disk confocal microscopy

The palette of fluorescent proteins (FPs) has grown exponentially over the past decade, and as a result, live imaging of cells expressing fluorescently tagged proteins is becoming more and more mainstream. Spinning disk confocal (SDC) microscopy is a high-speed optical sectioning technique and a method of choice to observe and analyze intracellular FP dynamics at high spatial and temporal resolution. In an SDC system, a rapidly rotating pinhole disk generates thousands of points of light that scan the specimen simultaneously, which allows direct capture of the confocal image with low-noise scientific grade-cooled charge-coupled device cameras, and can achieve frame rates of up to 1000 frames per second. In this chapter, we describe important components of a state-of-the-art spinning disk system optimized for live cell microscopy and provide a rationale for specific design choices. We also give guidelines of how other imaging techniques such as total internal reflection microscopy or spatially controlled photoactivation can be coupled with SDC imaging and provide a short protocol on how to generate cell lines stably expressing fluorescently tagged proteins by lentivirus-mediated transduction.

Optical gas sensing properties of nanoporous Nb2O5 films

Nanoporous Nb2O5 has been previously demonstrated to be a viable electrochromic material with strong intercalation characteristics. Despite showing such promising properties, its potential for optical gas sensing applications, which involves the production of ionic species such as H+, has yet to be explored. Nanoporous Nb2O5 can accommodate a large amount of H+ ions in a process that results in an energy bandgap change of the material, which induces an optical response. Here, we demonstrate the optical hydrogen gas (H¬2) sensing capability of nanoporous anodic Nb2O5 with a large surface-to-volume ratio prepared via a high temperature anodization method. The large active surface area of the film provides enhanced pathways for efficient hydrogen adsorption and dissociation, which are facilitated by a thin layer of Pt catalyst. We show that the process of H2 sensing causes optical modulations that are investigated in terms of response magnitudes and dynamics. The optical modulations induced by the intercalation process and sensing properties of nanoporous anodic Nb2O5 shown in this work can potentially be used for future optical gas sensing systems.

Single layer lead iodide: Computational exploration of structural, electronic and optical properties, strain induced band modulation and the role of spin-orbital-coupling

Graphitic like layered materials exhibit intriguing electronic structures and thus the search for new types of two-dimensional (2D) monolayer materials is of great interest for developing novel nano-devices. By using density functional theory (DFT) method, here we for the first time investigate the structure, stability, electronic and optical properties of monolayer lead iodide (PbI2). The stability of PbI2 monolayer is first confirmed by phonon dispersion calculation. Compared to the calculation using generalized gradient approximation, screened hybrid functional and spin–orbit coupling effects can not only predicts an accurate bandgap (2.63 eV), but also the correct position of valence and conduction band edges. The biaxial strain can tune its bandgap size in a wide range from 1 eV to 3 eV, which can be understood by the strain induced uniformly change of electric field between Pb and I atomic layer. The calculated imaginary part of the dielectric function of 2D graphene/PbI2 van der Waals type hetero-structure shows significant red shift of absorption edge compared to that of a pure monolayer PbI2. Our findings highlight a new interesting 2D material with potential applications in nanoelectronics and optoelectronics.