Overcoming shadows in 3-source photometric stereo

Light occlusions are one of the most significant difficulties of photometric stereo methods. When three or more images are available without occlusion, the local surface orientation is overdetermined so that shape can be computed and the shadowed pixels can be discarded. In this paper, we look at the challenging case when only two images are available without occlusion, leading to a one degree of freedom ambiguity per pixel in the local orientation. We show that, in the presence of noise, integrability alone cannot resolve this ambiguity and reconstruct the geometry in the shadowed regions. As the problem is ill-posed in the presence of noise, we describe two regularization schemes that improve the numerical performance of the algorithm while preserving the data. Finally, the paper describes how this theory applies in the framework of color photometric stereo where one is restricted to only three images and light occlusions are common. Experiments on synthetic and real image sequences are presented.

Multispectral imaging of the ocular fundus using light emitting diode illumination

We present an imaging system based on light emitting diode (LED) illumination that produces multispectral optical images of the human ocular fundus. It uses a conventional fundus camera equipped with a high power LED light source and a highly sensitive electron-multiplying charge coupled device camera. It is able to take pictures at a series of wavelengths in rapid succession at short exposure times, thereby eliminating the image shift introduced by natural eye movements (saccades). In contrast with snapshot systems the images retain full spatial resolution. The system is not suitable for applications where the full spectral resolution is required as it uses discrete wavebands for illumination. This is not a problem in retinal imaging where the use of selected wavelengths is common. The modular nature of the light source allows new wavelengths to be introduced easily and at low cost. The use of wavelength-specific LEDs as a source is preferable to white light illumination and subsequent filtering of the remitted light as it minimizes the total light exposure of the subject. The system is controlled via a graphical user interface that enables flexible control of intensity, duration, and sequencing of sources in synchrony with the camera. Our initial experiments indicate that the system can acquire multispectral image sequences of the human retina at exposure times of 0.05 s in the range of 500-620 nm with mean signal to noise ratio of 17 dB (min 11, std 4.5), making it suitable for quantitative analysis with application to the diagnosis and screening of eye diseases such as diabetic retinopathy and age-related macular degeneration.

Can mean shift trackers perform better?

Many tracking algorithms have difficulties dealing with occlusions and background clutters, and consequently don't converge to an appropriate solution. Tracking based on the mean shift algorithm has shown robust performance in many circumstances but still fails e.g. when encountering dramatic intensity or colour changes in a pre-defined neighbourhood. In this paper, we present a robust tracking algorithm that integrates the advantages of mean shift tracking with those of tracking local invariant features. These features are integrated into the mean shift formulation so that tracking is performed based both on mean shift and feature probability distributions, coupled with an expectation maximisation scheme. Experimental results show robust tracking performance on a series of complicated real image sequences. © 2010 IEEE.

Analysis of foveation sequences in congenital nystagmus

Congenital nystagmus (CN) is an ocular-motor disorder that appears at birth or during the first few months of life; it is characterised by involuntary, conjugated, bilateral to and fro ocular oscillations. Pathogenesis of congenital nystagmus is still unknown. Eye movement recording allow to extract and analyse nystagmus main features such as shape, amplitude and frequency; depending on the morphology of the oscillations nystagmus can be classified in different categories (pendular, jerk, horizontal unidirectional, bidirectional). In general, CN patient show a considerable decrease of the visual acuity: image fixation on the retina is disturbed by nystagmus continuous oscillations; however, image stabilisation is still achieved during the short foveation periods in which eye velocity slows down while the target image is placed onto the fovea. Visual acuity was found to be mainly dependent on foveation periods duration, but cycle-to-cycle foveation repeatability and reduction of retinal image velocities also contribute in increasing visual acuity. This study concentrate on cycle-to-cycle image position variation onto fovea, trying to characterise the sequences of foveation positions. Eye-movement (infrared oculographic or electro oculographic) recordings, relative to different gaze positions and belonging to more than 30 CN patients, were analysed. Preliminary results suggest that sequences of foveations show a cyclic pattern with a dominant frequency (around 0.3 Hz on average) much lower than that of the nystagmus (about 3.3 Hz on average). Sequences of foveations reveals an horizontal ocular swing of more than 2 degree on average, which can explain the low visual acuity of the CN patient. Current CN therapies, pharmacological treatment or surgery of the ocular muscles, mainly aim to increase the patient's visual acuity. Hence, it is fundamental to have an objective parameter (expected visual acuity) for therapy planning. The information about sequences of foveations can improve estimation of patient visual acuity. © 2008 Springer-Verlag.

Detection of foveation windows and analysis of foveation sequences in congenital nystagmus

Congenital nystagmus (CN) is an ocular-motor disorder characterised by involuntary, conjugated ocular oscillations, that can arise since the first months of life. Pathogenesis of congenital nystagmus is still under investigation. In general, CN patients show a considerable decrease of their visual acuity: image fixation on the retina is disturbed by nystagmus continuous oscillations, mainly horizontal. However, image stabilisation is still achieved during the short periods in which eye velocity slows down while the target image is placed onto the fovea (called foveation intervals). To quantify the extent of nystagmus, eye movement recording are routinely employed, allowing physicians to extract and analyse nystagmus main features such as shape, amplitude and frequency. Using eye movement recording, it is also possible to compute estimated visual acuity predictors: analytical functions which estimates expected visual acuity using signal features such as foveation time and foveation position variability. Use of those functions add information to typical visual acuity measurement (e.g. Landolt C test) and could be a support for therapy planning or monitoring. This study focus on robust detection of CN patients' foveations. Specifically, it proposes a method to recognize the exact signal tracts in which a subject foveates, This paper also analyses foveation sequences. About 50 eyemovement recordings, either infrared-oculographic or electrooculographic, from different CN subjects were acquired. Results suggest that an exponential interpolation for the slow phases of nystagmus could improve foveation time computing and reduce influence of breaking saccades and data noise. Moreover a concise description of foveation sequence variability can be achieved using non-fitting splines. © 2009 Springer Berlin Heidelberg.