Robust Audio-Visual Speech Recognition under Noisy Audio-Video Conditions

This paper presents the maximum weighted stream posterior (MWSP) model as a robust and efficient stream integration method for audio-visual speech recognition in environments, where the audio or video streams may be subjected to unknown and time-varying corruption. A significant advantage of MWSP is that it does not require any specific measurements of the signal in either stream to calculate appropriate stream weights during recognition, and as such it is modality-independent. This also means that MWSP complements and can be used alongside many of the other approaches that have been proposed in the literature for this problem. For evaluation we used the large XM2VTS database for speaker-independent audio-visual speech recognition. The extensive tests include both clean and corrupted utterances with corruption added in either/both the video and audio streams using a variety of types (e.g., MPEG-4 video compression) and levels of noise. The experiments show that this approach gives excellent performance in comparison to another well-known dynamic stream weighting approach and also compared to any fixed-weighted integration approach in both clean conditions or when noise is added to either stream. Furthermore, our experiments show that the MWSP approach dynamically selects suitable integration weights on a frame-by-frame basis according to the level of noise in the streams and also according to the naturally fluctuating relative reliability of the modalities even in clean conditions. The MWSP approach is shown to maintain robust recognition performance in all tested conditions, while requiring no prior knowledge about the type or level of noise.

Altered long-range alpha-band synchronization during visual short-term memory retention in children born very preterm

Children born very preterm, even when intelligence is broadly normal, often experience selective difficulties in executive function and visual-spatial processing. Development of structural cortical connectivity is known to be altered in this group, and functional magnetic resonance imaging (fMRI) evidence indicates that very preterm children recruit different patterns of functional connectivity between cortical regions during cognition. Synchronization of neural oscillations across brain areas has been proposed as a mechanism for dynamically assigning functional coupling to support perceptual and cognitive processing, but little is known about what role oscillatory synchronization may play in the altered neurocognitive development of very preterm children. To investigate this, we recorded magnetoencephalographic (MEG) activity while 7-8 year old children born very preterm and age-matched full-term controls performed a visual short-term memory task. Very preterm children exhibited reduced long-range synchronization in the alpha-band during visual short-term memory retention, indicating that cortical alpha rhythms may play a critical role in altered patterns functional connectivity expressed by this population during cognitive and perceptual processing. Long-range alpha-band synchronization was also correlated with task performance and visual-perceptual ability within the very preterm group, indicating that altered alpha oscillatory mechanisms mediating transient functional integration between cortical regions may be relevant to selective problems in neurocognitive development in this vulnerable population at school age.

Long-range synchronization and local desynchronization of alpha oscillations during visual short-term memory retention in children

Local alpha-band synchronization has been associated with both cortical idling and active inhibition. Recent evidence, however, suggests that long-range alpha synchronization increases functional coupling between cortical regions. We demonstrate increased long-range alpha and beta band phase synchronization during short-term memory retention in children 6-10 years of age. Furthermore, whereas alpha-band synchronization between posterior cortex and other regions is increased during retention, local alpha-band synchronization over posterior cortex is reduced. This constitutes a functional dissociation for alpha synchronization across local and long-range cortical scales. We interpret long-range synchronization as reflecting functional integration within a network of frontal and visual cortical regions. Local desynchronization of alpha rhythms over posterior cortex, conversely, likely arises because of increased engagement of visual cortex during retention.

Socio-economic deprivation and visual acuity at presentation in exudative age-related macular degeneration

Aim: To evaluate the influence of socio-economic factors on visual acuity (VA) at presentation in exudative age- related macular degeneration (AMD). Methods: The medical records of all consecutive patients with newly diagnosed exudative AMD examined at the Ophthalmology Departments of Grampian University Hospitals-NHS Trust, Aberdeen, and Gartnavel General Hospital, Glasgow, between July 2004 and June 2005, were reviewed. Demographics, duration of symptoms, VA in study and fellow eye, exudative AMD characteristics, status of fellow eye and patient home address, used to determine the Scottish Index of Multiple Deprivation (SIMD) score, were recorded. The effect of these parameters on VA at presentation was investigated using general linear modelling. Results: Two-hundred and forty patients (median age 79 years) were included in this study; 44 (18.3%) belonged to the lowest 20% SIMD score (most deprived). Age and location and type of the choroidal neovascular- isation were statistically significantly associated with VA at presentation (p = 0.003, p

Fundus autofluorescence in patients with age-related macular degeneration and high risk of visual loss

PURPOSE: To describe fundus autofluorescence (AF) patterns and their change over time in patients with age-related macular degeneration (AMD) and high risk of visual loss participating in the drusen laser study (DLS). DESIGN: Randomized clinical trial. METHODS: The study population consisted of 29 patients (35 eyes) participating in the DLS, which is a prospective, randomized, controlled clinical trial of prophylactic laser therapy in patients with AMD and high risk of neovascular complications. The intervention consisted of 16 eyes having prophylactic laser and 19 receiving no treatment. The main outcome measures were changes in the distribution of drusen and AF. Patients were reviewed for a median follow-up or 24 months (range 12-36 months). RESULTS: At baseline, four patterns of fundus AF were recognized: focal increased AF (n = 18), reticular AF (n = 3), combined focal and reticular AF (n = 2), and homogeneous AF (n = 12). At last follow-up, fundus AF remained unchanged in 15 untreated (78%) and in seven treated (43%) eyes. In only one untreated eye, focal areas of increased AF returned to background levels and were no longer detectable at last follow-up, compared with six treated eyes. This difference was statistically significant (P = .03). Only large foveal soft drusen (drusenoid pigment epithelium detachments) consistently corresponded with focal changes in AF, whereas no obvious correspondence was found between small soft drusen located elsewhere and changes in AF. CONCLUSION: The lack of obvious correspondence between the distribution of drusen and of AF found in this study appears to indicate that drusen and AF represent independent measures of aging in the posterior pole. © 2002 Elsevier Science Inc. All rights reserved.

Transpupillary thermotherapy for choroidal melanoma:Tumor control and visual results in 100 consecutive cases

Objective: The authors evaluated the results of primary transpupillary thermotherapy for choroidal melanoma in 100 cases. Design: Prospective nonrandomized analysis of treatment method. Participants: One hundred patients with choroidal melanoma were studied. Main Outcome Measures: Tumor response, ocular side effects, and visual results. Results: Of 100 consecutive patients with choroidal melanoma treated with transpupillary thermotherapy, the mean tumor basal diameter was 7.1 mm and tumor thickness was 2.8 mm. The tumor margin touched the optic disc in 34 eyes (34%) and was beneath the fovea in 42 eyes (42%). Documented growth was present in 64 eyes (64%), and known clinical risks for growth were present in all of the remaining 36 eyes (36%), with an average of 4 of 5 statistical risk factors for growth per tumor. After a mean of three treatment sessions and 14 months of follow-up, the mean tumor thickness was reduced to 1.4 mm. Treatment was successful in 94 eyes (94%) and failed in 6 eyes (6%). Three patients with amelanotic tumors showed no initial response to thermotherapy, but subsequent intravenous indocyanine green administration during thermotherapy resulted in improved heat absorption and tumor regression to a flat scar. The six eyes classified as treatment failures included four eyes with tumors that showed partial or no response to thermotherapy, thus requiring plaque radiotherapy or enucleation, and two eyes with recurrence, subsequently controlled with additional thermotherapy. After treatment, the visual acuity was the same (within 1 line) or better than the pretreatment visual acuity in 58 eyes (58%) and worse in 42 eyes (42%). The main reasons for poorer vision included treatment through the foveola for subfoveal tumor (25 eyes), retinal traction (10 eyes), retinal vascular obstruction (5 eyes), optic disc edema (1 eye), and unrelated ocular ischemia (1 eye). Temporal location (versus nasal and superior, P = 0.02) and greater distance from the optic disc (P = 0.04) were risks for retinal traction. Conclusions: Transpupillary thermotherapy may be an effective treatment for small posterior choroidal melanoma, especially those near the optic disc and fovea. Despite satisfactory local tumor control, ocular side effects can result in decreased vision. Longer follow- up will be necessary to assess the impact of thermotherapy on ultimate local tumor control and metastatic disease.

Visual outcomes in the subfoveal radiotherapy study:A randomized controlled trial of teletherapy for age-related macular degeneration

Objective: To determine whether teletherapy with 6-mV photons can reduce visual loss in patients with subfoveal choroidal neovascularization in age-related macular degeneration. Design: A multicenter, single-masked, randomized controlled trial of 12 Gy of external beam radiation therapy delivered to the macula of an affected eye vs observation only. Setting: Three United Kingdom-based hospital units. Participants: Patients with age-related macular degeneration, aged 60 years and older, who had subfoveal choroidal neovascularization and a visual acuity of 20/200 (logMAR 1.0) or better. Methods: Two hundred three patients were randomly assigned to radiotherapy or observation. Treatment was undertaken at designated radiotherapy centers, and patients assigned to the treatment group received a total dosage of 12 Gy of 6-mV photons in 6 fractions. Follow-up was scheduled at 3, 6, 12, and 24 months. After excluding protocol violators, the data from 199 patients were analyzed. Main Outcome Measures: The primary outcome measure was mean loss of distance visual acuity in the study eye at 12 and 24 months. Other outcome variables analyzed were near visual acuity and contrast sensitivity. The proportions of patients losing 3 or more or 6 or more lines of distance and near acuity and 0.3 or more or 0.6 or more log units of contrast sensitivity at each follow-up were also analyzed. Results: At all time points, mean distance visual acuity was better in the radiotherapy-treated group than in the control group, but the differences did not reach statistical significance. At 24 months, analysis of the proportions of patients with loss of 3 or more (moderate) (P=.08) or 6 or more (severe) (P=.29) lines of distance vision showed that fewer treated patients had severe losses, but there was no statistically significant difference between groups. For near visual acuity, although there was no evidence of treatment benefit at 12 and 24 months, a significant difference in favor of treatment was present at 6 months (P=.048). When analyzed by the proportions of patients losing 3 lines of contrast sensitivity, there was a significant difference in favor of treatment at 24 months (P=.02). No adverse retinal effects were observed during the study, but transient disturbance of the precorneal tear film was noted in treated patients. Conclusion: The results of the present trial do not support the routine clinical use of external beam radiation therapy in subjects with subfoveal choroidal neovascularization in age-related macular degeneration.

Detection of visual-field deterioration by Glaucoma Progression Analysis and Threshold Noiseless Trend programs

BACKGROUND: To compare the ability of Glaucoma Progression Analysis (GPA) and Threshold Noiseless Trend (TNT) programs to detect visual-field deterioration.

METHODS: Patients with open-angle glaucoma followed for a minimum of 2 years and a minimum of seven reliable visual fields were included. Progression was assessed subjectively by four masked glaucoma experts, and compared with GPA and TNT results. Each case was judged to be stable, deteriorated or suspicious of deterioration

RESULTS: A total of 56 eyes of 42 patients were followed with a mean of 7.8 (SD 1.0) tests over an average of 5.5 (1.04) years. Interobserver agreement to detect progression was good (mean kappa = 0.57). Progression was detected in 10-19 eyes by the experts, in six by GPA and in 24 by TNT. Using the consensus expert opinion as the gold standard (four clinicians detected progression), the GPA sensitivity and specificity were 75% and 83%, respectively, while the TNT sensitivity and specificity was 100% and 77%, respectively.

CONCLUSION: TNT showed greater concordance with the experts than GPA in the detection of visual-field deterioration. GPA showed a high specificity but lower sensitivity, mainly detecting cases of high focality and pronounced mean defect slopes.

Quantitative estimation of retinal nerve fiber layer height in glaucoma and the relationship with optic nerve head topography and visual field

Purpose: The authors estimated the retinal nerve fiber layer height (RNFLH) measurements in patients with glaucoma compared with those in age-matched healthy subjects as obtained by the laser scanning tomography and assessed the relationship between RNFLH measurements and optic and visual field status. Methods: Parameters of optic nerve head topography and RNFLH were evaluated in 125 eyes of 21 healthy subjects and 104 patients with glaucoma using the Heidelberg Retina Tomograph ([HRT] Heidelberg Engineering GmbH, Heidelberg, Germany) for the entire disc area and for the superior 70°(50°temporal and 20°nasal to the vertical midline) and inferior 70°sectors of the optic disc. The mean deviation of the visual field, as determined by the Humphrey program 24-2 (Humphrey Instruments, Inc., San Leonardo, CA, U.S.A) was calculated in the entire field and in the superior and inferior Bjerrum area. Result: Retinal nerve fiber layer height parameters (mean RNFLH and RNFL cross-sectional area) were decreased significantly in patients with glaucoma compared with healthy individuals. Retinal nerve fiber layer height parameters was correlated strongly with rim volume, rim area, and cup/disc area ratio. Of the various topography measures, retinal nerve fiber layer (RNFL) parameters and cup/disc area ratio showed the strongest correlation with visual field mean deviation in patients with glaucoma. Conclusion: Retinal nerve fiber layer height measures were reduced substantially in patients with glaucoma compared with age-matched healthy subjects. Retinal nerve fiber layer height was correlated strongly with topographic optic disc parameters and visual field changes in patients with glaucoma.

Interpretation on Humphrey's visual field tests. Is it glaucoma?

This article describes a step-wise approach for the understanding and interpretation of Humphrey's SITA visual field tests. The goal of this article is to help the reader to differentiate between non-specific abnormalities of the visual field and changes of the visual field that are suggestive of glaucoma.

Lifetime visual prognosis of patients with glaucoma

BACKGROUND: To investigate the visual outcome of glaucoma patients.

DESIGN: This is a retrospective study of case notes of patients who died while under follow up in a glaucoma clinic of a University Hospital in Scotland between 2006 and 2009.

PARTICIPANTS: Seventy-seven patients were identified.

METHODS: Data collected included type of glaucoma, coexisting pathology and best-corrected visual acuity in Snellen (converted to decimal values) for the first and final clinic visit. The final visual status was evaluated based on the best-corrected visual acuity of the better seeing eye at the last glaucoma clinic visit. Patients who had best-corrected visual acuity of less than Snellen decimal 0.5 were considered not to meet the standards for driving.

MAIN OUTCOME MEASURES: Snellen decimal best-corrected visual acuity, fulfilment of driving standards, and eligibility for partial sight and blind registration at the last clinic visit.

RESULTS: The mean ages at presentation and death were 71.8 ± 10.3 years and 82.2 ± 8.7 years respectively. The mean Snellen decimal best-corrected visual acuity of the better eye at presentation was 0.78, and at the final clinic visit was 0.61. At the final clinic visit, no patients were partial sight registrable, four (5.2%) were blind registrable, and 27 (35.1%) did not fulfil UK driving criteria. Glaucoma patients with other ocular pathologies were more likely to fail UK driving criteria at presentation (P = 0.02) and at last clinic visit (P = 0.03).

CONCLUSION: The majority of glaucoma patients maintained good visual function at the end of their lifetime.

Quantification of interpoint topographic correlations of threshold values in glaucomatous visual fields

Purpose: The authors sought to quantify neighboring and distant interpoint correlations of threshold values within the visual field in patients with glaucoma. Methods: Visual fields of patients with confirmed or suspected glaucoma were analyzed (n = 255). One eye per patient was included. Patients were examined using the 32 program of the Octopus 1-2-3. Linear regression analysis among each of the locations and the rest of the points of the visual field was performed, and the correlation coefficient was calculated. The degree of correlation was categorized as high (r > 0.66), moderate (0.66 = r > 0.33), or low (r = 0.33). The standard error of threshold estimation was calculated. Results: Most locations of the visual field had high and moderate correlations with neighboring points and with distant locations corresponding to the same nerve fiber bundle. Locations of the visual field had low correlations with those of the opposite hemifield, with the exception of locations temporal to the blind spot. The standard error of threshold estimation increased from 0.6 to 0.9 dB with an r reduction of 0.1. Conclusion: Locations of the visual field have highest interpoint correlation with neighboring points and with distant points in areas corresponding to the distribution of the retinal nerve fiber layer. The quantification of interpoint correlations may be useful in the design and interpretation of visual field tests in patients with glaucoma.

Severe visual loss after autologous blood injection for mitomycin-C- associated hypotonous maculopathy

It has been shown that mitomycin-C increases the success rate of trabeculectomy; however, a rise in the incidence of postoperative complications has also been reported. Consequently, the use of antimetabolite is usually reserved for patients who are at high risk of surgical failure or for patients with advanced glaucoma in whom low intraocular pressure is desired. This report describes a patient who suffered severe visual loss which was a direct result of hypotonous maculopathy after trabeculectomy with mitomycin-C and various other complications from the subsequent interventions.