Hidden Conditional Random Fields for Visual Speech Recognition

In this paper we present the application of Hidden Conditional Random Fields (HCRFs) to modelling speech for visual speech recognition. HCRFs may be easily adapted to model long range dependencies across an observation sequence. As a result visual word recognition performance can be improved as the model is able to take more of a contextual approach to generating state sequences. Results are presented from a speaker-dependent, isolated digit, visual speech recognition task using comparisons with a baseline HMM system. We firstly illustrate that word recognition rates on clean video using HCRFs can be improved by increasing the number of past and future observations being taken into account by each state. Secondly we compare model performances using various levels of video compression on the test set. As far as we are aware this is the first attempted use of HCRFs for visual speech recognition.

Evaluation of a Passive Millimeter Wave (PMMW) imager for wire detection in degraded visual conditions

Ground vehicle tests have been performed to evaluate the performance of a Passive Millimeter Wave (PMMW) imager in reduced visibility conditions and in particular, the ability to detect power lines and cables. A PMMW imager was
compared with Long Wave Infrared (LWIR) and visible imaging cameras. The three sensors were mounted on a Land Rover, together with GPS and digital recording system. All three sensors plus the GPS data were recorded simultaneously in order to provide direct comparisons. The vehicle collected imagery from a number of sites in the vicinity of Malvern, UK, in January, 2008. Imagery was collected both while the vehicle was stationary at specific sites
and while it was moving. Weather conditions during the data collection included clear, drizzle, rain and fog. Imagery was collected during the day, at night, and during dusk/dawn transition periods. The PMMW imager was a prototype which operated at 94 GHz and was based on a conically scanned folded Schmidt camera and the LWIR and visible sensors were commercial off the shelf items.

Help needed in medication self-management for people with visual impairment: case-control study

Background: Visual impairment (VI) is rising in prevalence and contributing to increasing morbidity, particularly among older people. Understanding patients' problems is fundamental to achieving optimal health outcomes but little is known about how VI impacts on self-management of medication.

Aim: To compare issues relating to medication self-management between older people with and without VI.

Design and setting: Case-control study with participants aged =65 years, prescribed at least two long-term oral medications daily, living within the community.

Method: The study recruited 156 patients with VI (best corrected visual acuity [BCVA] 6/18 to 3/60) at low-vision clinics; community optometrists identified 158 controls (BCVA 6/9 or better). Researchers visited participants in their homes, administered two validated questionnaires to assess medication adherence (Morisky; Medication Adherence Report Scale [MARS]), and asked questions about medication self-management, beliefs, and support.

Results: Approximately half of the participants in both groups reported perfect adherence on both questionnaires (52.5% Morisky; 43.3%, MARS). Despite using optical aids, few (3%) with VI could read medication information clearly; 24% had difficulty distinguishing different tablets. More people with VI (29%) than controls (13%) (odds ratio [OR] = 2.8; 95% confidence interval [CI] = 1.6 to 5.0) needed help managing their medication, from friends (19% versus 10%) or pharmacists (10% versus 2.5%; OR = 4.4, 95% CI = 1.4 to 13.5); more received social service support (OR = 7.1; 95% CI = 3.9 to 12.9).

Conclusion: Compared to their peers without VI, older people with VI are more than twice as likely to need help in managing medication. In clinical practice in primary care, patients' needs for practical support in taking prescribed treatment must be recognised. Strategies for effective medication self-management should be explored.

Altered Long-Range Phase Synchronization and Cortical Activation in Children Born Very Preterm

Children born very preterm, even with broadly normal IQ, commonly show selective difficulties in visuospatial processing and executive functioning. Very little, however, is known what alterations in cortical processing underlie these deficits. We recorded MEG while eight children born very preterm (=32 weeks gestational age) and eight full-term controls performed a visual short-term memory task at mean age 7.5 years (range 6.4 - 8.4). Previously, we demonstrated increased long-range alpha and beta band phase synchronization between MEG sensors during STM retention in a group of 17 full-term children age 6-10 years. Here we present preliminary evidence that long-range phase synchronization in very preterm children, relative to controls, is reduced in the alpha-band but increased in the theta-band. In addition, we investigated cortical activation during STM retention employing synthetic aperture magnetometry (SAM) beamformer to localize changes in gamma-band power. Preliminary results indicate sequential activation of occipital, parietal and frontal cortex in control children, as well as reduced activation in very preterm children relative to controls. These preliminary results suggest that children born very preterm exhibit altered inter-regional functional connectivity and cortical activation during cognitive processing.

Long-term graft survival in patients with flexible open-loop anterior chamber intraocular lenses

Purpose. To evaluate the long-term graft survival in patients with flexible open-loop anterior chamber intraocular lenses (AC IOL). Methods. We retrospectively reviewed the records of patients with aphakic/pseudophakic bullous keratopathy who underwent penetrating keratoplasty and flexible open-loop AC IOL implantation in our institution from 1983 to 1988. Results. 79 eyes from 77 patients were included in the study. Mean follow-up was 50 months (range 1 to 123 months). At last follow-up 61 eyes (77.2%) had clear grafts. Among them, the visual acuity was = 20/40 in 14 eyes (23.0%), 20/50-20/100 in 22 eyes (36.1%), 20/200-20/400 in 9 eyes (14.8%) and = CF in 16 (26.2%). Increment of glaucoma medications and/or glaucoma surgery was the most frequent complication (37 eyes, 46,8%). Cystoid macular edema was newly diagnosed in 10 eyes (12.7%). Conclusions. Flexible, open-loop anterior chamber lens are a viable option in the treatment of patients with aphakic or pseudophakic bullous keratopathy undergoing penetrating keratoplasty.

Long-term neuropsychological and psychosocial outcomes of decompressive hemicraniectomy following malignant middle cerebral artery infarctions

Purpose: This study examines long-term neuropsychological and psychosocial outcomes of survivors of malignant middle cerebral artery infarction treated via decompressive hemicraniectomy. Method: A case series design facilitated a detailed analysis of the outcomes among five participants. Neuropsychological domains assessed included premorbid and current IQ, sustained, selective and divided attention, visual and auditory memory, executive functioning and visuo-spatial ability. Psychosocial domains assessed included self-rated depression, anxiety and quality of life. Participants and their main carer were asked about their retrospective view of surgery. Results: All participants showed neuropsychological impairments in multiple cognitive domains, with preserved ability in others. Effects of laterality of brain function were evident in some domains. Clinically significant depression was evident in two participants. Overall quality of life was within average limits in three of four assessed participants. Four participants retrospectively considered surgery as having been a favourable course of action. Conclusion: While neuropsychological impairments are highly likely post-surgery, preserved abilities and social support may serve a protective function against depression and an unacceptably poor quality of life. Results do not support the suggestion that decompressive hemicraniectomy following malignant middle cerebral artery infarction necessarily leads to unacceptable neuropsychological or psychosocial outcomes.

Direct costs of glaucoma and severity of the disease:A multinational long term study of resource utilisation in Europe

Background: Resource utilisation and direct costs associated with glaucoma progression in Europe are unknown. As population progressively ages, the economic impact of the disease will increase. Methods: From a total of 1655 consecutive cases, the records of 194 patients were selected and stratified by disease severity. Record selection was based on diagnoses of primary open angle glaucoma, glaucoma suspect, ocular hypertension, or normal tension glaucoma; 5 years minimum follow up were required. Glaucoma severity was assessed using a six stage glaucoma staging system based on static threshold visual field parameters. Resource utilisation data were abstracted from the charts and unit costs were applied to estimate direct costs to the payer. Resource utilisation and estimated direct cost of treatment, per person year, were calculated. Results: A statistically significant increasing linear trend (p = 0.018) in direct cost as disease severity worsened was demonstrated. The direct cost of treatment increased by an estimated €86 for each incremental step ranging from €455 per person year for stage 0 to €969 per person year for stage 4 disease. Medication costs ranged from 42% to 56% of total direct cost for all stages of disease. Conclusions: These results demonstrate for the first time in Europe that resource utilisation and direct medical costs of glaucoma management increase with worsening disease severity. Based on these findings, managing glaucoma and effectively delaying disease progression would be expected to significantly reduce the economic burden of this disease. These data are relevant to general practitioners and healthcare administrators who have a direct influence on the distribution of resources.

We Were There:Experiences of women in the Maze and Long Kesh Prison

A feature documentary on the experiences of women in the Maze and Long Kesh Prison

Why is “blindsight” blind? A new perspective on primary visual cortex, recurrent activity and visual awareness

The neuropsychological phenomenon of blindsight has been taken to suggest that the primary visual cortex (V1) plays a unique role in visual awareness, and that extrastriate activation needs to be fed back to V1 in order for the content of that activation to be consciously perceived. The aim of this review is to evaluate this theoretical framework and to revisit its key tenets. Firstly, is blindsight truly a dissociation of awareness and visual detection? Secondly, is there sufficient evidence to rule out the possibility that the loss of awareness resulting from a V1 lesion simply reflects reduced extrastriate responsiveness, rather than a unique role of V1 in conscious experience? Evaluation of these arguments and the empirical evidence leads to the conclusion that the loss of phenomenal awareness in blindsight may not be due to feedback activity in V1 being the hallmark awareness. On the basis of existing literature, an alternative explanation of blindsight is proposed. In this view, visual awareness is a “global” cognitive function as its hallmark is the availability of information to a large number of perceptual and cognitive systems; this requires inter-areal long-range synchronous oscillatory activity. For these oscillations to arise, a specific temporal profile of neuronal activity is required, which is established through recurrent feedback activity involving V1 and the extrastriate cortex. When V1 is lesioned, the loss of recurrent activity prevents inter-areal networks on the basis of oscillatory activity. However, as limited amount of input can reach extrastriate cortex and some extrastriate neuronal selectivity is preserved, computations involving comparison of neural firing rates within a cortical area remain possible. This enables “local” read-out from specific brain regions, allowing for the detection and discrimination of basic visual attributes. Thus blindsight is blind due to lack of “global” long-range synchrony, and it functions via “local” neural readout from extrastriate areas.

Application of Visual-Inertial SLAM for 3D Mapping of Underground Environments

The underground scenarios are one of the most challenging environments for accurate and precise 3d mapping where hostile conditions like absence of Global Positioning Systems, extreme lighting variations and geometrically smooth surfaces may be expected. So far, the state-of-the-art methods in underground modelling remain restricted to environments in which pronounced geometric features are abundant. This limitation is a consequence of the scan matching algorithms used to solve the localization and registration problems. This paper contributes to the expansion of the modelling capabilities to structures characterized by uniform geometry and smooth surfaces, as is the case of road and train tunnels. To achieve that, we combine some state of the art techniques from mobile robotics, and propose a method for 6DOF platform positioning in such scenarios, that is latter used for the environment modelling. A visual monocular Simultaneous Localization and Mapping (MonoSLAM) approach based on the Extended Kalman Filter (EKF), complemented by the introduction of inertial measurements in the prediction step, allows our system to localize himself over long distances, using exclusively sensors carried on board a mobile platform. By feeding the Extended Kalman Filter with inertial data we were able to overcome the major problem related with MonoSLAM implementations, known as scale factor ambiguity. Despite extreme lighting variations, reliable visual features were extracted through the SIFT algorithm, and inserted directly in the EKF mechanism according to the Inverse Depth Parametrization. Through the 1-Point RANSAC (Random Sample Consensus) wrong frame-to-frame feature matches were rejected. The developed method was tested based on a dataset acquired inside a road tunnel and the navigation results compared with a ground truth obtained by post-processing a high grade Inertial Navigation System and L1/L2 RTK-GPS measurements acquired outside the tunnel. Results from the localization strategy are presented and analyzed.

Differential effect of long versus short wavelength light exposure on pupillary re-dilation in patients with outer retinal disease.

BACKGROUND: In patients with outer retinal degeneration, a differential pupil response to long wavelength (red) versus short wavelength (blue) light stimulation has been previously observed. The goal of this study was to quantify differences in the pupillary re-dilation following exposure to red versus blue light in patients with outer retinal disease and compare them with patients with optic neuropathy and with healthy subjects. DESIGN: Prospective comparative cohort study. PARTICIPANTS: Twenty-three patients with outer retinal disease, 13 patients with optic neuropathy and 14 normal subjects. METHODS: Subjects were tested using continuous red and blue light stimulation at three intensities (1, 10 and 100 cd/m2) for 13 s per intensity. Pupillary re-dilation dynamics following the brightest intensity was analysed and compared between the three groups. MAIN OUTCOME MEASURES: The parameters of pupil re-dilation used in this study were: time to recover 90% of baseline size; mean pupil size at early and late phases of re-dilation; and differential re-dilation time for blue versus red light. RESULTS: Patients with outer retinal disease showed a pupil that tended to stay smaller after light termination and thus had a longer time to recovery. The differential re-dilation time was significantly greater in patients with outer retinal disease (median = 28.0 s, P < 0.0001) compared with controls and patients with optic neuropathy. CONCLUSIONS: A differential response of pupil re-dilation following red versus blue light stimulation is present in patients with outer retinal disease but is not found in normal eyes or among patients with visual loss from optic neuropathy.

Long-term close follow-up of chorioretinal lesions in presumed ocular tuberculosis.

PURPOSE: To evaluate the long-term outcome (up to 7 years) of presumed ocular tuberculosis (TB) when the therapeutic decision was based on WHO guidelines. METHODS: Twelve out of 654 new uveitic patients (1998-2004) presented with choroiditis and positive tuberculosis skin test (TST) (skin lesion diameter >15 mm). Therapy was administered according to WHO recommendations after ophthalmic and systemic investigation. The area size of ocular lesions at presentation and after therapy, measured on fluorescein and indocyanine green angiographies, was considered the primary outcome. Relapse of choroiditis was considered a secondary outcome. The T-SPOT TB test was performed when it became available. RESULTS: Visual acuity significantly improved after therapy (p=0.0357). The mean total surface of fluorescein lesions at entry was 44.8 ± 20.9 (arbitrary units) and decreased to 32.5 ± 16.9 after therapy (p=0.0165). The mean total surface of indocyanine green lesions at entry was 24.5 ± 13.3 and decreased to 10.8 ± 5.4 after therapy (p=0.0631). The T-SPOT TB revealed 2 false TST-positive results. The mean follow-up was 4.5 ± 1.5 years. Two relapses out of 10 confirmed ocular TB was observed after complete lesion healing, 2.5 years and 4.5 years after therapy, respectively. CONCLUSIONS: A decrease of ocular lesion mean size and a mean improvement of VA were observed after antituberculous therapy. Our long-term follow-up of chorioretinal lesions demonstrated relapse of ocular tuberculosis in 10% of patients with confirmed ocular TB, despite complete initial retinal scarring.

Suivi à long terme de l’efficacité d’un traitement de physiothérapie sur l'incontinence urinaire d'effort persistante en période postnatale

L’incontinence urinaire d’effort (IUE) est une condition fréquente en période postnatale pouvant affecter jusqu’à 77% des femmes. Neuf femmes sur dix souffrant d’IUE trois mois après l’accouchement, vont présenter une IUE cinq ans plus tard. Le traitement en physiothérapie de l’IUE par le biais d’un programme d’exercices de renforcement des muscles du plancher pelvien est reconnu comme étant un traitement de première ligne efficace. Les études ont prouvé l’efficacité de cette approche sur l’IUE persistante à court terme, mais les résultats de deux ECR à long terme n’ont pas démontré un maintien de l’effet de traitement. L’effet d’un programme en physiothérapie de renforcement du plancher pelvien intensif et étroitement supervisé sur l’IUE postnatale persistante avait été évalué lors d’un essai clinique randomisé il y a sept ans. Le but principal de la présente étude était d’évaluer l’effet de ce programme sept ans après la fin des interventions de l’ECR initial. Un objectif secondaire était de comparer l’effet de traitement à long terme entre un groupe ayant fait seulement des exercices de renforcement du plancher pelvien et un groupe ayant fait des exercices de renforcement du plancher pelvien et des abdominaux profonds. Un troisième objectif était d’explorer l’influence de quatre facteurs de risques sur les symptômes d’IUE et la qualité de vie à long terme. Les cinquante-sept femmes ayant complétées l’ECR initial ont été invitées à participer à l’évaluation du suivi sept ans. Vingt et une femmes ont participé à l’évaluation clinique et ont répondu à quatre questionnaires, tandis que dix femmes ont répondu aux questionnaires seulement. L’évaluation clinique incluait un pad test et la dynamométrie du plancher pelvien. La mesure d’effet primaire était un pad test modifié de 20 minutes. Les mesures d’effets secondaires étaient la dynamométrie du plancher pelvien, les symptômes d’IUE mesuré par le questionnaire Urogenital Distress Inventory, la qualité de vie mesurée par le questionnaire Incontinence Impact Questionnaire et la perception de la sévérité de l’IUE mesuré par l’Échelle Visuelle Analogue. De plus, un questionnaire portant sur quatre facteurs de risques soit, la présence de grossesses subséquentes, la v présence de constipation chronique, l’indice de masse corporel et la fréquence des exercices de renforcement du plancher pelvien de l’IUE, venait compléter l’évaluation. Quarante-huit pour-cent (10/21) des participantes étaient continentes selon de pad test. La moyenne d’amélioration entre le résultat pré-traitement et le suivi sept ans était de 26,9 g. (écart-type = 68,0 g.). Il n’y avait pas de différence significative des paramètres musculaires du plancher pelvien entre le pré-traitement, le post-traitement et le suivi sept ans. Les scores du IIQ et du VAS étaient significativement plus bas à sept ans qu’en prétraitement (IIQ : 23,4 vs 15,6, p = 0,007) et (VAS : 6,7 vs 5,1, p = 0,001). Les scores du UDI étaient plus élevés au suivi sept ans (15,6) qu’en pré-traitement (11,3, p = 0,041) et en post-traitement (5,7, p = 0,00). La poursuite des exercices de renforcement du plancher pelvien à domicile était associée à une diminution de 5,7 g. (p = 0,051) des fuites d’urine observées au pad test selon une analyse de régression linéaire. Les limites de cette étude sont ; la taille réduite de l’échantillon et un biais relié au désir de traitement pour les femmes toujours incontinentes. Cependant, les résultats semblent démontrer que l’effet du traitement à long terme d’un programme de renforcement des muscles du plancher pelvien qui est intensif et étroitement supervisé, est maintenu chez environ une femme sur deux. Bien que les symptômes d’IUE tel que mesuré par les pad test et le questionnaire UDI, semblent réapparaître avec le temps, la qualité de vie, telle que mesurée par des questionnaires, est toujours meilleure après sept qu’à l’évaluation initiale. Puisque la poursuite des exercices de renforcement du plancher pelvien est associée à une diminution de la quantité de fuite d’urine au pad test, les participantes devraient être encouragées à poursuivre leurs exercices après la fin d’un programme supervisé. Pour des raisons de logistique la collecte de donnée de ce projet de recherche s’est continuée après la rédaction de ce mémoire. Les résultats finaux sont disponibles auprès de Chantale Dumoulin pht, PhD., professeure agrée à l’Université de Montréal.

Rôle de l’apport prénatal en acides gras oméga-3 sur le développement à long terme des fonctions visuelles chez les enfants Inuits

La consommation de poisson et de mammifères marins représente une source importante d’acides gras oméga-3 connus pour leurs effets bénéfiques sur le développement des fonctions cérébrales et notamment, sur le développement du système visuel. Afin de tester l’hypothèse selon laquelle l’exposition prénatale aux acides gras oméga-3 a des effets bénéfiques à long terme, nous avons examiné les fonctions visuelles chez des enfants Inuits d’âge scolaire exposés à de grandes quantités d’oméga-3 durant la période de gestation. Des enfants Inuits (n = 136; moyenne d’âge = 11.3 ans) du nord du Québec (Nunavik) ont participé à cette étude. Un protocole de potentiels évoqués visuels (PEVs) utilisant des stimuli en couleur et en mouvement a été employé afin d’appréhender les réponses parvo- et magnocellulaires respectivement. Les concentrations d’acide docosahexaénoïque (ADH) ont été mesurées à la naissance à partir du sang de cordon ombilical et au moment du testing, reflétant ainsi les expositions pré- et post-natales. Les relations entre les niveaux sanguins d’ADH et les PEVs ont été examinées à l’aide d’analyses de régression multiples, en tenant compte des contaminants environnementaux et d’autres variables potentiellement confondantes. Aucune association significative n’a été trouvée en ce qui concerne les stimuli de mouvement. Cependant, après ajustement pour les covariables, les concentrations d’ADH à la naissance étaient associées à une latence plus courte des composantes N1 et P1 des PEVs couleur. Notre étude démontre, pour la première fois, des effets bénéfiques de l’exposition prénatale à l’ADH sur le système parvocellulaire à l’âge scolaire.

Affective word priming in the left and right visual fields in young and older individuals

Alors que les hypothèses de valence et de dominance hémisphérique droite ont longtemps été utilisées afin d’expliquer les résultats de recherches portant sur le traitement émotionnel de stimuli verbaux et non-verbaux, la littérature sur le traitement de mots émotionnels est généralement en désaccord avec ces deux hypothèses et semble converger vers celle du décours temporel. Cette dernière hypothèse stipule que le décours temporal lors du traitement de certains aspects du système sémantique est plus lent pour l’hémisphère droit que pour l’hémisphère gauche. L’objectif de cette thèse est d’examiner la façon dont les mots émotionnels sont traités par les hémisphères cérébraux chez des individus jeunes et âgés. À cet effet, la première étude a pour objectif d’évaluer l’hypothèse du décours temporel en examinant les patrons d’activations relatif au traitement de mots émotionnels par les hémisphères gauche et droit en utilisant un paradigme d’amorçage sémantique et une tâche d’évaluation. En accord avec l’hypothèse du décours temporel, les résultats obtenus pour les hommes montrent que l’amorçage débute plus tôt dans l’hémisphère gauche et plus tard dans l’hémisphère droit. Par contre, les résultats obtenus pour les femmes sont plutôt en accord avec l’hypothèse de valence, car les mots à valence positive sont principalement amorcés dans l’hémisphère gauche, alors que les mots à valence négative sont principalement amorcés dans l’hémisphère droit. Puisque les femmes sont considérées plus « émotives » que les hommes, les résultats ainsi obtenus peuvent être la conséquence des effets de la tâche, qui exige une décision explicite au sujet de la cible. La deuxième étude a pour objectif d’examiner la possibilité que la préservation avec l’âge de l’habileté à traiter des mots émotionnels s’exprime par un phénomène compensatoire d’activations bilatérales fréquemment observées chez des individus âgés et maintenant un haut niveau de performance, ce qui est également connu sous le terme de phénomène HAROLD (Hemispheric Asymmetry Reduction in OLDer adults). En comparant les patrons d’amorçages de mots émotionnels auprès de jeunes adultes et d’adultes âgés performants à des niveaux élevés sur le plan comportemental, les résultats révèlent que l’amorçage se manifeste unilatéralement chez les jeunes participants et bilatéralement chez les participants âgés. Par ailleurs, l’amorçage se produit chez les participants âgés avec un léger délai, ce qui peut résulter d’une augmentation des seuils sensoriels chez les participants âgés, qui nécessiteraient alors davantage de temps pour encoder les stimuli et entamer l’activation à travers le réseau sémantique. Ainsi, la performance équivalente au niveau de la précision retrouvée chez les deux groupes de participants et l’amorçage bilatéral observé chez les participants âgés sont en accord avec l’hypothèse de compensation du phénomène HAROLD.