Robust Audio-Visual Speech Recognition under Noisy Audio-Video Conditions

This paper presents the maximum weighted stream posterior (MWSP) model as a robust and efficient stream integration method for audio-visual speech recognition in environments, where the audio or video streams may be subjected to unknown and time-varying corruption. A significant advantage of MWSP is that it does not require any specific measurements of the signal in either stream to calculate appropriate stream weights during recognition, and as such it is modality-independent. This also means that MWSP complements and can be used alongside many of the other approaches that have been proposed in the literature for this problem. For evaluation we used the large XM2VTS database for speaker-independent audio-visual speech recognition. The extensive tests include both clean and corrupted utterances with corruption added in either/both the video and audio streams using a variety of types (e.g., MPEG-4 video compression) and levels of noise. The experiments show that this approach gives excellent performance in comparison to another well-known dynamic stream weighting approach and also compared to any fixed-weighted integration approach in both clean conditions or when noise is added to either stream. Furthermore, our experiments show that the MWSP approach dynamically selects suitable integration weights on a frame-by-frame basis according to the level of noise in the streams and also according to the naturally fluctuating relative reliability of the modalities even in clean conditions. The MWSP approach is shown to maintain robust recognition performance in all tested conditions, while requiring no prior knowledge about the type or level of noise.

Altered long-range alpha-band synchronization during visual short-term memory retention in children born very preterm

Children born very preterm, even when intelligence is broadly normal, often experience selective difficulties in executive function and visual-spatial processing. Development of structural cortical connectivity is known to be altered in this group, and functional magnetic resonance imaging (fMRI) evidence indicates that very preterm children recruit different patterns of functional connectivity between cortical regions during cognition. Synchronization of neural oscillations across brain areas has been proposed as a mechanism for dynamically assigning functional coupling to support perceptual and cognitive processing, but little is known about what role oscillatory synchronization may play in the altered neurocognitive development of very preterm children. To investigate this, we recorded magnetoencephalographic (MEG) activity while 7-8 year old children born very preterm and age-matched full-term controls performed a visual short-term memory task. Very preterm children exhibited reduced long-range synchronization in the alpha-band during visual short-term memory retention, indicating that cortical alpha rhythms may play a critical role in altered patterns functional connectivity expressed by this population during cognitive and perceptual processing. Long-range alpha-band synchronization was also correlated with task performance and visual-perceptual ability within the very preterm group, indicating that altered alpha oscillatory mechanisms mediating transient functional integration between cortical regions may be relevant to selective problems in neurocognitive development in this vulnerable population at school age.

Long-range synchronization and local desynchronization of alpha oscillations during visual short-term memory retention in children

Local alpha-band synchronization has been associated with both cortical idling and active inhibition. Recent evidence, however, suggests that long-range alpha synchronization increases functional coupling between cortical regions. We demonstrate increased long-range alpha and beta band phase synchronization during short-term memory retention in children 6-10 years of age. Furthermore, whereas alpha-band synchronization between posterior cortex and other regions is increased during retention, local alpha-band synchronization over posterior cortex is reduced. This constitutes a functional dissociation for alpha synchronization across local and long-range cortical scales. We interpret long-range synchronization as reflecting functional integration within a network of frontal and visual cortical regions. Local desynchronization of alpha rhythms over posterior cortex, conversely, likely arises because of increased engagement of visual cortex during retention.

Anticipatory Planning Reveals Segmentation of Cortical Motor Output During Action Observation

It has been argued that the variation in brain activity that occurs when observing another person reflects a representation of actions that is indivisible, and which plays out in full once the intent of the actor can be discerned. We used transcranial magnetic stimulation to probe the excitability of corticospinal projections to 2 intrinsic hand muscles while motions to reach and grasp an object were observed. A symbolic cue either faithfully indicated the required final orientation of the object and thus the nature of the grasp that was required, or was in conflict with the movement subsequently displayed. When the cue was veridical, modulation of excitability was in accordance with the functional role of the muscles in the action observed. If however the cue had indicated that the alternative grasp would be required, modulation of output to first dorsal interosseus was consistent with the action specified, rather than the action observed-until the terminal phase of the motion sequence during which the object was seen lifted. Modulation of corticospinal output during observation is thus segmented-it progresses initially in accordance with the action anticipated, and if discrepancies are revealed by visual input, coincides thereafter with that of the action seen.

Virtual Thrower Versus Real Goalkeeper: The Influence of Different Visual Conditions on Performance

In order to use virtual reality as a sport analysis tool, we need to be sure that an immersed athlete reacts realistically in a virtual environment. This has been validated for a real handball goalkeeper facing a virtual thrower. However, we currently ignore which visual variables induce a realistic motor behavior of the immersed handball goalkeeper. In this study, we used virtual reality to dissociate the visual information related to the movements of the player from the visual information related to the trajectory of the ball. Thus, the aim is to evaluate the relative influence of these different visual information sources on the goalkeeper's motor behavior. We tested 10 handball goalkeepers who had to predict the final position of the virtual ball in the goal when facing the following: only the throwing action of the attacking player (TA condition), only the resulting ball trajectory (BA condition), and both the throwing action of the attacking player and the resulting ball trajectory (TB condition). Here we show that performance was better in the BA and TB conditions, but contrary to expectations, performance was substantially worse in the TA condition. A significant effect of ball landing zone does, however, suggest that the relative importance between visual information from the player and the ball depends on the targeted zone in the goal. In some cases, body-based cues embedded in the throwing actions may have a minor influence on the ball trajectory and vice versa. Kinematics analysis was then combined with these results to determine why such differences occur depending on the ball landing zone and consequently how it can clarify the role of different sources of visual information on the motor behavior of an athlete immersed in a virtual environment.

Role of early visual cortex in trans-saccadic memory of object features

Early visual cortex (EVC) participates in visual feature memory and the updating of remembered locations across saccades, but its role in the trans-saccadic integration of object features is unknown. We hypothesized that if EVC is involved in updating object features relative to gaze, feature memory should be disrupted when saccades remap an object representation into a simultaneously perturbed EVC site. To test this, we applied transcranial magnetic stimulation (TMS) over functional magnetic resonance imaging-localized EVC clusters corresponding to the bottom left/right visual quadrants (VQs). During experiments, these VQs were probed psychophysically by briefly presenting a central object (Gabor patch) while subjects fixated gaze to the right or left (and above). After a short memory interval, participants were required to detect the relative change in orientation of a re-presented test object at the same spatial location. Participants either sustained fixation during the memory interval (fixation task) or made a horizontal saccade that either maintained or reversed the VQ of the object (saccade task). Three TMS pulses (coinciding with the pre-, peri-, and postsaccade intervals) were applied to the left or right EVC. This had no effect when (a) fixation was maintained, (b) saccades kept the object in the same VQ, or (c) the EVC quadrant corresponding to the first object was stimulated. However, as predicted, TMS reduced performance when saccades (especially larger saccades) crossed the remembered object location and brought it into the VQ corresponding to the TMS site. This suppression effect was statistically significant for leftward saccades and followed a weaker trend for rightward saccades. These causal results are consistent with the idea that EVC is involved in the gaze-centered updating of object features for trans-saccadic memory and perception.

Postural Control Deficits in Autism Spectrum Disorder: The Role of Sensory Integration

We investigated the nature of sensory integration deficits in postural control of young adults with ASD. Postural control was assessed in a fixed environment, and in three environments in which sensory information about body sway from visual, proprioceptive or both channels was inaccurate. Furthermore, two levels of inaccurate information were used within each channel (gain 1 and 1.6). ASD participants showed greater postural sway when information from proprioceptive and both channels were inaccurate. In addition, control participants' ellipse area at gain 1.6 was identical to ASD participants' at gain 1, reflecting hyper-reactivity in ASD. Our results provide evidence for hyper-reactivity in posture-related sensory information, which reflects a general, rather than channel-specific sensory integration impairment in ASD.

A population-based study of visual impairment among pre-school children in Beijing: the Beijing study of visual impairment in children.

PURPOSE: To evaluate the prevalence and causes of visual impairment among Chinese children aged 3 to 6 years in Beijing. DESIGN: Population-based prevalence survey. METHODS: Presenting and pinhole visual acuity were tested using picture optotypes or, in children with pinhole vision < 6/18, a Snellen tumbling E chart. Comprehensive eye examinations and cycloplegic refraction were carried out for children with pinhole vision < 6/18 in the better-seeing eye. RESULTS: All examinations were completed on 17,699 children aged 3 to 6 years (95.3% of sample). Subjects with bilateral correctable low vision (presenting vision < 6/18 correctable to >or= 6/18) numbered 57 (0.322%; 95% confidence interval [CI], 0.237% to 0.403%), while 14 (0.079%; 95% CI, 0.038% to 0.120%) had bilateral uncorrectable low vision (best-corrected vision of < 6/18 and >or= 3/60), and 5 subjects (0.028%; 95% CI, 0.004% to 0.054%) were bilaterally blind (best-corrected acuity < 3/60). The etiology of 76 cases of visual impairment included: refractive error in 57 children (75%), hereditary factors (microphthalmos, congenital cataract, congenital motor nystagmus, albinism, and optic nerve disease) in 13 children (17.1 %), amblyopia in 3 children (3.95%), and cortical blindness in 1 child (1.3%). The cause of visual impairment could not be established in 2 (2.63%) children. The prevalence of visual impairment did not differ by gender, but correctable low vision was significantly (P < .0001) more common among urban as compared with rural children. CONCLUSION: The leading causes of visual impairment among Chinese preschool-aged children are refractive error and hereditary eye diseases. A higher prevalence of refractive error is already present among urban as compared with rural children in this preschool population.

Measuring healthcare integration: Operationalization of a framework for a systems evaluation of palliative care structures, processes, and outcomes

BACKGROUND: Healthcare integration is a priority in many countries, yet there remains little direction on how to systematically evaluate this construct to inform further development. The examination of community-based palliative care networks provides an ideal opportunity for the advancement of integration measures, in consideration of how fundamental provider cohesion is to effective care at end of life.

AIM: This article presents a variable-oriented analysis from a theory-based case study of a palliative care network to help bridge the knowledge gap in integration measurement.

DESIGN: Data from a mixed-methods case study were mapped to a conceptual framework for evaluating integrated palliative care and a visual array depicting the extent of key factors in the represented palliative care network was formulated.

SETTING/PARTICIPANTS: The study included data from 21 palliative care network administrators, 86 healthcare professionals, and 111 family caregivers, all from an established palliative care network in Ontario, Canada.

RESULTS: The framework used to guide this research proved useful in assessing qualities of integration and functioning in the palliative care network. The resulting visual array of elements illustrates that while this network performed relatively well at the multiple levels considered, room for improvement exists, particularly in terms of interventions that could facilitate the sharing of information.

CONCLUSION: This study, along with the other evaluative examples mentioned, represents important initial attempts at empirically and comprehensively examining network-integrated palliative care and healthcare integration in general.