AVEC 2011–The First International Audio/Visual Emotion Challenge

The Audio/Visual Emotion Challenge and Workshop (AVEC 2011) is the first competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and audiovisual emotion analysis, with all participants competing under strictly the same conditions. This paper first describes the challenge participation conditions. Next follows the data used – the SEMAINE corpus – and its partitioning into train, development, and test partitions for the challenge with labelling in four dimensions, namely activity, expectation, power, and valence. Further, audio and video baseline features are introduced as well as baseline results that use these features for the three sub-challenges of audio, video, and audiovisual emotion recognition.

Help needed in medication self-management for people with visual impairment: case-control study

Background: Visual impairment (VI) is rising in prevalence and contributing to increasing morbidity, particularly among older people. Understanding patients' problems is fundamental to achieving optimal health outcomes but little is known about how VI impacts on self-management of medication.

Aim: To compare issues relating to medication self-management between older people with and without VI.

Design and setting: Case-control study with participants aged =65 years, prescribed at least two long-term oral medications daily, living within the community.

Method: The study recruited 156 patients with VI (best corrected visual acuity [BCVA] 6/18 to 3/60) at low-vision clinics; community optometrists identified 158 controls (BCVA 6/9 or better). Researchers visited participants in their homes, administered two validated questionnaires to assess medication adherence (Morisky; Medication Adherence Report Scale [MARS]), and asked questions about medication self-management, beliefs, and support.

Results: Approximately half of the participants in both groups reported perfect adherence on both questionnaires (52.5% Morisky; 43.3%, MARS). Despite using optical aids, few (3%) with VI could read medication information clearly; 24% had difficulty distinguishing different tablets. More people with VI (29%) than controls (13%) (odds ratio [OR] = 2.8; 95% confidence interval [CI] = 1.6 to 5.0) needed help managing their medication, from friends (19% versus 10%) or pharmacists (10% versus 2.5%; OR = 4.4, 95% CI = 1.4 to 13.5); more received social service support (OR = 7.1; 95% CI = 3.9 to 12.9).

Conclusion: Compared to their peers without VI, older people with VI are more than twice as likely to need help in managing medication. In clinical practice in primary care, patients' needs for practical support in taking prescribed treatment must be recognised. Strategies for effective medication self-management should be explored.

Robust visual tracking based on online learning sparse representation

Handling appearance variations is a very challenging problem for visual tracking. Existing methods usually solve this problem by relying on an effective appearance model with two features: (1) being capable of discriminating the tracked target from its background, (2) being robust to the target's appearance variations during tracking. Instead of integrating the two requirements into the appearance model, in this paper, we propose a tracking method that deals with these problems separately based on sparse representation in a particle filter framework. Each target candidate defined by a particle is linearly represented by the target and background templates with an additive representation error. Discriminating the target from its background is achieved by activating the target templates or the background templates in the linear system in a competitive manner. The target's appearance variations are directly modeled as the representation error. An online algorithm is used to learn the basis functions that sparsely span the representation error. The linear system is solved via ℓ1 minimization. The candidate with the smallest reconstruction error using the target templates is selected as the tracking result. We test the proposed approach using four sequences with heavy occlusions, large pose variations, drastic illumination changes and low foreground-background contrast. The proposed approach shows excellent performance in comparison with two latest state-of-the-art trackers.

Adaptations of lateral hand movements to early and late visual occlusion in catching

Recent studies suggested that the control of hand movements in catching involves continuous vision-based adjustments. More insight into these adjustments may be gained by examining the effects of occluding different parts of the ball trajectory. Here, we examined the effects of such occlusion on lateral hand movements when catching balls approaching from different directions, with the occlusion conditions presented in blocks or in randomized order. The analyses showed that late occlusion only had an effect during the blocked presentation, and early occlusion only during the randomized presentation. During the randomized presentation movement biases were more leftward if the preceding trial was an early occlusion trial. The effect of early occlusion during the randomized presentation suggests that the observed leftward movement bias relates to the rightward visual acceleration inherent to the ball trajectories used, while its absence during the blocked presentation seems to reflect trial-by-trial adaptations in the visuomotor gain, reminiscent of dynamic gain control in the smooth pursuit system. The movement biases during the late occlusion block were interpreted in terms of an incomplete motion extrapolation--a reduction of the velocity gain--caused by the fact that participants never saw the to-be-extrapolated part of the ball trajectory. These results underscore that continuous movement adjustments for catching do not only depend on visual information, but also on visuomotor adaptations based on non-visual information.

A comparison of real catching with catching using stereoscopic visual displays

To date, the usefulness of stereoscopic visual displays in research on manual interceptive actions has never been examined. In this study, we compared the catching movements of 8 right-handed participants (6 men, 2 women) in a real environment (with suspended balls swinging past the participant, requiring lateral hand movements for interception) with those in a situation in which similar virtual ball trajectories were displayed stereoscopically in a virtual reality system (Cave Automated Virtual Environment [CAVE]; Cruz-Neira, Sandin, DeFranti, Kenyon, & Hart, 1992) with the head fixated. Catching the virtual ball involved grasping a lightweight ball attached to the palm of the hand. The results showed that, compared to real catching, hand movements in the CAVE were (a) initiated later, (b) less accurate, (c) smoother, and (d) aimed more directly at the interception point. Although the latter 3 observations might be attributable to the delayed movement initiation observed in the CAVE, this delayed initiation might have resulted from the use of visual displays. This suggests that stereoscopic visual displays such as present in many virtual reality systems should be used circumspectly in the experimental study of catching and should be used only to address research questions requiring no detailed analysis of the information-based online control of the catching movements.

Reinforced concrete wall construction formed with OSB:First published use in the United Kingdom and acknowledged by Terry Pawson Architects as the source of inspiration for the internal concrete finish of the 2010 Carlow VISUAL Centre for Contemporary Art.

The artefact was published in the following :

Bennett, D., (October 2007), Architectural Insitu Concrete, RIBA Publishing, London, , ISBN 124-3671-245, pp 101-103

Bennett, D., (2008), Concrete Elegance Four, London, Concrete Centre and RIBA Publishing, pp cover, c, 4, 9-12 & back.

Stacey, Professor M., (2011) Concrete: a studio design guide, London, Concrete Centre and RIBA Publishing, pp74-75.

Cognitive functioning in subjects with recent-onset psychosis from a low-middle-income environment: Multiple-domain deficits and longitudinal evaluation

Cognitive deficits are a key feature of recent-onset psychosis, but there is no consensus on whether such deficits are generalized or confined to specific domains. Besides, it is unclear whether cognitive deficits: a) are found in psychotic patients in samples from outside high-income countries; and b) whether they progress uniformly over time in schizophrenia and affective psychoses. We applied 12 tests organized into eight cognitive domains, comparing psychosis patients (n = 56, time from initial contact = 677.95+/-183.27 days) versus healthy controls (n = 70) recruited from the same area of Sao Paulo, Brazil. Longitudinal comparisons (digit span and verbal fluency) were conducted between a previous assessment of the subjects carried out at their psychosis onset, and the current follow-up evaluation. Psychosis patients differed significantly from controls on five domains, most prominently on verbal memory. Cognitive deficits remained detectable in separate comparisons of the schizophrenia subgroup and, to a lesser extent, the affective psychosis subjects against controls. Longitudinal comparisons indicated significant improvement in schizophrenia, affective psychoses, and control subjects, with no significant group-by-time interactions. Our results reinforce the view that there are generalized cognitive deficits in association with recent-onset psychoses, particularly of non-affective nature, which persist over time. (C) 2009 Elsevier Ireland Ltd. All rights reserved.

Cognitive deficits in first-episode psychosis: A population-based study in Sao Paulo, Brazil

Background: Studies conducted in high-income countries have reported significant cognitive deficits in first on set schizophrenia subjects relative to asymptotic controls, and it has been suggested that the severity of such deficits could be directly related to the duration of untreated psychosis (DUP). It is relevant to conduct similar studies in developing countries, given the supposedly better outcome for schizophrenia patients living in the latter environments.

Methods: We applied verbal fluency and digit span tests to an epidemiological-based series of patients with first-onset psychoses (n = 179) recruited in the city of Sao Paulo, and compared the findings with those from non-psychotic control subjects randomly selected from the same geographical areas (n=383).

Results: Psychosis subjects showed lower scores on the three tests relative to controls, with greatest between-group differences for the backward digit span task (p < 0.0001). There were no significant differences between subjects with affective and schizophreniform psychosis. Cognitive performance indices were negatively correlated with the severity of negative symptoms, but showed no relation to DUP.

Conclusion: We found significant cognitive deficits in patients investigated early during the course of psychotic disorders in an environment that is distinct from those where the subjects investigated in previous studies have been drawn from. We found no support to the hypothesis of an association between greater cognitive deficits and a longer DUP. (c) 2006 Published by Elsevier B.V.

Volume reduction of the corpus callosum and its relationship with deficits in interhemispheric transfer of information in recent-onset psychosis

The present study aimed to investigate the presence of corpus callosum (CC) volume deficits in a population-based recent-onset psychosis (ROP) sample, and whether CC volume relates to interhemispheric communication deficits. For this purpose, we used voxel-based morphometry comparisons of magnetic resonance imaging data between ROP (n = 122) and healthy control (n = 94) subjects. Subgroups (38 ROP and 39 controls) were investigated for correlations between CC volumes and performance on the Crossed Finger Localization Test (CFLT). Significant CC volume reductions in ROP subjects versus controls emerged after excluding substance misuse and non-right-handedness. CC reductions retained significance in the schizophrenia subgroup but not in affective psychoses subjects. There were significant positive correlations between CC volumes and CFLT scores in ROP subjects, specifically in subtasks involving interhemispheric communication. From these results, we can conclude that CC volume reductions are present in association with ROP. The relationship between such deficits and CFLT performance suggests that interhemispheric communication impairments are directly linked to CC abnormalities in ROP. (C) 2010 Elsevier Ireland Ltd. All rights reserved.

Episodic memory and learning in patients with chronic schizophrenia

This study explored the pattern of memory functioning in 58 patients with chronic schizophrenia and compared their performance with 53 normal controls. Multiple domains of memory were assessed, including verbal and nonverbal memory span, verbal and non-verbal paired associate learning, verbal and visual long-term memory, spatial and non-spatial conditional associative learning, recognition memory and memory for temporal order. Consistent with previous studies, substantial deficits in long-term memory were observed, with relative preservation of memory span. Memory for temporal order and recognition memory was intact, although significant deficits were observed on the conditional associative learning tasks. There was no evidence of lateralized memory impairment. In these respects, the pattern of memory impairment in schizophrenia is more similar in nature to that found in patients with memory dysfunction following mesiotemporal lobe lesions, rather than that associated with focal frontal lobe damage. (C) 1999 Elsevier Science B.V. All rights reserved.

Mood congruent psychotic symptoms and specific cognitive deficits in carriers of the novel schizophrenia risk variant at MIR-137

Objective: The Schizophrenia Psychiatric Genome-wide Association (GWAS) Consortium recently reported on five novel schizophrenia susceptibility loci. The most significant finding mapped to a micro-RNA, MIR-137, which may be involved in regulating the function of other schizophrenia and bipolar disorder susceptibility genes. Method: We genotyped 821 patients with confirmed DSM-IV diagnoses of schizophrenia, bipolar affective disorder I and schizoaffective disorder for the risk SNP (rs1625579) and investigated the clinical profiles of risk allele carriers using a within-case design. We also assessed neurocognitive performance in a subset of cases (n=399) and controls (n=171). Results: Carriers of the risk allele had lower scores for an OPCRIT-derived positive symptom factor (p=0.04) and lower scores on a lifetime measure of psychosis incongruity (p=0.017). Risk allele carriers also had more cognitive deficits involving episodic memory and attentional control. Conclusion: This is the first evidence that the MIR-137 risk variant may be associated with a specific subgroup of psychosis patients. Although the effect of this single SNP was not clinically relevant, investigation of the impact of carrying multiple risk SNPs in the MIR-137 regulatory network on diagnosis and illness profile may be warranted. © 2012 Elsevier Ireland Ltd.

Understanding Online Audio-Visual Content: A European Initiative, Media Literacy and the User

Recent debates about media literacy and the internet have begun to acknowledge the importance of active user-engagement and interaction. It is not enough simply to access material online, but also to comment upon it and re-use. Yet how do these new user expectations fit within digital initiatives which increase access to audio-visual-content but which prioritise access and preservation of archives and online research rather than active user-engagement? This article will address these issues of media literacy in relation to audio-visual content. It will consider how these issues are currently being addressed, focusing particularly on the high-profile European initiative EUscreen. EUscreen brings together 20 European television archives into a single searchable database of over 40,000 digital items. Yet creative re-use restrictions and copyright issues prevent users from re-working the material they find on the site. Instead of re-use, EUscreen instead offers access and detailed contextualisation of its collection of material. But if the emphasis for resources within an online environment rests no longer upon access but on user-engagement, what does EUscreen and similar sites offer to different users?

Robust Audio-Visual Speech Recognition under Noisy Audio-Video Conditions

This paper presents the maximum weighted stream posterior (MWSP) model as a robust and efficient stream integration method for audio-visual speech recognition in environments, where the audio or video streams may be subjected to unknown and time-varying corruption. A significant advantage of MWSP is that it does not require any specific measurements of the signal in either stream to calculate appropriate stream weights during recognition, and as such it is modality-independent. This also means that MWSP complements and can be used alongside many of the other approaches that have been proposed in the literature for this problem. For evaluation we used the large XM2VTS database for speaker-independent audio-visual speech recognition. The extensive tests include both clean and corrupted utterances with corruption added in either/both the video and audio streams using a variety of types (e.g., MPEG-4 video compression) and levels of noise. The experiments show that this approach gives excellent performance in comparison to another well-known dynamic stream weighting approach and also compared to any fixed-weighted integration approach in both clean conditions or when noise is added to either stream. Furthermore, our experiments show that the MWSP approach dynamically selects suitable integration weights on a frame-by-frame basis according to the level of noise in the streams and also according to the naturally fluctuating relative reliability of the modalities even in clean conditions. The MWSP approach is shown to maintain robust recognition performance in all tested conditions, while requiring no prior knowledge about the type or level of noise.