AVEC 2011–The First International Audio/Visual Emotion Challenge

The Audio/Visual Emotion Challenge and Workshop (AVEC 2011) is the first competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and audiovisual emotion analysis, with all participants competing under strictly the same conditions. This paper first describes the challenge participation conditions. Next follows the data used – the SEMAINE corpus – and its partitioning into train, development, and test partitions for the challenge with labelling in four dimensions, namely activity, expectation, power, and valence. Further, audio and video baseline features are introduced as well as baseline results that use these features for the three sub-challenges of audio, video, and audiovisual emotion recognition.

Help needed in medication self-management for people with visual impairment: case-control study

Background: Visual impairment (VI) is rising in prevalence and contributing to increasing morbidity, particularly among older people. Understanding patients' problems is fundamental to achieving optimal health outcomes but little is known about how VI impacts on self-management of medication.

Aim: To compare issues relating to medication self-management between older people with and without VI.

Design and setting: Case-control study with participants aged =65 years, prescribed at least two long-term oral medications daily, living within the community.

Method: The study recruited 156 patients with VI (best corrected visual acuity [BCVA] 6/18 to 3/60) at low-vision clinics; community optometrists identified 158 controls (BCVA 6/9 or better). Researchers visited participants in their homes, administered two validated questionnaires to assess medication adherence (Morisky; Medication Adherence Report Scale [MARS]), and asked questions about medication self-management, beliefs, and support.

Results: Approximately half of the participants in both groups reported perfect adherence on both questionnaires (52.5% Morisky; 43.3%, MARS). Despite using optical aids, few (3%) with VI could read medication information clearly; 24% had difficulty distinguishing different tablets. More people with VI (29%) than controls (13%) (odds ratio [OR] = 2.8; 95% confidence interval [CI] = 1.6 to 5.0) needed help managing their medication, from friends (19% versus 10%) or pharmacists (10% versus 2.5%; OR = 4.4, 95% CI = 1.4 to 13.5); more received social service support (OR = 7.1; 95% CI = 3.9 to 12.9).

Conclusion: Compared to their peers without VI, older people with VI are more than twice as likely to need help in managing medication. In clinical practice in primary care, patients' needs for practical support in taking prescribed treatment must be recognised. Strategies for effective medication self-management should be explored.

Robust visual tracking based on online learning sparse representation

Handling appearance variations is a very challenging problem for visual tracking. Existing methods usually solve this problem by relying on an effective appearance model with two features: (1) being capable of discriminating the tracked target from its background, (2) being robust to the target's appearance variations during tracking. Instead of integrating the two requirements into the appearance model, in this paper, we propose a tracking method that deals with these problems separately based on sparse representation in a particle filter framework. Each target candidate defined by a particle is linearly represented by the target and background templates with an additive representation error. Discriminating the target from its background is achieved by activating the target templates or the background templates in the linear system in a competitive manner. The target's appearance variations are directly modeled as the representation error. An online algorithm is used to learn the basis functions that sparsely span the representation error. The linear system is solved via ℓ1 minimization. The candidate with the smallest reconstruction error using the target templates is selected as the tracking result. We test the proposed approach using four sequences with heavy occlusions, large pose variations, drastic illumination changes and low foreground-background contrast. The proposed approach shows excellent performance in comparison with two latest state-of-the-art trackers.

Adaptations of lateral hand movements to early and late visual occlusion in catching

Recent studies suggested that the control of hand movements in catching involves continuous vision-based adjustments. More insight into these adjustments may be gained by examining the effects of occluding different parts of the ball trajectory. Here, we examined the effects of such occlusion on lateral hand movements when catching balls approaching from different directions, with the occlusion conditions presented in blocks or in randomized order. The analyses showed that late occlusion only had an effect during the blocked presentation, and early occlusion only during the randomized presentation. During the randomized presentation movement biases were more leftward if the preceding trial was an early occlusion trial. The effect of early occlusion during the randomized presentation suggests that the observed leftward movement bias relates to the rightward visual acceleration inherent to the ball trajectories used, while its absence during the blocked presentation seems to reflect trial-by-trial adaptations in the visuomotor gain, reminiscent of dynamic gain control in the smooth pursuit system. The movement biases during the late occlusion block were interpreted in terms of an incomplete motion extrapolation--a reduction of the velocity gain--caused by the fact that participants never saw the to-be-extrapolated part of the ball trajectory. These results underscore that continuous movement adjustments for catching do not only depend on visual information, but also on visuomotor adaptations based on non-visual information.

A comparison of real catching with catching using stereoscopic visual displays

To date, the usefulness of stereoscopic visual displays in research on manual interceptive actions has never been examined. In this study, we compared the catching movements of 8 right-handed participants (6 men, 2 women) in a real environment (with suspended balls swinging past the participant, requiring lateral hand movements for interception) with those in a situation in which similar virtual ball trajectories were displayed stereoscopically in a virtual reality system (Cave Automated Virtual Environment [CAVE]; Cruz-Neira, Sandin, DeFranti, Kenyon, & Hart, 1992) with the head fixated. Catching the virtual ball involved grasping a lightweight ball attached to the palm of the hand. The results showed that, compared to real catching, hand movements in the CAVE were (a) initiated later, (b) less accurate, (c) smoother, and (d) aimed more directly at the interception point. Although the latter 3 observations might be attributable to the delayed movement initiation observed in the CAVE, this delayed initiation might have resulted from the use of visual displays. This suggests that stereoscopic visual displays such as present in many virtual reality systems should be used circumspectly in the experimental study of catching and should be used only to address research questions requiring no detailed analysis of the information-based online control of the catching movements.

Reinforced concrete wall construction formed with OSB:First published use in the United Kingdom and acknowledged by Terry Pawson Architects as the source of inspiration for the internal concrete finish of the 2010 Carlow VISUAL Centre for Contemporary Art.

The artefact was published in the following :

Bennett, D., (October 2007), Architectural Insitu Concrete, RIBA Publishing, London, , ISBN 124-3671-245, pp 101-103

Bennett, D., (2008), Concrete Elegance Four, London, Concrete Centre and RIBA Publishing, pp cover, c, 4, 9-12 & back.

Stacey, Professor M., (2011) Concrete: a studio design guide, London, Concrete Centre and RIBA Publishing, pp74-75.

Understanding Online Audio-Visual Content: A European Initiative, Media Literacy and the User

Recent debates about media literacy and the internet have begun to acknowledge the importance of active user-engagement and interaction. It is not enough simply to access material online, but also to comment upon it and re-use. Yet how do these new user expectations fit within digital initiatives which increase access to audio-visual-content but which prioritise access and preservation of archives and online research rather than active user-engagement? This article will address these issues of media literacy in relation to audio-visual content. It will consider how these issues are currently being addressed, focusing particularly on the high-profile European initiative EUscreen. EUscreen brings together 20 European television archives into a single searchable database of over 40,000 digital items. Yet creative re-use restrictions and copyright issues prevent users from re-working the material they find on the site. Instead of re-use, EUscreen instead offers access and detailed contextualisation of its collection of material. But if the emphasis for resources within an online environment rests no longer upon access but on user-engagement, what does EUscreen and similar sites offer to different users?

Robust Audio-Visual Speech Recognition under Noisy Audio-Video Conditions

This paper presents the maximum weighted stream posterior (MWSP) model as a robust and efficient stream integration method for audio-visual speech recognition in environments, where the audio or video streams may be subjected to unknown and time-varying corruption. A significant advantage of MWSP is that it does not require any specific measurements of the signal in either stream to calculate appropriate stream weights during recognition, and as such it is modality-independent. This also means that MWSP complements and can be used alongside many of the other approaches that have been proposed in the literature for this problem. For evaluation we used the large XM2VTS database for speaker-independent audio-visual speech recognition. The extensive tests include both clean and corrupted utterances with corruption added in either/both the video and audio streams using a variety of types (e.g., MPEG-4 video compression) and levels of noise. The experiments show that this approach gives excellent performance in comparison to another well-known dynamic stream weighting approach and also compared to any fixed-weighted integration approach in both clean conditions or when noise is added to either stream. Furthermore, our experiments show that the MWSP approach dynamically selects suitable integration weights on a frame-by-frame basis according to the level of noise in the streams and also according to the naturally fluctuating relative reliability of the modalities even in clean conditions. The MWSP approach is shown to maintain robust recognition performance in all tested conditions, while requiring no prior knowledge about the type or level of noise.

Altered long-range alpha-band synchronization during visual short-term memory retention in children born very preterm

Children born very preterm, even when intelligence is broadly normal, often experience selective difficulties in executive function and visual-spatial processing. Development of structural cortical connectivity is known to be altered in this group, and functional magnetic resonance imaging (fMRI) evidence indicates that very preterm children recruit different patterns of functional connectivity between cortical regions during cognition. Synchronization of neural oscillations across brain areas has been proposed as a mechanism for dynamically assigning functional coupling to support perceptual and cognitive processing, but little is known about what role oscillatory synchronization may play in the altered neurocognitive development of very preterm children. To investigate this, we recorded magnetoencephalographic (MEG) activity while 7-8 year old children born very preterm and age-matched full-term controls performed a visual short-term memory task. Very preterm children exhibited reduced long-range synchronization in the alpha-band during visual short-term memory retention, indicating that cortical alpha rhythms may play a critical role in altered patterns functional connectivity expressed by this population during cognitive and perceptual processing. Long-range alpha-band synchronization was also correlated with task performance and visual-perceptual ability within the very preterm group, indicating that altered alpha oscillatory mechanisms mediating transient functional integration between cortical regions may be relevant to selective problems in neurocognitive development in this vulnerable population at school age.

Long-range synchronization and local desynchronization of alpha oscillations during visual short-term memory retention in children

Local alpha-band synchronization has been associated with both cortical idling and active inhibition. Recent evidence, however, suggests that long-range alpha synchronization increases functional coupling between cortical regions. We demonstrate increased long-range alpha and beta band phase synchronization during short-term memory retention in children 6-10 years of age. Furthermore, whereas alpha-band synchronization between posterior cortex and other regions is increased during retention, local alpha-band synchronization over posterior cortex is reduced. This constitutes a functional dissociation for alpha synchronization across local and long-range cortical scales. We interpret long-range synchronization as reflecting functional integration within a network of frontal and visual cortical regions. Local desynchronization of alpha rhythms over posterior cortex, conversely, likely arises because of increased engagement of visual cortex during retention.

Socio-economic deprivation and visual acuity at presentation in exudative age-related macular degeneration

Aim: To evaluate the influence of socio-economic factors on visual acuity (VA) at presentation in exudative age- related macular degeneration (AMD). Methods: The medical records of all consecutive patients with newly diagnosed exudative AMD examined at the Ophthalmology Departments of Grampian University Hospitals-NHS Trust, Aberdeen, and Gartnavel General Hospital, Glasgow, between July 2004 and June 2005, were reviewed. Demographics, duration of symptoms, VA in study and fellow eye, exudative AMD characteristics, status of fellow eye and patient home address, used to determine the Scottish Index of Multiple Deprivation (SIMD) score, were recorded. The effect of these parameters on VA at presentation was investigated using general linear modelling. Results: Two-hundred and forty patients (median age 79 years) were included in this study; 44 (18.3%) belonged to the lowest 20% SIMD score (most deprived). Age and location and type of the choroidal neovascular- isation were statistically significantly associated with VA at presentation (p = 0.003, p

Fundus autofluorescence in patients with age-related macular degeneration and high risk of visual loss

PURPOSE: To describe fundus autofluorescence (AF) patterns and their change over time in patients with age-related macular degeneration (AMD) and high risk of visual loss participating in the drusen laser study (DLS). DESIGN: Randomized clinical trial. METHODS: The study population consisted of 29 patients (35 eyes) participating in the DLS, which is a prospective, randomized, controlled clinical trial of prophylactic laser therapy in patients with AMD and high risk of neovascular complications. The intervention consisted of 16 eyes having prophylactic laser and 19 receiving no treatment. The main outcome measures were changes in the distribution of drusen and AF. Patients were reviewed for a median follow-up or 24 months (range 12-36 months). RESULTS: At baseline, four patterns of fundus AF were recognized: focal increased AF (n = 18), reticular AF (n = 3), combined focal and reticular AF (n = 2), and homogeneous AF (n = 12). At last follow-up, fundus AF remained unchanged in 15 untreated (78%) and in seven treated (43%) eyes. In only one untreated eye, focal areas of increased AF returned to background levels and were no longer detectable at last follow-up, compared with six treated eyes. This difference was statistically significant (P = .03). Only large foveal soft drusen (drusenoid pigment epithelium detachments) consistently corresponded with focal changes in AF, whereas no obvious correspondence was found between small soft drusen located elsewhere and changes in AF. CONCLUSION: The lack of obvious correspondence between the distribution of drusen and of AF found in this study appears to indicate that drusen and AF represent independent measures of aging in the posterior pole. © 2002 Elsevier Science Inc. All rights reserved.

Transpupillary thermotherapy for choroidal melanoma:Tumor control and visual results in 100 consecutive cases

Objective: The authors evaluated the results of primary transpupillary thermotherapy for choroidal melanoma in 100 cases. Design: Prospective nonrandomized analysis of treatment method. Participants: One hundred patients with choroidal melanoma were studied. Main Outcome Measures: Tumor response, ocular side effects, and visual results. Results: Of 100 consecutive patients with choroidal melanoma treated with transpupillary thermotherapy, the mean tumor basal diameter was 7.1 mm and tumor thickness was 2.8 mm. The tumor margin touched the optic disc in 34 eyes (34%) and was beneath the fovea in 42 eyes (42%). Documented growth was present in 64 eyes (64%), and known clinical risks for growth were present in all of the remaining 36 eyes (36%), with an average of 4 of 5 statistical risk factors for growth per tumor. After a mean of three treatment sessions and 14 months of follow-up, the mean tumor thickness was reduced to 1.4 mm. Treatment was successful in 94 eyes (94%) and failed in 6 eyes (6%). Three patients with amelanotic tumors showed no initial response to thermotherapy, but subsequent intravenous indocyanine green administration during thermotherapy resulted in improved heat absorption and tumor regression to a flat scar. The six eyes classified as treatment failures included four eyes with tumors that showed partial or no response to thermotherapy, thus requiring plaque radiotherapy or enucleation, and two eyes with recurrence, subsequently controlled with additional thermotherapy. After treatment, the visual acuity was the same (within 1 line) or better than the pretreatment visual acuity in 58 eyes (58%) and worse in 42 eyes (42%). The main reasons for poorer vision included treatment through the foveola for subfoveal tumor (25 eyes), retinal traction (10 eyes), retinal vascular obstruction (5 eyes), optic disc edema (1 eye), and unrelated ocular ischemia (1 eye). Temporal location (versus nasal and superior, P = 0.02) and greater distance from the optic disc (P = 0.04) were risks for retinal traction. Conclusions: Transpupillary thermotherapy may be an effective treatment for small posterior choroidal melanoma, especially those near the optic disc and fovea. Despite satisfactory local tumor control, ocular side effects can result in decreased vision. Longer follow- up will be necessary to assess the impact of thermotherapy on ultimate local tumor control and metastatic disease.