AVEC 2011–The First International Audio/Visual Emotion Challenge

The Audio/Visual Emotion Challenge and Workshop (AVEC 2011) is the first competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and audiovisual emotion analysis, with all participants competing under strictly the same conditions. This paper first describes the challenge participation conditions. Next follows the data used – the SEMAINE corpus – and its partitioning into train, development, and test partitions for the challenge with labelling in four dimensions, namely activity, expectation, power, and valence. Further, audio and video baseline features are introduced as well as baseline results that use these features for the three sub-challenges of audio, video, and audiovisual emotion recognition.

Frontal EEG/ERP correlates of attentional processes, cortisol and motivational states in adolescents from lower and higher socioeconomic status

Event-related potentials (ERPs) and other electroencephalographic (EEG) evidence show that frontal brain areas of higher and lower socioeconomic status (SES) children are recruited differently during selective attention tasks. We assessed whether multiple variables related to self-regulation (perceived mental effort) emotional states (e.g., anxiety, stress, etc.) and motivational states (e.g., boredom, engagement, etc.) may co-occur or interact with frontal attentional processing probed in two matched-samples of fourteen lower-SES and higher-SES adolescents. ERP and EEG activation were measured during a task probing selective attention to sequences of tones. Pre- and post-task salivary cortisol and self-reported emotional states were also measured. At similar behavioural performance level, the higher-SES group showed a greater ERP differentiation between attended (relevant) and unattended (irrelevant) tones than the lower-SES group. EEG power analysis revealed a cross-over interaction, specifically, lower-SES adolescents showed significantly higher theta power when ignoring rather than attending to tones, whereas, higher-SES adolescents showed the opposite pattern. Significant theta asymmetry differences were also found at midfrontal electrodes indicating left hypo-activity in lower-SES adolescents. The attended vs. unattended difference in right midfrontal theta increased with individual SES rank, and (independently from SES) with lower cortisol task reactivity and higher boredom. Results suggest lower-SES children used additional compensatory resources to monitor/control response inhibition to distracters, perceiving also more mental effort, as compared to higher-SES counterparts. Nevertheless, stress, boredom and other task-related perceived states were unrelated to SES. Ruling out presumed confounds, this study confirms the midfrontal mechanisms responsible for the SES effects on selective attention reported previously and here reflect genuine cognitive differences.

Cognitive and task-related EEG correlates of arithmetic performance in adolescents

Cognitive and neurophysiological correlates of arithmetic calculation, concepts, and applications were examined in 41 adolescents, ages 12-15 years. Psychological and task-related EEG measures which correctly distinguished children who scored low vs. high (using a median split) in each arithmetic subarea were interpreted as indicative of processes involved. Calculation was related to visual-motor sequencing, spatial visualization, theta activity measured during visual-perceptual and verbal tasks at right- and left-hemisphere locations, and right-hemisphere alpha activity measured during a verbal task. Performance on arithmetic word problems was related to spatial visualization and perception, vocabulary, and right-hemisphere alpha activity measured during a verbal task. Results suggest a complex interplay of spatial and sequential operations in arithmetic performance, consistent with processing model concepts of lateralized brain function.

EEG decoding of semantic category reveals distributed representations for single concepts

Achieving a clearer picture of categorial distinctions in the brain is essential for our understanding of the conceptual lexicon, but much more fine-grained investigations are required in order for this evidence to contribute to lexical research. Here we present a collection of advanced data-mining techniques that allows the category of individual concepts to be decoded from single trials of EEG data. Neural activity was recorded while participants silently named images of mammals and tools, and category could be detected in single trials with an accuracy well above chance, both when considering data from single participants, and when group-training across participants. By aggregating across all trials, single concepts could be correctly assigned to their category with an accuracy of 98%. The pattern of classifications made by the algorithm confirmed that the neural patterns identified are due to conceptual category, and not any of a series of processing-related confounds. The time intervals, frequency bands and scalp locations that proved most informative for prediction permit physiological interpretation: the widespread activation shortly after appearance of the stimulus (from 100. ms) is consistent both with accounts of multi-pass processing, and distributed representations of categories. These methods provide an alternative to fMRI for fine-grained, large-scale investigations of the conceptual lexicon. © 2010 Elsevier Inc.