Facial emotion processing in schizophrenia : no evidence for a deficit specific to negative emotions in a differential deficit design

People with schizophrenia perform poorly when recognising facial expressions of emotion, particularly negative emotions such as fear. This finding has been taken as evidence of a “negative emotion specific deficit”, putatively associated with a dysfunction in the limbic system, particularly the amygdala. An alternative explanation is that greater difficulty in recognising negative emotions may reflect a priori differences in task difficulty. The present study uses a differential deficit design to test the above argument. Facial emotion recognition accuracy for seven emotion categories was compared across three groups. Eighteen schizophrenia patients and one group of healthy age- and gender-matched controls viewed identical sets of stimuli. A second group of 18 age- and gender-matched controls viewed a degraded version of the same stimuli. The level of stimulus degradation was chosen so as to equate overall level of accuracy to the schizophrenia patients. Both the schizophrenia group and the degraded image control group showed reduced overall recognition accuracy and reduced recognition accuracy for fearful and sad facial stimuli compared with the intact-image control group. There were no differences in recognition accuracy for any emotion category between the schizophrenia group and the degraded image control group. These findings argue against a negative emotion specific deficit in schizophrenia.

Functional MRI of facial emotion recognition deficits in schizophrenia and their electrophysiological correlates

Empirical evidence suggests impaired facial emotion recognition in schizophrenia. However, the nature of this deficit is the subject of ongoing research. The current study tested the hypothesis that a generalized deficit at an early stage of face-specific processing (i.e. putatively subserved by the fusiform gyrus) accounts for impaired facial emotion recognition in schizophrenia as opposed to the Negative Emotion-specific Deficit Model, which suggests impaired facial information processing at subsequent stages. Event-related potentials (ERPs) were recorded from 11 schizophrenia patients and 15 matched controls while performing a gender discrimination and a facial emotion recognition task. Significant reduction of the face-specific vertex positive potential (VPP) at a peak latency of 165 ms was confirmed in schizophrenia subjects whereas their early visual processing, as indexed by P1, was found to be intact. Attenuated VPP was found to correlate with subsequent P3 amplitude reduction and to predict accuracy when performing a facial emotion discrimination task. A subset of ten schizophrenia patients and ten matched healthy control subjects also performed similar tasks in the magnetic resonance imaging scanner. Patients showed reduced blood oxygenation level-dependent (BOLD) activation in the fusiform, inferior frontal, middle temporal and middle occipital gyrus as well as in the amygdala. Correlation analyses revealed that VPP and the subsequent P3a ERP components predict fusiform gyrus BOLD activation. These results suggest that problems in facial affect recognition in schizophrenia may represent flow-on effects of a generalized deficit in early visual processing.

Differential susceptibility to performance degradation across categories of facial emotion - a model confirmation

Patients with a number of psychiatric and neuropathological conditions demonstrate problems in recognising facial expressions of emotion. Research indicating that patients with schizophrenia perform more poorly in the recognition of negative valence facial stimuli than positive valence stimuli has been interpreted as evidence of a negative emotion specific deficit. An alternate explanation rests in the psychometric properties of the stimulus materials. This model suggests that the pattern of impairment observed in schizophrenia may reflect initial discrepancies in task difficulty between stimulus categories, which are not apparent in healthy subjects because of ceiling effects. This hypothesis is tested, by examining the performance of healthy subjects in a facial emotion categorisation task with three levels of stimulus resolution. Results confirm the predictions of the model, showing that performance degrades differentially across emotion categories, with the greatest deterioration to negative valence stimuli. In the light of these results, a possible methodology for detecting emotion specific deficits in clinical samples is discussed.

FaceXpress : an integrated software suite for facial emotion stimulus manipulation and facial measurement

The characterisation of facial expression through landmark-based analysis methods such as FACEM (Pilowsky & Katsikitis, 1994) has a variety of uses in psychiatric and psychological research. In these systems, important structural relationships are extracted from images of facial expressions by the analysis of a pre-defined set of feature points. These relationship measures may then be used, for instance, to assess the degree of variability and similarity between different facial expressions of emotion. FaceXpress is a multimedia software suite that provides a generalised workbench for landmark-based facial emotion analysis and stimulus manipulation. It is a flexible tool that is designed to be specialised at runtime by the user. While FaceXpress has been used to implement the FACEM process, it can also be configured to support any other similar, arbitrary system for quantifying human facial emotion. FaceXpress also implements an integrated set of image processing tools and specialised tools for facial expression stimulus production including facial morphing routines and the generation of expression-representative line drawings from photographs.

A generalised deficit can account for problems in facial emotion recognition in schizophrenia

Neuroimaging research has shown localised brain activation to different facial expressions. This, along with the finding that schizophrenia patients perform poorly in their recognition of negative emotions, has raised the suggestion that patients display an emotion specific impairment. We propose that this asymmetry in performance reflects task difficulty gradations, rather than aberrant processing in neural pathways subserving recognition of specific emotions. A neural network model is presented, which classifies facial expressions on the basis of measurements derived from human faces. After training, the network showed an accuracy pattern closely resembling that of healthy subjects. Lesioning of the network led to an overall decrease in the network’s discriminant capacity, with the greatest accuracy decrease to fear, disgust and anger stimuli. This implies that the differential pattern of impairment in schizophrenia patients can be explained without having to postulate impairment of specific processing modules for negative emotion recognition.

Using viewer’s facial expression and heart rate for sports video highlights detection

Viewer interests, evoked by video content, can potentially identify the highlights of the video. This paper explores the use of facial expressions (FE) and heart rate (HR) of viewers captured using camera and non-strapped sensor for identifying interesting video segments. The data from ten subjects with three videos showed that these signals are viewer dependent and not synchronized with the video contents. To address this issue, new algorithms are proposed to effectively combine FE and HR signals for identifying the time when viewer interest is potentially high. The results show that, compared with subjective annotation and match report highlights, ‘non-neutral’ FE and ‘relatively higher and faster’ HR is able to capture 60%-80% of goal, foul, and shot-on-goal soccer video events. FE is found to be more indicative than HR of viewer’s interests, but the fusion of these two modalities outperforms each of them.

Tissue-engineered fibroin scaffolds for ocular tissue reconstruction

The silk protein fibroin (Bombyx mori) provides a potential substrate for use in ocular tissue reconstruction. We have previously demonstrated that transparent membranes produced from fibroin support cultivation of human limbal epithelial (HLE) cells (Tissue Eng A. 14(2008)1203-11). We extend this body of work to studies of limbal mesenchymal stromal cell (L-MSC) growth on fibroin. Also, we investigate the ability to produce a fibroin dual-layer scaffold with an upper HLE layer and lower L-MSC layer...

Towards robust automatic affective classification of images using facial expressions for practical applications

Affect is an important feature of multimedia content and conveys valuable information for multimedia indexing and retrieval. Most existing studies for affective content analysis are limited to low-level features or mid-level representations, and are generally criticized for their incapacity to address the gap between low-level features and high-level human affective perception. The facial expressions of subjects in images carry important semantic information that can substantially influence human affective perception, but have been seldom investigated for affective classification of facial images towards practical applications. This paper presents an automatic image emotion detector (IED) for affective classification of practical (or non-laboratory) data using facial expressions, where a lot of “real-world” challenges are present, including pose, illumination, and size variations etc. The proposed method is novel, with its framework designed specifically to overcome these challenges using multi-view versions of face and fiducial point detectors, and a combination of point-based texture and geometry. Performance comparisons of several key parameters of relevant algorithms are conducted to explore the optimum parameters for high accuracy and fast computation speed. A comprehensive set of experiments with existing and new datasets, shows that the method is effective despite pose variations, fast, and appropriate for large-scale data, and as accurate as the method with state-of-the-art performance on laboratory-based data. The proposed method was also applied to affective classification of images from the British Broadcast Corporation (BBC) in a task typical for a practical application providing some valuable insights.

Additive tissue manufacturing for breast reconstruction: Combining CAD/CAM with adipose tissue engineering

The primary aim of this multidisciplinary project was to develop a new generation of breast implants. Disrupting the currently prevailing paradigm of silicone implants which permanently introduce a foreign body into mastectomy patients, highly porous implants developed as part of this PhD project are biodegradable by the body and augment the growth of natural tissue. Our technology platform leverages computer-assisted-design which allows us to manufacture fully patient-specific implants based on a personalised medicine approach. Multiple animal studies conducted in this project have shown that the polymeric implant slowly degrades within the body harmlessly while the body's own tissue forms concurrently.

Reconstruction of a multi-vent kimberlite eruption from deposit and host rock characteristics: Jericho kimberlite, Nunavut, Canada

The Jericho kimberlite (173.1. ±. 1.3. Ma) is a small (~. 130. ×. 70. m), multi-vent system that preserves products from deep (>. 1. km?) portions of kimberlite vents. Pit mapping, drill core examination, petrographic study, image analysis of olivine crystals (grain size distributions and shape studies), and compositional and mineralogical studies, are used to reconstruct processes from near-surface magma ascent to kimberlite emplacement and alteration. The Jericho kimberlite formed by multiple eruptions through an Archean granodiorite batholith that was overlain by mid-Devonian limestones ~. 1. km in thickness. Kimberlite magma ascended through granodiorite basement by dyke propagation but ascended through limestone, at least in part, by locally brecciating the host rocks. After the first explosive breakthrough to surface, vent deepening and widening occurred by the erosive forces of the waxing phase of the eruption, by gravitationally induced failures as portions of the vent margins slid into the vent and, in the deeper portions of the vent (>. 1. km), by scaling, as thin slabs burst from the walls into the vent. At currently exposed levels, coherent kimberlite (CK) dykes (<. 40. cm thick) are found to the north and south of the vent complex and represent the earliest preserved in-situ products of Jericho magmatism. Timing of CK emplacement on the eastern side of the vent complex is unclear; some thick CK (15-20. m) may have been emplaced after the central vent was formed. Explosive eruptive products are preserved in four partially overlapping vents that are roughly aligned along strike with the coherent kimberlite dyke. The volcaniclastic kimberlite (VK) facies are massive and poorly sorted, with matrix- to clast-supported textures. The VK facies fragmented by dry, volatile-driven processes and were emplaced by eruption column collapse back into the volcanic vents. The first explosive products, poorly preserved because of partial destruction by later eruptions, are found in the central-east vent and were formed by eruption column collapse after the vent was largely cleared of country rock debris. The next active vent was either the north or south vent. Collapse of the eruption column, linked to a vent widening episode, resulted in coeval avalanching of pipe margin walls into the north vent, forming interstratified lenses of country rock-rich boulder breccias in finer-grained volcaniclastic kimberlite. South vent kimberlite has similar characteristics to kimberlite of the north vent and likely formed by similar processes. The final eruptive phase formed olivine-rich and moderately sorted deposits of the central vent. Better sorting is attributed to recycling of kimberlite debris by multiple eruptions through the unconsolidated volcaniclastic pile and associated collapse events. Post-emplacement alteration varies in intensity, but in all cases, has overprinted the primary groundmass and matrix, in CK and VK, respectively. Erosion has since removed all limestone cover.