Sparse temporal representations for facial expression recognition

In automatic facial expression recognition, an increasing number of techniques had been proposed for in the literature that exploits the temporal nature of facial expressions. As all facial expressions are known to evolve over time, it is crucially important for a classifier to be capable of modelling their dynamics. We establish that the method of sparse representation (SR) classifiers proves to be a suitable candidate for this purpose, and subsequently propose a framework for expression dynamics to be efficiently incorporated into its current formulation. We additionally show that for the SR method to be applied effectively, then a certain threshold on image dimensionality must be enforced (unlike in facial recognition problems). Thirdly, we determined that recognition rates may be significantly influenced by the size of the projection matrix \Phi. To demonstrate these, a battery of experiments had been conducted on the CK+ dataset for the recognition of the seven prototypic expressions - anger, contempt, disgust, fear, happiness, sadness and surprise - and comparisons have been made between the proposed temporal-SR against the static-SR framework and state-of-the-art support vector machine.

Cerclage, evolution and potential of a Cinderella Technology : an overview with reference to periprosthetic fractures

Periprosthetic fractures are increasingly frequent. The fracture may be located over the shaft of the prosthesis, at its tip or below (21). The treatment of explosion fractures is difficult because the shaft blocks the application of implants, like screws, which need to penetrate the medullary cavity. The cerclage, as a simple periosteal loop, made of wire or more recently cable, does not only avoid the medullary cavity. Its centripetal mode of action is well suited for reducing and maintaining radially displaced fractures. Furthermore, the cerclage lends itself well for minimally invasive internal fixation. New insight challenges the disrepute of which the cerclage technology suffered for decades. The outcome of cerclage fixation benefits from an improved understanding of its technology, mechano-biology and periosteal blood supply. Preconceived and generally accepted opinions like "strangulation of blood supply" need to be re-examined. Recent mechanical evaluations (22) demonstrate that the wire application may be improved but cable is superior in hand- ling, maintenance of tension and strength. Beside the classical concepts of absolute and relative stability a defined stability condition needs consideration. It is typical for cerclage. Called "loose-lock stability" it specifies the situation where a loosened implant allows first unimpeded displacement changing abruptly into a locked fixation preventing further dislocation.

Technical note : a technique for measuring the surface area of articular cartilage in acetabular fractures

The aim of this study was to develop a reliable technique for measuring the area of a curved surface from an axial computed tomography (CT) scan and to apply this clinically in the measurement of articular cartilage surface area in acetabular fractures. The method used was a triangulation algorithm. In order to determine the accuracy of the technique, areas of hemispheres of known size were measured to give the percentage error in area measurement. Seven such hemispheres were machined into a Perspex block and their area measured geometrically, and also from CT scans by means of the triangulation algorithm. Scans of 1, 2 and 4 mm slice thickness and separation were used. The error varied with slice thickness and hemisphere diameter. It was shown that the 2 mm slice thickness provides the most accurate area measurement, while 1 mm cuts overestimate and 4 mm cuts underestimate the area. For a hemisphere diameter of 5 cm, which is of similar size to the acetabulum, the error was -11.2% for 4 mm cuts, +4.2% for 2 mm cuts and + 5.1% for 1 mm cuts. As expected, area measurement was more accurate for larger hemispheres. This method can be applied clinically to quantify acetabular fractures by measuring the percentage area of intact articular cartilage. In the case of both column fractures, the percentage area of secondary congruence can be determined. This technique of quantifying acetabular fractures has a potential clinical application as a prognostic factor and an indication for surgery in the long term.

No evidence for subliminal affective priming with emotional facial expression primes

The present study investigated whether facial expressions of emotion presented outside consciousness awareness will elicit evaluative responses as assessed in affective priming. Participants were asked to evaluate pleasant and unpleasant target words that were preceded by masked or unmasked schematic (Experiment 1) or photographic faces (Experiments 1 and 2) with happy or angry expressions. They were either required to perform the target evaluation only or to perform the target evaluation and to name the emotion expressed by the face prime. Prime-target interval was 300 ms in Experiment 1 and 80 ms in Experiment 2. Naming performance confirmed the effectiveness of the masking procedure. Affective priming was evident after unmasked primes in tasks that required naming of the facial expressions for schematic and photographic faces and after unmasked primes in tasks that did not require naming for photographic faces. No affective priming was found after masked primes. The present study failed to provide evidence for affective priming with masked face primes, however, it indicates that voluntary attention to the primes enhances affective priming.

Discovering the best feature extraction and selection algorithms for spontaneous facial expression recognition

Feature extraction and selection are critical processes in developing facial expression recognition (FER) systems. While many algorithms have been proposed for these processes, direct comparison between texture, geometry and their fusion, as well as between multiple selection algorithms has not been found for spontaneous FER. This paper addresses this issue by proposing a unified framework for a comparative study on the widely used texture (LBP, Gabor and SIFT) and geometric (FAP) features, using Adaboost, mRMR and SVM feature selection algorithms. Our experiments on the Feedtum and NVIE databases demonstrate the benefits of fusing geometric and texture features, where SIFT+FAP shows the best performance, while mRMR outperforms Adaboost and SVM. In terms of computational time, LBP and Gabor perform better than SIFT. The optimal combination of SIFT+FAP+mRMR also exhibits a state-of-the-art performance.

Improved facial expression recognition via uni-hyperplane classification

Large margin learning approaches, such as support vector machines (SVM), have been successfully applied to numerous classification tasks, especially for automatic facial expression recognition. The risk of such approaches however, is their sensitivity to large margin losses due to the influence from noisy training examples and outliers which is a common problem in the area of affective computing (i.e., manual coding at the frame level is tedious so coarse labels are normally assigned). In this paper, we leverage the relaxation of the parallel-hyperplanes constraint and propose the use of modified correlation filters (MCF). The MCF is similar in spirit to SVMs and correlation filters, but with the key difference of optimizing only a single hyperplane. We demonstrate the superiority of MCF over current techniques on a battery of experiments.

Outcomes following operative and non-operative management of humeral midshaft fractures: a prospective, observational cohort study of 47 patients

Background Although the non-operative management of closed humeral midshaft fractures has been advocated for years, the increasing popularity of operative intervention has left the optimal treatment choice unclear. Objective To compare the outcomes of operative and non-operative treatment of traumatic closed humeral midshaft fractures in adult patients. Methods A multicentre prospective comparative cohort study across 20 centres was conducted. Patients with AO type 12 A2, A3 and B2 fractures were treated with a functional brace or a retrograde-inserted unreamed humeral nail. Follow-up measurements were taken at 6, 12 and 52 weeks after the injury. The primary outcome was fracture healing after 1 year. Secondary outcomes included sub-items of the Constant score, general patient satisfaction, complications and cost-effectiveness parameters. Functions of the uninjured extremity were used as reference parameters. Intention-to-treat analysis was applied with the use of t-tests, Fisher’s exact tests, Mann–Whitney U-tests and adjusted analysis of variance (ANOVA). Results Forty-seven patients were included. The patient sample consisted of 23 women and 24 men, with a mean age of 52.7 years (range 17–86 years). Of the 47 cases, 14 were treated non-operatively and 33 operatively. The follow-up rate at 1 year was 81%. After 1 year, 11 fractures (100%) healed in the non-operative group and at least 24 fractures (≥89%) healed in the operative group [1 non-union patient (4%) and no data for 2 patients (7%)]. There were no significant differences in pain, range of motion (ROM) of the shoulder and elbow, and return to work after 6 weeks, 12 weeks and 1 year. Although operatively treated patients showed significantly greater shoulder abduction strength (p = 0.036), elbow flexion strength (p = 0.021), functional hand positioning (p = 0.008) and return to recreational activities (p = 0.043) after 6 weeks, no statistically significant differences existed in any outcome measure at the 1-year follow-up. Conclusions Our findings indicate that the non-operative management of humeral midshaft fractures can be expected to have similar functional outcomes and patient satisfaction at 1 year, despite an early benefit to operative treatment. If no radiological evidence of fracture healing exists in non-operatively treated patients during early follow-up, a switch to surgical treatment results in good functional outcomes and patient satisfaction. Keywords: Humeral shaft fracture, Non-operative treatment, Functional brace, Operative treatment, Unreamed humeral nail (UHN), Prospective, Cohort study

Robust facial feature extraction and matching

Automated feature extraction and correspondence determination is an extremely important problem in the face recognition community as it often forms the foundation of the normalisation and database construction phases of many recognition and verification systems. This paper presents a completely automatic feature extraction system based upon a modified volume descriptor. These features form a stable descriptor for faces and are utilised in a reversible jump Markov chain Monte Carlo correspondence algorithm to automatically determine correspondences which exist between faces. The developed system is invariant to changes in pose and occlusion and results indicate that it is also robust to minor face deformations which may be present with variations in expression.

Towards spontaneous facial expression recognition in real-world video

Facial expression is an important channel of human social communication. Facial expression recognition (FER) aims to perceive and understand emotional states of humans based on information in the face. Building robust and high performance FER systems that can work in real-world video is still a challenging task, due to the various unpredictable facial variations and complicated exterior environmental conditions, as well as the difficulty of choosing a suitable type of feature descriptor for extracting discriminative facial information. Facial variations caused by factors such as pose, age, gender, race and occlusion, can exert profound influence on the robustness, while a suitable feature descriptor largely determines the performance. Most present attention on FER has been paid to addressing variations in pose and illumination. No approach has been reported on handling face localization errors and relatively few on overcoming facial occlusions, although the significant impact of these two variations on the performance has been proved and highlighted in many previous studies. Many texture and geometric features have been previously proposed for FER. However, few comparison studies have been conducted to explore the performance differences between different features and examine the performance improvement arisen from fusion of texture and geometry, especially on data with spontaneous emotions. The majority of existing approaches are evaluated on databases with posed or induced facial expressions collected in laboratory environments, whereas little attention has been paid on recognizing naturalistic facial expressions on real-world data. This thesis investigates techniques for building robust and high performance FER systems based on a number of established feature sets. It comprises of contributions towards three main objectives: (1) Robustness to face localization errors and facial occlusions. An approach is proposed to handle face localization errors and facial occlusions using Gabor based templates. Template extraction algorithms are designed to collect a pool of local template features and template matching is then performed to covert these templates into distances, which are robust to localization errors and occlusions. (2) Improvement of performance through feature comparison, selection and fusion. A comparative framework is presented to compare the performance between different features and different feature selection algorithms, and examine the performance improvement arising from fusion of texture and geometry. The framework is evaluated for both discrete and dimensional expression recognition on spontaneous data. (3) Evaluation of performance in the context of real-world applications. A system is selected and applied into discriminating posed versus spontaneous expressions and recognizing naturalistic facial expressions. A database is collected from real-world recordings and is used to explore feature differences between standard database images and real-world images, as well as between real-world images and real-world video frames. The performance evaluations are based on the JAFFE, CK, Feedtum, NVIE, Semaine and self-collected QUT databases. The results demonstrate high robustness of the proposed approach to the simulated localization errors and occlusions. Texture and geometry have different contributions to the performance of discrete and dimensional expression recognition, as well as posed versus spontaneous emotion discrimination. These investigations provide useful insights into enhancing robustness and achieving high performance of FER systems, and putting them into real-world applications.

Life impact of ankle fractures : qualitative analysis of patient and clinician experiences

Background: Ankle fractures are one of the more commonly occurring forms of trauma managed by orthopaedic teams worldwide. The impacts of these injuries are not restricted to pain and disability caused at the time of the incident, but may also result in long term physical, psychological, and social consequences. There are currently no ankle fracture specific patient-reported outcome measures with a robust content foundation. This investigation aimed to develop a thematic conceptual framework of life impacts following ankle fracture from the experiences of people who have suffered ankle fractures as well as the health professionals who treat them. Methods: A qualitative investigation was undertaken using in-depth semi-structured interviews with people (n=12) who had previously sustained an ankle fracture (patients) and health professionals (n=6) that treat people with ankle fractures. Interviews were audio-recorded and transcribed. Each phrase was individually coded and grouped in categories and aligned under emerging themes by two independent researchers. Results: Saturation occurred after 10 in-depth patient interviews. Time since injury for patients ranged from 6 weeks to more than 2 years. Experience of health professionals ranged from 1 year to 16 years working with people with ankle fractures. Health professionals included an Orthopaedic surgeon (1), physiotherapists (3), a podiatrist (1) and an occupational therapist (1). The emerging framework derived from patient data included eight themes (Physical, Psychological, Daily Living, Social, Occupational and Domestic, Financial, Aesthetic and Medication Taking). Health professional responses did not reveal any additional themes, but tended to focus on physical and occupational themes. Conclusions: The nature of life impact following ankle fractures can extend beyond short term pain and discomfort into many areas of life. The findings from this research have provided an empirically derived framework from which a condition-specific patient-reported outcome measure can be developed.