Real time feature-based facial tracking using Lie algebras

We have developed a novel human facial tracking system that operates in real time at a video frame rate without needing any special hardware. The approach is based on the use of Lie algebra, and uses three-dimensional feature points on the targeted human face. It is assumed that the roughly estimated facial model (relative coordinates of the three-dimensional feature points) is known. First, the initial feature positions of the face are determined using a model fitting technique. Then, the tracking is operated by the following sequence: (1) capture the new video frame and render feature points to the image plane; (2) search for new positions of the feature points on the image plane; (3) get the Euclidean matrix from the moving vector and the three-dimensional information for the points; and (4) rotate and translate the feature points by using the Euclidean matrix, and render the new points on the image plane. The key algorithm of this tracker is to estimate the Euclidean matrix by using a least square technique based on Lie algebra. The resulting tracker performed very well on the task of tracking a human face.

An algorithm for removing facial makeup disturbances based on high dimensional imaginal geometry

In this paper, a novel algorithm for removing facial makeup disturbances as a face detection preprocess based on high dimensional imaginal geometry is proposed. After simulation and practical application experiments, the algorithm is theoretically analyzed. Its apparent effect of removing facial makeup and the advantages of face detection with this pre-process over face detection without it are discussed. Furthermore, in our experiments with color images, the proposed algorithm even gives some surprises.

Image Ratio Features for Facial Expression Recognition Application

Video-based facial expression recognition is a challenging problem in computer vision and human-computer interaction. To target this problem, texture features have been extracted and widely used, because they can capture image intensity changes raised by skin deformation. However, existing texture features encounter problems with albedo and lighting variations. To solve both problems, we propose a new texture feature called image ratio features. Compared with previously proposed texture features, e. g., high gradient component features, image ratio features are more robust to albedo and lighting variations. In addition, to further improve facial expression recognition accuracy based on image ratio features, we combine image ratio features with facial animation parameters (FAPs), which describe the geometric motions of facial feature points. The performance evaluation is based on the Carnegie Mellon University Cohn-Kanade database, our own database, and the Japanese Female Facial Expression database. Experimental results show that the proposed image ratio feature is more robust to albedo and lighting variations, and the combination of image ratio features and FAPs outperforms each feature alone. In addition, we study asymmetric facial expressions based on our own facial expression database and demonstrate the superior performance of our combined expression recognition system.

The benefit of context for facial composite construction.

Purpose - The aim of this study was to investigate whether the presence of a whole-face context during facial composite production facilitates construction of facial composite images. Design/Methodology - In Experiment 1, constructors viewed a celebrity face and then developed a facial composite using PRO-fit in one of two conditions: either the full-face was visible while facial features were selected, or only the feature currently being selected was visible. The composites were named by different participants. We then replicated the study using a more forensically-valid procedure: In Experiment 2 non-football fans viewed an image of a premiership footballer and 24 hours later constructed a composite of the face with a trained software operator. The resulting composites were named by football fans. Findings - In both studies we found that presence of the facial context promoted more identifiable facial composite images. Research limitations/implications – Though this study uses current software in an unconventional way, this was necessary to avoid error arising from between-system differences. Practical implications - Results confirm that composite software should have the whole-face context visible to witnesses throughout construction. Though some software systems do this, there remain others that present features in isolation and these findings show that these systems are unlikely to be optimal. Originality/value - This is the first study to demonstrate the importance of a full-face context for the construction of facial composite images. Results are valuable to police forces and developers of composite software.

Facial Feature Tracking and Occlusion Recovery in American Sign Language

Facial features play an important role in expressing grammatical information in signed languages, including American Sign Language(ASL). Gestures such as raising or furrowing the eyebrows are key indicators of constructions such as yes-no questions. Periodic head movements (nods and shakes) are also an essential part of the expression of syntactic information, such as negation (associated with a side-to-side headshake). Therefore, identification of these facial gestures is essential to sign language recognition. One problem with detection of such grammatical indicators is occlusion recovery. If the signer's hand blocks his/her eyebrows during production of a sign, it becomes difficult to track the eyebrows. We have developed a system to detect such grammatical markers in ASL that recovers promptly from occlusion. Our system detects and tracks evolving templates of facial features, which are based on an anthropometric face model, and interprets the geometric relationships of these templates to identify grammatical markers. It was tested on a variety of ASL sentences signed by various Deaf native signers and detected facial gestures used to express grammatical information, such as raised and furrowed eyebrows as well as headshakes.

Optimizing perioperative analgesia for patients undergoing operative fixation of hip fractures

This PhD thesis describes work carried out on investigation of various interventions with the aim to optimise the anaesthetic management of patients scheduled to undergo operative fixation of hip fractures. We analysed the perioperative effects of continuous femoral nerve block, single preoperative dose of i.v. dexamethasone, the intention to deposit local anaesthetic in different locations around the femoral nerve during ultrasound guided femoral nerve block, continuous spinal anaesthesia and peri-surgical site infiltration with local anaesthetic after surgical fixation of hip fractures. Continuous femoral nerve block provided more effective preoperative analgesia six hours after the insertion of the perineural catheter compared to a standard opiate-based regimen in patients undergoing operative fixation of fractured hip. A single low dose of preoperative dexamethasone in the intervention group decreased pain scores by 75% six hours after the surgery. Both interventions had no major effect on the functional recovery in the first year after the surgical fixation of fractured hip. The results of the ultrasound guided femoral nerve block trial showed no clinical advantage of intending to deposit local anaesthetic circumferentially during performing femoral nerve block. Using the Dixon and Massey’s “up- and-down” method, we demonstrated that intrathecal 0.26 ml of 0.5% bupivacaine provided adequate surgical anaesthesia within 15 minutes in 50% of patients undergoing operative fixation of hip fracture. Finally, we demonstrated that local anaesthetic infiltration had no effect on pain scores 12 hours after the surgical fixation of fractured neck of femur. In addition to this original body of work, a review article was published on femoral nerve block highlighting the use of ultrasound guidance. In conclusion, the results of this thesis offer an insight into interventions aimed at optimising perioperative analgesia in patients scheduled to undergo operative fixation of hip fractures.

Bone fractures among postmenopausal patients with endocrine-responsive early breast cancer treated with 5 years of letrozole or tamoxifen in the BIG 1-98 trial.

To compare the incidence and timing of bone fractures in postmenopausal women treated with 5 years of adjuvant tamoxifen or letrozole for endocrine-responsive early breast cancer in the Breast International Group (BIG) 1-98 trial.

Informatic Opacity: Biometric Facial Recognition and the Aesthetics and Politics of Defacement

Confronting the rapidly increasing, worldwide reliance on biometric technologies to surveil, manage, and police human beings, my dissertation Informatic Opacity: Biometric Facial Recognition and the Aesthetics and Politics of Defacement charts a series of queer, feminist, and anti-racist concepts and artworks that favor opacity as a means of political struggle against surveillance and capture technologies in the 21st century. Utilizing biometric facial recognition as a paradigmatic example, I argue that today's surveillance requires persons to be informatically visible in order to control them, and such visibility relies upon the production of technical standardizations of identification to operate globally, which most vehemently impact non- normative, minoritarian populations. Thus, as biometric technologies turn exposures of the face into sites of governance, activists and artists strive to make the face biometrically illegible and refuse the political recognition biometrics promises through acts of masking, escape, and imperceptibility. Although I specifically describe tactics of making the face unrecognizable as "defacement," I broadly theorize refusals to visually cohere to digital surveillance and capture technologies' gaze as "informatic opacity," an aesthetic-political theory and practice of anti- normativity at a global, technical scale whose goal is maintaining the autonomous determination of alterity and difference by evading the quantification, standardization, and regulation of identity imposed by biometrics and the state. My dissertation also features two artworks: Facial Weaponization Suite, a series of masks and public actions, and Face Cages, a critical, dystopic installation that investigates the abstract violence of biometric facial diagramming and analysis. I develop an interdisciplinary, practice-based method that pulls from contemporary art and aesthetic theory, media theory and surveillance studies, political and continental philosophy, queer and feminist theory, transgender studies, postcolonial theory, and critical race studies.

Facial and expression recognition for the blind using computer vision

Gemstone Team FACE

Fractures in myelomeningocele.

BACKGROUND: In patients with myelomeningocele (MMC), a high number of fractures occur in the paralyzed extremities, affecting mobility and independence. The aims of this retrospective cross-sectional study are to determine the frequency of fractures in our patient cohort and to identify trends and risk factors relevant for such fractures. MATERIALS AND METHODS: Between March 1988 and June 2005, 862 patients with MMC were treated at our hospital. The medical records, surgery reports, and X-rays from these patients were evaluated. RESULTS: During the study period, 11% of the patients (n = 92) suffered one or more fractures. Risk analysis showed that patients with MMC and thoracic-level paralysis had a sixfold higher risk of fracture compared with those with sacral-level paralysis. Femoral-neck z-scores measured by dual-energy X-ray absorptiometry (DEXA) differed significantly according to the level of neurological impairment, with lower z-scores in children with a higher level of lesion. Furthermore, the rate of epiphyseal separation increased noticeably after cast immobilization. Mainly patients who could walk relatively well were affected. CONCLUSIONS: Patients with thoracic-level paralysis represent a group with high fracture risk. According to these results, fracture and epiphyseal injury in patients with MMC should be treated by plaster immobilization. The duration of immobilization should be kept to a minimum (<4 weeks) because of increased risk of secondary fractures. Alternatively, patients with refractures can be treated by surgery, when nonoperative treatment has failed.