Using viewer’s facial expression and heart rate for sports video highlights detection

Viewer interests, evoked by video content, can potentially identify the highlights of the video. This paper explores the use of facial expressions (FE) and heart rate (HR) of viewers captured using camera and non-strapped sensor for identifying interesting video segments. The data from ten subjects with three videos showed that these signals are viewer dependent and not synchronized with the video contents. To address this issue, new algorithms are proposed to effectively combine FE and HR signals for identifying the time when viewer interest is potentially high. The results show that, compared with subjective annotation and match report highlights, ‘non-neutral’ FE and ‘relatively higher and faster’ HR is able to capture 60%-80% of goal, foul, and shot-on-goal soccer video events. FE is found to be more indicative than HR of viewer’s interests, but the fusion of these two modalities outperforms each of them.

Towards robust automatic affective classification of images using facial expressions for practical applications

Affect is an important feature of multimedia content and conveys valuable information for multimedia indexing and retrieval. Most existing studies for affective content analysis are limited to low-level features or mid-level representations, and are generally criticized for their incapacity to address the gap between low-level features and high-level human affective perception. The facial expressions of subjects in images carry important semantic information that can substantially influence human affective perception, but have been seldom investigated for affective classification of facial images towards practical applications. This paper presents an automatic image emotion detector (IED) for affective classification of practical (or non-laboratory) data using facial expressions, where a lot of “real-world” challenges are present, including pose, illumination, and size variations etc. The proposed method is novel, with its framework designed specifically to overcome these challenges using multi-view versions of face and fiducial point detectors, and a combination of point-based texture and geometry. Performance comparisons of several key parameters of relevant algorithms are conducted to explore the optimum parameters for high accuracy and fast computation speed. A comprehensive set of experiments with existing and new datasets, shows that the method is effective despite pose variations, fast, and appropriate for large-scale data, and as accurate as the method with state-of-the-art performance on laboratory-based data. The proposed method was also applied to affective classification of images from the British Broadcast Corporation (BBC) in a task typical for a practical application providing some valuable insights.

Prediction of maximal surface electromyographically based voluntary contractions of erector spinae muscles from sonographic measurements during isometric contractions

Objectives Currently, there are no studies combining electromyography (EMG) and sonography to estimate the absolute and relative strength values of erector spinae (ES) muscles in healthy individuals. The purpose of this study was to establish whether the maximum voluntary contraction (MVC) of the ES during isometric contractions could be predicted from the changes in surface EMG as well as in fiber pennation and thickness as measured by sonography. Methods Thirty healthy adults performed 3 isometric extensions at 45° from the vertical to calculate the MVC force. Contractions at 33% and 100% of the MVC force were then used during sonographic and EMG recordings. These measurements were used to observe the architecture and function of the muscles during contraction. Statistical analysis was performed using bivariate regression and regression equations. Results The slope for each regression equation was statistically significant (P < .001) with R2 values of 0.837 and 0.986 for the right and left ES, respectively. The standard error estimate between the sonographic measurements and the regression-estimated pennation angles for the right and left ES were 0.10 and 0.02, respectively. Conclusions Erector spinae muscle activation can be predicted from the changes in fiber pennation during isometric contractions at 33% and 100% of the MVC force. These findings could be essential for developing a regression equation that could estimate the level of muscle activation from changes in the muscle architecture.

A genome-wide association study identifies five loci influencing facial morphology in Europeans

Inter-individual variation in facial shape is one of the most noticeable phenotypes in humans, and it is clearly under genetic regulation; however, almost nothing is known about the genetic basis of normal human facial morphology. We therefore conducted a genome-wide association study for facial shape phenotypes in multiple discovery and replication cohorts, considering almost ten thousand individuals of European descent from several countries. Phenotyping of facial shape features was based on landmark data obtained from three-dimensional head magnetic resonance images (MRIs) and two-dimensional portrait images. We identified five independent genetic loci associated with different facial phenotypes, suggesting the involvement of five candidate genes-PRDM16, PAX3, TP63, C5orf50, and COL17A1-in the determination of the human face. Three of them have been implicated previously in vertebrate craniofacial development and disease, and the remaining two genes potentially represent novel players in the molecular networks governing facial development. Our finding at PAX3 influencing the position of the nasion replicates a recent GWAS of facial features. In addition to the reported GWA findings, we established links between common DNA variants previously associated with NSCL/P at 2p21, 8q24, 13q31, and 17q22 and normal facial-shape variations based on a candidate gene approach. Overall our study implies that DNA variants in genes essential for craniofacial development contribute with relatively small effect size to the spectrum of normal variation in human facial morphology. This observation has important consequences for future studies aiming to identify more genes involved in the human facial morphology, as well as for potential applications of DNA prediction of facial shape such as in future forensic applications.

Electronic Control of Facial Selection in Additions to Sterically Unbiased Ketones and Olefins

By definition, the two faces of a pi bond are equivalent.1 However, they are rendered nonequivalent in most molecules because of the absence of a plane of symmetry encompassing the double bond and the adjacent substituents. As a result, additions to trigonal centers from the two faces need not be equally facile. Exploiting this stereodifferentiation in a controlled manner represents one of the core problems in organic synthesis. Evidently, the factors which determine such diastereoselection need to be delineated in as much detail as possible.

Muscular activity and fatigue in lower-limb and trunk muscles during different sit-to-stand tests

Sit-to-stand (STS) tests measure the ability to get up from a chair, reproducing an important component of daily living activity. As this functional task is essential for human independence, STS performance has been studied in the past decades using several methods, including electromyography. The aim of this study was to measure muscular activity and fatigue during different repetitions and speeds of STS tasks using surface electromyography in lower-limb and trunk muscles. This cross-sectional study recruited 30 healthy young adults. Average muscle activation, percentage of maximum voluntary contraction, muscle involvement in motion and fatigue were measured using surface electrodes placed on the medial gastrocnemius (MG), biceps femoris (BF), vastus medialis of the quadriceps (QM), the abdominal rectus (AR), erector spinae (ES), rectus femoris (RF), soleus (SO) and the tibialis anterior (TA). Five-repetition STS, 10-repetition STS and 30-second STS variants were performed. MG, BF, QM, ES and RF muscles showed differences in muscle activation, while QM, AR and ES muscles showed significant differences in MVC percentage. Also, significant differences in fatigue were found in QM muscle between different STS tests. There was no statistically significant fatigue in the BF, MG and SO muscles of the leg although there appeared to be a trend of increasing fatigue. These results could be useful in describing the functional movements of the STS test used in rehabilitation programs, notwithstanding that they were measured in healthy young subjects.

Muscle morphometry of the individual hamstring muscles in semi-elite AFL Players: Preliminary findings from a longitudinal study

Hamstring strains in the Australian Football League (AFL) have a high incidence (15%) and recurrence rate (34%) with lateral hamstring injuries most common (83%). Retrospective studies have found significant muscle volume asymmetries ≤23 months post hamstring injury; however examination of the association between hamstring strains and muscle asymmetry has not been investigated prospectively. This study presents baseline data from a longitudinal study focusing on individual hamstring morphometry in uninjured and injured semi-elite AFL players.

Morphometric analyses of the hamstring muscles using MRI: What is the best way?

Associations between injury and muscle asymmetries, as determined with magnetic resonance (MR) imaging, have been investigated in a number of sports medicine-based studies. For interventional or prospective studies into musculoskeletal injuries, it is important to determine the repeatability of the morphometric procedures used for quantifying muscle asymmetries. This study examines the intra-observer repeatability of manual segmentation for determining bilateral volumes of the individual hamstring muscles.

Morphology-based interslice interpolation on manual segmentations of joint bones and muscles in MRI

This paper presents a validation study on the application of a novel interslice interpolation technique for musculoskeletal structure segmentation of articulated joints and muscles on human magnetic resonance imaging data. The interpolation technique is based on morphological shape-based interpolation combined with intensity based voxel classification. Shape-based interpolation in the absence of the original intensity image has been investigated intensively. However, in some applications of medical image analysis, the intensity image of the slice to be interpolated is available. For example, when manual segmentation is conducted on selected slices, the segmentation on those unselected slices can be obtained by interpolation. We proposed a two- step interpolation method to utilize both the shape information in the manual segmentation and local intensity information in the image. The method was tested on segmentations of knee, hip and shoulder joint bones and hamstring muscles. The results were compared with two existing interpolation methods. Based on the calculated Dice similarity coefficient and normalized error rate, the proposed method outperformed the other two methods.

Social perception and cognition : processing of gestures, postures and facial expressions in the human brain

Humans are a social species with the internal capability to process social information from other humans. To understand others behavior and to react accordingly, it is necessary to infer their internal states, emotions and aims, which are conveyed by subtle nonverbal bodily cues such as postures, gestures, and facial expressions. This thesis investigates the brain functions underlying the processing of such social information. Studies I and II of this thesis explore the neural basis of perceiving pain from another person s facial expressions by means of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). In Study I, observing another s facial expression of pain activated the affective pain system (previously associated with self-experienced pain) in accordance with the intensity of the observed expression. The strength of the response in anterior insula was also linked to the observer s empathic abilities. The cortical processing of facial pain expressions advanced from the visual to temporal-lobe areas at similar latencies (around 300 500 ms) to those previously shown for emotional expressions such as fear or disgust. Study III shows that perceiving a yawning face is associated with middle and posterior STS activity, and the contagiousness of a yawn correlates negatively with amygdalar activity. Study IV explored the brain correlates of interpreting social interaction between two members of the same species, in this case human and canine. Observing interaction engaged brain activity in very similar manner for both species. Moreover, the body and object sensitive brain areas of dog experts differentiated interaction from noninteraction in both humans and dogs whereas in the control subjects, similar differentiation occurred only for humans. Finally, Study V shows the engagement of the brain area associated with biological motion when exposed to the sounds produced by a single human being walking. However, more complex pattern of activation, with the walking sounds of several persons, suggests that as the social situation becomes more complex so does the brain response. Taken together, these studies demonstrate the roles of distinct cortical and subcortical brain regions in the perception and sharing of others internal states via facial and bodily gestures, and the connection of brain responses to behavioral attributes.

Anticipatory and reactive response to falls: Muscle synergy activation of forearm muscles

We investigated the surface electromyogram response of six forearm muscles to falls onto the outstretched hand. The extensor carpi radialis longus, extensor carpi radialis brevis, extensor carpi ulnaris, abductor pollicis longus, flexor carpi radialis and flexor carpi ulnaris muscles were sampled from eight volunteers who underwent ten self-initiated falls. All muscles initiated prior to impact. Co-contraction is the most obvious surface electromyogram feature. The predominant response is in the radial deviators. The surface electromyogram timing we recorded would appear to be a complex anticipatory response to falling modified by the ef- fect on the forearm muscles following impact. The mitigation of the force of impact is probably more importantly through shoulder abduction and extension and elbow flexion rather than action of the forearm muscles.

A flexible hierarchical approach for facial age estimation based on multiple features

Age estimation from facial images is increasingly receiving attention to solve age-based access control, age-adaptive targeted marketing, amongst other applications. Since even humans can be induced in error due to the complex biological processes involved, finding a robust method remains a research challenge today. In this paper, we propose a new framework for the integration of Active Appearance Models (AAM), Local Binary Patterns (LBP), Gabor wavelets (GW) and Local Phase Quantization (LPQ) in order to obtain a highly discriminative feature representation which is able to model shape, appearance, wrinkles and skin spots. In addition, this paper proposes a novel flexible hierarchical age estimation approach consisting of a multi-class Support Vector Machine (SVM) to classify a subject into an age group followed by a Support Vector Regression (SVR) to estimate a specific age. The errors that may happen in the classification step, caused by the hard boundaries between age classes, are compensated in the specific age estimation by a flexible overlapping of the age ranges. The performance of the proposed approach was evaluated on FG-NET Aging and MORPH Album 2 datasets and a mean absolute error (MAE) of 4.50 and 5.86 years was achieved respectively. The robustness of the proposed approach was also evaluated on a merge of both datasets and a MAE of 5.20 years was achieved. Furthermore, we have also compared the age estimation made by humans with the proposed approach and it has shown that the machine outperforms humans. The proposed approach is competitive with current state-of-the-art and it provides an additional robustness to blur, lighting and expression variance brought about by the local phase features.

Glycogen debranching enzyme activity in the muscles of meat producing animals

Muscle glycogen exists in two forms: low molecular weight pro-glycogen and high molecular weight macro-glycogen. The degradation of glycogen to glucose 1 phosphate and free glucose is catalysed by glycogen phosphorylase together with glycogen debranching enzyme (GDE). The process in which glycogen is broken down via anaerobic pathways to lactate, results in the acidification of the muscles and has a great influence on meat quality. Thus, the overall aim of this thesis was to characterise the post mortem action of GDE in muscles of meat production animals (pigs, cattle and chickens). Interest was focused on the differences in GDE activity between fast twitch glycolytic muscles and slow twitch oxidative muscles. The effects of pH, temperature, RN genotype (PRKAG3 gene), and of time post mortem on GDE activity were also investigated. This thesis showed that there are differences in GDE activity between animal species and between different muscles of an animal. It was shown that in pigs and cattle, higher GDE activity and phosphorylase activity exists in the fast twitch glycolytic muscles than in slow twitch oxidative muscles of the same animal. Thus, the high activity of these enzymes enables a faster rate of glycogenolysis in glycolytic M. longissimus dorsi compared to oxidative M. masseter. In chicken muscles, the GDE activity was low compared to pig or cattle muscles. Furthermore, the GDE activity in the glycolytic M. pectoralis superficialis was lower than in more oxidative M. quadriceps femoris despite the high phosphorylase activity in the former. The relative ratios between phosphorylase and GDE activity were higher in fast twitch glycolytic muscles than in slow twitch oxidative muscles of all studied animals. This suggests that the relatively low GDE activity compared to the phosphorylase activity in fast twitch glycolytic muscles may be a protection mechanism in living muscle against a very fast pH decrease. Chilling significantly decreased GDE activity and below 15 C porcine GDE was almost inactive. The effect of pH on GDE activity was only minor at the range normally found in post mortem muscles (pH 7.4 to 5.0). The GDE activity remained level for several hours after slaughter. During the first hours post mortem, GDE activity was similar in RN- carrier pigs and in wild type pigs. However, the GDE activity declined faster in M. longissimus dorsi from wild type pigs than in the RN carrier pigs, the difference between genotypes was significant after 24 h post mortem. Pro-glycogen and macro-glycogen contents were higher, pH decrease was faster and ultimate pH was lower in RN- carrier pigs than in wild type pigs. In the RN- carriers, the prolonged high GDE activity level may enable an extended pH decrease and lower ultimate pH in their muscles. In conclusion, GDE is not the main factor determining the rate or the extent of post mortem glycogenolysis, but under certain conditions, such as in very fast chilling, the inhibition of GDE activity in meat may reduce the rate of pH decrease and result in higher ultimate pH. The rate and extent of pH decrease affects several meat quality traits.

Peripheral facial palsy : Grading, Etiology, and Melkersson-Rosenthal Syndrome

The objective of this study was to assess the utility of two subjective facial grading systems, to evaluate the etiologic role of human herpesviruses in peripheral facial palsy (FP), and to explore characteristics of Melkersson-Rosenthal syndrome (MRS). Intrarater repeatability and interrater agreement were assessed for Sunnybrook (SFGS) and House-Brackmann facial grading systems (H-B FGS). Eight video-recorded FP patients were graded in two sittings by 26 doctors. Repeatability for SFGS was from good to excellent and agreement between doctors from moderate to excellent by intraclass correlation coefficient and coefficient of repeatability. For H-B FGS, repeatability was from fair to good and agreement from poor to fair by agreement percentage and kappa coefficients. Because SFGS was at least as good in repeatability as H-B FGS and showed more reliable results in agreement between doctors, we encourage the use of SFGS over H-B FGS. Etiologic role of human herpesviruses in peripheral FP was studied by searching DNA of herpes simplex virus (HSV) -1 and -2, varicella-zoster virus (VZV), human herpesvirus (HHV) -6A, -6B, and -7, Epstein-Barr virus (EBV), and cytomegalovirus (CMV) by PCR/microarray methods in cerebrospinal fluid (CSF) of 33 peripheral FP patients and 36 controls. Three patients and five controls had HHV-6 or -7 DNA in CSF. No DNA of HSV-1 or -2, VZV, EBV, or CMV was found. Detecting HHV-7 and dual HHV-6A and -6B DNA in CSF of FP patients is intriguing, but does not allow etiologic conclusions as such. These DNA findings in association with FP and the other diseases that they accompanied require further exploration. MRS is classically defined as a triad of recurrent labial or oro-facial edema, recurrent peripheral FP, and plicated tongue. All three signs are present in the minority of patients. Edema-dominated forms are more common in the literature, while MRS with FP has received little attention. The etiology and true incidence of MRS are unknown. Characteristics of MRS were evaluated at the Departments of Otorhinolaryngology and Dermatology focusing on patients with FP. There were 35 MRS patients, 20 with FP and they were mailed a questionnaire (17 answered) and were clinically examined (14 patients). At the Department of Otorhinolaryngology, every MRS patient had FP and half had the triad form of MRS. Two patients, whose tissue biopsies were taken during an acute edema episode, revealed nonnecrotizing granulomatous findings typical for MRS, the other without persisting edema and with symptoms for less than a year. A peripheral blood DNA was searched for gene mutations leading to UNC-93B protein deficiency predisposing to HSV-1 infections; no gene mutations were found. Edema in most MRS FP patients did not dominate the clinical picture, and no progression of the disease was observed, contrary to existing knowledge. At the Department of Dermatology, two patients had triad MRS and 15 had monosymptomatic granulomatous cheilitis with frequent or persistent edema and typical MRS tissue histology. The clinical picture of MRS varied according to the department where the patient was treated. More studies from otorhinolaryngology departments and on patients with FP would clarify the actual incidence and clinical picture of the syndrome.