Hidden Conditional Random Fields for Visual Speech Recognition

In this paper we present the application of Hidden Conditional Random Fields (HCRFs) to modelling speech for visual speech recognition. HCRFs may be easily adapted to model long range dependencies across an observation sequence. As a result visual word recognition performance can be improved as the model is able to take more of a contextual approach to generating state sequences. Results are presented from a speaker-dependent, isolated digit, visual speech recognition task using comparisons with a baseline HMM system. We firstly illustrate that word recognition rates on clean video using HCRFs can be improved by increasing the number of past and future observations being taken into account by each state. Secondly we compare model performances using various levels of video compression on the test set. As far as we are aware this is the first attempted use of HCRFs for visual speech recognition.

Face Recognition in Global Harmonic Subspace

In this paper, a novel pattern recognition scheme, global harmonic subspace analysis (GHSA), is developed for face recognition. In the proposed scheme, global harmonic features are extracted at the semantic scale to capture the 2-D semantic spatial structures of a face image. Laplacian Eigenmap is applied to discriminate faces in their global harmonic subspace. Experimental results on the Yale and PIE face databases show that the proposed GHSA scheme achieves an improvement in face recognition accuracy when compared with conventional subspace approaches, and a further investigation shows that the proposed GHSA scheme has impressive robustness to noise.

Optimization of Weighted Finite State Transducer for Speech Recognition

There is considerable interest in creating embedded, speech recognition hardware using the weighted finite state transducer (WFST) technique but there are performance and memory usage challenges. Two system optimization techniques are presented to address this; one approach improves token propagation by removing the WFST epsilon input arcs; another one-pass, adaptive pruning algorithm gives a dramatic reduction in active nodes to be computed. Results for memory and bandwidth are given for a 5,000 word vocabulary giving a better practical performance than conventional WFST; this is then exploited in an adaptive pruning algorithm that reduces the active nodes from 30,000 down to 4,000 with only a 2 percent sacrifice in speech recognition accuracy; these optimizations lead to a more simplified design with deterministic performance.

Face Recognition in the Scrambled Domain via Salience-Aware Ensembles of Many Kernels

With the rapid development of internet-of-things (IoT), face scrambling has been proposed for privacy protection during IoT-targeted image/video distribution. Consequently in these IoT applications, biometric verification needs to be carried out in the scrambled domain, presenting significant challenges in face recognition. Since face models become chaotic signals after scrambling/encryption, a typical solution is to utilize traditional data-driven face recognition algorithms. While chaotic pattern recognition is still a challenging task, in this paper we propose a new ensemble approach – Many-Kernel Random Discriminant Analysis (MK-RDA) to discover discriminative patterns from chaotic signals. We also incorporate a salience-aware strategy into the proposed ensemble method to handle chaotic facial patterns in the scrambled domain, where random selections of features are made on semantic components via salience modelling. In our experiments, the proposed MK-RDA was tested rigorously on three human face datasets: the ORL face dataset, the PIE face dataset and the PUBFIG wild face dataset. The experimental results successfully demonstrate that the proposed scheme can effectively handle chaotic signals and significantly improve the recognition accuracy, making our method a promising candidate for secure biometric verification in emerging IoT applications.

Phonic skills mediate improved literacy outcomes in at-risk primary school children: results from the Ready-to-Learn Programme

Background
Learning to read is a key goal during primary school: reading difficulties may curtail children’s learning trajectories. Controversy remains regarding what types of interventions are effective for children at risk for academic failure, such as children in disadvantaged areas. We present data from a complex intervention to test the hypothesis that phonic skills and word recognition abilities are a pivotal and specific causal mechanism for the development of reading skills in children at risk for poorer literacy outcomes.
Method
Over 500 pupils across 16 primary schools took part in a Cluster Randomised Controlled Trial from school year 1 to year 3. Schools were randomly allocated to the intervention or the control arm. The intervention involved a literacy-rich after-school programme. Children attending schools in the control arm of the study received the curriculum normally provided. Children in both arms completed batteries of language, phonic skills, and reading tests every year. We used multilevel mediation models to investigate mediating processes between intervention and outcomes.
Findings
Children who took part in the intervention displayed improvements in reading skills compared to those in the control arm. Results indicated a significant indirect effect of the intervention via phonics encoding.
Discussion
The results suggest that the intervention was effective in improving reading abilities of children at risk, and this effect was mediated by improving children’s phonic skills. This has relevance for designing interventions aimed at improving literacy skills of children exposed to socio-economic disadvantage. Results also highlight the importance of methods to investigate causal pathways from intervention to outcomes.

Proofreading Using an Assistive Software Homophone Tool Compensatory and Remedial Effects on the Literacy Skills of Students With Reading Difficulties

The present study investigated the effects of using an assistive software homophone tool on the assisted proofreading performance and unassisted basic skills of secondary-level students with reading difficulties. Students aged 13 to 15 years proofread passages for homophonic errors under three conditions: with the homophone tool, with homophones highlighted only, or with no help. The group using the homophone tool significantly outperformed the other two groups on assisted proofreading and outperformed the others on unassisted spelling, although not significantly. Remedial (unassisted) improvements in automaticity of word recognition, homophone proofreading, and basic reading were found over all groups. Results elucidate the differential contributions of each function of the homophone tool and suggest that with the proper training, assistive software can help not only students with diagnosed disabilities but also those with generally weak reading skills.

Changes in antibiotic susceptibility in staphylococci habituated to sub-lethal concentrations of tea tree oil (Melaleuca alternifolia)

Aims: To investigate the effect of sub-lethal challenge with tea tree oil (TTO) on the antibiotic resistance profiles of staphylococci.

Epistolarum Familiarium Liber Unus in The Complete Works of John Milton: Volume XI (672pp.)

This edition of Milton’s Epistolarum Familiarium Liber Unus and of his Uncollected Letters, will appear as 672 pp. of The Complete Works of John Milton Volume XI, eds. Gordon Campbell and Edward Jones (Oxford University Press, forthcoming 2016). A diplomatic Latin text and a new facing English translation are complemented by a detailed Introduction and commentary that situate Milton’s Latin letters in relation to the classical, pedagogical and essentially humanist contexts at the heart of their composition. Now the art of epistolography advocated and exemplified by Cicero and Quintilian and embraced by Renaissance pedagogical manuals is read through a humanist filter whereby, via the precedent (and very title) of Epistolae Familiares, the Miltonic Liber is shown to engage with a neo-Latin re-invention of the classical epistola that had come to birth in quattrocento Italy in the letters of Petrarch and his contemporaries. At the same time the Epistolae are seen as offering fresh insight into Milton’s views on education, philology, his relations with Italian literati, his blindness, the poetic dimension of his Latin prose, and especially his verbal ingenuity as the ‘words’ of Latin ‘Letters’ become a self-conscious showcasing of etymological punning on the ‘letters’ of Latin ‘words’. The edition also announces several new discoveries, most notably its uncovering and collation of a manuscript of Henry Oldenburg’s transcription (in his Liber Epistolaris held in Royal Society, London) of Milton’s Ep. Fam. 25 (to Richard Jones). Oldenburg’s transcription (from the original sent to his pupil Jones) is an important find, given the loss of all but two of the manuscripts of Milton’s original Latin letters included in the 1674 volume. The edition also presents new evidence in regard to Milton’s relationships with the Italian philologist Benedetto Buonmattei, the Greek humanist Leonard Philaras, the radical pastor Jean Labadie (and the French church of London), and the elusive Peter Heimbach.

Cross-Cultural Patterns in Dynamic Ratings of Positive and Negative Natural Emotional Behaviour

Background: Studies of cross-cultural variations in the perception of emotion have typically compared rates of recognition of static posed stimulus photographs. That research has provided evidence for universality in the recognition of a range of emotions but also for some systematic cross-cultural variation in the interpretation of emotional expression. However, questions remain about how widely such findings can be generalised to real life emotional situations. The present study provides the first evidence that the previously reported interplay between universal and cultural influences extends to ratings of natural, dynamic emotional stimuli.

Methodology/Principal Findings: Participants from Northern Ireland, Serbia, Guatemala and Peru used a computer based tool to continuously rate the strength of positive and negative emotion being displayed in twelve short video sequences by people from the United Kingdom engaged in emotional conversations. Generalized additive mixed models were developed to assess the differences in perception of emotion between countries and sexes. Our results indicate that the temporal pattern of ratings is similar across cultures for a range of emotions and social contexts. However, there are systematic differences in intensity ratings between the countries, with participants from Northern Ireland making the most extreme ratings in the majority of the clips.

Conclusions/Significance: The results indicate that there is strong agreement across cultures in the valence and patterns of ratings of natural emotional situations but that participants from different cultures show systematic variation in the intensity with which they rate emotion. Results are discussed in terms of both ‘in-group advantage’ and ‘display rules’ approaches. This study indicates that examples of natural spontaneous emotional behaviour can be used to study cross-cultural variations in the perception of emotion.

Female choice in the red mason bee, Osmia rufa (L.) (Megachilidae)

Females are often thought to use several cues and more than one modality in selection of a mate, possibly because they offer complementary information on a mate's suitability. In the red mason bee, Osmia rufa, we investigated the criteria a female uses to choose a mating partner. We hypothesized that the female uses male thorax vibrations and size as signs of male viability and male odor for kin discrimination and assessment of genetic relatedness. We therefore compared males that had been accepted by a female for copulation with those rejected, in terms of their size, their immediate precopulatory vibrations (using laser vibrometry), the genetic relatedness of unmated and mated pairs (using microsatellite markers) and emitted volatiles (using chemical analyses). Females showed a preference for intermediate-sized males that were slightly larger than the modal male size. Furthermore, male precopulatory vibration burst duration was significantly longer in males accepted for copulation compared with rejected males. Vibrations may indicate vigor and assure that males selected by females are metabolically active and healthy. Females preferentially copulated with males that were genetically more closely related, possibly to avoid outbreeding depression. Volatiles of the cuticular surface differed significantly between accepted and rejected males in the relative amounts of certain hydrocarbons, although the relationship between male odor and female preference was complex. Females may therefore also use differences in odor bouquet to select among males. Our investigations show that O. rufa females appear to use multiple cues in selecting a male. Future investigations are needed to demonstrate whether odor plays a role in kin recognition and how the multiple cues are integrated in mate choice by females.