Speech recognition in adverse environments using lip information

The performance of automatic speech recognition systems deteriorates in the presence of noise. One known solution is to incorporate video information with an existing acoustic speech recognition system. We investigate the performance of the individual acoustic and visual sub-systems and then examine different ways in which the integration of the two systems may be performed. The system is to be implemented in real time on a Texas Instruments' TMS320C80 DSP.

Robust speaker verification via fusion of speech and lip modalities

This paper investigates the use of lip information, in conjunction with speech information, for robust speaker verification in the presence of background noise. It has been previously shown in our own work, and in the work of others, that features extracted from a speaker's moving lips hold speaker dependencies which are complementary with speech features. We demonstrate that the fusion of lip and speech information allows for a highly robust speaker verification system which outperforms the performance of either sub-system. We present a new technique for determining the weighting to be applied to each modality so as to optimize the performance of the fused system. Given a correct weighting, lip information is shown to be highly effective for reducing the false acceptance and false rejection error rates in the presence of background noise

The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs

Investigates the use of temporal lip information, in conjunction with speech information, for robust, text-dependent speaker identification. We propose that significant speaker-dependent information can be obtained from moving lips, enabling speaker recognition systems to be highly robust in the presence of noise. The fusion structure for the audio and visual information is based around the use of multi-stream hidden Markov models (MSHMM), with audio and visual features forming two independent data streams. Recent work with multi-modal MSHMMs has been performed successfully for the task of speech recognition. The use of temporal lip information for speaker identification has been performed previously (T.J. Wark et al., 1998), however this has been restricted to output fusion via single-stream HMMs. We present an extension to this previous work, and show that a MSHMM is a valid structure for multi-modal speaker identification

The use of speech and lip modalities for robust speaker verification under adverse conditions

Investigates the use of lip information, in conjunction with speech information, for robust speaker verification in the presence of background noise. We have previously shown (Int. Conf. on Acoustics, Speech and Signal Proc., vol. 6, pp. 3693-3696, May 1998) that features extracted from a speaker's moving lips hold speaker dependencies which are complementary with speech features. We demonstrate that the fusion of lip and speech information allows for a highly robust speaker verification system which outperforms either subsystem individually. We present a new technique for determining the weighting to be applied to each modality so as to optimize the performance of the fused system. Given a correct weighting, lip information is shown to be highly effective for reducing the false acceptance and false rejection error rates in the presence of background noise

Can audio-visual speech recognition outperform acoustically enhanced speech recognition in automotive environment?

The use of visual features in the form of lip movements to improve the performance of acoustic speech recognition has been shown to work well, particularly in noisy acoustic conditions. However, whether this technique can outperform speech recognition incorporating well-known acoustic enhancement techniques, such as spectral subtraction, or multi-channel beamforming is not known. This is an important question to be answered especially in an automotive environment, for the design of an efficient human-vehicle computer interface. We perform a variety of speech recognition experiments on a challenging automotive speech dataset and results show that synchronous HMM-based audio-visual fusion can outperform traditional single as well as multi-channel acoustic speech enhancement techniques. We also show that further improvement in recognition performance can be obtained by fusing speech-enhanced audio with the visual modality, demonstrating the complementary nature of the two robust speech recognition approaches.

The association between playgroup participation, learning competence and social-emotional wellbeing for children aged 4-5 years in Australia

Data from Growing Up in Australia: The Longitudinal Study of Australian Children is used to examine the associations between playgroup participation and the outcomes for children aged 4 to 5 years. Controlling for a range of socio-economic and family characteristics, playgroup participation across the ages of 0-3 years was used to predict learning competence and social-emotional functioning outcomes at age 4-5 years. For learning competence, both boys and girls from disadvantaged families scored 3-4% higher if they attended playgroup when aged 0-1 and 2-3 years compared to boys and girls from disadvantaged families who did not attend playgroup. For social and emotional functioning, girls from disadvantaged families who attended playgroup when they were aged 0-1 and 2-3 years scored nearly 5% higher than those who did not attend. Demographic characteristics also showed that disadvantaged families were the families least likely to access these services. Despite data limitations, this study provides evidence that continued participation in playgroups is associated with better outcomes for children from disadvantaged families.

Social and emotional determinants of health

- describe what is meant by socioeconomic differences in health, and the social and emotional determinants of health - understand how health inequalities are affected by the social and economic circumstances that people experience throughout their lives - discuss how factors such as living and working conditions, income, place and education can impact on health - identify actions for public health policy-makers that have the potential to make a difference in improving health outcomes within populations - appreciate the concept of social cohesion and social capital, and their role as potential protective factors in health - understand conceptual models that can assist in analysing these issues.

Positive emotional responses to hybridised writing about a socio-scientific issue

In order to understand better the role of affect in learning about socio-scientificissues (SSI), this study investigated Year 12 students’ emotional arousal as they participated in an online writing-to-learn science project about the socio-scientific issue of biosecurity. Students wrote a series of hybridised scientific narratives, or BioStories, that integrate scientific information about biosecurity with narrative storylines, and uploaded these to a dedicated website. Throughout their participation in the project, students recorded their emotional responses to the various activities (N=50). Four case students were also video recorded during selected science lessons as they researched, composed and uploaded their BioStories for peer review. Analysis of these data, as well as interview data obtained from the case students, revealed that pride, strength, determination, interest and alertness were among the positive emotions most strongly elicited by the project. These emotions reflected students’ interest in learning about a new socio-scientific issue, and their enhanced feelings of self-efficacy in successfully writing hybridised scientific narratives in science. The results of this study suggest that the elicitation of positive emotional responses as students engage in hybridised writing about SSI with strong links to environmental education, such as biosecurity, can be valuable in engaging students in education for sustainability.

Categorising emotional experiences with portable interactive devices

This paper reports on a six month longitudinal study exploring people’s emotional experience with two categories of portable interactive devices (PIDs); media and health related PIDs. The focus is on emotions and how PIDs mediate these experiences in everyday contexts. Previous findings presented by the authors (Gomez 2009, 2010) revealed that people’s emotional experiences with PIDs over time are influenced by whether interactions were at a personal or social level. This paper presents four categories of activities identified and their relationship to emotional experiences with PIDs that have been developed through further analysis of the data. It concludes with a discussion of the findings and their implications to the field of Design on the design of future PIDs.

The effect of emotional and attentional load on attentional startle modulation

The interactive effects of emotion and attention on attentional startle modulation were investigated in two experiments. Participants performed a discrimination and counting task with two visual stimuli during which acoustic eyeblink startle-eliciting probes were presented at long lead intervals. In Experiment 1, this task was combined with aversive Pavlovian conditioning. In Group Attend CS+, the attended stimulus was followed by an aversive unconditional stimulus (US) and the ignored stimulus was presented alone whereas the ignored stimulus was paired with the US in Group Attend CS−. In Experiment 2, a non-aversive reaction time task US replaced the aversive US. Regardless of the conditioning manipulation and consistent with a modality non-specific account of attentional startle modulation, startle magnitude was larger during attended than ignored stimuli in both experiments. Blink latency shortening was differentially affected by the conditioning manipulations suggesting additive effects of conditioning and discrimination and counting task on blink startle.

No evidence for subliminal affective priming with emotional facial expression primes

The present study investigated whether facial expressions of emotion presented outside consciousness awareness will elicit evaluative responses as assessed in affective priming. Participants were asked to evaluate pleasant and unpleasant target words that were preceded by masked or unmasked schematic (Experiment 1) or photographic faces (Experiments 1 and 2) with happy or angry expressions. They were either required to perform the target evaluation only or to perform the target evaluation and to name the emotion expressed by the face prime. Prime-target interval was 300 ms in Experiment 1 and 80 ms in Experiment 2. Naming performance confirmed the effectiveness of the masking procedure. Affective priming was evident after unmasked primes in tasks that required naming of the facial expressions for schematic and photographic faces and after unmasked primes in tasks that did not require naming for photographic faces. No affective priming was found after masked primes. The present study failed to provide evidence for affective priming with masked face primes, however, it indicates that voluntary attention to the primes enhances affective priming.

Cognitive behavior therapy and dialectical behavior therapy for treating obese emotional eaters

This study describes the treatment of obese individuals who rated high on emotional eating using four case studies that involved 22 sessions of either cognitive behavioral therapy (CBT) or dialectical behavioral therapy (DBT). Outcomes measures relating to weight, body mass index, emotional eating, depression, anxiety, and stress were all assessed with each participant prior to each baseline (three weekly sessions), during treatment and posttherapy. At the 8-week follow-up, the two cases that had received DBT had lost 10.1% and 7.6% of their initial body weight, whereas the two cases that had received CBT had lost 0.7% and 0.6% of their initial body weight. The two DBT cases also exhibited reductions in emotional distress, frequency of emotional eating or quantity of food eating in response to emotions, whereas the two CBT cases showed no overall reductions in these areas. Important processes from all four cases are described as are the implications to clinicians for developing more effective interventions for obese clients who engage in emotional eating.

An emotional father and son reunion that sometimes is at a loss for words [Review]

DRAMA often develops around the idea of a return: a return to events of the past, memories of the past, or people from the past...

Australian children with special health care needs: Social-emotional and learning competencies in the early years

This study examined the relationship between special health care needs and social-emotional and learning competence in the early years, reporting on two waves of data from the Kindergarten Cohort of Growing up in Australia: The Longitudinal Study of Australian Children (LSAC). Six hundred and fifty children were identified through the 2-question Special Health Care Needs Screener as having special health care needs. Children with special health care needs were more likely to be male, to have been of low birth weight, to be taking prescription medications, to be diagnosed with a specific health condition and to be from families where the mother was less well educated. These children scored significantly lower on teacher-rated social-emotional and learning competencies prior to school compared to a control group of children without special health care needs. Multiple regression analyses indicated that being identified with a special health care need prior to school predicted lower social-emotional and learning competencies in the early years of school. Results are discussed in terms of the implications for policy and practice.