Perceptual Evaluation of Video-Realistic Speech

abstract With many visual speech animation techniques now available, there is a clear need for systematic perceptual evaluation schemes. We describe here our scheme and its application to a new video-realistic (potentially indistinguishable from real recorded video) visual-speech animation system, called Mary 101. Two types of experiments were performed: a) distinguishing visually between real and synthetic image- sequences of the same utterances, ("Turing tests") and b) gauging visual speech recognition by comparing lip-reading performance of the real and synthetic image-sequences of the same utterances ("Intelligibility tests"). Subjects that were presented randomly with either real or synthetic image-sequences could not tell the synthetic from the real sequences above chance level. The same subjects when asked to lip-read the utterances from the same image-sequences recognized speech from real image-sequences significantly better than from synthetic ones. However, performance for both, real and synthetic, were at levels suggested in the literature on lip-reading. We conclude from the two experiments that the animation of Mary 101 is adequate for providing a percept of a talking head. However, additional effort is required to improve the animation for lip-reading purposes like rehabilitation and language learning. In addition, these two tasks could be considered as explicit and implicit perceptual discrimination tasks. In the explicit task (a), each stimulus is classified directly as a synthetic or real image-sequence by detecting a possible difference between the synthetic and the real image-sequences. The implicit perceptual discrimination task (b) consists of a comparison between visual recognition of speech of real and synthetic image-sequences. Our results suggest that implicit perceptual discrimination is a more sensitive method for discrimination between synthetic and real image-sequences than explicit perceptual discrimination.

Experience in introduction of English terminology in engineering lessons: methodology and evaluation

This communication explains a experience for the introduction of English terminology in a technical degree of higher education. We present the methodology and assessment procedures used to evaluate the way the students perceived the introduction of terminology in English in two different subjects from 3rd and 5th year courses of a Computer Science degree in which English was not the vehicular language. We propose a strategy based on two main pillars, namely: 1) The design of materials, explanations, and exams, paying particular attention to the way in which the specific terminology was exposed to the students, and 2) The assessment of the impact in the students by means of the analysis of the feedback trough a set of enquiries. Our experience showed that the students responded very positively to the introduction of English terminology, and presented an affirmative feedback about the impact that an improvement of their linguistic abilities would have in their future work. Further, we present statistics regarding the use of English as the vehicular language for technical reports, which is envisaged as very useful by the students. Finally, we propose a set of questions for further debate which are centered in the role that English terminology should pay in technical degrees, and about the way in which universities should deploy resources in English languages within the different Syllabus

The sight of silence : the conceptualisation of silence in the visual cultures of sign language communities

Deaf people are perceived by hearing people as living in a silent world. Yet, silence cannot exist without sound, so if sound is not heard, can there be silence? From a linguistic point of view silence is the absence of, or intermission in, communication. Silence can be communicative or noncommunicative. Thus, silence must exist in sign languages as well. Sign languages are based on visual perception and production through movement and sight. Silence must, therefore, be visually perceptible; and, if there is such a thing as visual silence, how does it look? The paper will analyse the topic of silence from a Deaf perspective. The main aspects to be explored are the perception and evaluation of acoustic noise and silence by Deaf people; the conceptualisation of silence in visual languages, such as sign languages; the qualities of visual silence; the meaning of silence as absence of communication (particularly between hearing and Deaf people); social rules for silence; and silencing strategies.

Speech and the hearing-impaired child: evaluation and revision of the CID Speech Skills Worksheet

The purpose of this study was to evaluate the current use of the Central Institute for the Deaf’s Speech Skills Worksheet by teacher of the deaf and speech-language pathologists, review the current literature on speech development in hearing-impaired children, and apply the findings to develop a more comprehensive Speech Skills Worksheet.

Second language listening strategy research: methodological challenges and perspectives

This paper explores methodological issues related to research into second language listening strategies. We argue that a number of central questions regarding research methodology in this line of enquiry are underexamined, and we engage in the discussion of three key methodological questions: (1) To what extent is a verbal report a valid and reliable way of eliciting information about strategies? (2) Should we control for learners' level of linguistic knowledge when examining their listening strategy use? and (3) What are the problems surrounding the analysis of data gained through verbal reports? We discuss each of these three methodological issues within the framework of a research project investigating listening strategies deployed by learners of French in secondary schools in England. Implications from these findings for future research are discussed.

Motivation in second language acquisition in Chinese research students in the UK

The present study sets out to examine motivation to learn English by Chinese research students in an informal setting. Data were collected, using semi-structured interviews, from four research students at two points in time during their first year in the UK. The main findings are: they believed that learning English was important; their main goal orientations were instrumental and extrinsic; they set learning goals and persisted to attain them; they valued their current learning environment in general and saw it as supportive of their goals; they held both positive and negative attitudes towards the British, which had differential effects on their motivation; their self-perceived support seemed to have a positive impact on their motivation and the development of self-confidence; they tended to attribute their success to stable causes such as the environment and failure to unstable but controllable causes such as effort. It is concluded that qualitative data of this kind may complement insights from quantitative research. Implications for target country institutions in the provision of support are discussed.

Why all counter-evidence to the critical period hypothesis in second language acquisition is not equal or problematic

That adult and child language acquisitions differ in route and outcome is observable. Notwithstanding, there is controversy as to what this observation means for the Critical Period Hypothesis’ (CPH) application to adult second language acquisition (SLA). As most versions of the CPH applied to SLA claim that differences result from maturational effects on in-born linguistic mechanisms, the CPH has many implications that are amendable to empirical investigation. To date, there is no shortage of literature claiming that the CPH applies or does not apply to normal adult SLA. Herein, I provide an epistemological discussion on the conceptual usefulness of the CPH in SLA (cf. Singleton 2005) coupled with a review of Long's (2005) evaluation of much available relevant research. Crucially, I review studies that Long did not consider and conclude differently that there is no critical/sensitive period for L2 syntactic and semantic acquisition.

Unconscious effects of language-specific terminology on pre-attentive colour perception

It is now established that native language affects one's perception of the world. However, it is unknown whether this effect is merely driven by conscious, language-based evaluation of the environment or whether it reflects fundamental differences in perceptual processing between individuals speaking different languages. Using brain potentials, we demonstrate that the existence in Greek of 2 color terms—ghalazio and ble—distinguishing light and dark blue leads to greater and faster perceptual discrimination of these colors in native speakers of Greek than in native speakers of English. The visual mismatch negativity, an index of automatic and preattentive change detection, was similar for blue and green deviant stimuli during a color oddball detection task in English participants, but it was significantly larger for blue than green deviant stimuli in native speakers of Greek. These findings establish an implicit effect of language-specific terminology on human color perception.

Evaluation and revision of inferential comprehension in narrative texts: an eye movement study

We investigated the processes of how adult readers evaluate and revise their situation model during reading by monitoring their eye movements as they read narrative texts and subsequent critical sentences. In each narrative text, a short introduction primed a knowledge-based inference, followed by a target concept that was either expected (e.g., “oven”) or unexpected (e.g., “grill”) in relation to the inferred concept. Eye movements showed that readers detected a mismatch between the new unexpected information and their prior interpretation, confirming their ability to evaluate inferential information. Just below the narrative text, a critical sentence included a target word that was either congruent (e.g., “roasted”) or incongruent (e.g., “barbecued”) with the expected but not the unexpected concept. Readers spent less time reading the congruent than the incongruent target word, reflecting the facilitation of prior information. In addition, when the unexpected (but not expected) concept had been presented, participants with lower verbal (but not visuospatial) working memory span exhibited longer reading times and made more regressions (from the critical sentence to previous information) on encountering congruent information, indicating difficulty in inhibiting their initial incorrect interpretation and revising their situation model

Teaching Intercultural Communication in Foreign Language Education through Video Conferencing

Since 1980s, Western linguists and specialists on second language acquisition have emphasized the importance of enhancing students’ intercultural communication competence in foreign language education. At the same time, the demand for intercultural communicative competence increased along with the advances of communication technology with its increasingly global reach and the process of globalization itself.In the field of distance language education, these changes have resulted in a shift of focus from the production and distribution of learning materials towards communication and learning as a social process, facilitated by various internet-based platforms. The current focus on learners interacting and communicating synchronously trough videoconferencing is known as the fourth generation of distance language education. Despite the fact that teaching of Chinese as a foreign language (CFL) faces the same or even greater challenges as teaching other languages, the intercultural communication perspective is still quite a new trend in CFL and its implementation and evaluation are still under development. Moreover, the advocates of the new trends in CFL have so far focused almost exclusively on classroom-based courses, neglecting the distance mode of CFL and leaving it as an open field for others to explore. In this under-researched context, Dalarna University (Sweden), where I currently work, started to provide web-based courses of the Chinese language in 2007. Since 2010, the Chinese language courses have been available only in the distance form, using the same teaching materials as the previous campus-based courses. The textbooks used in both settings basically followed the functional nationalism approach. However, in order to catch up with the main trend of foreign-language education, we felt a need to implement the cross-cultural dimension into the distance courses as well. Therefore in 2010, a pilot study has been carried out to explore opportunities and challenges for implementing a cross-cultural perspective into existing courses and evaluating the effectiveness of this implementation based on the feedback of the students and on the experience of the teacher/researcher.

Evaluation of partially dentate patients' knowledge about caries and periodontal disease

Objective: This investigation evaluated the knowledge of dental caries and periodontal disease among removable partial denture (RPD) wearers.Method: A total of 127 partially dentate patients participated in this observational study. A structured questionnaire, which included eight questions referring to knowledge about aetiology and prevention of dental caries and periodontal disease, was developed in the local language (Portuguese) and used to collect the data of all the partial denture wearers. A descriptive analysis of data was performed by means of drafting tables.Results: The results demonstrated that 68.5% of patients interviewed had previously received information about oral health care. With regard to bacterial plaque, it was observed that only 34.6% reported having knowledge of this. Whereas, in relation to caries, 76.4% of the interviewees replied that they knew the meaning of this. Nevertheless, 28.3% referred to caries as a whole in the teeth, 16.5% as bad teeth and 9.4% bacteria/creatures on the teeth. Only 17.3% of the partially edentulous patients evaluated were shown to know what disease of the gingiva was.Conclusion: By means of the methodology applied, it could be concluded that the patients who wore RPDs presented deficient knowledge with regard to the prevention, aetiology and development of dental caries and periodontal disease.

Cross-cultural adaptation of Preschool Language Assessment Instrument: Second Edition

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Trajectory and outcomes of speech language therapy in the Prader-Willi syndrome (PWS): case report

The aim of this study was to describe the trajectory and the outcomes of speech-language therapy in Prader-Willi syndrome through a longitudinal study of the case of an 8 year-old boy, along four years of speech-language therapy follow-up. The therapy sessions were filmed and documental analysis of information from the child's records regarding anamnesis, evaluation and speech-language therapy reports and multidisciplinary evaluations were carried out. The child presented typical characteristics of Prader-Willi syndrome, such as obesity, hyperfagia, anxiety, behavioral problems and self aggression episodes. Speech-language pathology evaluation showed orofacial hypotony, sialorrhea, hypernasal voice, cognitive deficits, oral comprehension difficulties, communication using gestures and unintelligible isolated words. Initially, speech-language therapy had the aim to promote the language development emphasizing social interaction through recreational activities. With the evolution of the case, the main focus became the development of conversation and narrative abilities. It were observed improvements in attention, symbolic play, social contact and behavior. Moreover, there was an increase in vocabulary, and evolution in oral comprehension and the development of narrative abilities. Hence, speech-language pathology intervention in the case described was effective in different linguistic levels, regarding phonological, syntactic, lexical and pragmatic abilities.

Subtitling as a pedagogical tool for language teaching in journalism

This study was designed to present and discuss some results produced by a research involving the use of English subtitles of some news videos from the webiste Reuters.com (http://www.reuters.com) with pedagogical reasons in a Brazilian context (Academic English for Journalism). We have developed the research during two semesters at UNESP (Universidade Estadual Paulista Júlio de Mesquita Filho). The professor in charge of the study has chosen the students of Journalism as the audience to whom the videos were presented. The assumptions of many theorists and experts in Audiovisual Translation were adopted as our Theoretical Sources. The first step of the study was the assessment of the syllabus of each course. This was very helpful as a guidance in order to choose the most relevant and interesting videos for students. After the evaluation of academic and professional interests, we chose some videos to insert appropriate subtitles, according to some strategies suggested by Panayota Georgakopoulou and Henrik Gottlieb. Finally we presented the videos during the English classes. At the first time, they were presented without subtitles just to notice the comprehension level of the students. After that, the videos were presented with English subtitles. As we first assumed, the students haven’t had the whole comprehension of specific details during the first presentation, they have just used their previous knowledge and the visual aids to help them in a superficial understanding of the news. As the subtitles appear, the process of communication was finally accomplished.

Desempenho de pré-escolares com queixa de Distúrbios da Comunicação no Preschool Language Assessment Instrument (Plai-2)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)