Automatic transcription of conversational telephone speech

This paper discusses the Cambridge University HTK (CU-HTK) system for the automatic transcription of conversational telephone speech. A detailed discussion of the most important techniques in front-end processing, acoustic modeling and model training, language and pronunciation modeling are presented. These include the use of conversation side based cepstral normalization, vocal tract length normalization, heteroscedastic linear discriminant analysis for feature projection, minimum phone error training and speaker adaptive training, lattice-based model adaptation, confusion network based decoding and confidence score estimation, pronunciation selection, language model interpolation, and class based language models. The transcription system developed for participation in the 2002 NIST Rich Transcription evaluations of English conversational telephone speech data is presented in detail. In this evaluation the CU-HTK system gave an overall word error rate of 23.9%, which was the best performance by a statistically significant margin. Further details on the derivation of faster systems with moderate performance degradation are discussed in the context of the 2002 CU-HTK 10 × RT conversational speech transcription system. © 2005 IEEE.

Creating a spontaneous conversational speech corpus

Speech recognition and language analysis of spontaneous speech arising in naturally spoken conversations are becoming the subject of much research. However, there is a shortage of spontaneous speech corpora that are freely available for academics. We therefore undertook the building of a natural conversation speech database, recording over 200 hours of conversations in English by over 600 local university students. With few exceptions, the students used their own cell phones from their own rooms or homes to speak to one another, and they were permitted to speak on any topic they chose. Although they knew that they were being recorded and that they would receive a small payment, their conversations in the corpus are probably very close to being natural and spontaneous. This paper describes a detailed case study of the problems we faced and the methods we used to make the recordings and control the collection of these social science data on a limited budget.

Conversational success in Williams syndrome: communication in the face of cognitive and linguistic limitations

Williams syndrome (WS) is characterized by apparent relative strengths in language, facial processing and social cognition but by profound impairment in spatial cognition, planning and problem solving. Following recent research which suggests that individuals with WS may be less linguistically able than was once thought, in this paper we begin to investigate why and how they may give the impression of linguistic proficiency despite poor standardized test results. This case study of Brendan, a 12-year-old boy with WS, who presents with a considerable lack of linguistic ability, suggests that impressions of linguistic competence may to some extent be the result of conversational strategies which enable him to compensate for various cognitive and linguistic deficits with a considerable degree of success. These conversational strengths are not predicted by his standardized language test results, and provide compelling support for the use of approaches such as Conversation Analysis in the assessment of individuals with communication impairments.

Social interaction deficits and conversational inadequacy in Williams syndrome

Research on social communication skills in individuals with Williams syndrome has been inconclusive, with some arguing that these skills are a relative strength and others that they are a weakness. The aim of the present study was to investigate social interaction abilities in a group of children with WS, and to compare them to a group of children with specific language impairment and a group of typically developing children. Semi-structured conversations were conducted and 100-150 utterances were selected for analysis in terms of exchange structure, turn taking, information transfer and conversational inadequacy. The statistical analyses showed that the children with WS had difficulties with exchange structure and responding appropriately to the interlocutor's requests for information and clarification. They also had significant difficulties with interpreting meaning and providing enough information for the conversational partner. Despite similar language abilities with a group of children with specific language impairment, the children with WS had different social interaction skills, which suggests that they follow an atypical trajectory of development and their neurolinguistic profile does not directly support innate modularity. (c) 2005 Elsevier Ltd. All rights reserved.

Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments

Participants' eye-gaze is generally not captured or represented in immersive collaborative virtual environment (ICVE) systems. We present EyeCVE. which uses mobile eye-trackers to drive the gaze of each participant's virtual avatar, thus supporting remote mutual eye-contact and awareness of others' gaze in a perceptually unfragmented shared virtual workspace. We detail trials in which participants took part in three-way conferences between remote CAVE (TM) systems linked via EyeCVE. Eye-tracking data was recorded and used to evaluate interaction, confirming; the system's support for the use of gaze as a communicational and management resource in multiparty conversational scenarios. We point toward subsequent investigation of eye-tracking in ICVEs for enhanced remote social-interaction and analysis.

Entity-based semantic search on conversational transcripts semantic

This paper describes the implementation of a semantic web search engine on conversation styled transcripts. Our choice of data is Hansard, a publicly available conversation style transcript of parliamentary debates. The current search engine implementation on Hansard is limited to running search queries based on keywords or phrases hence lacks the ability to make semantic inferences from user queries. By making use of knowledge such as the relationship between members of parliament, constituencies, terms of office, as well as topics of debates the search results can be improved in terms of both relevance and coverage. Our contribution is not algorithmic instead we describe how we exploit a collection of external data sources, ontologies, semantic web vocabularies and named entity extraction in the analysis of underlying semantics of user queries as well as the semantic enrichment of the search index thereby improving the quality of results.

Analysis of speech fluency in Williams syndrome

Williams syndrome (WS) is a neurodevelopmental genetic disorder, often referred as being characterized by dissociation between verbal and non-verbal abilities, although the number of studies disputing this proposal is emerging. Indeed, although they have been traditionally reported as displaying increased speech fluency, this topic has not been fully addressed in research. In previous studies carried out with a small group of individuals with WS, we reported speech breakdowns during conversational and autobiographical narratives suggestive of language difficulties. In the current study, we characterized the speech fluency profile using an ecologically based measure - a narrative task (story generation) was collected from a group of individuals with WS (n = 30) and typically developing group (n = 39) matched in mental age. Oral narratives were elicited using a picture stimulus - the cookie theft picture from Boston Diagnosis Aphasia Test. All narratives were analyzed according to typology and frequency of fluency breakdowns (non-stuttered and stuttered disfluencies). Oral narratives in WS group differed from typically developing group, mainly due to a significant increase in the frequency of disfluencies, particularly in terms of hesitations, repetitions and pauses. This is the first evidence of disfluencies in WS using an ecologically based task (oral narrative task), suggesting that these speech disfluencies may represent a significant marker of language problems in WS. (C) 2011 Elsevier Ltd. All rights reserved.

Lexical phrases in telecommunication blogs: a genre analysis

The study presented in this paper aims to provide a description of telecommunication blogs as a genre. Lexical phrases are analysed in order to reach conclusions regarding the nature of the language in these texts and the extent to which the results obtained are comparable with other written or conversational discourse types. Although the departing hypothesis is that the articles in blogs are basically transactional and their main objective is to transfer information, the conclusions point to interaction as a distinctive characteristic of this type of discourse and also to a more careful organization in the comments to the blogs entries than originally expected. RESUMEN. Este trabajo presenta una descripción de los blogs de Telecomunicación como género. A través del análisis de frases léxicas se llega a conclusiones sobre algunas de las características que definen la lengua que se usa en este tipo de textos y se comparan los resultados obtenidos con otros previos sobre el discurso escrito y el conversacional. Aunque la hipótesis de partida es que los artículos de los blogs son básicamente transaccionales, donde el principal objetivo es transmitir información, los resultados llevan a conclusiones sobre la importancia de la interacción en este tipo de discurso y también apuntan a una mayor organización de la esperable en las entradas de los comentarios al artículo principal del blog.

Phraseological features in conversational routines: An integrative model of autonomy

This paper deals with the analysis of routine formulas according to their degree of independence in discourse, with the aim of establishing a gradual line which restructures Sphere III (Corpas 1996, Alvarado 2015) — where phraseological utterances belong. The system developed by Briz and the Val.Es.Co. Group (2003, 2014) will help us segment conversation and check that phraseological utterances show various degrees of independence, both in Peninsular Spanish and in Latin American Spanish, which will make it possible to restructure Sphere III. The methodology utilized corresponds to the phraseological and pragmatic approach, and the examples were extracted from the Corpus de Conversaciones Coloquiales of Briz and the Val.Es.Co. Group (2002), and from the Corpus Preseea (2014).

Conversational interaction in the scanner:mentalizing during language processing as revealed by MEG

Humans are especially good at taking another's perspective-representing what others might be thinking or experiencing. This "mentalizing" capacity is apparent in everyday human interactions and conversations. We investigated its neural basis using magnetoencephalography. We focused on whether mentalizing was engaged spontaneously and routinely to understand an utterance's meaning or largely on-demand, to restore "common ground" when expectations were violated. Participants conversed with 1 of 2 confederate speakers and established tacit agreements about objects' names. In a subsequent "test" phase, some of these agreements were violated by either the same or a different speaker. Our analysis of the neural processing of test phase utterances revealed recruitment of neural circuits associated with language (temporal cortex), episodic memory (e.g., medial temporal lobe), and mentalizing (temporo-parietal junction and ventromedial prefrontal cortex). Theta oscillations (3-7 Hz) were modulated most prominently, and we observed phase coupling between functionally distinct neural circuits. The episodic memory and language circuits were recruited in anticipation of upcoming referring expressions, suggesting that context-sensitive predictions were spontaneously generated. In contrast, the mentalizing areas were recruited on-demand, as a means for detecting and resolving perceived pragmatic anomalies, with little evidence they were activated to make partner-specific predictions about upcoming linguistic utterances.

Language Outcomes of the Play and Language for Autistic Youngsters (PLAY) Project Home Consultation model—An Extended Analysis

The current study is a post-hoc analysis of data from the original randomized control trial of the Play and Language for Autistic Youngsters (PLAY) Home Consultation program, a parent-mediated, DIR/Floortime based early intervention program for children with ASD (Solomon, Van Egeren, Mahone, Huber, & Zimmerman, 2014). We examined 22 children from the original RCT who received the PLAY program. Children were split into two groups (high and lower functioning) based on the ADOS module administered prior to intervention. Fifteen-minute parent-child video sessions were coded through the use of CHILDES transcription software. Child and maternal language, communicative behaviors, and communicative functions were assessed in the natural language samples both pre- and post-intervention. Results demonstrated significant improvements in both child and maternal behaviors following intervention. There was a significant increase in child verbal and non-verbal initiations and verbal responses in whole group analysis. Total number of utterances, word production, and grammatical complexity all significantly improved when viewed across the whole group of participants; however, lexical growth did not reach significance. Changes in child communicative function were especially noteworthy, and demonstrated a significant increase in social interaction and a significant decrease in non-interactive behaviors. Further, mothers demonstrated an increase in responsiveness to the child’s conversational bids, increased ability to follow the child’s lead, and a decrease in directiveness. When separated for analyses within groups, trends emerged for child and maternal variables, suggesting greater gains in use of communicative function in both high and low groups over changes in linguistic structure. Additional analysis also revealed a significant inverse relationship between maternal responsiveness and child non-interactive behaviors; as mothers became more responsive, children’s non-engagement was decreased. Such changes further suggest that changes in learned skills following PLAY parent training may result in improvements in child social interaction and language abilities.

Raman microscopy of formamide-intercalated kaolinites treated by controlled-rate thermal analysis technology

Raman spectroscopy of formamide-intercalated kaolinites treated using controlled-rate thermal analysis technology (CRTA), allowing the separation of adsorbed formamide from intercalated formamide in formamide-intercalated kaolinites, is reported. The Raman spectra of the CRTA-treated formamide-intercalated kaolinites are significantly different from those of the intercalated kaolinites, which display a combination of both intercalated and adsorbed formamide. An intense band is observed at 3629 cm-1, attributed to the inner surface hydroxyls hydrogen bonded to the formamide. Broad bands are observed at 3600 and 3639 cm-1, assigned to the inner surface hydroxyls, which are hydrogen bonded to the adsorbed water molecules. The hydroxyl-stretching band of the inner hydroxyl is observed at 3621 cm-1 in the Raman spectra of the CRTA-treated formamide-intercalated kaolinites. The results of thermal analysis show that the amount of intercalated formamide between the kaolinite layers is independent of the presence of water. Significant differences are observed in the CO stretching region between the adsorbed and intercalated formamide.

Detailed analysis of a conservative difference approximation for the time fractional diffusion equation

Diffusion equations that use time fractional derivatives are attractive because they describe a wealth of problems involving non-Markovian Random walks. The time fractional diffusion equation (TFDE) is obtained from the standard diffusion equation by replacing the first-order time derivative with a fractional derivative of order α ∈ (0, 1). Developing numerical methods for solving fractional partial differential equations is a new research field and the theoretical analysis of the numerical methods associated with them is not fully developed. In this paper an explicit conservative difference approximation (ECDA) for TFDE is proposed. We give a detailed analysis for this ECDA and generate discrete models of random walk suitable for simulating random variables whose spatial probability density evolves in time according to this fractional diffusion equation. The stability and convergence of the ECDA for TFDE in a bounded domain are discussed. Finally, some numerical examples are presented to show the application of the present technique.