A socio friendly approach to the analysis of emotive speech

This paper describes certain findings of intonation and intensity study of emotive speech with the minimal use of signal processing algorithms. This study was based on six basic emotions and the neutral, elicited from 1660 English utterances obtained from the speech recordings of six Indian women. The correctness of the emotional content was verified through perceptual listening tests. Marked similarity was noted among pitch contours of like-worded, positive valence emotions, though no such similarity was observed among the four negative valence emotional expressions. The intensity patterns were also studied. The results of the study were validated using arbitrary television recordings for four emotions. The findings are useful to technical researchers, social psychologists and to the common man interested in the dynamics of vocal expression of emotions

Jitter measurements for Performance enhancement in the Service Sector

In a leading service economy like India, services lie at the very center of economic activity. Competitive organizations now look not only at the skills and knowledge, but also at the behavior required by an employee to be successful on the job. Emotionally competent employees can effectively deal with occupational stress and maintain psychological well-being. This study explores the scope of the first two formants and jitter to assess seven common emotional states present in the natural speech in English. The k-means method was used to classify emotional speech as neutral, happy, surprised, angry, disgusted and sad. The accuracy of classification obtained using raw jitter was more than 65 percent for happy and sad but less accurate for the others. The overall classification accuracy was 72% in the case of preprocessed jitter. The experimental study was done on 1664 English utterances of 6 females. This is a simple, interesting and more proactive method for employees from varied backgrounds to become aware of their own communication styles as well as that of their colleagues' and customers and is therefore socially beneficial. It is a cheap method also as it requires only a computer. Since knowledge of sophisticated software or signal processing is not necessary, it is easy to analyze

Computational Structure of Human Language

The central thesis of this report is that human language is NP-complete. That is, the process of comprehending and producing utterances is bounded above by the class NP, and below by NP-hardness. This constructive complexity thesis has two empirical consequences. The first is to predict that a linguistic theory outside NP is unnaturally powerful. The second is to predict that a linguistic theory easier than NP-hard is descriptively inadequate. To prove the lower bound, I show that the following three subproblems of language comprehension are all NP-hard: decide whether a given sound is possible sound of a given language; disambiguate a sequence of words; and compute the antecedents of pronouns. The proofs are based directly on the empirical facts of the language user's knowledge, under an appropriate idealization. Therefore, they are invariant across linguistic theories. (For this reason, no knowledge of linguistic theory is needed to understand the proofs, only knowledge of English.) To illustrate the usefulness of the upper bound, I show that two widely-accepted analyses of the language user's knowledge (of syntactic ellipsis and phonological dependencies) lead to complexity outside of NP (PSPACE-hard and Undecidable, respectively). Next, guided by the complexity proofs, I construct alternate linguisitic analyses that are strictly superior on descriptive grounds, as well as being less complex computationally (in NP). The report also presents a new framework for linguistic theorizing, that resolves important puzzles in generative linguistics, and guides the mathematical investigation of human language.

Perceptual Evaluation of Video-Realistic Speech

abstract With many visual speech animation techniques now available, there is a clear need for systematic perceptual evaluation schemes. We describe here our scheme and its application to a new video-realistic (potentially indistinguishable from real recorded video) visual-speech animation system, called Mary 101. Two types of experiments were performed: a) distinguishing visually between real and synthetic image- sequences of the same utterances, ("Turing tests") and b) gauging visual speech recognition by comparing lip-reading performance of the real and synthetic image-sequences of the same utterances ("Intelligibility tests"). Subjects that were presented randomly with either real or synthetic image-sequences could not tell the synthetic from the real sequences above chance level. The same subjects when asked to lip-read the utterances from the same image-sequences recognized speech from real image-sequences significantly better than from synthetic ones. However, performance for both, real and synthetic, were at levels suggested in the literature on lip-reading. We conclude from the two experiments that the animation of Mary 101 is adequate for providing a percept of a talking head. However, additional effort is required to improve the animation for lip-reading purposes like rehabilitation and language learning. In addition, these two tasks could be considered as explicit and implicit perceptual discrimination tasks. In the explicit task (a), each stimulus is classified directly as a synthetic or real image-sequence by detecting a possible difference between the synthetic and the real image-sequences. The implicit perceptual discrimination task (b) consists of a comparison between visual recognition of speech of real and synthetic image-sequences. Our results suggest that implicit perceptual discrimination is a more sensitive method for discrimination between synthetic and real image-sequences than explicit perceptual discrimination.

The acquisition of expository uses of language

Objective: This study offers a description of the kinds of linguistic aids offered by adults while giving explanations to young children about different issues. During the midst of these conversations children have several opportunities to learn, not only from objects and events, but also from the utterances used to refer to them, learning how realities are named after, and in many cases, how to participate in them. Methodology: Through the analysis of eleven minutes of interaction between young child and his maternal grandparents. Results: Adults offers young child different discursive ways for helping him to add information, organize and clarify the topic that he is talking about. Conclusions: The results allow to identify different ways that the adults use for helping young child to improve his explanations.

Procedural Meaning Explicatures in the Development of New Subordination Strategies in Romance

The sociocultural changes that led to the genesis of Romance languages widened the gap between oral and written patterns, which display different discoursive and linguistic devices. In early documents, discoursive implicatures connecting propositions were not generally codified, so that the reader should furnish the correct interpretation according to his own perception of real facts; which can still be attested in current oral utterances. Once Romance languages had undergone several levelling processes which concluded in the first standardizations, implicatures became explicatures and were syntactically codified by means of univocal new complex conjunctions. As a consequence of the emergence of these new subordination strategies, a freer distribution of the information conveyed by the utterances is allowed. The success of complex structural patterns ran alongside of the genesis of new narrative genres and the generalization of a learned rhetoric. Both facts are a spontaneous effect of new approaches to the act of reading. Ancient texts were written to be read to a wide audience, whereas those printed by the end of the XV th century were conceived to be read quietly, in a low voice, by a private reader. The goal of this paper is twofold, since we will show that: a) The development of new complex conjunctions through the history of Romance languages accommodates to four structural patterns that range from parataxis to hypotaxis. b) This development is a reflex of the well known grammaticalization path from discourse to syntax that implies the codification of discoursive strategies (Givón 2 1979, Sperber and Wilson 1986, Carston 1988, Grice 1989, Bach 1994, Blackemore 2002, among others]

The Developmental Sentence Analysis and the Grammatical Analysis of Elicited Language - Complex Level: a correlative study

This paper studies the Developmental Sentence Analysis (DSA), which measures syntactic maturity of spontaneous utterances, and the Grammatical Analysis of Elicited Language (GAEL), which uses a highly structured set of games and activities designed to elicit specific target sentences.

Changing state disruption of lip-reading by irrelevant sound in perceptual and memory tasks

Three experiments investigated irrelevant sound interference of lip-read lists. In Experiment 1, an acoustically changing sequence of nine irrelevant utterances was more disruptive to spoken immediate identification of lists of nine lip-read digits than nine repetitions of the same utterances (the changing-state effect; Jones, Madden, & Miles, 1992). Experiment 2 replicated this finding when lip-read items were sampled with replacement from the nine digits to form the lip-read lists. In Experiment 3, when the irrelevant sound was confined to the retention interval of a delayed recall task, a changing-state pattern of disruption also occurred. Results confirm a changing-state effect in memory for lip-read items but also point to the possibility that, for lip-reading, changing-state effects may occur at an earlier, perceptual stage.

Auditory memory and the irrelevant sound effect: further evidence for changing state disruption

Four experiments investigate the hypothesis that irrelevant sound interferes with serial recall of auditory items in the same fashion as with visually presented items. In Experiment 1 an acoustically changing sequence of 30 irrelevant utterances was more disruptive than 30 repetitions of the same utterance (the changing-state effect; Jones, Madden, & Miles, 1992) whether the to-be-remembered items were visually or auditorily presented. Experiment 2 showed that two different utterances spoken once (a heterogeneous compound suffix; LeCompte & Watkins, 1995) produced less disruption to serial recall than 15 repetitions of the same sequence. Disruption thus depends on the number of sounds in the irrelevant sequence. In Experiments 3a and 3b the number of different sounds, the "token-set" size (Tremblay & Jones, 1998), in an irrelevant sequence also influenced the magnitude of disruption in both irrelevant sound and compound suffix conditions. The results support the view that the disruption of memory for auditory items, like memory for visually presented items, is dependent on the number of different irrelevant sounds presented and the size of the set from which these sounds are taken. Theoretical implications are discussed.

Social interaction deficits and conversational inadequacy in Williams syndrome

Research on social communication skills in individuals with Williams syndrome has been inconclusive, with some arguing that these skills are a relative strength and others that they are a weakness. The aim of the present study was to investigate social interaction abilities in a group of children with WS, and to compare them to a group of children with specific language impairment and a group of typically developing children. Semi-structured conversations were conducted and 100-150 utterances were selected for analysis in terms of exchange structure, turn taking, information transfer and conversational inadequacy. The statistical analyses showed that the children with WS had difficulties with exchange structure and responding appropriately to the interlocutor's requests for information and clarification. They also had significant difficulties with interpreting meaning and providing enough information for the conversational partner. Despite similar language abilities with a group of children with specific language impairment, the children with WS had different social interaction skills, which suggests that they follow an atypical trajectory of development and their neurolinguistic profile does not directly support innate modularity. (c) 2005 Elsevier Ltd. All rights reserved.

Disruption of sitting balance after stroke: influence of spoken output

Objectives: To identify the extent of dual task interference between cognitive and motor tasks, (cognitive motor interference (CMI)) in sitting balance during recovery from stroke; to compare CMI in sitting balance between stroke and non-stroke groups; and to record any changes to CMI during sitting that correlate with functional recovery. Method: 36 patients from stroke rehabilitation settings in three NHS trusts. Healthy control group: 21 older volunteers. Measures of seated postural sway were taken in unsupported sitting positions, alone, or concurrently with either a repetitive utterance task or an oral word category generation task. Outcome measures were variability of sway area, path length of sway, and the number of valid words generated. Results: Stroke patients were generally less stable than controls during unsupported sitting tasks. They showed greater sway during repetitive speech compared with quiet sitting, but did not show increased instability to posture between repetitive speech and word category generation. When compared with controls, stroke patients experienced greater dual task interferences during repetitive utterance but not during word generation. Sway during repetitive speech was negatively correlated with concurrent function on the Barthel ADL index. Conclusions: The stroke patients showed postural instability and poor word generation skills. The results of this study show that the effort of verbal utterances alone was sufficient to disturb postural control early after stroke, and the extent of this instability correlated with concomitant Barthel ADL function.

Clustered functional MRI of overt speech production

To investigate the neural network of overt speech production, eventrelated fMRI was performed in 9 young healthy adult volunteers. A clustered image acquisition technique was chosen to minimize speechrelated movement artifacts. Functional images were acquired during the production of oral movements and of speech of increasing complexity (isolated vowel as well as monosyllabic and trisyllabic utterances). This imaging technique and behavioral task enabled depiction of the articulo-phonologic network of speech production from the supplementary motor area at the cranial end to the red nucleus at the caudal end. Speaking a single vowel and performing simple oral movements involved very similar activation of the corticaland subcortical motor systems. More complex, polysyllabic utterances were associated with additional activation in the bilateral cerebellum,reflecting increased demand on speech motor control, and additional activation in the bilateral temporal cortex, reflecting the stronger involvement of phonologic processing.

The type and frequency of interactions that occur between staff and children outside in Early Years Foundation Stage settings during a fixed playtime period when there are tricycles available

This study reports on an investigation into adult and child interactions observed in the outdoor play environment in four Local Authority early years foundation stage settings in England. In this instance the common two features across the settings were the presence of tricycles and a timetabled outdoor play period. In total, across the four schools, there were 204 children. The study aimed to gain an understanding of the nature of the dialogues between staff and children, that is, the types of exchange that occurred when either the child approached an adult or the adult approached a child. The most frequent type of utterance was also analysed. The study concludes that adults in these settings spoke more than children and the greatest type of utterance was that of the adult about domestic matters. When the child initiated the conversation there were more extended child utterances than domestic utterances. This may suggest that children wish to be involved in conversations of depth and meaning and that staff need to become aware of how to develop this conversational language with children.

A cognitive and psycholinguistic investigation of neologisms

Background: Jargon aphasia with neologisms (i.e., novel nonword utterances) is a challenging language disorder that lacks a definitive theoretical description as well as clear treatment recommendations (Marshall, 2006). Aim: The aims of this two part investigation were to determine the source of neologisms in an individual with jargon aphasia (FF), to identify potential facilitatory semantic and/or phonological cuing effects in picture naming, and to determine whether the timing of the cues relative to the target picture mediated the cuing advantage. Methods and Procedures: FF’s underlying linguistic deficits were determined using several cognitive and linguistic tests. A series of computerized naming experiments using a modified version of the 175 item-Philadelphia Naming Test (Roach, Schwartz, Martin, Grewal, & Brecher, 1996) manipulated the cue type (semantic versus phonological) and relatedness (related versus unrelated). In a follow-up experiment, the relative timing of phonological cues was manipulated to test the effect of timing on the cuing advantage. The accuracy of naming responses and error patterns were analyzed. Outcome and Results: FF’s performance on the linguistic and cognitive test battery revealed a severe naming impairment with relatively spared word and nonword repetition, auditory comprehension of words and monitoring, and fairly well preserved semantic abilities. This performance profile was used to evaluate various explanations for neologisms including a loss of phonological codes, monitoring failure, and impairments in semantic system. The primary locus of his deficit appears to involve the connection between semantics to phonology, specifically, when word production involves accessing the phonological forms following semantic access. FF showed a significant cuing advantage only for phonological cues in picture naming, particularly when the cue preceded or coincided with the onset of the target picture. Conclusions: When integrated with previous findings, the results from this study suggest that the core deficit of this and at least some other jargon aphasics is in the connection from semantics to phonology. The facilitative advantage of phonological cues could potentially be exploited in future clinical and research studies to test the effectiveness of these cues for enhancing naming performance in individuals like FF.

Evidence for insertional codemixing: mixed compounds and French nominal groups in Brussels Dutch

In this paper we analyse mixed compounds, such as legume+winkel ‘vegetable shop, greengrocery’ and winter+paletot ‘winter coat’ which contain a French and a Dutch element, and French nominal groups, such as carte d’identité ‘identity card’, and journal parlé ‘radio news’, which bilingual speakers from Brussels frequently insert into Brussels Dutch utterances. Using Muysken’s (2000) typology of bilingual speech, we claim that the mixed compounds and the nominal groups display the characteristics of insertional code-mixing. In addition, some evidence for the existence of a continuum between borrowing and code-switching can be obtained from these examples. As the multimorphemic units that are inserted into Dutch are neither single words, nor full constituents, their status in the lexicon raises interesting issues for researchers interested in the interface between syntax and the lexicon (see also Backus 2003). We try to argue that nominal groups such as carte d’identité and journal parlé are probably best seen as lexical templates or constructional idioms (Booij, 2002b). The insertion of French constructional idioms in Brussels Dutch represents an innovation in the lexical patterns that are available to speakers of this language, which is highly relevant for theories of language change.