Visual Speech Segmentation: Using Facial Cues to Locate Word Boundaries in Continuous Speech

Speech is typically a multimodal phenomenon, yet few studies have focused on the exclusive contributions of visual cues to language acquisition. To address this gap, we investigated whether visual prosodic information can facilitate speech segmentation. Previous research has demonstrated that language learners can use lexical stress and pitch cues to segment speech and that learners can extract this information from talking faces. Thus, we created an artificial speech stream that contained minimal segmentation cues and paired it with two synchronous facial displays in which visual prosody was either informative or uninformative for identifying word boundaries. Across three familiarisation conditions (audio stream alone, facial streams alone, and paired audiovisual), learning occurred only when the facial displays were informative to word boundaries, suggesting that facial cues can help learners solve the early challenges of language acquisition.

Thai word segmentation with hidden Markov Model and decision tree

The Thai written language is one of the languages that does not have word boundaries. In order to discover the meaning of the document, all texts must be separated into syllables, words, sentences, and paragraphs. This paper develops a novel method to segment the Thai text by combining a non-dictionary based technique with a dictionary-based technique. This method first applies the Thai language grammar rules to the text for identifying syllables. The hidden Markov model is then used for merging possible syllables into words. The identified words are verified with a lexical dictionary and a decision tree is employed to discover the words unidentified by the lexical dictionary. Documents used in the litigation process of Thai court proceedings have been used in experiments. The results which are segmented words, obtained by the proposed method outperform the results obtained by other existing methods.

汉语句子和语篇韵律层级边界的认知加工及其ERP效应

The aim of the present study was to explore whether the CPS (Closure Positive Shift) which reflected prosodic processing will be elicited when listeners perceived different hierarchical prosodic boundaries in Chinese sentence and discourse (Quatrain). In addiction, the similarity and difference in amplitude, onset latency and scalp distribution between these CPS were investigated. The nature of the CPS and its relationship to acoustic parameters was also explored systematically. The main results and conclusions of the present study were: (1) Phonological phrase boundaries and intonational phrase boundaries in Chinese sentences both elicited the CPS; however, phonological word boundaries can't evoke it. The CPS induced by phonological phrase boundaries was earlier than the one related to intonational phrase boundaries in onset latency, and the amplitude was also somewhat lower. When the pauses in the vicinity of these two boundaries were removed, the onset latency difference disappeared while amplitude in the new conditions was also lower. This indicates that whenever listeners segment sentence into phrases, the CPS will be elicited. Besides, pause was not the decisive factor to elicit the CPS, but can modify its onset latency and amplitude effectively. (2) The different hierarchical prosodic boundaries in seven character quatrain including phonological phrase boundaries, intonational phrase boundaries and sentence pair boundaries elicited the CPS respectively. Furthermore, just like in the sentence level, onset latency of the CPS induced by the prosodic boundaries in the discourse was also influenced by the length of pause: the shorter the pause was, the earlier the onset latency. For the comparison between the CPS evoked by the same and different hierarchical prosodic boundaries, its amplitude was influenced by the extent to which prosodic representations were activated. Thus, the condition of the CPS elicitation was extended to the prosodic bounaries in discourse, and further indicated that it was influenced by acoustic parameters. (3) No matter what task the participants completed, just like word detection or rythem matching task, the CPS will be evoked. However, its amplitude was larger in the anterior region, when listeners completed the word detection task which needed more attention and higher load of working memory. The present result indicated that the elicitation of the CPS was not influenced by the task the participants completed, but different task influence its scalp distribution. (4) The final syllable of the sentence and quatrain can't elicit the CPS, but a P300-like positive component. Although the scalp distribution was similar to the CPS, it was much higher in amplitude. The present result suggested that only the prosodic boundaries reflecting not only the closure of the former prosodic unit but also integrating the later one will elicit the CPS.

Assessing segmentation processes by click detection: online measure of statistical learning, or simple interference?

Statistical learning can be used to extract the words from continuous speech. Gómez, Bion, and Mehler (Language and Cognitive Processes, 26, 212–223, 2011) proposed an online measure of statistical learning: They superimposed auditory clicks on a continuous artificial speech stream made up of a random succession of trisyllabic nonwords. Participants were instructed to detect these clicks, which could be located either within or between words. The results showed that, over the length of exposure, reaction times (RTs) increased more for within-word than for between-word clicks. This result has been accounted for by means of statistical learning of the between-word boundaries. However, even though statistical learning occurs without an intention to learn, it nevertheless requires attentional resources. Therefore, this process could be affected by a concurrent task such as click detection. In the present study, we evaluated the extent to which the click detection task indeed reflects successful statistical learning. Our results suggest that the emergence of RT differences between within- and between-word click detection is neither systematic nor related to the successful segmentation of the artificial language. Therefore, instead of being an online measure of learning, the click detection task seems to interfere with the extraction of statistical regularities.

Across the bridge: CLEF 2001 - Non-English monolingual retrieval. The French task.

This paper presents work on document retrieval based on first time participation in the CLEF 2001 monolingual retrieval task using French. The experiment findings indicated that Okapi, the text retrieval system in use, can successfully be used for non-English text retrieval. A lot of internal pre-processing is required in the basic search system for conversion into Okapi access formats. Various shell scripts were written to achieve the conversion in a UNIX environment, failure of which would significantly have impeded the overall performance. Based on the experiment findings using Okapi - originally designed for English - it was clear that, although most European languages share conventional word boundaries and variant word morphemes formed by the additon of suffixes, there is significant difference between French and English retrieval depending on the adaptation of indexing and search strategies in use. No sophisticated method for higher recall and precision such as stemming techniques, phrase translation or de-compounding was employed for the experiment and our results were suggestively poor. Future participation would include more refined query translation tools.

Segmentações não-convencionais de palavra nos quatro últimos anos do ensino fundamental: um estudo longitudinal

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Hipersegmentação de palavras: análise de aspectos prosódicos e discursivos

This paper deals with hypersegmentation of words that are characterized by the unconventional employment of a graphical boundary (using a white space or hyphen) within the limits of the word, as in "em bora" (“although”, using a white space), and "chama-da" (“called”, using the hyphen). In a study conducted on these data, we identified motivations arising not only from their literate nature but also from the morphosyntactic and prosodic information. We showed that there are linguistic features recurrent in these registers of word boundaries, based on the analysis of texts produced by the students who attended the last four years of elementary school in a public school in São Paulo. In this paper, we advance on this study by selecting data whose characteristics do not match those which were recurrent. We will argue that the unconventional presence of boundary within the written word limits may be interpreted as representing prosodic configurations (of intonation and rhythm nature) which contribute to the construction of the relation of meanings in the text.

Seeing Spaces: An Eye-Tracking Study Of Speech Segmentation

Speech is often a multimodal process, presented audiovisually through a talking face. One area of speech perception influenced by visual speech is speech segmentation, or the process of breaking a stream of speech into individual words. Mitchel and Weiss (2013) demonstrated that a talking face contains specific cues to word boundaries and that subjects can correctly segment a speech stream when given a silent video of a speaker. The current study expanded upon these results, using an eye tracker to identify highly attended facial features of the audiovisual display used in Mitchel and Weiss (2013). In Experiment 1, subjects were found to spend the most time watching the eyes and mouth, with a trend suggesting that the mouth was viewed more than the eyes. Although subjects displayed significant learning of word boundaries, performance was not correlated with gaze duration on any individual feature, nor was performance correlated with a behavioral measure of autistic-like traits. However, trends suggested that as autistic-like traits increased, gaze duration of the mouth increased and gaze duration of the eyes decreased, similar to significant trends seen in autistic populations (Boratston & Blakemore, 2007). In Experiment 2, the same video was modified so that a black bar covered the eyes or mouth. Both videos elicited learning of word boundaries that was equivalent to that seen in the first experiment. Again, no correlations were found between segmentation performance and SRS scores in either condition. These results, taken with those in Experiment, suggest that neither the eyes nor mouth are critical to speech segmentation and that perhaps more global head movements indicate word boundaries (see Graf, Cosatto, Strom, & Huang, 2002). Future work will elucidate the contribution of individual features relative to global head movements, as well as extend these results to additional types of speech tasks.

Word sense disambiguation via high order of learning in complex networks

Complex networks have been employed to model many real systems and as a modeling tool in a myriad of applications. In this paper, we use the framework of complex networks to the problem of supervised classification in the word disambiguation task, which consists in deriving a function from the supervised (or labeled) training data of ambiguous words. Traditional supervised data classification takes into account only topological or physical features of the input data. On the other hand, the human (animal) brain performs both low- and high-level orders of learning and it has facility to identify patterns according to the semantic meaning of the input data. In this paper, we apply a hybrid technique which encompasses both types of learning in the field of word sense disambiguation and show that the high-level order of learning can really improve the accuracy rate of the model. This evidence serves to demonstrate that the internal structures formed by the words do present patterns that, generally, cannot be correctly unveiled by only traditional techniques. Finally, we exhibit the behavior of the model for different weights of the low- and high-level classifiers by plotting decision boundaries. This study helps one to better understand the effectiveness of the model. Copyright (C) EPLA, 2012

Look before you leap : the epistemic violence that sometimes hides behind the word "inclusion"

This paper demonstrates how Indigenous Studies is controlled in some Australian universities in ways that continue the marginalisation, denigration and exploitation of Indigenous peoples. Moreover, it shows how the engagement of white notions of “inclusion” can result in the maintenance of racism, systemic marginalisation, white race privilege and radicalised subjectivity. A case study will be utilised which draws from the experience of two Indigenous scholars who were invited to be part of a panel to review one Australian university’s plan and courses in Indigenous studies. The case study offers the opportunity to destabilise the relationships between oppression and privilege and the epistemology that maintains them. The paper argues for the need to examine exactly what is being offered when universities provide opportunities for “inclusion”.

Crossing boundaries: Implications of advances in basic sciences for the management of addiction.

This set of papers in this issue of "Addictive Behaviors" was presented at the 2004 'Addictions' conference, which, for the first time, was held in the Southern Hemisphere, on the Sunshine Coast of Queensland, Australia. The theme of the conference, Crossing Boundaries: Implications of Advances in Basic Sciences for the Management of Addiction, speaks for itself. The papers derive from a wide range of empirical paradigms and cover issues with relevance to the development of addiction, to the maintenance of problematic use, and to assessment, treatment, and relapse. Research from Europe and the United States is represented, as well as work from Australia. An international perspective is strongly emphasized from the initial paper by Obot, Poznyak, and Moneiro, (see record 2004-19599-015) which describes the WHO Report on the Neuroscience of Psychoactive Substance Use and Dependence, and summarises some of the report's implications for policy and practice. Hall, Carter, and Morley (see record 2004-19599-014) close the issue with a paper on the wide-ranging ethical implications of advances in neuroscience research, including issues arising from the identification of high risk for addiction, the potential for coercive pharmacotherapy, use of medications to enhance function, and risks to privacy.