Do grafema ao gesto : contributos linguísticos para um sistema de síntese de base articulatória

Motivados pelo propósito central de contribuir para a construção, a longo prazo, de um sistema completo de conversão de texto para fala, baseado em síntese articulatória, desenvolvemos um modelo linguístico para o português europeu (PE), com base no sistema TADA (TAsk Dynamic Application), que visou a obtenção automática da trajectória dos articuladores a partir do texto de entrada. A concretização deste objectivo ditou o desenvolvimento de um conjunto de tarefas, nomeadamente 1) a implementação e avaliação de dois sistemas de silabificação automática e de transcrição fonética, tendo em vista a transformação do texto de entrada num formato adequado ao TADA; 2) a criação de um dicionário gestual para os sons do PE, de modo a que cada fone obtido à saída do conversor grafema-fone pudesse ter correspondência com um conjunto de gestos articulatórios adaptados para o PE; 3) a análise do fenómeno da nasalidade à luz dos princípios dinâmicos da Fonologia Articulatória (FA), com base num estudo articulatório e perceptivo. Os dois algoritmos de silabificação automática implementados e testados fizeram apelo a conhecimentos de natureza fonológica sobre a estrutura da sílaba, sendo o primeiro baseado em transdutores de estados finitos e o segundo uma implementação fiel das propostas de Mateus & d'Andrade (2000). O desempenho destes algoritmos – sobretudo do segundo – mostrou-se similar ao de outros sistemas com as mesmas potencialidades. Quanto à conversão grafema-fone, seguimos uma metodologia baseada em regras de reescrita combinada com uma técnica de aprendizagem automática. Os resultados da avaliação deste sistema motivaram a exploração posterior de outros métodos automáticos, procurando também avaliar o impacto da integração de informação silábica nos sistemas. A descrição dinâmica dos sons do PE, ancorada nos princípios teóricos e metodológicos da FA, baseou-se essencialmente na análise de dados de ressonância magnética, a partir dos quais foram realizadas todas as medições, com vista à obtenção de parâmetros articulatórios quantitativos. Foi tentada uma primeira validação das várias configurações gestuais propostas, através de um pequeno teste perceptual, que permitiu identificar os principais problemas subjacentes à proposta gestual. Este trabalho propiciou, pela primeira vez para o PE, o desenvolvimento de um primeiro sistema de conversão de texto para fala, de base articulatória. A descrição dinâmica das vogais nasais contou, quer com os dados de ressonância magnética, para caracterização dos gestos orais, quer com os dados obtidos através de articulografia electromagnética (EMA), para estudo da dinâmica do velo e da sua relação com os restantes articuladores. Para além disso, foi efectuado um teste perceptivo, usando o TADA e o SAPWindows, para avaliar a sensibilidade dos ouvintes portugueses às variações na altura do velo e alterações na coordenação intergestual. Este estudo serviu de base a uma interpretação abstracta (em termos gestuais) das vogais nasais do PE e permitiu também esclarecer aspectos cruciais relacionados com a sua produção e percepção.

Codeswitching in Igbo-English Bilingualism

This study evaluates the Matrix Language Frame model of codeswitching with Igbo-English data and concludes that the data can indeed be considered a classic case of codeswitching, in that a Matrix Language can be clearly identified in bilingual clauses. It establishes this through both qualitative and quantitative analyses that make use of the typological contrasts between Igbo and English to uncover supportive evidence for the Matrix Language Frame model and its associated three principles: the Matrix Language Principle, the Asymmetry Principle, and the Uniform Structure Principle. The investigation goes one step further by using spectrograms and the analysis of vowel harmony between English free morphemes and Igbo bound affixes to demonstrate that two phonologies can co-exist in codeswitching and that codeswitching forms are essentially pronounced with a phonology that does not entirely resemble that of the Matrix Language variety. Furthermore, the study finds that the same language production mechanisms as detailed under the Matrix Language Frame model and its associated three principles underlie both single word and multi-word codeswitching. That is, the present study, like those before it adopting the Matrix Language framework (see Amuzu 2010: 277), underlines the importance of the assumptions underpinning the Matrix Language Principle: (1) that language production is modular; (2) that lexical structure is both complex and abstract; and (3) that languages in contact divide responsibilities in what they may contribute toward lexical structure during the production of mixed constituents. Moreover, the study finds that Igbo-English bilinguals can always sustain ready access to their mother tongue mental lexicon during online speech production and thus Igbo-English may duly be described as a ‘classic’ case of codeswitching.

Aprendendo naturalmente: a importância da oralidade na aquisição da língua inglesa

Mestrado em Ensino Precoce do Inglês

Explicit versus implicit spelling strategy instruction and its effects on grade one children's invented spellings

The intent of this study was to investigate .the effectiveness of teaching thirty-five Grade One children a variety of effective spelling strategies in comparison to tradit~onal spelling instruction. Strategy instruction included training in phonology, imagery and analogy. In addition, the type of instruction pro~ided (implicit versus explicit) was also examined. Children were seen in small groups of four or five, for four, twenty-five minute sessions. All children were tested prior and immediately following the training sessions, as well as at 14-day follow-ups. Pretest and posttest measures included a dictated spelling test (based on words used in training), a developmental spelling test and a sample of each child's writing. In addition, children completed a metacognitive spelling test as a measure of their strategy awareness. Performance scores on the pretest and posttest measures were compared to determine if any differences existed between the three spelling instruction groups using the Dunn-Bonferroni and Dunnett procedures. Findings revealed that explicit strategy instruction was the most effective spelling program for improving Grade One children's invented spellings. Children who received this instruction were able to spell targeted words more accurately, even after a 14-day follow-up, and were able to recall more effective spelling strategies than children who received either implicit strategy instruction or traditional strategy instruction.

Rôle des circuits cortico-striataux dans la planification et l'exécution de règles lexicales

Des recherches, autant chez l’homme que chez l’animal, proposent qu’il existerait, au sein des réseaux cérébraux, une organisation anatomique parallèle de circuits qui coordonne l’activité des structures qui participent à la planification et à l’exécution d’une action. Dans cette foulée, un modèle émerge qui attribue au cortex préfrontal (CPF) latéral une spécificité anatomo-fonctionnelle basée sur les niveaux de traitement en mémoire de travail (MT). Il s’agit du modèle « niveaux de traitement-dépendant », qui accorde un rôle important au CPF latéral dans l’acquisition et la représentation de règles guidant nos comportements. Des études en neuroimagerie fonctionnelle, utilisant le Wisconsin Card Sorting Task (WCST) ont permis de corroborer ce modèle et de dissocier trois niveaux de traitement en MT non seulement au sein du CPF latéral mais encore aux structures sous- corticales, les ganglions de la base (GB). Ces études suggèrent que certains noyaux des GB seraient topographiquement organisés avec le CPF latéral et contriburaient, sous certaines conditions, à des processus cognitifs et moteurs semblables à leur homologue cortical. Le but de notre étude est d'explorer la généralisation de la contribution des GB et du CPF au modèle niveaux de traitement-dépendant afin de voir si ce dernier est indépendant de la nature des stimuli en mémoire de travail. À cet effet, nous avons modifié le WCST en l’appliquant à un autre domaine, celui du langage. Nous avons remplacé les pictogrammes par des mots et modifié les règles formes, couleurs, nombres, par des règles sémantiques et phonologiques. L’analyse des résultats a démontré que différentes parties des GB de concert avec différentes régions du CPF se différencient quant aux niveaux de traitement en MT et ce, indépendamment de la nature des stimuli. Une deuxième analyse a permis d’évaluer les patrons d’activations liés aux conditions sémantiques et phonologiques. Ces résultats ont mis en évidence que les réseaux préfrontaux semblent liés aux processus exécutifs nécessaires à la réalisation de la tâche, indépendamment de la condition tandis que les aires associatives se dissocient davantage et contiennent des réseaux propres à la sémantique et à la phonologie.

Musique et langage : spécificités, interactions et associations spatiales

Thèse numérisée par la Division de la gestion de documents et des archives de l'Université de Montréal

Changes in cortical and sub-cortical patterns of activity associated with aging during the performance of a lexical set-shifting task

Bien que le passage du temps altère le cerveau, la cognition ne suit pas nécessairement le même destin. En effet, il existe des mécanismes compensatoires qui permettent de préserver la cognition (réserve cognitive) malgré le vieillissement. Les personnes âgées peuvent utiliser de nouveaux circuits neuronaux (compensation neuronale) ou des circuits existants moins susceptibles aux effets du vieillissement (réserve neuronale) pour maintenir un haut niveau de performance cognitive. Toutefois, la façon dont ces mécanismes affectent l’activité corticale et striatale lors de tâches impliquant des changements de règles (set-shifting) et durant le traitement sémantique et phonologique n’a pas été extensivement explorée. Le but de cette thèse est d’explorer comment le vieillissement affecte les patrons d’activité cérébrale dans les processus exécutifs d’une part et dans l’utilisation de règles lexicales d’autre part. Pour cela nous avons utilisé l’imagerie par résonance magnétique fonctionnelle (IRMf) lors de la performance d’une tâche lexicale analogue à celle du Wisconsin. Cette tâche a été fortement liée à de l’activité fronto-stritale lors des changements de règles, ainsi qu’à la mobilisation de régions associées au traitement sémantique et phonologique lors de décisions sémantiques et phonologiques, respectivement. Par conséquent, nous avons comparé l’activité cérébrale de jeunes individus (18 à 35 ans) à celle d’individus âgés (55 à 75 ans) lors de l’exécution de cette tâche. Les deux groupes ont montré l’implication de boucles fronto-striatales associées à la planification et à l’exécution de changements de règle. Toutefois, alors que les jeunes semblaient activer une « boucle cognitive » (cortex préfrontal ventrolatéral, noyau caudé et thalamus) lorsqu’ils se voyaient indiquer qu’un changement de règle était requis, et une « boucle motrice » (cortex postérieur préfrontal et putamen) lorsqu’ils devaient effectuer le changement, les participants âgés montraient une activation des deux boucles lors de l’exécution des changements de règle seulement. Les jeunes adultes tendaient à présenter une augmentation de l’activité du cortex préfrontal ventrolatéral, du gyrus fusiforme, du lobe ventral temporale et du noyau caudé lors des décisions sémantiques, ainsi que de l’activité au niveau de l’aire de Broca postérieur, de la junction temporopariétale et du cortex moteur lors de décisions phonologiques. Les participants âgés ont montré de l’activité au niveau du cortex préfrontal latéral et moteur durant les deux types de décisions lexicales. De plus, lorsque les décisions sémantiques et phonologiques ont été comparées entre elles, les jeunes ont montré des différences significatives au niveau de plusieurs régions cérébrales, mais pas les âgés. En conclusion, notre première étude a montré, lors du set-shifting, un délai de l’activité cérébrale chez les personnes âgées. Cela nous a permis de conceptualiser l’Hypothèse Temporelle de Compensation (troisième manuscrit) qui consiste en l’existence d’un mécanisme compensatoire caractérisé par un délai d’activité cérébrale lié au vieillissement permettant de préserver la cognition au détriment de la vitesse d’exécution. En ce qui concerne les processus langagiers (deuxième étude), les circuits sémantiques et phonologiques semblent se fusionner dans un seul circuit chez les individus âgés, cela représente vraisemblablement des mécanismes de réserve et de compensation neuronales qui permettent de préserver les habilités langagières.

Complexity of Human Language Comprehension

The goal of this article is to reveal the computational structure of modern principle-and-parameter (Chomskian) linguistic theories: what computational problems do these informal theories pose, and what is the underlying structure of those computations? To do this, I analyze the computational complexity of human language comprehension: what linguistic representation is assigned to a given sound? This problem is factored into smaller, interrelated (but independently statable) problems. For example, in order to understand a given sound, the listener must assign a phonetic form to the sound; determine the morphemes that compose the words in the sound; and calculate the linguistic antecedent of every pronoun in the utterance. I prove that these and other subproblems are all NP-hard, and that language comprehension is itself PSPACE-hard.

Habilidades cognitivas e competências de leitura em crianças do 1º ano

A criança quando inicia a educação pré-escolar, já sabe muitas coisas sobre o mundo que a rodeia através do seu meio familiar e sociocultural. O conjunto de estimulações fornecidas, desde muito cedo, faz com que a criança desenvolva o potencial cognitivo e afetivo. O desenvolvimento e as aprendizagens adquiridas dependem das estimulações realizadas pelo meio envolvente e da qualidade das interações logo desde o nascimento. Este processo antes da entrada na escola é movido pelo desejo de saber da criança e a sua exploração do meio, passando com o início da escolaridade a ser movido por necessidades externas à criança. O aluno é confrontado com um currículo formal com objetivos prévios de aprendizagem que, por vezes, podem estar além dos seus desejos de descoberta ou da sua história de vida. A aprendizagem da leitura é uma construção que tem início antes da entrada no 1º ciclo através do desenvolvimento da linguagem oral e do contacto com a cultura escrita, que permite novas modalidades de comunicação, nova capacidade de simbolizar e de dominar o meio envolvente. O sucesso escolar vai depender quer das aprendizagens prévias quer da capacidade de adaptação e integração no meio escolar. Foi nosso propósito verificar se existem habilidades cognitivas antecedentes que predizem o sucesso da leitura. O interesse por este estudo prende-se com a necessidade que professores e restantes profissionais da educação têm em compreender e analisar com cuidado a situação de entrada na aprendizagem da leitura de cada uma das crianças. Escolhemos, baseado na literatura científica, duas habilidades que testamos previamente em alunos do 1.º ano: a consciência fonológica e o vocabulário. Entre Março e Junho foi aplicado um teste de leitura/descodificação. O estudo é de tipo correlacional que se situa entre o estudo descritivo e uma abordagem experimental. Constatamos que na análise dos resultados obtidos nesta pesquisa, não observamos correlação entre os níveis da consciência fonológica e a leitura e o vocabulário e a leitura, não permitindo afirmar que existe uma relação preditora de uma dessas habilidades com a competência leitora.

Como os nossos filhos aprendem a falar? : percurso de aquisição da Língua Portuguesa falada no Brasil

Esta investigação teve como objetivo descrever o percurso de aquisição da Língua Portuguesa falada no Brasil. Como base teórica, adotamos um referencial múltiplo, com abordagem das teorias behaviorista, inatista, cognitivista piagetiana, sócio-interacionista e emergentista, no intuito de buscar em cada uma delas as contribuições que nos auxiliassem no estudo da aquisição da linguagem. Trata-se de um estudo longitudinal em que registramos quinzenalmente em áudio o desenvolvimento linguístico de duas crianças brasileiras, desde a idade de 1;00 até 5;00. Os dados obtidos receberam transcrição fonética e/ou ortográfica e foram analisados nos aspectos fonológico, morfológico e sintático. Na área da fonologia, apresentamos o percurso de aquisição dos fonemas, os fonemas de difícil pronunciação e as estratégias de reparo usadas pelas crianças. Na morfologia, descrevemos o processo de aprendizagem dos morfemas flexivos nominais e verbais. Na sintaxe, apresentamos o caminho percorrido pelas crianças na construção das orações simples e dos diversos tipos de orações compostas. De modo geral, observamos um processo de aprendizagem lenta e gradual, em que provavelmente interatuam fatores de ordem biológica, cognitiva, social e linguística, marcado por elevações e regressões indicativas de uma auto-regulação do sistema-que-aprende.

An experimental comparison between rival theories of rapid automatized naming performance and its relationship to reading

Two studies investigated the degree to which the relationship between rapid automatized naming (RAN) performance and reading development is driven by shared phonological processes. Study 1 assessed RAN, phonological awareness, and reading performance in 1010 7- to -10 year-olds. Results showed that RAN deficits occurred in the absence of phonological awareness deficits. These were accompanied by modest reading delays. In structural equation modeling, solutions where RAN was subsumed within a phonological processing factor did not provide a good fit to the data, suggesting that processes outside phonology may drive RAN performance and its association with reading. Study 2 investigated Kail’s proposal that speed of processing underlies this relationship. Children with single RAN deficits showed slower speed of processing than did closely matched controls performing normally on RAN. However, regression analysis revealed that RAN made a unique contribution to reading even after accounting for processing speed. Theoretical implications are discussed.

Reverberant auditory environments: the effects of multiple echoes on distraction by 'irrelevant' speech

Two experiments examine the effect on an immediate recall test of simulating a reverberant auditory environment in which auditory distracters in the form of speech are played to the participants (the 'irrelevant sound effect'). An echo-intensive environment simulated by the addition of reverberation to the speech reduced the extent of 'changes in state' in the irrelevant speech stream by smoothing the profile of the waveform. In both experiments, the reverberant auditory environment produced significantly smaller irrelevant sound distraction effects than an echo-free environment. Results are interpreted in terms of changing-state hypothesis, which states that acoustic content of irrelevant sound, rather than phonology or semantics, determines the extent of the irrelevant sound effect (ISE). Copyright (C) 2007 John Wiley & Sons, Ltd.

On the nature and cause of Specific Language Impairment: a view from sentence processing and infant research

This paper addresses the nature and cause of Specific Language Impairment (SLI) by reviewing recent research in sentence processing of children with SLI compared to typically developing (TD) children and research in infant speech perception. These studies have revealed that children with SLI are sensitive to syntactic, semantic, and real-world information, but do not show sensitivity to grammatical morphemes with low phonetic saliency, and they show longer reaction times than age-matched controls. TD children from the age of 4 show trace reactivation, but some children with SLI fail to show this effect, which resembles the pattern of adults and TD children with low working memory. Finally, findings from the German Language Development (GLAD) Project have revealed that a group of children at risk for SLI had a history of an auditory delay and impaired processing of prosodic information in the first months of their life, which is not detectable later in life. Although this is a single project that needs to be replicated with a larger group of children, it provides preliminary support for accounts of SLI which make an explicit link between an early deficit in the processing of phonology and later language deficits, and the Computational Complexity Hypothesis that argues that the language deficit in children with SLI lies in difficulties integrating different types of information at the interfaces.

A cognitive and psycholinguistic investigation of neologisms

Background: Jargon aphasia with neologisms (i.e., novel nonword utterances) is a challenging language disorder that lacks a definitive theoretical description as well as clear treatment recommendations (Marshall, 2006). Aim: The aims of this two part investigation were to determine the source of neologisms in an individual with jargon aphasia (FF), to identify potential facilitatory semantic and/or phonological cuing effects in picture naming, and to determine whether the timing of the cues relative to the target picture mediated the cuing advantage. Methods and Procedures: FF’s underlying linguistic deficits were determined using several cognitive and linguistic tests. A series of computerized naming experiments using a modified version of the 175 item-Philadelphia Naming Test (Roach, Schwartz, Martin, Grewal, & Brecher, 1996) manipulated the cue type (semantic versus phonological) and relatedness (related versus unrelated). In a follow-up experiment, the relative timing of phonological cues was manipulated to test the effect of timing on the cuing advantage. The accuracy of naming responses and error patterns were analyzed. Outcome and Results: FF’s performance on the linguistic and cognitive test battery revealed a severe naming impairment with relatively spared word and nonword repetition, auditory comprehension of words and monitoring, and fairly well preserved semantic abilities. This performance profile was used to evaluate various explanations for neologisms including a loss of phonological codes, monitoring failure, and impairments in semantic system. The primary locus of his deficit appears to involve the connection between semantics to phonology, specifically, when word production involves accessing the phonological forms following semantic access. FF showed a significant cuing advantage only for phonological cues in picture naming, particularly when the cue preceded or coincided with the onset of the target picture. Conclusions: When integrated with previous findings, the results from this study suggest that the core deficit of this and at least some other jargon aphasics is in the connection from semantics to phonology. The facilitative advantage of phonological cues could potentially be exploited in future clinical and research studies to test the effectiveness of these cues for enhancing naming performance in individuals like FF.