Making the impact on research and society : a case study: crowdsourcing solutions developed for the linguistic research and citizen science

Can crowdsourcing solutions serve many masters? Can they be beneficial for both, for the layman or native speakers of minority languages on the one hand and serious linguistic research on the other? How did an infrastructure that was designed to support linguistics turn out to be a solution for raising awareness of native languages? Since 2012 the National Library of Finland has been developing the Digitisation Project for Kindred Languages, in which the key objective is to support a culture of openness and interaction in linguistic research, but also to promote crowdsourcing as a tool for participation of the language community in research. In the course of the project, over 1,200 monographs and nearly 111,000 pages of newspapers in Finno-Ugric languages will be digitised and made available in the Fenno-Ugrica digital collection. This material was published in the Soviet Union in the 1920s and 1930s, and users have had only sporadic access to the material. The publication of open-access and searchable materials from this period is a goldmine for researchers. Historians, social scientists and laymen with an interest in specific local publications can now find text materials pertinent to their studies. The linguistically-oriented population can also find writings to delight them: (1) lexical items specific to a given publication, and (2) orthographically-documented specifics of phonetics. In addition to the open access collection, we developed an open source code OCR editor that enables the editing of machine-encoded text for the benefit of linguistic research. This tool was necessary since these rare and peripheral prints often include already archaic characters, which are neglected by modern OCR software developers but belong to the historical context of kindred languages, and are thus an essential part of the linguistic heritage. When modelling the OCR editor, it was essential to consider both the needs of researchers and the capabilities of lay citizens, and to have them participate in the planning and execution of the project from the very beginning. By implementing the feedback iteratively from both groups, it was possible to transform the requested changes as tools for research that not only supported the work of linguistics but also encouraged the citizen scientists to face the challenge and work with the crowdsourcing tools for the benefit of research. This presentation will not only deal with the technical aspects, developments and achievements of the infrastructure but will highlight the way in which user groups, researchers and lay citizens were engaged in a process as an active and communicative group of users and how their contributions were made to mutual benefit.

Nichesourcing The Uralic Languages For The Benefit Of Linguistic Research And Lingual Societies

The emerging technologies have recently challenged the libraries to reconsider their role as a mere mediator between the collections, researchers, and wider audiences (Sula, 2013), and libraries, especially the nationwide institutions like national libraries, haven’t always managed to face the challenge (Nygren et al., 2014). In the Digitization Project of Kindred Languages, the National Library of Finland has become a node that connects the partners to interplay and work for shared goals and objectives. In this paper, I will be drawing a picture of the crowdsourcing methods that have been established during the project to support both linguistic research and lingual diversity. The National Library of Finland has been executing the Digitization Project of Kindred Languages since 2012. The project seeks to digitize and publish approximately 1,200 monograph titles and more than 100 newspapers titles in various, and in some cases endangered Uralic languages. Once the digitization has been completed in 2015, the Fenno-Ugrica online collection will consist of 110,000 monograph pages and around 90,000 newspaper pages to which all users will have open access regardless of their place of residence. The majority of the digitized literature was originally published in the 1920s and 1930s in the Soviet Union, and it was the genesis and consolidation period of literary languages. This was the era when many Uralic languages were converted into media of popular education, enlightenment, and dissemination of information pertinent to the developing political agenda of the Soviet state. The ‘deluge’ of popular literature in the 1920s to 1930s suddenly challenged the lexical orthographic norms of the limited ecclesiastical publications from the 1880s onward. Newspapers were now written in orthographies and in word forms that the locals would understand. Textbooks were written to address the separate needs of both adults and children. New concepts were introduced in the language. This was the beginning of a renaissance and period of enlightenment (Rueter, 2013). The linguistically oriented population can also find writings to their delight, especially lexical items specific to a given publication, and orthographically documented specifics of phonetics. The project is financially supported by the Kone Foundation in Helsinki and is part of the Foundation’s Language Programme. One of the key objectives of the Kone Foundation Language Programme is to support a culture of openness and interaction in linguistic research, but also to promote citizen science as a tool for the participation of the language community in research. In addition to sharing this aspiration, our objective within the Language Programme is to make sure that old and new corpora in Uralic languages are made available for the open and interactive use of the academic community as well as the language societies. Wordlists are available in 17 languages, but without tokenization, lemmatization, and so on. This approach was verified with the scholars, and we consider the wordlists as raw data for linguists. Our data is used for creating the morphological analyzers and online dictionaries at the Helsinki and Tromsø Universities, for instance. In order to reach the targets, we will produce not only the digitized materials but also their development tools for supporting linguistic research and citizen science. The Digitization Project of Kindred Languages is thus linked with the research of language technology. The mission is to improve the usage and usability of digitized content. During the project, we have advanced methods that will refine the raw data for further use, especially in the linguistic research. How does the library meet the objectives, which appears to be beyond its traditional playground? The written materials from this period are a gold mine, so how could we retrieve these hidden treasures of languages out of the stack that contains more than 200,000 pages of literature in various Uralic languages? The problem is that the machined-encoded text (OCR) contains often too many mistakes to be used as such in research. The mistakes in OCRed texts must be corrected. For enhancing the OCRed texts, the National Library of Finland developed an open-source code OCR editor that enabled the editing of machine-encoded text for the benefit of linguistic research. This tool was necessary to implement, since these rare and peripheral prints did often include already perished characters, which are sadly neglected by the modern OCR software developers, but belong to the historical context of kindred languages and thus are an essential part of the linguistic heritage (van Hemel, 2014). Our crowdsourcing tool application is essentially an editor of Alto XML format. It consists of a back-end for managing users, permissions, and files, communicating through a REST API with a front-end interface—that is, the actual editor for correcting the OCRed text. The enhanced XML files can be retrieved from the Fenno-Ugrica collection for further purposes. Could the crowd do this work to support the academic research? The challenge in crowdsourcing lies in its nature. The targets in the traditional crowdsourcing have often been split into several microtasks that do not require any special skills from the anonymous people, a faceless crowd. This way of crowdsourcing may produce quantitative results, but from the research’s point of view, there is a danger that the needs of linguists are not necessarily met. Also, the remarkable downside is the lack of shared goal or the social affinity. There is no reward in the traditional methods of crowdsourcing (de Boer et al., 2012). Also, there has been criticism that digital humanities makes the humanities too data-driven and oriented towards quantitative methods, losing the values of critical qualitative methods (Fish, 2012). And on top of that, the downsides of the traditional crowdsourcing become more imminent when you leave the Anglophone world. Our potential crowd is geographically scattered in Russia. This crowd is linguistically heterogeneous, speaking 17 different languages. In many cases languages are close to extinction or longing for language revitalization, and the native speakers do not always have Internet access, so an open call for crowdsourcing would not have produced appeasing results for linguists. Thus, one has to identify carefully the potential niches to complete the needed tasks. When using the help of a crowd in a project that is aiming to support both linguistic research and survival of endangered languages, the approach has to be a different one. In nichesourcing, the tasks are distributed amongst a small crowd of citizen scientists (communities). Although communities provide smaller pools to draw resources, their specific richness in skill is suited for complex tasks with high-quality product expectations found in nichesourcing. Communities have a purpose and identity, and their regular interaction engenders social trust and reputation. These communities can correspond to research more precisely (de Boer et al., 2012). Instead of repetitive and rather trivial tasks, we are trying to utilize the knowledge and skills of citizen scientists to provide qualitative results. In nichesourcing, we hand in such assignments that would precisely fill the gaps in linguistic research. A typical task would be editing and collecting the words in such fields of vocabularies where the researchers do require more information. For instance, there is lack of Hill Mari words and terminology in anatomy. We have digitized the books in medicine, and we could try to track the words related to human organs by assigning the citizen scientists to edit and collect words with the OCR editor. From the nichesourcing’s perspective, it is essential that altruism play a central role when the language communities are involved. In nichesourcing, our goal is to reach a certain level of interplay, where the language communities would benefit from the results. For instance, the corrected words in Ingrian will be added to an online dictionary, which is made freely available for the public, so the society can benefit, too. This objective of interplay can be understood as an aspiration to support the endangered languages and the maintenance of lingual diversity, but also as a servant of ‘two masters’: research and society.

La pronunciación de ELE en los alumnos quebequenses : dificultades concretas y pautas de corrección

Mon sujet de recherche traite sur la prononciation de l'espagnol comme langue étrangère chez les élèves québécois, sur leurs difficultés concrètes et lignes de correction qui peuvent leur être attribuées. Dans une première partie plus générale, nous traiterons sur l'enseignement de la prononciation, de la place qu'elle occupe dans l'enseignement d'une langue étrangère. Nous croyons que la prononciation est un aspect de la langue qui a été mis de côté pour mettre en valeur la communication. Si une "mauvaise" prononciation n'entrave pas à la compréhension ou à la communication, elle n'est pas corrigée ni travaillée. Nous pouvons donc nous retrouver avec des étudiants ayant un haut niveau d'espagnol mais dont la prononciation connaît certaines lacunes. Nous déterminerons également ce que nous entendons par "meilleure" ou "mauvaise" prononciation, nous nous interrogerons également sur la pertinence de l'enseignement de la phonétique. Nous nous poserons aussi la question sur la place de la prononciation selon la méthodologie didactique utilisée, et analyserons la quantité et qualité des exercices de prononciation présents ou pas dans les manuels scolaires, et s'ils correspondent aux exigences des documents officiels tels le Cadre commun européenne de référence, ou le Plan curricular de l'institut Cervantès. Dans une deuxième partie nous nous questionnons sur les facteurs qui conditionnent l'apprentissage d'une langue et le perfectionnement de la prononciation dans une langue étrangère, car nous croyons que peut importe l'âge de l'étudiant, il y a toujours place à l'amélioration dans la prononciation. Nous nous interrogeons ensuite sur les tendances générales des francophones lors de leur prononciation de l'espagnol, nous ferons une étude contrastive des phonèmes espagnols et français, puis nous étudierons plus en détail les tendances des élèves québécois, car nous croyons que ces derniers sont dotés de certains atouts en comparaison à d'autres francophones. Dans une troisième partie, nous proposons des exercices visant à améliorer la prononciation chez nos élèves, et afin de vérifier l'efficacité de ces exercices, nous enregistrerons des étudiants ayant bénéficié de ces exercices, et d'autres qui n'y auront pas eu droit. Cette étude comparative cherche à prouver que ces exercices aident réellement et qu'ils, ou d'autres exercices de ce genre, devraient être inclus dans l'enseignement. Le questionnaire dont il s'agit s'attarde principalement au phénomène du [r], que nous croyons être un, ou le son le plus difficile à prononcer en espagnol (autant la vibrante simple comme multiple). Bien entendu, une partie de ce chapitre sera consacrée à l'analyse de résultats.

La composition au moyen des quarts de ton

La version intégrale de cette thèse est disponible uniquement pour consultation individuelle à la Bibliothèque de musique de l’Université de Montréal.

Les variables du mensonge dans la parole : une analyse discriminante

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal

Le chunking perceptif de la parole : sur la nature du groupement temporel et son effet sur la mémoire immédiate

Dans de nombreux comportements qui reposent sur le rappel et la production de séquences, des groupements temporels émergent spontanément, créés par des délais ou des allongements. Ce « chunking » a été observé tant chez les humains que chez certains animaux et plusieurs auteurs l’attribuent à un processus général de chunking perceptif qui est conforme à la capacité de la mémoire à court terme. Cependant, aucune étude n’a établi comment ce chunking perceptif s’applique à la parole. Nous présentons une recension de la littérature qui fait ressortir certains problèmes critiques qui ont nui à la recherche sur cette question. C’est en revoyant ces problèmes qu’on propose une démonstration spécifique du chunking perceptif de la parole et de l’effet de ce processus sur la mémoire immédiate (ou mémoire de travail). Ces deux thèmes de notre thèse sont présentés séparément dans deux articles. Article 1 : The perceptual chunking of speech: a demonstration using ERPs Afin d’observer le chunking de la parole en temps réel, nous avons utilisé un paradigme de potentiels évoqués (PÉ) propice à susciter la Closure Positive Shift (CPS), une composante associée, entre autres, au traitement de marques de groupes prosodiques. Nos stimuli consistaient en des énoncés et des séries de syllabes sans sens comprenant des groupes intonatifs et des marques de groupements temporels qui pouvaient concorder, ou non, avec les marques de groupes intonatifs. Les analyses démontrent que la CPS est suscitée spécifiquement par les allongements marquant la fin des groupes temporels, indépendamment des autres variables. Notons que ces marques d’allongement, qui apparaissent universellement dans la langue parlée, créent le même type de chunking que celui qui émerge lors de l’apprentissage de séquences par des humains et des animaux. Nos résultats appuient donc l’idée que l’auditeur chunk la parole en groupes temporels et que ce chunking perceptif opère de façon similaire avec des comportements verbaux et non verbaux. Par ailleurs, les observations de l’Article 1 remettent en question des études où on associe la CPS au traitement de syntagmes intonatifs sans considérer les effets de marques temporels. Article 2 : Perceptual chunking and its effect on memory in speech processing:ERP and behavioral evidence Nous avons aussi observé comment le chunking perceptif d’énoncés en groupes temporels de différentes tailles influence la mémoire immédiate d’éléments entendus. Afin d’observer ces effets, nous avons utilisé des mesures comportementales et des PÉ, dont la composante N400 qui permettait d’évaluer la qualité de la trace mnésique d’éléments cibles étendus dans des groupes temporels. La modulation de l’amplitude relative de la N400 montre que les cibles présentées dans des groupes de 3 syllabes ont bénéficié d’une meilleure mise en mémoire immédiate que celles présentées dans des groupes plus longs. D’autres mesures comportementales et une analyse de la composante P300 ont aussi permis d’isoler l’effet de la position du groupe temporel (dans l’énoncé) sur les processus de mise en mémoire. Les études ci-dessus sont les premières à démontrer le chunking perceptif de la parole en temps réel et ses effets sur la mémoire immédiate d’éléments entendus. Dans l’ensemble, nos résultats suggèrent qu’un processus général de chunking perceptif favorise la mise en mémoire d’information séquentielle et une interprétation de la parole « chunk par chunk ».

Les bénéfices du chant dans la réadaptation de l’aphasie

Les personnes ayant une aphasie, un trouble acquis du langage causé par une lésion cérébrale, parviennent temporairement à mieux prononcer des mots quand elles les chantent dans des chansons familières ou en chant choral. Dans cette thèse nous examinons comment le chant peut entrainer des bénéfices durables sur le langage et la communication de ces personnes. Deux contextes sont envisagés : (1) une thérapie chantée de l’aphasie, la Melodic intonation therapy en anglais (MIT), et (2) une activité de loisir, une chorale de personnes aphasiques. La première étude de cette thèse (Chapitre 2) est une recension critique de la variété de recherches dont la MIT a fait l’objet. Nous soutenons que plusieurs protocoles de traitement présentés sous le label MIT ne correspondent pas à la MIT originale et que les effets immédiats du chant, qui sont examinés dans des études transversales, ne devraient pas être confondus avec les effets durables, observés dans des études longitudinales. Cette grille de lecture permet de réconcilier des conclusions d’études contradictoires à propos des mécanismes de la MIT et met en évidence des questions de recherches en suspens, notamment sur la contribution relative du rythme et de la hauteur musicale dans les effets de cette thérapie, que nous traitons dans le troisième chapitre. Nous y rapportons une étude avec trois participants ayant une aphasie de Broca chronique. Trois traitements ont été comparés dans un devis en carré latin : une thérapie comportant de la parole chantée (i.e., avec rythme et hauteurs musicales) proche de la MIT originale, une thérapie équivalente avec de la parole uniquement rythmée, et une thérapie comportant de la parole normale. Puisque seule la thérapie chantée a amélioré le langage dans le discours naturel des participants, nous soutenons que le chant dans son entièreté est un élément actif de la MIT. Enfin, dans le quatrième chapitre, nous présentons la première étude de groupe contrôlée, randomisée et à simple insu tentant de déterminer si le chant pratiqué comme simple loisir peut aussi avoir un effet bénéfique dans la réadaptation de l’aphasie. Nous avons comparé les progrès en communication fonctionnelle de 17 personnes ayant différents types d’aphasies chroniques réparties dans un groupe chorale, où elles devaient participer à six mois d’activité hebdomadaire de chorale, un groupe théâtre, où elles devaient suivre un atelier de théâtre, et une liste d’attente pour ces deux activités seulement. Nos résultats ont montré une corrélation positive entre l’amélioration de la communication fonctionnelle et le nombre de présences aux activités sociales, quelles qu’elles soient, mais nous n’avons pas trouvé d’effet spécifique à l’activité de chorale. Ainsi, la pratique du chant en chorale pourrait avoir un potentiel thérapeutique général, mais pas spécifique à l’utilisation du chant. D’autres études sont toutefois nécessaires pour le confirmer. Ainsi, cette thèse soutient globalement que dans la réadaptation de l’aphasie, le chant apporte des bénéfices spécifiques sur le langage lorsqu’il est intégré dans une thérapie comme la MIT et des bénéfices comparables à d’autres activités sociales lorsqu’il est pratiqué comme activité de loisir dans une chorale.

A socio friendly approach to the analysis of emotive speech

This paper describes certain findings of intonation and intensity study of emotive speech with the minimal use of signal processing algorithms. This study was based on six basic emotions and the neutral, elicited from 1660 English utterances obtained from the speech recordings of six Indian women. The correctness of the emotional content was verified through perceptual listening tests. Marked similarity was noted among pitch contours of like-worded, positive valence emotions, though no such similarity was observed among the four negative valence emotional expressions. The intensity patterns were also studied. The results of the study were validated using arbitrary television recordings for four emotions. The findings are useful to technical researchers, social psychologists and to the common man interested in the dynamics of vocal expression of emotions

La Reflexió metalingüística a l'entorn dels sons: una proposta basada en l'experimentació fonètica

L'ensenyament de la llengua oral ha anat guanyat pes en els darrers anys en els currículums de l'ensenyament obligatori (Decret 95/1992, de 28 d'abril, pel qual s'estableix l'ordenacio curricular de l'educació primària (DOGC 1593, de 13 de maig de 1992) i Decret 142/2007, de 26 de juny, pel qual s'estableix l'ordenació dels ensenyaments de l'educació primària (DOGC 4915, de 29 de juny de 2007)). Aquest canvi en la concepció de l'ensenyament-aprenentatge de la llengua ha estat impulsat per les teories pedagògiques que promouen un aprenentatge significatiu i comunicatiu (o funcional), en contrast amb l’aprenentatge de la gramàtica predominant fins a les dècades de 1960 i 1970. Entre els primers treballs en aquesta línia destaquen aportacions de la sociolingüística (Hymes 1971, amb la introducció del concepte de competència comunicativa; o Widdowson 1978 sobre la dimensió comunicativa de l’ensenyament de la llengua) i de l’aprenentatge de segones llengues (Jonhson 1981; Van Ek 1975, 1986, 1990; Richterich 1972; Richterich i Chancerel 1977, 1978; o els cursos com Follow me –per a l’ensenymanet de l’anglès– o Digui, digui…–per al catala– impulsats Consell d’Europa)

Variación en los procesos de palatalización de yod segunda (o cómo la sincronía permite la explicación de la diacronía)

La evolución de Lj latina hacia el fonema /x/ del español actual ha sido descrita con gran detalle en la bibliografía especializada en diacronía. Sin embargo, en ella no se aportan razones fonéticas que permitan entender el porqué de este cambio. Por este motivo, en el presente trabajo se ha acudido a las obras de Lindblom, Ohala o Blevins (entre otros), quienes defienden que el estudio de la variación fonética sincrónica permite una extrapolación a los datos antiguos y, por lo tanto, una aproximación y posible explicación de los procesos históricos. Así pues, con el objetivo de dar cuenta tanto de las razones del cambio como de su difusión, se ha partido del análisis fonético experimental del habla y de los datos obtenidos del estudio dialectal de /l/ y /ʎ/. Los resultados obtenidos permiten comprender cómo pudo producirse la evolución que ha llevado a la aparición del fonema /x/.

Conversational success in Williams syndrome: communication in the face of cognitive and linguistic limitations

Williams syndrome (WS) is characterized by apparent relative strengths in language, facial processing and social cognition but by profound impairment in spatial cognition, planning and problem solving. Following recent research which suggests that individuals with WS may be less linguistically able than was once thought, in this paper we begin to investigate why and how they may give the impression of linguistic proficiency despite poor standardized test results. This case study of Brendan, a 12-year-old boy with WS, who presents with a considerable lack of linguistic ability, suggests that impressions of linguistic competence may to some extent be the result of conversational strategies which enable him to compensate for various cognitive and linguistic deficits with a considerable degree of success. These conversational strengths are not predicted by his standardized language test results, and provide compelling support for the use of approaches such as Conversation Analysis in the assessment of individuals with communication impairments.

Expressive versus receptive language skills in specific reading disorder

Despite ample research into the language skills of children with specific reading disorder no studies so far have investigated whether there may be a difference between expressive and receptive language skills in this population. Yet, neuro-anatomical models would predict that children who have specific reading disorder which is not associated with movement or attention difficulties, would have lower receptive language skills than expressive. This study investigates the difference between expressive and receptive language skills in a sample of 17 children with specific reading difficulty aged between 7 and 12 years. They were administered a battery of two receptive and two expressive language measures. The results showed that as the neuro-anatomical model would predict, the children scored significantly lower on tests of receptive than on tests of expressive language skills.

Linguistic heterogeneity in Williams syndrome

Williams syndrome (WS) is a rare genetic disorder resulting from a deletion on chromosome 7. A number of studies have shown that individuals with WS have a superior linguistic profile compared to their non-verbal abilities, however the evidence has been inconclusive, as many studies have disputed such a profile. The vast majority of studies on WS have assumed a single, homogeneous WS linguistic profile in order to support various theoretical viewpoints. The present study investigated the linguistic profiles of 5 individuals with WS on a number of standardized verbal measures and in conversational settings. The results indicated substantially variable performance in all aspects of the verbal domain, which supports the view that WS, linguistically, is a rather heterogeneous condition and this should be taken into consideration when referring to it in theoretical accounts of language acquisition and debates on modularity.

Affective prosody in children with Williams syndrome

The aim of the current study was to investigate expressive affect in children with Williams syndrome ( WS) in comparison to typically developing children in an experimental task and in spontaneous speech. Fourteen children with WS, 14 typically developing children matched to the WS group for receptive language ( LA) and 15 typically developing children matched to the WS groups for chronological age ( CA) were recruited. Affect was investigated using an experimental Output Affect task from the Profiling Elements of Prosodic Systems-Child version ( PEPS-C) battery, and by measuring pitch range and vowel durations from a spontaneous speech task. The children were also rated for level of emotional involvement by phonetically naive listeners. The WS group performed similarly to the LA and CA groups on the Output Affect task. With regard to vowel durations, the WS group was no different from the LA group; however both the WS and the LA groups were found to use significantly longer vowels than the CA group. The WS group differed significantly from both control groups on their range of pitch range and was perceived as being significantly more emotionally involved than the two control groups.

The neural response to emotional prosody, as revealed by functional magnetic resonance imaging

Prosody is an important feature of language, comprising intonation, loudness, and tempo. Emotional prosodic processing forms an integral part of our social interactions. The main aim of this study was to use bold contrast fMRI to clarify the normal functional neuroanatomy of emotional prosody, in passive and active contexts. Subjects performed six separate scanning studies, within which two different conditions were contrasted: (1) "pure" emotional prosody versus rest; (2) congruent emotional prosody versus 'neutral' sentences; (3) congruent emotional prosody versus rest; (4) incongruent emotional prosody versus rest; (5) congruent versus incongruent emotional prosody; and (6) an active experiment in which subjects were instructed to either attend to the emotion conveyed by semantic content or that conveyed by tone of voice. Data resulting from these contrasts were analysed using SPM99. Passive listening to emotional prosody consistently activated the lateral temporal lobe (superior and/or middle temporal gyri). This temporal lobe response was relatively right-lateralised with or without semantic information. Both the separate and direct comparisons of congruent and incongruent emotional prosody revealed that subjects used fewer brain regions to process incongruent emotional prosody than congruent. The neural response to attention to semantics, was left lateralised, and recruited an extensive network not activated by attention to emotional prosody. Attention to emotional prosody modulated the response to speech, and induced right-lateralised activity, including the middle temporal gyrus. In confirming the results of lesion and neuropsychological studies, the current study emphasises the importance of the right hemisphere in the processing of emotional prosody, specifically the lateral temporal lobes. (C) 2003 Elsevier Science Ltd. All rights reserved.