Facial Feature Tracking and Occlusion Recovery in American Sign Language

Facial features play an important role in expressing grammatical information in signed languages, including American Sign Language(ASL). Gestures such as raising or furrowing the eyebrows are key indicators of constructions such as yes-no questions. Periodic head movements (nods and shakes) are also an essential part of the expression of syntactic information, such as negation (associated with a side-to-side headshake). Therefore, identification of these facial gestures is essential to sign language recognition. One problem with detection of such grammatical indicators is occlusion recovery. If the signer's hand blocks his/her eyebrows during production of a sign, it becomes difficult to track the eyebrows. We have developed a system to detect such grammatical markers in ASL that recovers promptly from occlusion. Our system detects and tracks evolving templates of facial features, which are based on an anthropometric face model, and interprets the geometric relationships of these templates to identify grammatical markers. It was tested on a variety of ASL sentences signed by various Deaf native signers and detected facial gestures used to express grammatical information, such as raised and furrowed eyebrows as well as headshakes.

A Neural Network Model of Speech Acquisition and Motor Equivalent Speech Production

This article describes a neural network model that addresses the acquisition of speaking skills by infants and subsequent motor equivalent production of speech sounds. The model learns two mappings during a babbling phase. A phonetic-to-orosensory mapping specifies a vocal tract target for each speech sound; these targets take the form of convex regions in orosensory coordinates defining the shape of the vocal tract. The babbling process wherein these convex region targets are formed explains how an infant can learn phoneme-specific and language-specific limits on acceptable variability of articulator movements. The model also learns an orosensory-to-articulatory mapping wherein cells coding desired movement directions in orosensory space learn articulator movements that achieve these orosensory movement directions. The resulting mapping provides a natural explanation for the formation of coordinative structures. This mapping also makes efficient use of redundancy in the articulator system, thereby providing the model with motor equivalent capabilities. Simulations verify the model's ability to compensate for constraints or perturbations applied to the articulators automatically and without new learning and to explain contextual variability seen in human speech production.

A corpus-driven error analysis of the oral and written production of Leaving Certificate Spanish learners

The Leaving Certificate (LC) is the national, standardised state examination in Ireland necessary for entry to third level education – this presents a massive, raw corpus of data with the potential to yield invaluable insight into the phenomena of learner interlanguage. With samples of official LC Spanish examination data, this project has compiled a digitised corpus of learner Spanish comprised of the written and oral production of 100 candidates. This corpus was then analysed using a specific investigative corpus technique, Computer-aided Error Analysis (CEA, Dagneaux et al, 1998). CEA is a powerful apparatus in that it greatly facilitates the quantification and analysis of a large learner corpus in digital format. The corpus was both compiled and analysed with the use of UAM Corpus Tool (O’Donnell 2013). This Tool allows for the recording of candidate-specific variables such as grade, examination level, task type and gender, therefore allowing for critical analysis of the corpus as one unit, as separate written and oral sub corpora and also of performance per task, level and gender. This is an interdisciplinary work combining aspects of Applied Linguistics, Learner Corpus Research and Foreign Language (FL) Learning. Beginning with a review of the context of FL learning in Ireland and Europe, I go on to discuss the disciplinary context and theoretical framework for this work and outline the methodology applied. I then perform detailed quantitative and qualitative analyses before going on to combine all research findings outlining principal conclusions. This investigation does not make a priori assumptions about the data set, the LC Spanish examination, the context of FLs or of any aspect of learner competence. It undertakes to provide the linguistic research community and the domain of Spanish language learning and pedagogy in Ireland with an empirical, descriptive profile of real learner performance, characterising learner difficulty.

H.M.'s personal crossword puzzles: understanding memory and language.

The amnesic patient H.M. has been solving crossword puzzles nearly all his life. Here, we analysed the linguistic content of 277 of H.M.'s crossword-puzzle solutions. H.M. did not have any unusual difficulties with the orthographic and grammatical components inherent to the puzzles. He exhibited few spelling errors, responded with appropriate parts of speech, and provided answers that were, at times, more convincing to observers than those supplied by the answer keys. These results suggest that H.M.'s lexical word-retrieval skills remain fluid despite his profound anterograde amnesia. Once acquired, the maintenance of written language comprehension and production does not seem to require intact medial temporal lobe structures.

Why do we struggle when we try to learn a language as adults?

Whereas the acquisition of a first language is successful for normally developing individuals, native-like attainment in a language learnt as adults is not guaranteed. As far as grammar is concerned, the area that typically shows up as more problematic is that of Morphology, and more specifically, that part of Morphology related to the specific ways languages have to indicate notions like temporal location (e.g. English –-ed for past tense She walked) or person agreement (e.g. English –s for the third person singular She sings). Language students and teachers are familiar with exclamations like “Oh, after so many years I still have problems with the past tenses in Spanish!” or “I cannot cope with the masculine/feminine thing in French!” In this talk I will present two different accounts that are currently debated in the field of Second Language Acquisition about why it is not enough to memorize those “blessed endings” for us to master their use in our speech production. I will also introduce the latest study I have conducted in collaboration with colleagues, with the aim of evaluating the explanatory power of the hypotheses debated in current literature. [From the Author]

Neural basis of language switching in the brain: fMRI evidence from Korean-Chinese early bilinguals

Using fMRI, we conducted two types of property generation task that involved language switching, with early bilingual speakers of Korean and Chinese. The first is a more conventional task in which a single language (L1 or L2) was used within each trial, but switched randomly from trial to trial. The other consists of a novel experimental design where language switching happens within each trial, alternating in the direction of the L1/L2 translation required. Our findings support a recently introduced cognitive model, the 'hodological' view of language switching proposed by Moritz-Gasser and Duffau. The nodes of a distributed neural network that this model proposes are consistent with the informative regions that we extracted in this study, using both GLM methods and Multivariate Pattern Analyses: the supplementary motor area, caudate, supramarginal gyrus and fusiform gyrus and other cortical areas. 

L’évolution de la production des voyelles du français chez des immigrants adultes hispanophones : une étude de cas

Cette recherche s’inscrit dans le domaine des études visant à documenter le processus d’apprentissage du système phonologique de la langue du pays d’accueil chez des apprenants hispanophones du français en situation d’immigration. Nous avons effectué une étude de cas à l’aide d’enregistrements recueillis à quatre reprises pour documenter l’appropriation de sept nouvelles voyelles françaises à l’intérieur de paires minimales courantes comme vu et vous. Nous avons observé une réorganisation importante de l’inventaire des voyelles suscitée par le passage de l’espagnol au français : création d’une nouvelle catégorie phonétique pour les voyelles antérieures arrondies et distinction des nouveaux contrastes [e/ɛ], [o/ɔ] et [a/ɑ]. Par ailleurs, nous avons noté une amélioration marquée des contrastes vocaliques chez l’un des quatre participants, et une légère amélioration chez les trois autres.

Émergence du fumisme dans la production d'un nouvel esprit littéraire

La présente thèse se veut une relecture du fumisme en tant que concept et mouvement historique daté (années 1860-1880) et situé (la France), ou moment qui représente une économie de sens qui a bouleversé les habitudes perceptuelles et intellectuelles de la réception depuis la seconde moitié du dix-neuvième siècle. Selon la lecture habituelle du fumisme, les productions des poètes et artistes fumistes, qualifiées de « fumisteries », ne forment qu’un chapitre, ou une catégorie négligeable, de l’histoire littéraire. Cette histoire confond le fumisme en tant que mouvement littéraire éphémère avec les épisodes décadent et symboliste pour le réduire à un concours de mystifications de bourgeois par des bohèmes en marge par rapport à l’institution littéraire organisées par le comédien Sapeck et l’écrivain Alphonse Allais, tous deux nommés ironiquement chefs de « l’École fumiste » vers 1880. Or, en offusquant la conception positiviste du langage qu’elle lui applique afin de le réduire à une simple provocation sans but, et en assimilant Rimbaud aux « fumisteries » des « décadents », la critique littéraire nous donne l’outil principal de démystification du fumisme en tant que pratique ou mode de production d’une économie de sens. C’est cette économie qui constitue notre principal point d’intérêt. Contemporain des épisodes décadent et symboliste, le moment fumiste oblige la réception à reconfigurer la façon de produire du sens. Les productions fumistes (essentiellement des poèmes et des caricatures, comme dans l’Album zutique, notre corpus principal) sont fondées sur une économie du rébus. Exemplifiée par le sonnet de Rimbaud intitulé « Voyelles », cette économie, qui crée des « documents », des textes inséparables de leur matière, introduit l’économie artistique du vingtième siècle – en particulier, au mode de perception cinématographique tel que fabriqué par le fumiste Émile Cohl.

The sight of silence : the conceptualisation of silence in the visual cultures of sign language communities

Deaf people are perceived by hearing people as living in a silent world. Yet, silence cannot exist without sound, so if sound is not heard, can there be silence? From a linguistic point of view silence is the absence of, or intermission in, communication. Silence can be communicative or noncommunicative. Thus, silence must exist in sign languages as well. Sign languages are based on visual perception and production through movement and sight. Silence must, therefore, be visually perceptible; and, if there is such a thing as visual silence, how does it look? The paper will analyse the topic of silence from a Deaf perspective. The main aspects to be explored are the perception and evaluation of acoustic noise and silence by Deaf people; the conceptualisation of silence in visual languages, such as sign languages; the qualities of visual silence; the meaning of silence as absence of communication (particularly between hearing and Deaf people); social rules for silence; and silencing strategies.

Validation of the Rhode Island Test of Language Structure with orally educated hearing-impaired students

This paper examines the Rhode Island Test of Language Structures (RITLS) and its measurement of the comprehension of syntax, and the relationship of this comprehension to the use of syntax in the production of spoken English by orally educated hearing-impaired students.

A study of imitation, comprehension, and production

This paper examines the relationship between imitation, comprehension and speech production in language disordered children, and in identifying whether language-disordered children are "language impaired" or "talking impaired."

Production of tense marking in successive bilingual children: when do they converge with their monolingual peers?

Children with English as a second language (L2) with exposure of 18 months or less exhibit similar difficulties to children with Specific Language Impairment in tense marking, a marker of language impairment for English. This paper examines whether L2 children with longer exposure converge with their monolingual peers in the production of tense marking. 38 Turkish-English L2 children with a mean age of 7;8 and 33 monolingual age-matched controls completed the screening test of the Test of Early Grammatical Impairment (TEGI). The L2 children as a group were as accurate as the controls in the production of -ed, but performed significantly lower than the controls in the production of third person –s. Age and YoE affected the children’s performance. The highest age-expected performance on the TEGI was attested in eight and nine year-old children who had 4-6 YoE. L1 and L2 children performed better in regular compared to irregular verbs, but L2 children overregularized more than L1 children and were less sensitive to the phonological properties of verbs. The results show that tense marking and the screening test of the TEGI may be promising for differential diagnosis in eight and nine year-old L2 children with at least four YoE.

Treatment of written verb and written sentence production in an individual with aphasia: A clinical study

Background: Although the efficacy of treatments for spoken verb and sentence production deficits in aphasia has been documented widely, less is known about interventions for written verb and written sentence production deficits. Aims: This study documents a treatment aiming to improve production of (a) written subject-verb sentences (involving intransitive verbs) and (b) written subject-verb-object sentences (involving transitive verbs). Methods & Procedures: The participant, a 63-year-old female aphasic speaker, had a marked language comprehension deficit, apraxia of speech, relatively good spelling abilities, and no hemiplegia. The treatment involved intransitive verbs producing subject-verb active sentences and transitive verbs producing subject-verb-object active non-reversible sentences. The treatment was undertaken in the context of current UK clinical practice. Outcomes & Results: Statistical improvements were noted for the trained sets of verbs and sentences. Other improvements were also noted in LW's ability to retrieve some non-treated verbs and construct written sentences. Treatment did not generalise to sentence comprehension and letter spelling to dictation. Conclusions: Our participant's ability to write verbs and sentences improved as a result of the treatment.

Workflow data exchange semantics, object discovery & integration architecture for cross media production & distribution

There has been a clear lack of common data exchange semantics for inter-organisational workflow management systems where the research has mainly focused on technical issues rather than language constructs. This paper presents the neutral data exchanges semantics required for the workflow integration within the AXAEDIS framework and presents the mechanism for object discovery from the object repository where little or no knowledge about the object is available. The paper also presents workflow independent integration architecture with the AXAEDIS Framework.