New kernel functions and learning methods for text and data mining

Recent advances in machine learning methods enable increasingly the automatic construction of various types of computer assisted methods that have been difficult or laborious to program by human experts. The tasks for which this kind of tools are needed arise in many areas, here especially in the fields of bioinformatics and natural language processing. The machine learning methods may not work satisfactorily if they are not appropriately tailored to the task in question. However, their learning performance can often be improved by taking advantage of deeper insight of the application domain or the learning problem at hand. This thesis considers developing kernel-based learning algorithms incorporating this kind of prior knowledge of the task in question in an advantageous way. Moreover, computationally efficient algorithms for training the learning machines for specific tasks are presented. In the context of kernel-based learning methods, the incorporation of prior knowledge is often done by designing appropriate kernel functions. Another well-known way is to develop cost functions that fit to the task under consideration. For disambiguation tasks in natural language, we develop kernel functions that take account of the positional information and the mutual similarities of words. It is shown that the use of this information significantly improves the disambiguation performance of the learning machine. Further, we design a new cost function that is better suitable for the task of information retrieval and for more general ranking problems than the cost functions designed for regression and classification. We also consider other applications of the kernel-based learning algorithms such as text categorization, and pattern recognition in differential display. We develop computationally efficient algorithms for training the considered learning machines with the proposed kernel functions. We also design a fast cross-validation algorithm for regularized least-squares type of learning algorithm. Further, an efficient version of the regularized least-squares algorithm that can be used together with the new cost function for preference learning and ranking tasks is proposed. In summary, we demonstrate that the incorporation of prior knowledge is possible and beneficial, and novel advanced kernels and cost functions can be used in algorithms efficiently.

Language Learning in Task Management and Task Accomplishment

In this paper we study student interaction in English and Swedish courses at a Finnish university. We focus on language choices made in task-related activities in small group interaction. Our research interests arose from the change in the teaching curriculum, in which content and language courses were integrated at Tampere University of Technology in 2013. Using conversation analysis, we analysed groups of 4-5 students who worked collaboratively on a task via a video conference programme. The results show how language alternation has different functions in 1) situations where students orient to managing the task, e.g., in transitions into task, or where they orient to technical problems, and 2) situations where students accomplish the task. With the results, we aim to show how language alternation can provide interactional opportunities for language learning. The findings will be useful in designing tasks in the future.

Individual differences in control of language interference in late bilinguals are mainly related to general executive abilities

Background: Recent research based on comparisons between bilinguals and monolinguals postulates that bilingualism enhances cognitive control functions, because the parallel activation of languages necessitates control of interference. In a novel approach we investigated two groups of bilinguals, distinguished by their susceptibility to cross-language interference, asking whether bilinguals with strong language control abilities ('non-switchers") have an advantage in executive functions (inhibition of irrelevant information, problem solving, planning efficiency, generative fluency and self-monitoring) compared to those bilinguals showing weaker language control abilities ('switchers"). Methods: 29 late bilinguals (21 women) were evaluated using various cognitive control neuropsychological tests [e.g., Tower of Hanoi, Ruff Figural Fluency Task, Divided Attention, Go/noGo] tapping executive functions as well as four subtests of the Wechsler Adult Intelligence Scale. The analysis involved t-tests (two independent samples). Non-switchers (n = 16) were distinguished from switchers (n = 13) by their performance observed in a bilingual picture-naming task. Results: The non-switcher group demonstrated a better performance on the Tower of Hanoi and Ruff Figural Fluency task, faster reaction time in a Go/noGo and Divided Attention task, and produced significantly fewer errors in the Tower of Hanoi, Go/noGo, and Divided Attention tasks when compared to the switchers. Non-switchers performed significantly better on two verbal subtests of the Wechsler Adult Intelligence Scale (Information and Similarity), but not on the Performance subtests (Picture Completion, Block Design). Conclusions: The present results suggest that bilinguals with stronger language control have indeed a cognitive advantage in the administered tests involving executive functions, in particular inhibition, self-monitoring, problem solving, and generative fluency, and in two of the intelligence tests. What remains unclear is the direction of the relationship between executive functions and language control abilities.

A Case-based reasoning approach to validate grammatical gender and number agreement in Spanish language

Across Latin America 420 indigenous languages are spoken. Spanish is considered a second language in indigenous communities and is progressively introduced in education. However, most of the tools to support teaching processes of a second language have been developed for the most common languages such as English, French, German, Italian, etc. As a result, only a small amount of learning objects and authoring tools have been developed for indigenous people considering the specific needs of their population. This paper introduces Multilingual–Tiny as a web authoring tool to support the virtual experience of indigenous students and teachers when they are creating learning objects in indigenous languages or in Spanish language, in particular, when they have to deal with the grammatical structures of Spanish. Multilingual–Tiny has a module based on the Case-based Reasoning technique to provide recommendations in real time when teachers and students write texts in Spanish. An experiment was performed in order to compare some local similarity functions to retrieve cases from the case library taking into account the grammatical structures. As a result we found the similarity function with the best performance

Training executive functions in the laboratory and in real life : cognitive consequences of computer-based exercises and bilingualism

The question of the trainability of executive functions and the impact of such training on related cognitive skills has stirred considerable research interest. Despite a number of studies investigating this, the question has not yet been solved. The general aim of this thesis was to investigate two very different types of training of executive functions: laboratory-based computerized training (Studies I-III) and realworld training through bilingualism (Studies IV-V). Bilingualism as a kind of training of executive functions is based on the idea that managing two languages requires executive resources, and previous studies have suggested a bilingual advantage in executive functions. Three executive functions were studied in the present thesis: updating of working memory (WM) contents, inhibition of irrelevant information, and shifting between tasks and mental sets. Studies I-III investigated the effects of computer-based training of WM updating (Study I), inhibition (Study II), and set shifting (Study III) in healthy young adults. All studies showed increased performance on the trained task. More importantly, improvement on an untrained task tapping the trained executive function (near transfer) was seen in Study I and II. None of the three studies showed improvement on untrained tasks tapping some other cognitive function (far transfer) as a result of training. Study I also used PET to investigate the effects of WM updating training on a neurotransmitter closely linked to WM, namely dopamine. The PET results revealed increased striatal dopamine release during WM updating performance as a result of training. Study IV investigated the ability to inhibit task-irrelevant stimuli in bilinguals and monolinguals by using a dichotic listening task. The results showed that the bilinguals exceeded the monolinguals in inhibiting task-irrelevant information. Study V introduced a new, complementary research approach to study the bilingual executive advantage and its underlying mechanisms. To circumvent the methodological problems related to natural groups design, this approach focuses only on bilinguals and examines whether individual differences in bilingual behavior correlate with executive task performances. Using measures that tap the three above-entioned executive functions, the results suggested that more frequent language switching was associated with better set shifting skills, and earlier acquisition of the second language was related to better inhibition skills. In conclusion, the present behavioral results showed that computer-based training of executive functions can improve performance on the trained task and on closely related tasks, but does not yield a more general improvement of cognitive skills. Moreover, the functional neuroimaging results reveal that WM training modulates striatal dopaminergic function, speaking for training-induced neural plasticity in this important neurotransmitter system. With regard to bilingualism, the results provide further support to the idea that bilingualism can enhance executive functions. In addition, the new complementary research approach proposed here provides some clues as to which aspects of everyday bilingual behavior may be related to the advantage in executive functions in bilingual individuals.

Language processing with dynamic fields

We construct a mapping from complex recursive linguistic data structures to spherical wave functions using Smolensky's filler/role bindings and tensor product representations. Syntactic language processing is then described by the transient evolution of these spherical patterns whose amplitudes are governed by nonlinear order parameter equations. Implications of the model in terms of brain wave dynamics are indicated.

Language in genetic syndromes and cognitive modularity

In recent years, research into the impact of genetic abnormalities on cognitive development, including language, has become recognized for its potential to make valuable contributions to our understanding of the brain–behaviour relationships underlying language acquisition as well as to understanding the cognitive architecture of the human mind. The publication of Fodor’s ( 1983 ) book The Modularity of Mind has had a profound impact on the study of language and the cognitive architecture of the human mind. Its central claim is that many of the processes involved in comprehension are undertaken by special brain systems termed ‘modules’. This domain specificity of language or modularity has become a fundamental feature that differentiates competing theories and accounts of language acquisition (Fodor 1983 , 1985 ; Levy 1994 ; Karmiloff-Smith 1998 ). However, although the fact that the adult brain is modularized is hardly disputed, there are different views of how brain regions become specialized for specific functions. A question of some interest to theorists is whether the human brain is modularized from the outset (nativist view) or whether these distinct brain regions develop as a result of biological maturation and environmental input (neuroconstructivist view). One source of insight into these issues has been the study of developmental disorders, and in particular genetic syndromes, such as Williams syndrome (WS) and Down syndrome (DS). Because of their uneven profiles characterized by dissociations of different cognitive skills, these syndromes can help us address theoretically significant questions. Investigations into the linguistic and cognitive profiles of individuals with these genetic abnormalities have been used as evidence to advance theoretical views about innate modularity and the cognitive architecture of the human mind. The present chapter will be organized as follows. To begin, two different theoretical proposals in the modularity debate will be presented. Then studies of linguistic abilities in WS and in DS will be reviewed. Here, the emphasis will be mainly on WS due to the fact that theoretical debates have focused primarily on WS, there is a larger body of literature on WS, and DS subjects have typically been used for the purposes of comparison. Finally, the modularity debate will be revisited in light of the literature review of both WS and DS. Conclusions will be drawn regarding the contribution of these two genetic syndromes to the issue of cognitive modularity, and in particular innate modularity.

Atypically rightward cerebral asymmetry in male adults with autism stratifies individuals with and without language delay

In humans, both language and fine motor skills are associated with left-hemisphere specialization, whereas visuospatial skills are associated with right-hemisphere specialization. Individuals with autism spectrum conditions (ASC) show a profile of deficits and strengths that involves these lateralized cognitive functions. Here we test the hypothesis that regions implicated in these functions are atypically rightward lateralized in individuals with ASC and, that such atypicality is associated with functional performance. Participants included 67 male, right-handed adults with ASC and 69 age- and IQ-matched neurotypical males. We assessed group differences in structural asymmetries in cortical regions of interest with voxel-based analysis of grey matter volumes, followed by correlational analyses with measures of language, motor and visuospatial skills. We found stronger rightward lateralization within the inferior parietal lobule and reduced leftward lateralization extending along the auditory cortex comprising the planum temporale, Heschl's gyrus, posterior supramarginal gyrus, and parietal operculum, which was more pronounced in ASC individuals with delayed language onset compared to those without. Planned correlational analyses showed that for individuals with ASC, reduced leftward asymmetry in the auditory region was associated with more childhood social reciprocity difficulties. We conclude that atypical cerebral structural asymmetry is a potential candidate neurophenotype of ASC

Conflicting language ideologies and contradictory language practices in Singaporean bilingual families

Informed by family language policy (FLP) as the theoretical framework, I illustrate in this paper how language ideologies can be incongruous and language policies can be conflicting through three multilingual families in Singapore representing three major ethnic groups – Chinese, Malay and Indian. By studying their family language audits, observing their language practices, and engaging in conversations about their language ideologies, I look at what these families do and do not do and what they claim to do and not to do. Data were collected over a period of 6 months with more than 700 minutes of recording of actual interactions. Analysis of the data reveals that language ideologies are ‘power-inflected’ and tend to become the source of educational and social tensions which in turn shape family language practices. In Singapore these tensions are illustrated by the bilingual policy recognising mother tongues (MTs) and English as official languages, and its educational policy establishing English as the medium of instruction. The view of English as having instrumental values and MTs as having cultural functions reveals that language choices and practices in family domains are value-laden in everyday interactions and explicitly negotiated and established through FLP.

Interactional dynamics in on-line and face-to-face peer-tutoring sessions for second language writers

This paper reports the results of a study comparing the interactional dynamics of face-to-face and on-line peer-tutoring in writing by university students in Hong Kong. Transcripts of face-to-face tutoring sessions, as well as logs of on-line sessions conducted by the same peer-tutors, were coded for speech functions using a system based on Halliday's functional-semantic view of dialogue. Results show considerable differences between the interactional dynamics in on-line and face-to-face tutoring sessions. In particular, face-to-face interactions involved more hierarchal encounters in which tutors took control of the discourse, whereas on-line interactions were more egalitarian, with clients controlling the discourse more. Differences were also found in the topics participants chose to focus on in the two modes, with issues of grammar, vocabulary, and style taking precedence in face-to-face sessions and more “global” writing concerns like content and process being discussed more in on-line sessions.

A Linguistic Analysis of the Written Production of Second Language Learners : The Variation of Article Usage by Adult Chinese Learners of English

This study aims to test Robertson’s lexical transfer principle, which posits that Chinese learners use demonstratives (particularly this) and the numeral one as markers of definiteness and indefiniteness. This is tested by analysing Chinese learners’ written production collected from the Spoken and Written English Corpus of Chinese Learners 2.0 (SWECCL 2.0). The purpose is to understand the variation of article usage by adult Chinese learners of English. More specifically, the study examines to what extent articles, possessive and demonstrative pronouns are used in Chinese learners’ English and how definite and indefinite articles are used by the Chinese learners. Findings suggest that Robertson’s lexical transfer principle was corroborated by the present study. In addition, Chinese learners prefer to use demonstrative determiners, the possessive determiner our, and the numeral one to perform the function of marking definiteness and indefiniteness. In particular, the learners try to use the demonstrative determiners that and this in the anaphoric function instead of the definite article, and the demonstrative determiner those is frequently used in the cataphoric function. What is more, the learners use the numeral one as a marker of indefiniteness, and it is also used as a marker of definiteness in the anaphoric function. Further, the possessive determiner our is used as a marker of definiteness in larger situation uses referring to something unique. To this end, the study is able to show that the definite article is used to perform the function of marking indefiniteness, and in some particular contexts the definite article functions as a Chinese specifier in Chinese learners’ English. Also, the indefinite article is frequently used in quantifier phrases but is rarely used in other functions. There are three main reasons that may explain why Chinese learners use determiners variously. Firstly, the choice of determiners by Chinese learners is influenced by linguistic contexts. Secondly, because of learning strategies, Chinese learners try to ignore the anaphoric function and cataphoric function that they are not yet ready to process in article usage. Thirdly, interlanguage grammar influences the optionality in the use of articles. 

Topic- and mode-sensitive interaction strategies : Functions of ellipsis in oral communication

In this article, we discuss ellipsis as an interactive strategy by analysing the author’s textchat corpus and the VOICE corpus of English as a Lingua Franca. It is found that there were fewer repetitions in the textchat data, and this is explained as a consequence of the textchat mode. Textchat contributions are preserved as long as the chat is active or has been saved, and therefore users can scroll through and review the discussion, compared to the more fleeting nature of oral conversation. As a result, repetition is less necessary. The frequency of other functions identified could be attributed to the topic of discourse. Discussions involve much ellipsis used to develop discourse, although some were self-presentations with repetition used to confirm details. Back-channel support and comments were often low because speakers instead used forms like yeah as supportive utterances.

Characterization of language disorders in children with lead poisoning

Background: lead poisoning can have a negative impact on the neuropsychological functions, including language, due to the damage it causes to the developthent of the Central Nervous System. Aim: to verify the occurrence of language disorders in children who suffered from led poisoning and to verify the correlation between the lead concentration level in the blood and the language disorders presented by the children. Method: language evaluation of 20 preschoolers, with lead concentration level in the blood above 10μg/dl. Results: 13 children presented language impairment involving only phonology or more than one language subsystem. The statistical analysis indicated that no correlation exists between the severity of the language impairment and the concentration levels of lead. Conclusion: the number of children with language impairment indicates lead poisoning as a risk factor for the present alterations, even though other risk factors for language disorders were found and the absence of correlation between the investigated variables.

Orofacial functions and quality of life in oral health in subjects with dentofacial deformity

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Language lateralization correlates with verbal memory performance in children with focal epilepsy

PURPOSE: Assessment of language dominance with functional magnetic resonance imaging (fMRI) and neuropsychological evaluation is often used prior to epilepsy surgery. This study explores whether language lateralization and cognitive performance are systematically related in young patients with focal epilepsy. METHODS: Language fMRI and neuropsychological data (language, visuospatial functions, and memory) of 40 patients (7-18 years of age) with unilateral, refractory focal epilepsy in temporal and/or frontal areas of the left (n = 23) or right hemisphere (n = 17) were analyzed. fMRI data of 18 healthy controls (7-18 years) served as a normative sample. A laterality index was computed to determine the lateralization of activation in three regions of interest (frontal, parietal, and temporal). RESULTS: Atypical language lateralization was demonstrated in 12 (30%) of 40 patients. A correlation between language lateralization and verbal memory performance occurred in patients with left-sided epilepsy over all three regions of interest, with bilateral or right-sided language lateralization being correlated with better verbal memory performance (Word Pairs Recall: frontal r = -0.4, p = 0.016; parietal r = -0.4, p = 0.043; temporal r = -0.4, p = 0.041). Verbal memory performance made the largest contribution to language lateralization, whereas handedness and side of seizures did not contribute to the variance in language lateralization. DISCUSSION: This finding reflects the association between neocortical language and hippocampal memory regions in patients with left-sided epilepsy. Atypical language lateralization is advantageous for verbal memory performance, presumably a result of transfer of verbal memory function. In children with focal epilepsy, verbal memory performance provides a better idea of language lateralization than handedness and side of epilepsy and lesion.