Investigating verbal intelligence using the TF-IDF approach

In this paper we investigated differences in language use of speakers yielding different verbal intelligence when they describe the same event. The work is based on a corpus containing descriptions of a short film and verbal intelligence scores of the speakers. For analyzing the monologues and the film transcript, the number of reused words, lemmas, n-grams, cosine similarity and other features were calculated and compared to each other for different verbal intelligence groups. The results showed that the similarity of monologues of higher verbal intelligence speakers was greater than of lower and average verbal intelligence participants. A possible explanation of this phenomenon is that candidates yielding higher verbal intelligence have a better short-term memory. In this paper we also checked a hypothesis that differences in vocabulary of speakers yielding different verbal intelligence are sufficient enough for good classification results. For proving this hypothesis, the Nearest Neighbor classifier was trained using TF-IDF vocabulary measures. The maximum achieved accuracy was 92.86%.

Modeling Individual Differences among Writers Using ReaderBench

The current study builds upon a previous study, which examined the degree to which the lexical properties of students’ essays could predict their vocabulary scores. We expand on this previous research by incorporating new natural language processing indices related to both the surface- and discourse-levels of students’ essays. Additionally, we investigate the degree to which these NLP indices can be used to account for variance in students’ reading comprehension skills. We calculated linguistic essay features using our framework, ReaderBench, which is an automated text analysis tools that calculates indices related to linguistic and rhetorical features of text. University students (n = 108) produced timed (25 minutes), argumentative essays, which were then analyzed by ReaderBench. Additionally, they completed the Gates-MacGinitie Vocabulary and Reading comprehension tests. The results of this study indicated that two indices were able to account for 32.4% of the variance in vocabulary scores and 31.6% of the variance in reading comprehension scores. Follow-up analyses revealed that these models further improved when only considering essays that contained multiple paragraph (R2 values = .61 and .49, respectively). Overall, the results of the current study suggest that natural language processing techniques can help to inform models of individual differences among student writers.

Neurobiological model of visuo-spatial cognition in young Williams Syndrome children: measures of dorsal-stream and frontal function

We examine hypotheses for the neural basis of the profile of visual cognition in young children with Williams syndrome (WS). These are: (a) that it is a consequence of anomalies in sensory visual processing; (b) that it is a deficit of the dorsal relative to the ventral cortical stream; (c) that it reflects deficit of frontal function, in particular of fronto-parietal interaction; (d) that it is related to impaired function in the right hemisphere relative to the left. The tests reported here are particularly relevant to (b) and (c). They form part of a more extensive programme of investigating visual, visuospatial, and cognitive function in large group of children with WS children, aged 8 months to 15 years. To compare performance across tests, avoiding floor and ceiling effects, we have measured performance in children with WS in terms of the ‘age equivalence’ for typically developing children. In this paper the relation between dorsal and ventral function was tested by motion and form coherence thresholds respectively. We confirm the presence of a subgroup of children with WS who perform particularly poorly on the motion (dorsal) task. However, such performance is also characteristic of normally developingchildren up to 5 years: thus the WS performance may reflect an overall persisting immaturity of visuospatial processing which is particularly evident in the dorsal stream. Looking at the performance on the global coherence tasks of the entire WS group, we find that there is also a subgroup who have both high form and motion coherence thresholds, relative to the performance of children of the same chronological age and verbal age on the BPVS, suggesting a more general global processing deficit. Frontal function was tested by a counterpointing task, ability to retrieve a ball from a ‘detour box’, and the Stroop-like ‘day-night’ task, all of which require inhibition of a familiar response. When considered in relation to overall development as indexed by vocabulary, the day-night task shows little specific impairment, the detour box shows a significant delay relative to controls, and the counterpointing task shows a marked and persistent deficit in many children. We conclude that frontal control processes show most impairment in WS when they are associated with spatially directed responses, reflecting a deficit of fronto-parietal processing. However, children with WS may successfully reduce the effect of this impairment by verbally mediated strategies. On all these tasks we find a range of difficulties across individual children and a small subset of WS who show very good performance, equivalent to chronological age norms of typically developing children. Neurobiological models of visuo-spatial cognition in children with WS p.4 Overall, we conclude that children with WS have specific processing difficulties with tasks involving frontoparietal circuits within the spatial domain. However, some children with WS can achieve similar performance to typically developing children on some tasks involving the dorsal stream, although the strategies and processing may be different in the two groups.

Brain-Based Individual Difference Measures of Reading Skill in Deaf and Hearing Adults

Thesis (Ph.D.)--University of Washington, 2015

Measuring lexical diversity among L2 learners of French: an exploration of the validity of D, MTLD and HD-D as measures of language ability

In this study two new measures of lexical diversity are tested for the first time on French. The usefulness of these measures, MTLD (McCarthy and Jarvis (2010 and this volume) ) and HD-D (McCarthy and Jarvis 2007), in predicting different aspects of language proficiency is assessed and compared with D (Malvern and Richards 1997; Malvern, Richards, Chipere and Durán 2004) and Maas (1972) in analyses of stories told by two groups of learners (n=41) of two different proficiency levels and one group of native speakers of French (n=23). The importance of careful lemmatization in studies of lexical diversity which involve highly inflected languages is also demonstrated. The paper shows that the measures of lexical diversity under study are valid proxies for language ability in that they explain up to 62 percent of the variance in French C-test scores, and up to 33 percent of the variance in a measure of complexity. The paper also provides evidence that dependence on segment size continues to be a problem for the measures of lexical diversity discussed in this paper. The paper concludes that limiting the range of text lengths or even keeping text length constant is the safest option in analysing lexical diversity.

The effects of speech production and vocabulary training on different components of spoken language performance

A group of 21 hard-of-hearing and deaf children attending primary school were trained by their teachers on the production of selected consonants and on the meanings of selected words. Speech production, vocabulary knowledge, reading aloud, and speech perception measures were obtained before and after each type of training. The speech production training produced a small but significant improvement in the percentage of consonants correctly produced in words. The vocabulary training improved knowledge of word meanings substantially. Performance on speech perception and reading aloud were significantly improved by both types of training. These results were in accord with the predictions of a mathematical model put forward to describe the relationships between speech perception, speech production, and language measures in children (Paatsch, Blamey, Sarant, Martin, & Bow, 2004). These training data demonstrate that the relationships between the measures are causal. In other words, improvements in speech production and vocabulary performance produced by training will carry over into predictable improvements in speech perception and reading scores. Furthermore, the model will help educators identify the most effective methods of improving receptive and expressive spoken language for individual children who are deaf or hard of hearing.

Are Working Memory Measures Free of Socioeconomic Influence?

Purpose: This study evaluated the impact of socioeconomic factors on children's performance on tests of working memory and vocabulary.Method: Twenty Brazilian children, aged 6 and 7 years, from low-income families, completed tests of working memory ( verbal short-term memory and verbal complex span) and vocabulary ( expressive and receptive). A further group of Brazilian children from families of higher socioeconomic status matched for age, gender, and nonverbal ability also participated in the study.Results: Children from the low socioeconomic group obtained significantly lower scores on measures of expressive and receptive vocabulary than their higher income peers but no significant group differences were found on the working memory measures.Conclusion: Measures of working memory provide assessments of cognitive abilities that appear to be impervious to substantial differences in socioeconomic background. As these measures are highly sensitive to language ability and learning in general, they appear to provide useful methods for diagnosing specific learning difficulties that are independent of environmental opportunity.

Automaticity in L2 learning: Correlation between vocabulary proficiency and response time in word recognition

Automaticity (in this essay defined as short response time) and fluency in language use are closely connected to each other and some research has been conducted regarding some of the aspects involved. In fact, the notion of automaticity is still debated and many definitions and opinions on what automaticity is have been suggested (Andersson,1987, 1992, 1993, Logan, 1988, Segalowitz, 2010). One aspect that still needs more research is the correlation between vocabulary proficiency (a person’s knowledge about words and ability to use them correctly) and response time in word recognition. Therefore, the aim of this study has been to investigate this correlation using two different tests; one vocabulary size test (Paul Nation) and one lexical decision task (SuperLab) that measures both response time and accuracy. 23 Swedish students partaking in the English 7 course in upper secondary Swedish school were tested. The data were analyzed using a quantitative method where the average values and correlations from the test were used to compare the results. The correlations were calculated using Pearson’s Coefficient Correlations Calculator. The empirical study indicates that vocabulary proficiency is not strongly correlated with shorter response times in word recognition. Rather, the data indicate that L2 learners instead are sensitive to the frequency levels of the vocabulary. The accuracy (number of correct recognized words) and response times correlate with the frequency level of the tested words. This indicates that factors other than vocabulary proficiency are important for the ability to recognize words quickly.

Treating Jarrod: A core vocabulary approach

This paper is the final paper in a special issue of Advances in Speech-Language Pathology. The paper presents an intervention case study of a 7 year old child with severe phonological difficulties described in Holm and Crosbie (2006). Dodd et al (2006) hypothesised that Jarrod had an underlying deficit of generating phonological plans for word production and suggested that Jarrod would benefit from core vocabulary therapy. This paper reports on one block of core vocabulary therapy undertaken with Jarrod. Pre- and post-intervention measures showed that Jarrod made significant progress. His speech became more consistent and his accuracy (percent consonants correct) increased.

THE RELATIVE SIGNIFICANCE OF SYNTACTIC KNOWLEDGE AND VOCABULARY KNOWLEDGE IN SECOND LANGUAGE LISTENING COMPREHENSION

The main purpose of the current study was to examine the role of vocabulary knowledge (VK) and syntactic knowledge (SK) in L2 listening comprehension, as well as their relative significance. Unlike previous studies, the current project employed assessment tasks to measure aural and proceduralized VK and SK. In terms of VK, to avoid under-representing the construct, measures of both breadth (VB) and depth (VD) were included. Additionally, the current study examined the role of VK and SK by accounting for individual differences in two important cognitive factors in L2 listening: metacognitive knowledge (MK) and working memory (WM). Also, to explore the role of VK and SK more fully, the current study accounted for the negative impact of anxiety on WM and L2 listening. The study was carried out in an English as a Foreign Language (EFL) context, and participants were 263 Iranian learners at a wide range of English proficiency from lower-intermediate to advanced. Participants took a battery of ten linguistic, cognitive and affective measures. Then, the collected data were subjected to several preliminary analyses, but structural equation modeling (SEM) was then used as the primary analysis method to answer the study research questions. Results of the preliminary analyses revealed that MK and WM were significant predictors of L2 listening ability; thus, they were kept in the main SEM analyses. The significant role of WM was only observed when the negative effect of anxiety on WM was accounted for. Preliminary analyses also showed that VB and VD were not distinct measures of VK. However, the results also showed that if VB and VD were considered separate, VD was a better predictor of L2 listening success. The main analyses of the current study revealed a significant role for both VK and SK in explaining success in L2 listening comprehension, which differs from findings from previous empirical studies. However, SEM analysis did not reveal a statistically significant difference in terms of the predictive power of the two linguistic factors. Descriptive results of the SEM analysis, along with results from regression analysis, indicated to a more significant role for VK.

Vocabulary Comprehension in Children with Autism

An open question in autism research is how to assess language abilities in this population. We investigated language development in monolingual and bilingual children with varying degrees of autism, ages 3 to 9, with the aim of better understanding vocabulary comprehension. Two different methodologies were used: the Receptive One-Word Picture Vocabulary Test (ROWPVT) and eye-tracker technique. We examined whether the eye-tracker could help in the assessment of these children because it does not require the child to point during the test. Four typically developing control children, 14 monolingual English children with moderate/mild autism, and 4 children (2 monolingual English, 2 bilingual Spanish/English) with severe autism were tested and the results of the ROWPVT test were compared to the eye-tracker results. Interestingly, bilingual children with severe autism had better results using eye-tracker than the traditional ROWPVT test. These results suggest that these children know more vocabulary than traditional test measures indicate.

On Ordinal VC-Dimension and Some Notions of Complexity

We generalize the classical notion of Vapnik–Chernovenkis (VC) dimension to ordinal VC-dimension, in the context of logical learning paradigms. Logical learning paradigms encompass the numerical learning paradigms commonly studied in Inductive Inference. A logical learning paradigm is defined as a set W of structures over some vocabulary, and a set D of first-order formulas that represent data. The sets of models of ϕ in W, where ϕ varies over D, generate a natural topology W over W. We show that if D is closed under boolean operators, then the notion of ordinal VC-dimension offers a perfect characterization for the problem of predicting the truth of the members of D in a member of W, with an ordinal bound on the number of mistakes. This shows that the notion of VC-dimension has a natural interpretation in Inductive Inference, when cast into a logical setting. We also study the relationships between predictive complexity, selective complexity—a variation on predictive complexity—and mind change complexity. The assumptions that D is closed under boolean operators and that W is compact often play a crucial role to establish connections between these concepts. We then consider a computable setting with effective versions of the complexity measures, and show that the equivalence between ordinal VC-dimension and predictive complexity fails. More precisely, we prove that the effective ordinal VC-dimension of a paradigm can be defined when all other effective notions of complexity are undefined. On a better note, when W is compact, all effective notions of complexity are defined, though they are not related as in the noncomputable version of the framework.