Reasoning about natural language phrases for semantic goal driven exploration

This paper presents a symbolic navigation system that uses spatial language descriptions to inform goal-directed exploration in unfamiliar office environments. An abstract map is created from a collection of natural language phrases describing the spatial layout of the environment. The spatial representation in the abstract map is controlled by a constraint based interpretation of each natural language phrase. In goal-directed exploration of an unseen office environment, the robot links the information in the abstract map to observed symbolic information and its grounded world representation. This paper demonstrates the ability of the system, in both simulated and real-world trials, to efficiently find target rooms in environments that it has never been to previously. In three unexplored environments, it is shown that on average the system travels only 8.42% further than the optimal path when using only natural language phrases to complete navigation tasks.

Language learning in infancy

Although immensely complex, speech is also a very efficient means of communication between humans. Understanding how we acquire the skills necessary for perceiving and producing speech remains an intriguing goal for research. However, while learning is likely to begin as soon as we start hearing speech, the tools for studying the language acquisition strategies in the earliest stages of development remain scarce. One prospective strategy is statistical learning. In order to investigate its role in language development, we designed a new research method. The method was tested in adults using magnetoencephalography (MEG) as a measure of cortical activity. Neonatal brain activity was measured with electroencephalography (EEG). Additionally, we developed a method for assessing the integration of seen and heard syllables in the developing brain as well as a method for assessing the role of visual speech when learning phoneme categories. The MEG study showed that adults learn statistical properties of speech during passive listening of syllables. The amplitude of the N400m component of the event-related magnetic fields (ERFs) reflected the location of syllables within pseudowords. The amplitude was also enhanced for syllables in a statistically unexpected position. The results suggest a role for the N400m component in statistical learning studies in adults. Using the same research design with sleeping newborn infants, the auditory event-related potentials (ERPs) measured with EEG reflected the location of syllables within pseudowords. The results were successfully replicated in another group of infants. The results show that even newborn infants have a powerful mechanism for automatic extraction of statistical characteristics from speech. We also found that 5-month-old infants integrate some auditory and visual syllables into a fused percept, whereas other syllable combinations are not fully integrated. Auditory syllables were paired with visual syllables possessing a different phonetic identity, and the ERPs for these artificial syllable combinations were compared with the ERPs for normal syllables. For congruent auditory-visual syllable combinations, the ERPs did not differ from those for normal syllables. However, for incongruent auditory-visual syllable combinations, we observed a mismatch response in the ERPs. The results show an early ability to perceive speech cross-modally. Finally, we exposed two groups of 6-month-old infants to artificially created auditory syllables located between two stereotypical English syllables in the formant space. The auditory syllables followed, equally for both groups, a unimodal statistical distribution, suggestive of a single phoneme category. The visual syllables combined with the auditory syllables, however, were different for the two groups, one group receiving visual stimuli suggestive of two separate phoneme categories, the other receiving visual stimuli suggestive of only one phoneme category. After a short exposure, we observed different learning outcomes for the two groups of infants. The results thus show that visual speech can influence learning of phoneme categories. Altogether, the results demonstrate that complex language learning skills exist from birth. They also suggest a role for the visual component of speech in the learning of phoneme categories.

Origins of the sex differences in handedness and mental rotation ability : genetic, environmental and hormonal effects

In humans, well-replicated and robust sex differences in cognitive functions exist for handedness and mental rotation ability. A common characteristic in human cognitive functions is the lateralization of language functions. Handedness is a common measure of laterality and is related to language lateralization. The prevalence of left-handedness is higher in males than in females, the male to female ratio being about 1.2. Among cognitive abilities, the largest sex difference is evident in the Vandenberg and Kuse Mental Rotation Test (MRT), which requires the ability to rotate objects in mental space. On average, males achieve scores one standard deviation higher than females in the MRT. The present thesis investigated the origins of the sex differences in laterality and spatial ability as represented by handedness and mental rotation ability, respectively. Two population-based Finnish twin cohorts were utilized in this study. Handedness was studied in 25 810 twins and 4068 singletons born before 1958 from the Older Finnish Twin Cohort, and in 4736 twins born in 1983-87 from the FinnTwin12. MRT was studied in a sub-sample of 804 young adult participants from the FinnTwin12 sample. The main findings of this study were: 1) the prevalence of left-handedness was higher among males than among females in both singletons and in twins; 2) males had significantly higher scores than females in MRT; 3) about one quarter of the variance in handedness and about half of the variance in MRT was explained by genetic effects, whereas the remainder of the variance in these traits was explained by environmental effects unique to each individual. The magnitude of the genetic effects was similar in both sexes; 4) left-handedness was significantly less common in female co-twins of a male than in female co-twins of a female, and female co-twins of a male scored significantly higher than did female co-twins of a female in the Mental Rotation Test. This dissertation discusses whether these differences between females from opposite- and same-sex twin pairs are due to the prenatal transfer of testosterone from the male fetus in females with male co-twins or whether they arise from postnatal socialization effects.

Paraphrastic language models and combination with neural network language models

In natural languages multiple word sequences can represent the same underlying meaning. Only modelling the observed surface word sequence can result in poor context coverage, for example, when using n-gram language models (LM). To handle this issue, paraphrastic LMs were proposed in previous research and successfully applied to a US English conversational telephone speech transcription task. In order to exploit the complementary characteristics of paraphrastic LMs and neural network LMs (NNLM), the combination between the two is investigated in this paper. To investigate paraphrastic LMs' generalization ability to other languages, experiments are conducted on a Mandarin Chinese broadcast speech transcription task. Using a paraphrastic multi-level LM modelling both word and phrase sequences, significant error rate reductions of 0.9% absolute (9% relative) and 0.5% absolute (5% relative) were obtained over the baseline n-gram and NNLM systems respectively, after a combination with word and phrase level NNLMs. © 2013 IEEE.

Attention during social interaction in children with autism: Comparison to specific language impairment, typical development, and links to cognition

Eye-tracking studies have shown how people with autism spend significantly less time looking at socially relevant information on-screen compared to those developing typically. This has been suggested to impact on the development of socio-cognitive skills in autism. We present novel evidence of how attention atypicalities in children with autism extend to real-life interaction, in comparison to typically developing (TD) children and children with specific language impairment (SLI). We explored the allocation of attention during social interaction with an interlocutor, and how aspects of attention (awareness checking) related to traditional measures of social cognition (false belief attribution). We found divergent attention allocation patterns across the groups in relation to social cognition ability. Even though children with autism and SLI performed similarly on the socio- cognitive tasks, there were syndrome-specific atypicalities of their attention patterns. Children with SLI were most similar to TD children in terms of prioritising attention to socially pertinent information (eyes, face, awareness checking). Children with autism showed reduced attention to the eyes and face, and slower awareness checking. This study provides unique and timely insight into real-world social gaze (a)typicality in autism, SLI and typical development, its relationship to socio-cognitive ability, and raises important issues for intervention.

Language evolution and recursion : an empirical investigation of human hierarchical processing

Tese de doutoramento, Ciências Biomédicas (Neurociências), Universidade de Lisboa, Faculdade de Medicina, 2014

Phonological and articulation treatment approaches in Portuguese children with speech and language impairments: a randomized controlled intervention study

Background: In Portugal, the routine clinical practice of speech and language therapists (SLTs) in treating children with all types of speech sound disorder (SSD) continues to be articulation therapy (AT). There is limited use of phonological therapy (PT) or phonological awareness training in Portugal. Additionally, at an international level there is a focus on collecting information on and differentiating between the effectiveness of PT and AT for children with different types of phonologically based SSD, as well as on the role of phonological awareness in remediating SSD. It is important to collect more evidence for the most effective and efficient type of intervention approach for different SSDs and for these data to be collected from diverse linguistic and cultural perspectives. Aims: To evaluate the effectiveness of a PT and AT approach for treatment of 14 Portuguese children, aged 4.0–6.7 years, with a phonologically based SSD. Methods & Procedures: The children were randomly assigned to one of the two treatment approaches (seven children in each group). All children were treated by the same SLT, blind to the aims of the study, over three blocks of a total of 25 weekly sessions of intervention. Outcome measures of phonological ability (percentage of consonants correct (PCC), percentage occurrence of different phonological processes and phonetic inventory) were taken before and after intervention. A qualitative assessment of intervention effectiveness from the perspective of the parents of participants was included. Outcomes & Results: Both treatments were effective in improving the participants’ speech, with the children receiving PT showing a more significant improvement in PCC score than those receiving the AT. Children in the PT group also showed greater generalization to untreated words than those receiving AT. Parents reported both intervention approaches to be as effective in improving their children’s speech. Conclusions & Implications: The PT (combination of expressive phonological tasks, phonological awareness, listening and discrimination activities) proved to be an effective integrated method of improving phonological SSD in children. These findings provide some evidence for Portuguese SLTs to employ PT with children with phonologically based SSD

Validity, reliability and responsiveness of the French language translation of the Western Ontario Shoulder Instability Index (WOSI).

BACKGROUND: The WOSI (Western Ontario Shoulder Instability Index) is a self-administered quality of life questionnaire designed to be used as a primary outcome measure in clinical trials on shoulder instability, as well as to measure the effect of an intervention on any particular patient. It is validated and is reliable and sensitive. As it is designed to measure subjective outcome, it is important that translation should be methodologically rigorous, as it is subject to both linguistic and cultural interpretation. OBJECTIVE: To produce a French language version of the WOSI that is culturally adapted to both European and North American French-speaking populations. MATERIALS AND METHODS: A validated protocol was used to create a French language WOSI questionnaire (WOSI-Fr) that would be culturally acceptable for both European and North American French-speaking populations. Reliability and responsiveness analyses were carried out, and the WOSI-Fr was compared to the F-QuickDASH-D/S (Disability of the Arm, Shoulder and Hand-French translation), and Walch-Duplay scores. RESULTS: A French language version of the WOSI (WOSI-Fr) was accepted by a multinational committee. The WOSI-Fr was then validated using a total of 144 native French-speaking subjects from Canada and Switzerland. Comparison of results on two WOSI-Fr questionnaires completed at a mean interval of 16 days showed that the WOSI-Fr had strong reliability, with a Pearson and interclass correlation of r=0.85 (P=0.01) and ICC=0.84 [95% CI=0.78-0.88]. Responsiveness, at a mean 378.9 days after surgical intervention, showed strong correlation with that of the F-QuickDASH-D/S, with r=0.67 (P<0.01). Moreover, a standardized response means analysis to calculate effect size for both the WOSI-Fr and the F-QuickDASH-D/S showed that the WOSI-Fr had a significantly greater ability to detect change (SRM 1.55 versus 0.87 for the WOSI-Fr and F-QuickDASH-D/S respectively, P<0.01). The WOSI-Fr showed fair correlation with the Walch-Duplay. DISCUSSION: A French-language translation of the WOSI questionnaire was created and validated for use in both Canadian and Swiss French-speaking populations. This questionnaire will facilitate outcome assessment in French-speaking settings, collaboration in multinational studies and comparison between studies performed in different countries. TYPE OF STUDY: Multicenter cohort study. LEVEL OF EVIDENCE: II.

The effectiveness of a multisensory writing program in improving cursive writing ability in children with sensorimotor difficulties

It is estimated that five to ten percent of children experience sensory motor difficulties that result in various learnlng disabilitiies , among them. inabllity to output Information on paper in the appropriate manner (Ayres ,1985). The relationship between sensorimotorabillty and handwriting is well documented in the literature (Freeman,1917; Townsend , 1951; Nlkola-Ll sa, 1987). While much of the literature is inconclusive, there are findings to suggest that muitisensory handwriting programmes are an effective approach to improvlng writing abIlity in these chlldren. For a number of years, Occupational Therapists have been involved in the remediation of handwriting utllizing , amongst other approaches . multisensory programmes. While subjective assessments of effectiveness have been extremerly positive. scientIfic evaluation has been minimal . If further intervention in this area is to occur, it Is essential that the profession be able to justify the existence of such programmes . The purpose of this study was to examine what effects a multlsensory writing prog~am would have on the curslve writing ability of chlldren with sensorimotor dlfficulties. A single case with multiple baselines across be havlours design was used , with the behavlours being cursive writing abilIty of fIve distInct letter groups. The fIve groups were taught in random order, one group every two weeks , In a one-hour session. Repeated measurements of writing speed and qualIty for each letter group were made. This design was repeated over three other cases . Results of the study yielded statistical signifi cance in trend changes In specIfic letter groups for all of the chlldren following interventlon. One child achieved statistical significance In the overall change In quality , while none of the children achieved overall statistical significance In speed score changes . Teacher reports and an assessment of written language prior to and following the program suggest that Intervention may have had a positive effect on self-confidence in written output, and on the maturlty of written expression in some of the cases . Further research in this field is needed to validate the continual use of multisensory writing programmes by Occupational Theraplsts worklng with this specific population and to provide some directlon with regards to the Integration of multlsensory writing programmes within the regular academic remedial programme .

The effects of a language intervention program on the phonological and word awareness skills of language-delayed kindergarten children

Over the past decade, research has suggested that phonological and word awareness skills (i.e., the ability to reflect on and manipulate the components of language) are important for early reading acquisition. This study examined the phonological and word awareness skills of language-delayed kindergarten children at the beginning and end of a language intervention program using five tasks. The results were compared to the performances of average kindergarten children who did not participate in the language intervention program. There were significant performance differences for all tasks, favouring the average children, at the beginning of the intervention program. However, at the end of the training interval, the languagedelayed children performed as well as the average children.

The generation effect and word learning: a test of the effect of the language experience approach versus the text approach in the acquisition of new reading vocabulary

A class of twenty-two grade one children was tested to determine their reading levels using the Stanford Diagnostic Reading Achievement Test. Based on these results and teacher input the students were paired according to reading ability. The students ages ranged from six years four months to seven years four months at the commencement of the study. Eleven children were assigned to the language experience group and their partners became the text group. Each member of the language experience group generated a list of eight to be learned words. The treatment consisted of exposing the student to a given word three times per session for ten sessions, over a period of five days. The dependent variables consisted of word identification speed, word identification accuracy, and word recognition accuracy. Each member of the text group followed the same procedure using his/her partner's list of words. Upon completion of this training, the entire process was repeated with members of the text group from the first part becoming members of the language experience group and vice versa. The results suggest that generally speaking language experience words are identified faster than text words but that there is no difference in the rate at which these words are learned. Language experience words may be identified faster because the auditory-semantic information is more readily available in them than in text words. The rate of learning in both types of words, however, may be dictated by the orthography of the to be learned word.

Identifying language needs of ESL students in a Canadian university based intensive English language program

This study investigated the needs of adult ESL learners intending to pursue higher education in Canada. Its chief purpose was to enable educators and administrators to design ESL programs that would prepare students to function at optimal levels in academic and social settings during their university studies. The study adopted a mixed research method that was predominantly qualitative in its orientation and narrative in its implementation. It focused on an Intensive English Language Program (IELP) offered at an Ontario university. Using a holistic approach, the study sought to represent the various perspectives of all the participants in the program: the students, the instructors, and the administrators. Analysis of both qualitative and quantitative data gathered from 17 students, 6 instructors, and 1 administrator in the IELP showed that to a large extent the academic needs ofESL learners in the IELP were generally not being met. Most notably, the study found that learners were not receiving sufficient training in speaking and listening skills, a factor that contributed to their sense of insecurity and lack of confidence in their ability to communicate successfully in academic and social settings. The study also revealed that the solutions to many of the problems it identified lay not in the classroom but in the way the ESL program was structured administratively. One major recommendation to come out of the study is that programs like the IELP should be restructured so as to give them greater flexibility in meeting individual needs. While the study labored under certain limitations and did not achieve all of its goals, it did succeed in creating awareness ofthe problems and in establishing a methodological approach that can serve as a framework within which future research may be conducted in this somewhat neglected area.

The effects of training in the tracking procedure on the speechreading ability of two profoundly hearing-impaired children

This paper discusses a study to determine whether training employing in the tracking procedure would prove beneficial to profoundly hearing-impaired children in comprehension of spoken language.

The effect and the use of the typewriter upon the reading and language of deaf children

This paper discusses a study to determine if the use of a typewriter had an effect on the reading ability of hearing impaired children.

Research review: reading comprehension in developmental disorders of language and communication

Background: Deficits in reading airment (SLI), Down syndrome (DS) and autism spectrum disorders (ASD). Methods: In this review (based on a search of the ISI Web of Knowledge database to 2011), the Simple View of Reading is used as a framework for considering reading comprehension in these groups. Conclusions: There is substantial evidence for reading comprehension impairments in SLI and growing evidence that weaknesses in this domain are common in DS and ASD. Further, in these groups reading comprehension is typically more impaired than word recognition. However, there is also evidence that some children and adolescents with DS, ASD and a history of SLI develop reading comprehension and word recognition skills at or above the age appropriate level. This review of the literature indicates that factors including word recognition, oral language, nonverbal ability and working memory may explain reading comprehension difficulties in SLI, DS and ASD. In addition, it highlights methodological issues, implications of poor reading comprehension and fruitful areas for future research.