FACSGen: a tool to synthesize emotional facial expressions through systematic manipulation of facial action units

To investigate the perception of emotional facial expressions, researchers rely on shared sets of photos or videos, most often generated by actor portrayals. The drawback of such standardized material is a lack of flexibility and controllability, as it does not allow the systematic parametric manipulation of specific features of facial expressions on the one hand, and of more general properties of the facial identity (age, ethnicity, gender) on the other. To remedy this problem, we developed FACSGen: a novel tool that allows the creation of realistic synthetic 3D facial stimuli, both static and dynamic, based on the Facial Action Coding System. FACSGen provides researchers with total control over facial action units, and corresponding informational cues in 3D synthetic faces. We present four studies validating both the software and the general methodology of systematically generating controlled facial expression patterns for stimulus presentation.

Prosodic abilities in Spanish and English children with Williams syndrome: a cross-linguistic study

The aim of this study was to compare the prosodic profiles of English and Spanish-speaking children with WS, examining cross-linguistic differences. Two groups of children with WS, English and Spanish, of similar chronological and nonverbal mental age, were compared on performance in expressive and receptive prosodic tasks from the Profiling Elements of Prosody in Speech-Communication (PEPS-C) battery in its English or Spanish version. Differences between the English and Spanish WS groups were found regarding the understanding of affect through prosodic means,using prosody to make words more prominent, and imitating different prosodic patterns. Such differences between the two WS groups on function prosody tasks mirrored the cross-linguistic differences already reported in typically developing children.

Spoken word recognition in adolescents with autism spectrum disorders and specific language impairment

Spoken word recognition, during gating, appears intact in specific language impairment (SLI). This study used gating to investigate the process in adolescents with autism spectrum disorders plus language impairment (ALI). Adolescents with ALI, SLI, and typical language development (TLD), matched on nonverbal IQ listened to gated words that varied in frequency (low/high) and number of phonological onset neighbors (low/high density). Adolescents with ALI required more speech input to initially identify low-frequency words with low competitor density than those with SLI and those with TLD, who did not differ. These differences may be due to less well specified word form representations in ALI.

Adult attachment orientation and implicit behavioral mimicry

We investigated whether adult attachment orientation predicted the extent to which individuals engaged in implicit behavioral mimicry of a confederate presented by video. Results demonstrated that following an attachment threat prime: (1) those low in attachment anxiety and high in attachment avoidance showed less mimicry of face-rubbing gestures than individuals low in both attachment avoidance and attachment anxiety; (2) those high in attachment anxiety and low in attachment avoidance showed less mimicry of face-rubbing gestures than individuals low in both attachment avoidance and attachment anxiety. Importantly, attachment orientation did not predict baseline levels of face-rubbing gesturing; demonstrating that attachment orientation had an effect on mimicry rather than overall behavior expression. Attachment anxiety was positively related to attraction to the confederate such that those higher in attachment anxiety rated the confederate as more attractive. The findings are discussed with reference to both the mimicry and attachment literatures.

Investigating orthographic and semantic aspects of word learning in poor comprehenders

This study compared orthographic and semantic aspects of word learning in children who differed in reading comprehension skill. Poor comprehenders and controls matched for age (9-10 years), nonverbal ability and decoding skill were trained to pronounce 20 visually presented nonwords, 10 in a consistent way and 10 in an inconsistent way. They then had an opportunity to infer the meanings of the new words from story context. Orthographic learning was measured in three ways: the number of trials taken to learn to pronounce nonwords correctly, orthographic choice and spelling. Across all measures, consistent items were easier than inconsistent items and poor comprehenders did not differ from control children. Semantic learning was assessed on three occasions, using a nonword-picture matching task. While poor comprehenders showed equivalent semantic learning to controls immediately after exposure to nonword meaning, this knowledge was not well retained over time. Results are discussed in terms of the language and reading skills of poor comprehenders and in relation to current models of reading development.

Research review: reading comprehension in developmental disorders of language and communication

Background: Deficits in reading airment (SLI), Down syndrome (DS) and autism spectrum disorders (ASD). Methods: In this review (based on a search of the ISI Web of Knowledge database to 2011), the Simple View of Reading is used as a framework for considering reading comprehension in these groups. Conclusions: There is substantial evidence for reading comprehension impairments in SLI and growing evidence that weaknesses in this domain are common in DS and ASD. Further, in these groups reading comprehension is typically more impaired than word recognition. However, there is also evidence that some children and adolescents with DS, ASD and a history of SLI develop reading comprehension and word recognition skills at or above the age appropriate level. This review of the literature indicates that factors including word recognition, oral language, nonverbal ability and working memory may explain reading comprehension difficulties in SLI, DS and ASD. In addition, it highlights methodological issues, implications of poor reading comprehension and fruitful areas for future research.

Wernicke’s aphasia reflects a combination of acoustic-phonological and semantic control deficits: A case-series comparison of Wernicke’s aphasia, semantic dementia and semantic aphasia

Wernicke’s aphasia (WA) is the classical neurological model of comprehension impairment and, as a result, the posterior temporal lobe is assumed to be critical to semantic cognition. This conclusion is potentially confused by (a) the existence of patient groups with semantic impairment following damage to other brain regions (semantic dementia and semantic aphasia) and (b) an ongoing debate about the underlying causes of comprehension impairment in WA. By directly comparing these three patient groups for the first time, we demonstrate that the comprehension impairment in Wernicke’s aphasia is best accounted for by dual deficits in acoustic-phonological analysis (associated with pSTG) and semantic cognition (associated with pMTG and angular gyrus). The WA group were impaired on both nonverbal and verbal comprehension assessments consistent with a generalised semantic impairment. This semantic deficit was most similar in nature to that of the semantic aphasia group suggestive of a disruption to semantic control processes. In addition, only the WA group showed a strong effect of input modality on comprehension, with accuracy decreasing considerably as acoustic-phonological requirements increased. These results deviate from traditional accounts which emphasise a single impairment and, instead, implicate two deficits underlying the comprehension disorder in WA.

Revealing and quantifying the impaired phonological analysis underpinning impaired comprehension in Wernicke’s aphasia

Wernicke’s aphasia is a condition which results in severely disrupted language comprehension following a lesion to the left temporo-parietal region. A phonological analysis deficit has traditionally been held to be at the root of the comprehension impairment in WA, a view consistent with current functional neuroimaging which finds areas in the superior temporal cortex responsive to phonological stimuli. However behavioural evidence to support the link between a phonological analysis deficit and auditory comprehension has not been yet shown. This study extends seminal work by Blumstein et al. (1977) to investigate the relationship between acoustic-phonological perception, measured through phonological discrimination, and auditory comprehension in a case series of Wernicke’s aphasia participants. A novel adaptive phonological discrimination task was used to obtain reliable thresholds of the phonological perceptual distance required between nonwords before they could be discriminated. Wernicke’s aphasia participants showed significantly elevated thresholds compared to age and hearing matched control participants. Acoustic-phonological thresholds correlated strongly with auditory comprehension abilities in Wernicke’s aphasia. In contrast, nonverbal semantic skills showed no relationship with auditory comprehension. The results are evaluated in the context of recent neurobiological models of language and suggest that impaired acoustic-phonological perception underlies the comprehension impairment in Wernicke’s aphasia and favour models of language which propose a leftward asymmetry in phonological analysis.

Fundamental deficits of auditory perception in Wernicke’s aphasia

Objective: This work investigates the nature of the comprehension impairment in Wernicke’s aphasia, by examining the relationship between deficits in auditory processing of fundamental, non-verbal acoustic stimuli and auditory comprehension. Wernicke’s aphasia, a condition resulting in severely disrupted auditory comprehension, primarily occurs following a cerebrovascular accident (CVA) to the left temporo-parietal cortex. Whilst damage to posterior superior temporal areas is associated with auditory linguistic comprehension impairments, functional imaging indicates that these areas may not be specific to speech processing but part of a network for generic auditory analysis. Methods: We examined analysis of basic acoustic stimuli in Wernicke’s aphasia participants (n = 10) using auditory stimuli reflective of theories of cortical auditory processing and of speech cues. Auditory spectral, temporal and spectro-temporal analysis was assessed using pure tone frequency discrimination, frequency modulation (FM) detection and the detection of dynamic modulation (DM) in “moving ripple” stimuli. All tasks used criterion-free, adaptive measures of threshold to ensure reliable results at the individual level. Results: Participants with Wernicke’s aphasia showed normal frequency discrimination but significant impairments in FM and DM detection, relative to age- and hearing-matched controls at the group level (n = 10). At the individual level, there was considerable variation in performance, and thresholds for both frequency and dynamic modulation detection correlated significantly with auditory comprehension abilities in the Wernicke’s aphasia participants. Conclusion: These results demonstrate the co-occurrence of a deficit in fundamental auditory processing of temporal and spectrotemporal nonverbal stimuli in Wernicke’s aphasia, which may have a causal contribution to the auditory language comprehension impairment Results are discussed in the context of traditional neuropsychology and current models of cortical auditory processing.

Individual differences and the role of the L1 in L2 processing: an ERP investigation

This study used ERP (event-related potentials) to examine both the role of the L1 and the role of individual differences in the processing of agreement violations. Theories of L2 acquisition differ with regard to whether or not native-like acquisition of L2 features is possible (Schwartz and Sprouse, 1994, 1996; Tsimpli and Mastropavlou, 2007), and the results of previous ERP studies are inconsistent when it comes to whether or not native-like processing is observed in response to L2 agreement violations (e.g., Sabourin, 2003; Tokowicz and MacWhinney, 2005). Furthermore, studies of learners in early stages of L2 acquisition have found variability in the emergence of native-like responses (e.g., McLaughlin et al., 2010; Tanner et al., 2009), but sources of variability have not been investigated. The current study examines responses to gender and number agreement violations in English-speaking learners of Spanish (n=24). Stimuli targeted agreement in three conditions: subject-verb agreement (el barco flota/*flotan), which is similar in Spanish and English; number agreement on adjectival predicates (la isla rocosa/*rocosas), a context in which agreement is not instantiated in English; and gender agreement on adjectival predicates (la isla rocosa/*rocoso), which is unique to Spanish. Grammaticality judgments and ERP responses were also tested for correlations with aptitude scores on the Modern Languages Aptitude Test (MLAT; Carroll and Sapon, 1959) and the Raven Advanced Progressive Matrices (Raven, 1965). Results are in line with theories that claim native-like processing is acquirable, since learners demonstrated similar ERP responses to a control group of native Spanish-speakers (n=8) with regard to all three agreement types. Additionally, the MLAT (but not the Raven) was significantly correlated with sensitivity to number violations, both in terms of grammaticality judgments and ERP amplitudes, indicating a role for verbal but not nonverbal aptitude in L2 processing.

Exploring writing in products in students with language impairments and autism spectrum disorders

Oral language skills scaffold written text production; students with oral language difficulties often experience writing problems. The current study examines the ways in which oral language problems experienced by students with language impairment (LI) and students with autism spectrum disorders (ASD) impact on their production of written text. One hundred and fifty seven participants (Mage = 10;2) with LI or ASD completed standardized measures of oral language, transcription, working memory, and nonverbal ability and produced a written narrative text assessed for productivity, grammatical accuracy, and quality. Measures of transcription, productivity, and grammatical accuracy, but not text quality, were poorer for students with LI. Transcription skills accounted for the majority of variance in the writing of the LI cohort. For the ASD cohort, handwriting, oral language and autism symptomatology were significant predictors. When students with ASD also experienced language problems, their performance was equivalent to that observed in the LI cohort.

Educational attainment in poor comprehenders

To date, only one study has investigated educational attainment in poor (reading) comprehenders, providing evidence of poor performance on national UK school tests at age 11 years relative to peers (Cain & Oakhill, 2006). In the present study, we adopted a longitudinal approach, tracking attainment on such tests from 11 years to the end of compulsory schooling in the UK (age 16 years). We aimed to investigate the proposal that educational weaknesses (defined as poor performance on national assessments) might become more pronounced over time, as the curriculum places increasing demands on reading comprehension. Participants comprised 15 poor comprehenders and 15 controls; groups were matched for chronological age, nonverbal reasoning ability and decoding skill. Children were identified at age 9 years using standardised measures of nonverbal reasoning, decoding and reading comprehension. These measures, along with a measure of oral vocabulary knowledge, were repeated at age 11 years. Data on educational attainment were collected from all participants (N = 30) at age 11 and from a subgroup (n = 21) at 16 years. Compared to controls, educational attainment in poor comprehenders was lower at ages 11 and 16 years, an effect that was significant at 11 years. When poor comprehenders were compared to national performance levels, they showed significantly lower performance at both time points. Low educational attainment was not evident for all poor comprehenders. Nonetheless, our findings point to a link between reading comprehension difficulties in mid to late childhood and poor educational outcomes at ages 11 and 16 years. At these ages, pupils in the UK are making key transitions: they move from primary to secondary schools at 11, and out of compulsory schooling at 16.

Linguistic relativity in SLA: towards a new research programme

The purpose of the current article is to support the investigation of linguistic relativity in second language acquisition and sketch methodological and theoretical prerequisites toward developing the domain into a full research program. We identify and discuss three theoretical-methodological components that we believe are needed to succeed in this enterprise. First, we highlight the importance of using nonverbal methods to study linguistic relativity effects in second language (L2) speakers. The use of nonverbal tasks is necessary in order to avoid the circularity that arises when inferences about nonverbal behavior are made on the basis of verbal evidence alone. Second, we identify and delineate the likely cognitive mechanisms underpinning cognitive restructuring in L2 speakers by introducing the theoretical framework of associative learning. By doing so, we demonstrate that the extent and nature of cognitive restructuring in L2 speakers is essentially a function of variation in individual learners’ trajectories. Third, we offer an in-depth discussion of the factors (e.g., L2 proficiency and L2 use) that characterize those trajectories, anchoring them to the framework of associative learning, and reinterpreting their relative strength in predicting L2 speaker cognition

Learning to think in a second language: effects of proficiency and length of exposure in English learners of German

The aim of the current study is to investigate motion event cognition in second language learners in a higher education learning context. Based on recent findings showing that speakers of grammatical aspect languages like English attend less to the endpoint (goal) of events than speakers of non-aspect languages like Swedish in a nonverbal categorization task involving working memory (Athanasopoulos & Bylund, 2013; Bylund & Athanasopoulos, this issue), the current study asks whether native speakers of an aspect language start paying more attention to event endpoints when learning a non-aspect language. Native English and German (a non-aspect language) speakers, and English learners of L2 German, who were pursuing studies in German language and literature at an English university, were asked to match a target scene with intermediate degree of endpoint orientation with two alternate scenes with low and high degree of endpoint orientation, respectively. Results showed that, when compared to the native English speakers, the learners of German were more prone to base their similarity judgements on endpoint saliency, rather than ongoingness, primarily as a function of increasing L2 proficiency and year of university study. Further analyses revealed a non-linear relationship between length of L2 exposure and categorization patterns, subserved by a progressive strengthening of the relationship between L2 proficiency and categorization as length of exposure increased. These findings present evidence that cognitive restructuring may occur through increasing experience with an L2, but also suggest that this relationship may be complex, and unfold over a long period of time.

Varieties of semantic ‘access’ deficit in Wernicke’s aphasia and semantic aphasia

Comprehension deficits are common in stroke aphasia, including in cases with (i) semantic aphasia (SA), characterised by poor executive control of semantic processing across verbal and nonverbal modalities, and (ii) Wernicke’s aphasia (WA), associated with poor auditory-verbal comprehension and repetition, plus fluent speech with jargon. However, the varieties of these comprehension problems, and their underlying causes, are not well-understood. Both patient groups exhibit some type of semantic ‘access’ deficit, as opposed to the ‘storage’ deficits observed in semantic dementia. Nevertheless, existing descriptions suggest these patients might have different varieties of ‘access’ impairment – related to difficulty resolving competition (in SA) vs. initial activation of concepts from sensory inputs (in WA). We used a case-series design to compare WA and SA patients on Warrington’s paradigmatic assessment of semantic ‘access’ deficits. In these verbal and non-verbal matching tasks, a small set of semantically-related items are repeatedly presented over several cycles so that the target on one trial becomes a distractor on another (building up interference and eliciting semantic ‘blocking’ effects). WA and SA patients were distinguished according to lesion location in the temporal cortex, but in each group, some individuals had additional prefrontal damage. Both of these aspects of lesion variability – one that mapped onto classical ‘syndromes’ and one that did not – predicted aspects of the semantic ‘access’ deficit. Both SA and WA cases showed multimodal semantic impairment, although as expected the WA group showed greater deficits on auditory-verbal than picture judgements. Distribution of damage in the temporal lobe was crucial for predicting the initially beneficial effects of stimulus repetition: WA cases showed initial improvement with repetition of words and pictures, while in SA, semantic access was initially good but declined in the face of competition from previous targets. Prefrontal damage predicted the harmful effects of repetition: the ability to re-select both word and picture targets in the face of mounting competition was linked to left prefrontal damage in both groups. Therefore, SA and WA patients have partially distinct impairment of semantic ‘access’ but, across these syndromes, prefrontal lesions produce declining comprehension with repetition in both verbal and non-verbal tasks.