Social perception and cognition : processing of gestures, postures and facial expressions in the human brain

Humans are a social species with the internal capability to process social information from other humans. To understand others behavior and to react accordingly, it is necessary to infer their internal states, emotions and aims, which are conveyed by subtle nonverbal bodily cues such as postures, gestures, and facial expressions. This thesis investigates the brain functions underlying the processing of such social information. Studies I and II of this thesis explore the neural basis of perceiving pain from another person s facial expressions by means of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). In Study I, observing another s facial expression of pain activated the affective pain system (previously associated with self-experienced pain) in accordance with the intensity of the observed expression. The strength of the response in anterior insula was also linked to the observer s empathic abilities. The cortical processing of facial pain expressions advanced from the visual to temporal-lobe areas at similar latencies (around 300 500 ms) to those previously shown for emotional expressions such as fear or disgust. Study III shows that perceiving a yawning face is associated with middle and posterior STS activity, and the contagiousness of a yawn correlates negatively with amygdalar activity. Study IV explored the brain correlates of interpreting social interaction between two members of the same species, in this case human and canine. Observing interaction engaged brain activity in very similar manner for both species. Moreover, the body and object sensitive brain areas of dog experts differentiated interaction from noninteraction in both humans and dogs whereas in the control subjects, similar differentiation occurred only for humans. Finally, Study V shows the engagement of the brain area associated with biological motion when exposed to the sounds produced by a single human being walking. However, more complex pattern of activation, with the walking sounds of several persons, suggests that as the social situation becomes more complex so does the brain response. Taken together, these studies demonstrate the roles of distinct cortical and subcortical brain regions in the perception and sharing of others internal states via facial and bodily gestures, and the connection of brain responses to behavioral attributes.

Sensory auditory processing and intuitive sound detection : an investigation of musical experts and nonexperts

The auditory system can detect occasional changes (deviants) in acoustic regularities without the need for subjects to focus their attention on the sound material. Deviant detection is reflected in the elicitation of the mismatch negativity component (MMN) of the event-related potentials. In the studies presented in this thesis, the MMN is used to investigate the auditory abilities for detecting similarities and regularities in sound streams. To investigate the limits of these processes, professional musicians have been tested in some of the studies. The results show that auditory grouping is already more advanced in musicians than in nonmusicians and that the auditory system of musicians can, unlike that of nonmusicians, detect a numerical regularity of always four tones in a series. These results suggest that sensory auditory processing in musicians is not only a fine tuning of universal abilities, but is also qualitatively more advanced than in nonmusicians. In addition, the relationship between the auditory change-detection function and perception is examined. It is shown that, contrary to the generally accepted view, MMN elicitation does not necessarily correlate with perception. The outcome of the auditory change-detection function can be implicit and the implicit knowledge of the sound structure can, after training, be utilized for behaviorally correct intuitive sound detection. These results illustrate the automatic character of the sensory change detection function.

Cognitive Functioning in Young Adults with Depression, Anxiety Disorders, or Burnout Symptoms : Findings from a Population-based Sample

Background. Evidence of cognitive dysfunction in depressive and anxiety disorders is growing. However, the neuropsychological profile of young adults has received only little systematic investigation, although depressive and anxiety disorders are major public health problems for this age group. Available studies have typically failed to account for psychiatric comorbidity, and samples derived from population-based settings have also seldom been investigated. Burnout-related cognitive functioning has previously been investigated in only few studies, again all using clinical samples and wide age groups. Aims. Based on the information gained by conducting a comprehensive review, studies on cognitive impairment in depressive and anxiety disorders among young adults are rare. The present study examined cognitive functioning in young adults with a history of unipolar depressive or anxiety disorders in comparison to healthy peers, and associations of current burnout symptoms with cognitive functioning, in a population-based setting. The aim was also to determine whether cognitive deficits vary as a function of different disorder characteristics, such as severity, psychiatric comorbidity, age at onset, or the treatments received. Methods. Verbal and visual short-term memory, verbal long-term memory and learning, attention, psychomotor processing speed, verbal intelligence, and executive functioning were measured in a population-based sample of 21-35 year olds. Performance was compared firstly between participants with pure non-psychotic depression (n=68) and healthy peers (n=70), secondly between pure (n=69) and comorbid depression (n=57), and thirdly between participants with anxiety disorders (n=76) and healthy peers (n=71). The diagnostic procedure was based on the SCID interview. Fourthly, the associations of current burnout symptoms, measured with the Maslach Burnout Inventory General Survey, and neuropsychological test performance were investigated among working young adults (n=225). Results. Young adults with depressive or anxiety disorders, with or without psychiatric comorbidity, were not found to have major cognitive impairments when compared to healthy peers. Only mildly compromised verbal learning was found among depressed participants. Pure and comorbid depression groups did not differ in cognitive functioning, either. Among depressed participants, those who had received treatment showed more impaired verbal memory and executive functioning, and earlier onset corresponded with more impaired executive functioning. In anxiety disorders, psychotropic medication and low psychosocial functioning were associated with deficits in executive functioning, psychomotor processing speed, and visual short-term memory. Current burnout symptoms were associated with better performance in verbal working memory and verbal intelligence. However, lower examiner-rated social and occupational functioning was associated with problems in verbal attention, memory, and learning. Conclusions. Depression, anxiety disorders, or burnout symptoms may not be associated with major cognitive deficits among young adults derived from the general population. Even psychiatric comorbidity may not aggravate cognitive functioning in depressive or anxiety disorders among these young adults. However, treatment-seeking in depression was found to be associated with cognitive deficits, suggesting that these deficits relate to increased distress. Additionally, early-onset depression, found to be associated with executive dysfunction, may represent a more severe form of the disorder. In anxiety disorders, those with low symptom-related psychosocial functioning may have cognitive impairment. An association with self-reported burnout symptoms and cognitive deficits was not detected, but individuals with low social and occupational functioning may have impaired cognition.

Cognitive deficits and the Paced Auditory Serial Addition Test performance among patients with multiple sclerosis

Multiple sclerosis (MS) is a chronic, inflammatory disease of the central nervous system, characterized especially by myelin and axon damage. Cognitive impairment in MS is common but difficult to detect without a neuropsychological examination. Valid and reliable methods are needed in clinical practice and research to detect deficits, follow their natural evolution, and verify treatment effects. The Paced Auditory Serial Addition Test (PASAT) is a measure of sustained and divided attention, working memory, and information processing speed, and it is widely used in MS patients neuropsychological evaluation. Additionally, the PASAT is the sole cognitive measure in an assessment tool primarly designed for MS clinical trials, the Multiple Sclerosis Functional Composite (MSFC). The aims of the present study were to determine a) the frequency, characteristics, and evolution of cognitive impairment among relapsing-remitting MS patients, and b) the validity and reliability of the PASAT in measuring cognitive performance in MS patients. The subjects were 45 relapsing-remitting MS patients from Seinäjoki Central Hospital, Department of Neurology and 48 healthy controls. Both groups underwent comprehensive neuropsychological assessments, including the PASAT, twice in a one-year follow-up, and additionally a sample of 10 patients and controls were evaluated with the PASAT in serial assessments five times in one month. The frequency of cognitive dysfunction among relapsing-remitting MS patients in the present study was 42%. Impairments were characterized especially by slowed information processing speed and memory deficits. During the one-year follow-up, the cognitive performance was relatively stable among MS patients on a group level. However, the practice effects in cognitive tests were less pronounced among MS patients than healthy controls. At an individual level the spectrum of MS patients cognitive deficits was wide in regards to their characteristics, severity, and evolution. The PASAT was moderately accurate in detecting MS-associated cognitive impairment, and 69% of patients were correctly classified as cognitively impaired or unimpaired when comprehensive neuropsychological assessment was used as a "gold standard". Self-reported nervousness and poor arithmetical skills seemed to explain misclassifications. MS-related fatigue was objectively demonstrated as fading performance towards the end of the test. Despite the observed practice effect, the reliability of the PASAT was excellent, and it was sensitive to the cognitive decline taking place during the follow-up in a subgroup of patients. The PASAT can be recommended for use in the neuropsychological assessment of MS patients. The test is fairly sensitive, but less specific; consequently, the reasons for low scores have to be carefully identified before interpreting them as clinically significant.

Neurochemical regulation of auditory information processing studied with EEG/MEG: application to schizophrenia

Cognitive impairments of attention, memory and executive functions are a fundamental feature of the pathophysiology of schizophrenia. The neurophysiological and neurochemical changes in the auditory cortex are shown to underlie cognitive impairmentsin schizophrenia patients. Functional state of the neural substrate of auditory information processing could be objectively and non-invasively probed with auditory event-related potentials (ERPs) and event- related fields (ERFs). In the current work, we explored the neurochemical effect on the neural origins of auditory information processing in relation to schizophrenia. By means of ERPs/ERFs we aimed to determine how neural substrates of auditory information processing are modulated by antipsychotic medication in schizophrenia spectrum patients (Studies I, II) and by neuropharmacological challenges in healthy human subjects (Studies III, IV). First, with auditory ERPs we investigated the effects of olanzapine (Study I) and risperidone (Study II) in a group of patients with schizophrenia spectrum disorders. After 2 and 4 weeks of treatment, olanzapine has no significant effects on mismatch negativity(MMN) and P300, which, as it has been suggested, respectively reflect preattentive and attention-dependent information processing. After 2 weeks of treatment, risperidone has no significant effect on P300, however risperidone reduces P200 amplitude. This latter effect of risperidone on neural resources responsible for P200 generation could be partly explained through the action of dopamine. Subsequently, we used simultaneous EEG/MEG to investigate the effects of memantine (Study III) and methylphenidate (Study IV) in healthy subjects. We found that memantine modulates MMN response without changing other ERP components. This could be interpreted as being due to the possible influence of memantine through the NMDA receptors on auditory change- detection mechanism, with processing of auditory stimuli remaining otherwise unchanged. Further, we found that methylphenidate does not modulate the MMN response. This finding could indicate no association between catecholaminergic activities and electrophysiological measures of preattentive auditory discrimination processes reflected in the MMN. However, methylphenidate decreases the P200 amplitudes. This could be interpreted as a modulation of auditory information processing reflected in P200 by dopaminergic and noradrenergic systems. Taken together, our set of studies indicates a complex pattern of neurochemical influences produced by the antipsychotic drugs in the neural substrate of auditory information processing in patients with schizophrenia spectrum disorders and by the pharmacological challenges in healthy subjects studied with ERPs and ERFs.

Towards automated content analysis of discussion transcripts: A cognitive presence case

In this paper, we present the results of an exploratory study that examined the problem of automating content analysis of student online discussion transcripts. We looked at the problem of coding discussion transcripts for the levels of cognitive presence, one of the three main constructs in the Community of Inquiry (CoI) model of distance education. Using Coh-Metrix and LIWC features, together with a set of custom features developed to capture discussion context, we developed a random forest classification system that achieved 70.3% classification accuracy and 0.63 Cohen's kappa, which is significantly higher than values reported in the previous studies. Besides improvement in classification accuracy, the developed system is also less sensitive to overfitting as it uses only 205 classification features, which is around 100 times less features than in similar systems based on bag-of-words features. We also provide an overview of the classification features most indicative of the different phases of cognitive presence that gives an additional insights into the nature of cognitive presence learning cycle. Overall, our results show great potential of the proposed approach, with an added benefit of providing further characterization of the cognitive presence coding scheme.

Religion Explained? : A Philosophical Appraisal of the Cognitive Science of Religion

This study examines philosophically the main theories and methodological assumptions of the field known as the cognitive science of religion (CSR). The study makes a philosophically informed reconstruction of the methodological principles of the CSR, indicates problems with them, and examines possible solutions to these problems. The study focuses on several different CSR writers, namely, Scott Atran, Justin Barrett, Pascal Boyer and Dan Sperber. CSR theorising is done in the intersection between cognitive sciences, anthropology and evolutionary psychology. This multidisciplinary nature makes CSR a fertile ground for philosophical considerations coming from philosophy of psychology, philosophy of mind and philosophy of science. The study begins by spelling out the methodological assumptions and auxiliary theories of CSR writers by situating these theories and assumptions in the nexus of existing approaches to religion. The distinctive feature of CSR is its emphasis on information processing: CSR writers claim that contemporary cognitive sciences can inform anthropological theorising about the human mind and offer tools for producing causal explanations. Further, they claim to explain the prevalence and persistence of religion by cognitive systems that undergird religious thinking. I also examine the core theoretical contributions of the field focusing mainly on the (1) “minimally counter-intuitiveness hypothesis” and (2) the different ways in which supernatural agent representations activate our cognitive systems. Generally speaking, CSR writers argue for the naturalness of religion: religious ideas and practices are widespread and pervasive because human cognition operates in such a way that religious ideas are easy to acquire and transmit. The study raises two philosophical problems, namely, the “problem of scope” and the “problem of religious relevance”. The problem of scope is created by the insistence of several critics of the CSR that CSR explanations are mostly irrelevant for explaining religion. Most CSR writers themselves hold that cognitive explanations can answer most of our questions about religion. I argue that the problem of scope is created by differences in explanation-begging questions: the former group is interested in explaining different things than the latter group. I propose that we should not stick too rigidly to one set of methodological assumptions, but rather acknowledge that different assumptions might help us to answer different questions about religion. Instead of adhering to some robust metaphysics as some strongly naturalistic writers argue, we should adopt a pragmatic and explanatory pluralist approach which would allow different kinds of methodological presuppositions in the study of religion provided that they attempt to answer different kinds of why-questions, since religion appears to be a multi-faceted phenomenon that spans over a variety of fields of special sciences. The problem of religious relevance is created by the insistence of some writers that CSR theories show religious beliefs to be false or irrational, whereas others invoke CSR theories to defend certain religious ideas. The problem is interesting because it reveals the more general philosophical assumptions of those who make such interpretations. CSR theories can (and have been) interpreted in terms of three different philosophical frameworks: strict naturalism, broad naturalism and theism. I argue that CSR theories can be interpreted inside all three frameworks without doing violence to the theories and that these frameworks give different kinds of results regarding the religious relevance of CSR theories.

Genetic background of bipolar disorder and related cognitive impairments

Bipolar disorder (BP) is a complex psychiatric disorder characterized by episodes of mania and depression. BP affects approximately 1% of the world’s population and shows no difference in lifetime prevalence between males and females. BP arises from complex interactions among genetic, developmental and environmental factors, and it is likely that several predisposing genes are involved in BP. The genetic background of BP is still poorly understood, although intensive and long-lasting research has identified several chromosomal regions and genes involved in susceptibility to BP. This thesis work aims to identify the genetic variants that influence bipolar disorder in the Finnish population by candidate gene and genome-wide linkage analyses in families with many BP cases. In addition to diagnosis-based phenotypes, neuropsychological traits that can be seen as potential endophenotypes or intermediate traits for BP were analyzed. In the first part of the thesis, we examined the role of the allelic variants of the TSNAX/DISC1 gene cluster to psychotic and bipolar spectrum disorders and found association of distinct allelic haplotypes with these two groups of disorders. The haplotype at the 5’ end of the Disrupted-in-Schizophrenia-1 gene (DISC1) was over-transmitted to males with psychotic disorder (p = 0.008; for an extended haplotype p = 0.0007 with both genders), whereas haplotypes at the 3’ end of DISC1 associated with bipolar spectrum disorder (p = 0.0002; for an extended haplotype p = 0.0001). The variants of these haplotypes also showed association with different cognitive traits. The haplotypes at the 5’ end associated with perseverations and auditory attention, while the variants at the 3’ end associated with several cognitive traits including verbal fluency and psychomotor processing speed. Second, in our complete set of BP families with 723 individuals we studied six functional candidate genes from three distinct signalling systems: serotonin-related genes (SLC6A4 and TPH2), BDNF -related genes (BDNF, CREB1 and NTRK2) and one gene related to the inflammation and cytokine system (P2RX7). We replicated association of the functional variant Val66Met of BDNF with BP and better performance in retention. The variants at the 5’ end of SLC6A4 also showed some evidence of association among males (p = 0.004), but the widely studied functional variants did not yield any significant results. A protective four-variant haplotype on P2RX7 showed evidence of association with BP and executive functions: semantic and phonemic fluency (p = 0.006 and p = 0.0003, respectively). Third, we analyzed 23 bipolar families originating from the North-Eastern region of Finland. A genome-wide scan was performed using the 6K single nucleotide polymorphism (SNP) array. We identified susceptibility loci at chromosomes 7q31 with a LOD score of 3.20 and at 9p13.1 with a LOD score of 4.02. We followed up both linkage findings in the complete set of 179 Finnish bipolar families. The finding on chromosome 9p13 was supported (maximum LOD score of 3.02), but the susceptibility gene itself remains unclarified. In the fourth part of the thesis, we wanted to test the role of the allelic variants that have associated with bipolar disorder in recent genome-wide association studies (GWAS). We could confirm findings for the DFNB31, SORCS2, SCL39A3, and DGKH genes. The best signal in this study comes from DFNB31, which remained significant after multiple testing corrections. Two variants of SORCS2 were allelic replications and presented the same signal as the haplotype analysis. However, no association was detected with the PALB2 gene, which was the most significantly associated region in the previous GWAS. Our results indicate that BP is heterogeneous and its genetic background may accordingly vary in different populations. In order to fully understand the allelic heterogeneity that underlies common diseases such as BP, complete genome sequencing for many individuals with and without the disease is required. Identification of the specific risk variants will help us better understand the pathophysiology underlying BP and will lead to the development of treatments with specific biochemical targets. In addition, it will further facilitate the identification of environmental factors that alter risk, which will potentially provide improved occupational, social and psychological advice for individuals with high risk of BP.

Cognitive Functioning in Alcohol and Other Substance Use Disorders in Young Adulthood : A Genetic Epidemiological Study

Alcohol and other substance use disorders (SUDs) result in great costs and suffering for individuals and families and constitute a notable public health burden. A multitude of factors, ranging from biological to societal, are associated with elevated risk of SUDs, but at the level of individuals, one of the best predictors is a family history of SUDs. Genetically informative twin and family studies have consistently indicated this familial risk to be mainly genetic. In addition, behavioral and temperamental factors such as early initiation of substance use and aggressiveness are associated with the development of SUDs. These familial, behavioral and temperamental risk factors often co-occur, but their relative importance is not well known. People with SUDs have also been found to differ from healthy controls in various domains of cognitive functioning, with poorer verbal ability being among the most consistent findings. However, representative population-based samples have rarely been used in neuropsychological studies of SUDs. In addition, both SUDs and cognitive abilities are influenced by genetic factors, but whether the co-variation of these traits might be partly explained by overlapping genetic influences has not been studied. Problematic substance use also often co-occurs with low educational level, but it is not known whether these outcomes share part of their underlying genetic influences. In addition, educational level may moderate the genetic etiology of alcohol problems, but gene-environment interactions between these phenomena have also not been widely studied. The incidence of SUDs peaks in young adulthood rendering epidemiological studies in this age group informative. This thesis investigated cognitive functioning and other correlates of SUDs in young adulthood in two representative population-based samples of young Finnish adults, one of which consisted of monozygotic and dizygotic twin pairs enabling genetically informative analyses. Using data from the population-based Mental Health in Early Adulthood in Finland (MEAF) study (n=605), the lifetime prevalence of DSM-IV any substance dependence or abuse among persons aged 21—35 years was found to be approximately 14%, with a majority of the diagnoses being alcohol use disorders. Several correlates representing the domains of behavioral and affective factors, parental factors, early initiation of substance use, and educational factors were individually associated with SUDs. The associations between behavioral and affective factors (attention or behavior problems at school, aggression, anxiousness) and SUDs were found to be largely independent of factors from other domains, whereas daily smoking and low education were still associated with SUDs after adjustment for behavioral and affective factors. Using a wide array of neuropsychological tests in the MEAF sample and in a subsample (n=602) of the population-based FinnTwin16 (FT16) study, consistent evidence of poorer verbal cognitive ability related to SUDs was found. In addition, participants with SUDs performed worse than those without disorders in a task assessing psychomotor processing speed in the MEAF sample, whereas no evidence of more specific cognitive deficits was found in either sample. Biometrical structural equation models of the twin data suggested that both alcohol problems and verbal ability had moderate heritabilities (0.54—0.72), and that their covariation could be explained by correlated genetic influences (genetic correlations -0.20 to -0.31). The relationship between educational level and alcohol problems, studied in the full epidemiological FT16 sample (n=4,858), was found to reflect both genetic correlation and gene-environment interaction. The co-occurrence of low education and alcohol problems was influenced by overlapping genetic factors. In addition, higher educational level was associated with increased relative importance of genetic influences on alcohol problems, whereas environmental influences played a more important role in young adults with lower education. In conclusion, SUDs, especially alcohol abuse and dependence, are common among young Finnish adults. Behavioral and affective factors are robustly related to SUDs independently of many other factors, and compared to healthy peers, young adults who have had SUDs during their life exhibit significantly poorer verbal cognitive ability, and possibly less efficient psychomotor processing. Genetic differences between individuals explain a notable proportion of individual differences in risk of alcohol dependence, verbal ability, and educational level, and the co-occurrence of alcohol problems with poorer verbal cognition and low education is influenced by shared genetic backgrounds. Finally, various environmental factors related to educational level in young adulthood moderate the relative importance of genetic factors influencing the risk of alcohol problems, possibly reflecting differences in social control mechanisms related to educational level.

Cognitive functioning and its heritability in bipolar I disorder

Bipolar I disorder is a severe psychiatric disorder characterized by episodic mood alterations that can be manic, depressive or mixed. Bipolar disorder seems to be highly genetic, but the etiology of this complex disorder has remained elusive. In recent years, studies have found that euthymic patients with bipolar disorder may have impairments particularly in executive functioning, verbal learning and memory. These impairments may be present also among some of the relatives of these patients, who may be vulnerable to the disorder. Using neuropsychological variables as endophenotypes, i.e. intermediate phenotypes between genes and the phenotypes, has been suggested to aid search for the etiological background of the disorder, but evidence is sparse on whether these variables fulfill the criteria for endophenotypes. The present thesis is part of the Genetic Epidemiology and Molecular Genetics of Severe Mental Disorders in Finland project. The specific aim was to investigate whether neuropsychological test variables would indicate genetic liability to the disorder and could therefore be regarded as endophenotypes. Thus, cognitive functions and their heritability were studied in bipolar I disorder patients and in their unaffected first-degree relatives from a population-based sample of families, comparing them to a population-based control group. In order to add homogeneity to the subgroups of bipolar disorder patients and their relatives, cognitive functions and their heritability were further studied in a group of families affected by bipolar I disorder only (bipolar families) and another group of families affected by both bipolar I disorder and schizophrenia or schizoaffective disorders (mixed families). Finally, the effect of processing speed on other cognitive functions was investigated. The study showed that especially executive functioning and processing speed fulfilled the endophenotype criteria. Impairments in these functions were found in bipolar patients and in their relatives irrespective of other severe psychopathology in the family. These functions were highly heritable in these families. Study also showed that generalized impairment in verbal memory may associate more with bipolar disorder than to vulnerability to other psychotic disorders, and be more related to fully developed disease; impairments in verbal learning and memory were found only in patients, and they were not found to be highly heritable. Finally, the most potential endophenotype, i.e. processing speed, seemed to contribute to a range of other cognitive dysfunctions seen in bipolar disorder patients. Processing speed, in particular, has also been shown to be a valid endophenotype in subsequent association analyses in psychiatric genetics in Finland and internationally. Information concerning cognitive impairments and their association with the psychosocial consequences of bipolar disorder is important in planning treatment. It is also important to understand and acknowledge that patients may have cognitive impairments that affect their everyday life. Psychosocial interventions and neuropsychological rehabilitation may supplement other conventional treatments for bipolar patients.

Neurocognitive processing of inflected and derived words

The representation of morphologically complex words in the mental lexicon and their neurocognitive processing has been a vigorously debated topic in psycholinguistics and the cognitive neuroscience of language. This thesis investigates the effect of stimulus modality on morphological processing, the spatiotemporal dynamics of the neural processing of inflected (e.g., work+ed ) and derived (e.g., work+er ) words and their interaction, using the Finnish language. Overall, the results suggest that the constituent morphemes of isolated written and spoken inflected words are accessed separately, whereas spoken derived words activate both their full form and the constituent morphemes. The processing of both spoken and written inflected words elicited larger N400 responses than monomorphemic words (Study I), whereas the responses to spoken derived words did not differ from those to monomorphemic words (Study IV). Spoken inflected words elicited a larger left-lateralized negativity and greater source strengths in the left temporal cortices than derived words (Study IV). Thus, the results suggest different cortical processing for derived and inflected words. Moreover, the neural mechanisms underlying inflection and derivation seem to be not only different, but also independent as indexed by the linear summation of the responses to derived and inflected stimuli in a combined (derivation+inflection) condition (Study III). Furthermore, the processing of meaningless, spoken derived pseudowords was more difficult than for existing derived words, indexed by a larger N400-type effect for the pseudowords. However, no differences were observed between meaningful derived pseudowords and existing derived words (Study II). The results of Study II suggest that semantic compatibility between morphemes seems to have a crucial role in a successful morphological analysis. As a methodological note, time-locking the auditory event-related potentials/fields (ERP/ERF) to the suffix onset revealed the processes related to morphological analysis more precisely (Studies II and IV), which also enables comparison of the neural processes in different modalities (Study I).

Linguistic and perceptual processing of communicative cues in Asperger Syndrome

Asperger Syndrome (AS) belongs to autism spectrum disorders where both verbal and non-verbal communication difficulties are at the core of the impairment. Social communication requires a complex use of affective, linguistic-cognitive and perceptual processes. In the four studies included in the current thesis, some of the linguistic and perceptual factors that are important for face-to-face communication were studied using behavioural methods. In all four studies the results obtained from individuals with AS were compared with typically developed age, gender and IQ matched controls. First, the language skills of school-aged children were characterized in detail with standardized tests that measured different aspects of receptive and expressive language (Study I). The children with AS were found to be worse than the controls in following complex verbal instructions. Next, the visual perception of facial expressions of emotion with varying degrees of visual detail was examined (Study II). Adults with AS were found to have impaired recognition of facial expressions on the basis of very low spatial frequencies which are important for processing global information. Following that, multisensory perception was investigated by looking at audiovisual speech perception (Studies III and IV). Adults with AS were found to perceive audiovisual speech qualitatively differently from typically developed adults, although both groups were equally accurate in recognizing auditory and visual speech presented alone. Finally, the effect of attention on audiovisual speech perception was studied by registering eye gaze behaviour (Study III) and by studying the voluntary control of visual attention (Study IV). The groups did not differ in eye gaze behaviour or in the voluntary control of visual attention. The results of the study series demonstrate that many factors underpinning face-to-face social communication are atypical in AS. In contrast with previous assumptions about intact language abilities, the current results show that children with AS have difficulties in understanding complex verbal instructions. Furthermore, the study makes clear that deviations in the perception of global features in faces expressing emotions as well as in the multisensory perception of speech are likely to harm face-to-face social communication.

Bayesian Decentralized Spectrum Sensing in Cognitive Radio Networks

This paper considers the problem of spectrum sensing, i.e., the detection of whether or not a primary user is transmitting data by a cognitive radio. The Bayesian framework is adopted, with the performance measure being the probability of detection error. A decentralized setup, where N sensors use M observations each to arrive at individual decisions that are combined at a fusion center to form the overall decision is considered. The unknown fading channel between the primary sensor and the cognitive radios makes the individual decision rule computationally complex, hence, a generalized likelihood ratio test (GLRT)-based approach is adopted. Analysis of the probabilities of false alarm and miss detection of the proposed method reveals that the error exponent with respect to M is zero. Also, the fusion of N individual decisions offers a diversity advantage, similar to diversity reception in communication systems, and a tight bound on the error exponent is presented. Through an analysis in the low power regime, the number of observations needed as a function of received power, to achieve a given probability of error is determined. Monte-Carlo simulations confirm the accuracy of the analysis.

Database Independent Human Emotion Recognition with Meta-Cognitive Neuro-Fuzzy Inference System

Facial emotions are the most expressive way to display emotions. Many algorithms have been proposed which employ a particular set of people (usually a database) to both train and test their model. This paper focuses on the challenging task of database independent emotion recognition, which is a generalized case of subject-independent emotion recognition. The emotion recognition system employed in this work is a Meta-Cognitive Neuro-Fuzzy Inference System (McFIS). McFIS has two components, a neuro-fuzzy inference system, which is the cognitive component and a self-regulatory learning mechanism, which is the meta-cognitive component. The meta-cognitive component, monitors the knowledge in the neuro-fuzzy inference system and decides on what-to-learn, when-to-learn and how-to-learn the training samples, efficiently. For each sample, the McFIS decides whether to delete the sample without being learnt, use it to add/prune or update the network parameter or reserve it for future use. This helps the network avoid over-training and as a result improve its generalization performance over untrained databases. In this study, we extract pixel based emotion features from well-known (Japanese Female Facial Expression) JAFFE and (Taiwanese Female Expression Image) TFEID database. Two sets of experiment are conducted. First, we study the individual performance of both databases on McFIS based on 5-fold cross validation study. Next, in order to study the generalization performance, McFIS trained on JAFFE database is tested on TFEID and vice-versa. The performance The performance comparison in both experiments against SVNI classifier gives promising results.

Action Recognition from Motion Capture Data using Meta-cognitive RBF Network Classifier

Action recognition plays an important role in various applications, including smart homes and personal assistive robotics. In this paper, we propose an algorithm for recognizing human actions using motion capture action data. Motion capture data provides accurate three dimensional positions of joints which constitute the human skeleton. We model the movement of the skeletal joints temporally in order to classify the action. The skeleton in each frame of an action sequence is represented as a 129 dimensional vector, of which each component is a 31) angle made by each joint with a fixed point on the skeleton. Finally, the video is represented as a histogram over a codebook obtained from all action sequences. Along with this, the temporal variance of the skeletal joints is used as additional feature. The actions are classified using Meta-Cognitive Radial Basis Function Network (McRBFN) and its Projection Based Learning (PBL) algorithm. We achieve over 97% recognition accuracy on the widely used Berkeley Multimodal Human Action Database (MHAD).