Social perception and cognition : processing of gestures, postures and facial expressions in the human brain

Humans are a social species with the internal capability to process social information from other humans. To understand others behavior and to react accordingly, it is necessary to infer their internal states, emotions and aims, which are conveyed by subtle nonverbal bodily cues such as postures, gestures, and facial expressions. This thesis investigates the brain functions underlying the processing of such social information. Studies I and II of this thesis explore the neural basis of perceiving pain from another person s facial expressions by means of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). In Study I, observing another s facial expression of pain activated the affective pain system (previously associated with self-experienced pain) in accordance with the intensity of the observed expression. The strength of the response in anterior insula was also linked to the observer s empathic abilities. The cortical processing of facial pain expressions advanced from the visual to temporal-lobe areas at similar latencies (around 300 500 ms) to those previously shown for emotional expressions such as fear or disgust. Study III shows that perceiving a yawning face is associated with middle and posterior STS activity, and the contagiousness of a yawn correlates negatively with amygdalar activity. Study IV explored the brain correlates of interpreting social interaction between two members of the same species, in this case human and canine. Observing interaction engaged brain activity in very similar manner for both species. Moreover, the body and object sensitive brain areas of dog experts differentiated interaction from noninteraction in both humans and dogs whereas in the control subjects, similar differentiation occurred only for humans. Finally, Study V shows the engagement of the brain area associated with biological motion when exposed to the sounds produced by a single human being walking. However, more complex pattern of activation, with the walking sounds of several persons, suggests that as the social situation becomes more complex so does the brain response. Taken together, these studies demonstrate the roles of distinct cortical and subcortical brain regions in the perception and sharing of others internal states via facial and bodily gestures, and the connection of brain responses to behavioral attributes.

Dynamics of contour, object and face processing in the human visual cortex

The neural basis of visual perception can be understood only when the sequence of cortical activity underlying successful recognition is known. The early steps in this processing chain, from retina to the primary visual cortex, are highly local, and the perception of more complex shapes requires integration of the local information. In Study I of this thesis, the progression from local to global visual analysis was assessed by recording cortical magnetoencephalographic (MEG) responses to arrays of elements that either did or did not form global contours. The results demonstrated two spatially and temporally distinct stages of processing: The first, emerging 70 ms after stimulus onset around the calcarine sulcus, was sensitive to local features only, whereas the second, starting at 130 ms across the occipital and posterior parietal cortices, reflected the global configuration. To explore the links between cortical activity and visual recognition, Studies II III presented subjects with recognition tasks of varying levels of difficulty. The occipito-temporal responses from 150 ms onwards were closely linked to recognition performance, in contrast to the 100-ms mid-occipital responses. The averaged responses increased gradually as a function of recognition performance, and further analysis (Study III) showed the single response strengths to be graded as well. Study IV addressed the attention dependence of the different processing stages: Occipito-temporal responses peaking around 150 ms depended on the content of the visual field (faces vs. houses), whereas the later and more sustained activity was strongly modulated by the observers attention. Hemodynamic responses paralleled the pattern of the more sustained electrophysiological responses. Study V assessed the temporal processing capacity of the human object recognition system. Above sufficient luminance, contrast and size of the object, the processing speed was not limited by such low-level factors. Taken together, these studies demonstrate several distinct stages in the cortical activation sequence underlying the object recognition chain, reflecting the level of feature integration, difficulty of recognition, and direction of attention.

Human brain networks of auditory attention and working memory

This thesis examines brain networks involved in auditory attention and auditory working memory using measures of task performance, brain activity, and neuroanatomical connectivity. Auditory orienting and maintenance of attention were compared with visual orienting and maintenance of attention, and top-down controlled attention was compared to bottom-up triggered attention in audition. Moreover, the effects of cognitive load on performance and brain activity were studied using an auditory working memory task. Corbetta and Shulman s (2002) model of visual attention suggests that what is known as the dorsal attention system (intraparietal sulcus/superior parietal lobule, IPS/SPL and frontal eye field, FEF) is involved in the control of top-down controlled attention, whereas what is known as the ventral attention system (temporo-parietal junction, TPJ and areas of the inferior/middle frontal gyrus, IFG/MFG) is involved in bottom-up triggered attention. The present results show that top-down controlled auditory attention also activates IPS/SPL and FEF. Furthermore, in audition, TPJ and IFG/MFG were activated not only by bottom-up triggered attention, but also by top-down controlled attention. In addition, the posterior cerebellum and thalamus were activated by top-down controlled attention shifts and the ventromedial prefrontal cortex (VMPFC) was activated by to-be-ignored, but attention-catching salient changes in auditory input streams. VMPFC may be involved in the evaluation of environmental events causing the bottom-up triggered engagement of attention. Auditory working memory activated a brain network that largely overlapped with the one activated by top-down controlled attention. The present results also provide further evidence of the role of the cerebellum in cognitive processing: During auditory working memory tasks, both activity in the posterior cerebellum (the crus I/II) and reaction speed increased when the cognitive load increased. Based on the present results and earlier theories on the role of the cerebellum in cognitive processing, the function of the posterior cerebellum in cognitive tasks may be related to the optimization of response speed.

Cone beam computed tomography in oral radiology

In dentistry, basic imaging techniques such as intraoral and panoramic radiography are in most cases the only imaging techniques required for the detection of pathology. Conventional intraoral radiographs provide images with sufficient information for most dental radiographic needs. Panoramic radiography produces a single image of both jaws, giving an excellent overview of oral hard tissues. Regardless of the technique, plain radiography has only a limited capability in the evaluation of three-dimensional (3D) relationships. Technological advances in radiological imaging have moved from two-dimensional (2D) projection radiography towards digital, 3D and interactive imaging applications. This has been achieved first by the use of conventional computed tomography (CT) and more recently by cone beam CT (CBCT). CBCT is a radiographic imaging method that allows accurate 3D imaging of hard tissues. CBCT has been used for dental and maxillofacial imaging for more than ten years and its availability and use are increasing continuously. However, at present, only best practice guidelines are available for its use, and the need for evidence-based guidelines on the use of CBCT in dentistry is widely recognized. We evaluated (i) retrospectively the use of CBCT in a dental practice, (ii) the accuracy and reproducibility of pre-implant linear measurements in CBCT and multislice CT (MSCT) in a cadaver study, (iii) prospectively the clinical reliability of CBCT as a preoperative imaging method for complicated impacted lower third molars, and (iv) the tissue and effective radiation doses and image quality of dental CBCT scanners in comparison with MSCT scanners in a phantom study. Using CBCT, subjective identification of anatomy and pathology relevant in dental practice can be readily achieved, but dental restorations may cause disturbing artefacts. CBCT examination offered additional radiographic information when compared with intraoral and panoramic radiographs. In terms of the accuracy and reliability of linear measurements in the posterior mandible, CBCT is comparable to MSCT. CBCT is a reliable means of determining the location of the inferior alveolar canal and its relationship to the roots of the lower third molar. CBCT scanners provided adequate image quality for dental and maxillofacial imaging while delivering considerably smaller effective doses to the patient than MSCT. The observed variations in patient dose and image quality emphasize the importance of optimizing the imaging parameters in both CBCT and MSCT.

Restorative treatment practices and dentist-related factors

This study aimed at elucidating real-life aspects of restorative treatment practices. In addition, dentists' views and perceptions of and variation in restorative treatment practices with respect to dentist-related factors were evaluated. Reasons for placement and replacement of restoration, material selection, posterior restoration longevity, and the use of local anesthesia were assessed on two cross-sectional data sets. Data from the Helsinki Public Dental Service (PDS) included details on 3057 restorations performed by dentists (n=134) during routine clinical work in 2001. The other PDS data from Vantaa were based on 205 patient records of young adults containing information on 1969 restorations investigated retrospectively from 1994-1996 backwards; 51 dentists performed the restorations. In addition, dentists’ self-reported use of local anesthesia and estimates of restoration longevity were investigated by means of a nationwide questionnaire sent to 592 general dental practitioners selected by systematic sampling from the membership list of the Finnish Dental Association in 2004. All data sets included some background information on dentists such as gender, year of birth or graduation, and working sector. In PDS in 2001, primary caries was the reason for placement of restoration more often among patients aged under 19 years than among older patients (p<0.001). Among patients over 36 years of age, replacements represented the majority. Regarding dentist-related factors, replacements of restorations were made by younger dentists more frequently than by older dentists (p<0.001). In PDS in 1994-1996, the replacement rate of posterior restorations was greater among female dentists than among male dentists (p=0.01), especially for amalgams (p=0.008). The mean age of replaced posterior restoration among young adults was 8.9 (SD 5.2) years for amalgam and 2.4 (SD 1.4) years for tooth-colored restorations, the actual replacement rate for all existing posterior restorations being 7% in PDS in 1994-1996. Of all restorative materials used, a clear majority (69%) were composites in PDS in 2001. Local anesthesia was used in 48% of cases and more frequently for older patients (55%) than for patients aged under 13 years (35%) (p<0.001). Younger dentists more often used local anesthesia for primary restoration than did the older dentists (p<0.001), especially for primary teeth (p=0.005). Working sector had an impact on dentists’ self-reported use of local anesthesia and estimates of restoration longevity; public sector dentists reported using local anesthesia more frequently than private sector dentists for Class II (p=0.04) and for Class III restorations (p=0.01). Private sector dentists gave longer estimates of posterior composite longevity than public sector dentists (p=0.001). In conclusion, restorative treatment practices seem to vary according to patient age and also dentist-related factors. Replacements of restorations are common for adults. For children, clear underuse of local anesthesia prevails.

On probability-based inference under data missing by design

Whether a statistician wants to complement a probability model for observed data with a prior distribution and carry out fully probabilistic inference, or base the inference only on the likelihood function, may be a fundamental question in theory, but in practice it may well be of less importance if the likelihood contains much more information than the prior. Maximum likelihood inference can be justified as a Gaussian approximation at the posterior mode, using flat priors. However, in situations where parametric assumptions in standard statistical models would be too rigid, more flexible model formulation, combined with fully probabilistic inference, can be achieved using hierarchical Bayesian parametrization. This work includes five articles, all of which apply probability modeling under various problems involving incomplete observation. Three of the papers apply maximum likelihood estimation and two of them hierarchical Bayesian modeling. Because maximum likelihood may be presented as a special case of Bayesian inference, but not the other way round, in the introductory part of this work we present a framework for probability-based inference using only Bayesian concepts. We also re-derive some results presented in the original articles using the toolbox equipped herein, to show that they are also justifiable under this more general framework. Here the assumption of exchangeability and de Finetti's representation theorem are applied repeatedly for justifying the use of standard parametric probability models with conditionally independent likelihood contributions. It is argued that this same reasoning can be applied also under sampling from a finite population. The main emphasis here is in probability-based inference under incomplete observation due to study design. This is illustrated using a generic two-phase cohort sampling design as an example. The alternative approaches presented for analysis of such a design are full likelihood, which utilizes all observed information, and conditional likelihood, which is restricted to a completely observed set, conditioning on the rule that generated that set. Conditional likelihood inference is also applied for a joint analysis of prevalence and incidence data, a situation subject to both left censoring and left truncation. Other topics covered are model uncertainty and causal inference using posterior predictive distributions. We formulate a non-parametric monotonic regression model for one or more covariates and a Bayesian estimation procedure, and apply the model in the context of optimal sequential treatment regimes, demonstrating that inference based on posterior predictive distributions is feasible also in this case.

Bayesian fisheries stock assessment: integrating and updating knowledge

In this thesis the use of the Bayesian approach to statistical inference in fisheries stock assessment is studied. The work was conducted in collaboration of the Finnish Game and Fisheries Research Institute by using the problem of monitoring and prediction of the juvenile salmon population in the River Tornionjoki as an example application. The River Tornionjoki is the largest salmon river flowing into the Baltic Sea. This thesis tackles the issues of model formulation and model checking as well as computational problems related to Bayesian modelling in the context of fisheries stock assessment. Each article of the thesis provides a novel method either for extracting information from data obtained via a particular type of sampling system or for integrating the information about the fish stock from multiple sources in terms of a population dynamics model. Mark-recapture and removal sampling schemes and a random catch sampling method are covered for the estimation of the population size. In addition, a method for estimating the stock composition of a salmon catch based on DNA samples is also presented. For most of the articles, Markov chain Monte Carlo (MCMC) simulation has been used as a tool to approximate the posterior distribution. Problems arising from the sampling method are also briefly discussed and potential solutions for these problems are proposed. Special emphasis in the discussion is given to the philosophical foundation of the Bayesian approach in the context of fisheries stock assessment. It is argued that the role of subjective prior knowledge needed in practically all parts of a Bayesian model should be recognized and consequently fully utilised in the process of model formulation.

Bayesian Inference for Retrospective Population Genetics Models Using Markov Chain Monte Carlo Methods

Genetics, the science of heredity and variation in living organisms, has a central role in medicine, in breeding crops and livestock, and in studying fundamental topics of biological sciences such as evolution and cell functioning. Currently the field of genetics is under a rapid development because of the recent advances in technologies by which molecular data can be obtained from living organisms. In order that most information from such data can be extracted, the analyses need to be carried out using statistical models that are tailored to take account of the particular genetic processes. In this thesis we formulate and analyze Bayesian models for genetic marker data of contemporary individuals. The major focus is on the modeling of the unobserved recent ancestry of the sampled individuals (say, for tens of generations or so), which is carried out by using explicit probabilistic reconstructions of the pedigree structures accompanied by the gene flows at the marker loci. For such a recent history, the recombination process is the major genetic force that shapes the genomes of the individuals, and it is included in the model by assuming that the recombination fractions between the adjacent markers are known. The posterior distribution of the unobserved history of the individuals is studied conditionally on the observed marker data by using a Markov chain Monte Carlo algorithm (MCMC). The example analyses consider estimation of the population structure, relatedness structure (both at the level of whole genomes as well as at each marker separately), and haplotype configurations. For situations where the pedigree structure is partially known, an algorithm to create an initial state for the MCMC algorithm is given. Furthermore, the thesis includes an extension of the model for the recent genetic history to situations where also a quantitative phenotype has been measured from the contemporary individuals. In that case the goal is to identify positions on the genome that affect the observed phenotypic values. This task is carried out within the Bayesian framework, where the number and the relative effects of the quantitative trait loci are treated as random variables whose posterior distribution is studied conditionally on the observed genetic and phenotypic data. In addition, the thesis contains an extension of a widely-used haplotyping method, the PHASE algorithm, to settings where genetic material from several individuals has been pooled together, and the allele frequencies of each pool are determined in a single genotyping.

Computational Techniques for Haplotype Inference and for Local Alignment Significance

This thesis which consists of an introduction and four peer-reviewed original publications studies the problems of haplotype inference (haplotyping) and local alignment significance. The problems studied here belong to the broad area of bioinformatics and computational biology. The presented solutions are computationally fast and accurate, which makes them practical in high-throughput sequence data analysis. Haplotype inference is a computational problem where the goal is to estimate haplotypes from a sample of genotypes as accurately as possible. This problem is important as the direct measurement of haplotypes is difficult, whereas the genotypes are easier to quantify. Haplotypes are the key-players when studying for example the genetic causes of diseases. In this thesis, three methods are presented for the haplotype inference problem referred to as HaploParser, HIT, and BACH. HaploParser is based on a combinatorial mosaic model and hierarchical parsing that together mimic recombinations and point-mutations in a biologically plausible way. In this mosaic model, the current population is assumed to be evolved from a small founder population. Thus, the haplotypes of the current population are recombinations of the (implicit) founder haplotypes with some point--mutations. HIT (Haplotype Inference Technique) uses a hidden Markov model for haplotypes and efficient algorithms are presented to learn this model from genotype data. The model structure of HIT is analogous to the mosaic model of HaploParser with founder haplotypes. Therefore, it can be seen as a probabilistic model of recombinations and point-mutations. BACH (Bayesian Context-based Haplotyping) utilizes a context tree weighting algorithm to efficiently sum over all variable-length Markov chains to evaluate the posterior probability of a haplotype configuration. Algorithms are presented that find haplotype configurations with high posterior probability. BACH is the most accurate method presented in this thesis and has comparable performance to the best available software for haplotype inference. Local alignment significance is a computational problem where one is interested in whether the local similarities in two sequences are due to the fact that the sequences are related or just by chance. Similarity of sequences is measured by their best local alignment score and from that, a p-value is computed. This p-value is the probability of picking two sequences from the null model that have as good or better best local alignment score. Local alignment significance is used routinely for example in homology searches. In this thesis, a general framework is sketched that allows one to compute a tight upper bound for the p-value of a local pairwise alignment score. Unlike the previous methods, the presented framework is not affeced by so-called edge-effects and can handle gaps (deletions and insertions) without troublesome sampling and curve fitting.

From actin monomers to bundles: The roles of twinfilin and α-actinin in Drosophila melanogaster development

The actin cytoskeleton is essential for a large variety of cell biological processes. Actin exists in either a monomeric or a filamentous form, and it is very important for many cellular functions that the local balance between these two actin populations is properly regulated. A large number of proteins participate in the regulation of actin dynamics in the cell, and twinfilin, one of the proteins examined in this thesis, belongs to this category. The second level of regulation involves proteins that crosslink or bundle actin filaments, thereby providing the cell with a certain shape. α-Actinin, the second protein studied, mainly acts as an actin crosslinking protein. Both proteins are conserved in organisms ranging from yeast to mammals. In this thesis, the roles of twinfilin and α-actinin in development were examined using Drosophila melanogaster as a model organism. Twinfilin is an actin monomer binding protein that is structurally related to cofilin. In vitro, twinfilin reduces actin polymerisation by sequestering actin monomers. The Drosophila twinfilin (twf) gene was identified and found to encode a protein functionally similar to yeast and mammalian twinfilins. A strong hypomorphic twf mutation was identified, and flies homozygous for this allele were viable and fertile. The adult twf mutant flies displayed reduced viability, a rough eye phenotype and severely malformed bristles. The shape of the adult bristle is determined by the actin bundles that are regularly spaced around the perimeter of the developing pupal bristles. Examination of the twf pupal bristles revealed an increased level of filamentous actin, which in turn resulted in splitting and displacement of the actin bundles. The bristle defect was rescued by twf overexpression in developing bristles. The Twinfilin protein was localised at sites of actin filament assembly, where it was required to limit actin polymerisation. A genetic interaction between twinfilin and twinstar (the gene encoding Cofilin) was detected, consistent with the model predicting that both proteins act to limit the amount of filamentous actin. α-Actinin has been implicated in several diverse cell biological processes. In Drosophila, the only function for α-actinin yet known is in the organisation of the muscle sarcomere. Muscle and non-muscle cells utilise different α-actinin isoforms, which in Drosophila are produced by alternative splicing of a single gene. In this work, novel α-actinin deletion alleles, including ActnΔ233, were generated, which specifically disrupted the transcript encoding the non-muscle α-actinin isoform. Nevertheless, ActnΔ233 homozygous mutant flies were viable and fertile with no obvious defects. By comparing α-actinin protein distribution in wild type and ActnΔ233 mutant animals, it could be concluded that non-muscle α-actinin is the only isoform expressed in young embryos, in the embryonic central nervous system and in various actin-rich structures of the ovarian germline cells. In the ActnΔ233 mutant, α-actinin was detected not only in muscle tissue, but also in embryonic epidermal cells and in certain follicle cell populations in the ovaries. The population of α-actinin protein present in non-muscle cells of the ActnΔ233 mutant is referred to as FC-α-actinin (Follicle Cell). The follicular epithelium in the Drosophila ovary is a well characterised model system for studies on patterning and morphogenesis. Therefore, α-actinin expression, regulation and function in this tissue were further analysed. Examination of the α-actinin localisation pattern revealed that the basal actin fibres of the main body follicle cells underwent an organised remodelling during the final stages of oogenesis. This involved the assembly of a transient adhesion site in the posterior of the cell, in which α-actinin and Enabled (Ena) accumulated. Follicle cells genetically manipulated to lack all α-actinin isoforms failed to remodel their cytoskeleton and translocate Ena to the posterior of the cell, while the actin fibres as such were not affected. Neither was epithelial morphogenesis disrupted. The reorganisation of the basal actin cytoskeleton was also disturbed following ectopic expression of Decapentaplegic (Dpp) or as a result of a heat shock. At late oogenesis, the main body follicle cells express both non-muscle α-actinin and FC-α-actinin, while the dorsal anterior follicle cells express only non-muscle α-actinin. The dorsal anterior cells are patterned by the Dpp and Epidermal growth factor receptor (EGFR) signalling pathways, and they will ultimately secrete the dorsal appendages of the egg. Experiments involving ectopic activation of EGFR and Dpp signalling showed that FC-α-actinin is negatively regulated by combined EGFR and Dpp signalling. Ubiquitous overexpression of the adult muscle-specific α-actinin isoform induced the formation of aberrant actin bundles in migrating follicle cells that did not normally express FC-α-actinin, provided that the EGFR signalling pathway was activated in the cells. Taken together, this work contributes new data to our knowledge of α-actinin function and regulation in Drosophila. The cytoskeletal remodelling shown to depend on α-actinin function provides the first evidence that α-actinin has a role in the organisation of the cytoskeleton in a non-muscle tissue. Furthermore, the cytoskeletal remodelling constitutes a previously undescribed morphogenetic event, which may provide us with a model system for in vivo studies on adhesion dynamics in Drosophila.

Functional imaging of peripheral vision and dorsal stream function in the human cerebral cortex

Visual information processing in brain proceeds in both serial and parallel fashion throughout various functionally distinct hierarchically organised cortical areas. Feedforward signals from retina and hierarchically lower cortical levels are the major activators of visual neurons, but top-down and feedback signals from higher level cortical areas have a modulating effect on neural processing. My work concentrates on visual encoding in hierarchically low level cortical visual areas in human brain and examines neural processing especially in cortical representation of visual field periphery. I use magnetoencephalography and functional magnetic resonance imaging to measure neuromagnetic and hemodynamic responses during visual stimulation and oculomotor and cognitive tasks from healthy volunteers. My thesis comprises six publications. Visual cortex forms a great challenge for modeling of neuromagnetic sources. My work shows that a priori information of source locations are needed for modeling of neuromagnetic sources in visual cortex. In addition, my work examines other potential confounding factors in vision studies such as light scatter inside the eye which may result in erroneous responses in cortex outside the representation of stimulated region, and eye movements and attention. I mapped cortical representations of peripheral visual field and identified a putative human homologue of functional area V6 of the macaque in the posterior bank of parieto-occipital sulcus. My work shows that human V6 activates during eye-movements and that it responds to visual motion at short latencies. These findings suggest that human V6, like its monkey homologue, is related to fast processing of visual stimuli and visually guided movements. I demonstrate that peripheral vision is functionally related to eye-movements and connected to rapid stream of functional areas that process visual motion. In addition, my work shows two different forms of top-down modulation of neural processing in the hierachically lowest cortical levels; one that is related to dorsal stream activation and may reflect motor processing or resetting signals that prepare visual cortex for change in the environment and another local signal enhancement at the attended region that reflects local feed-back signal and may perceptionally increase the stimulus saliency.