Studies of working memory in interrupted human-computer interaction

Distraction in the workplace is increasingly more common in the information age. Several tasks and sources of information compete for a worker's limited cognitive capacities in human-computer interaction (HCI). In some situations even very brief interruptions can have detrimental effects on memory. Nevertheless, in other situations where persons are continuously interrupted, virtually no interruption costs emerge. This dissertation attempts to reveal the mental conditions and causalities differentiating the two outcomes. The explanation, building on the theory of long-term working memory (LTWM; Ericsson and Kintsch, 1995), focuses on the active, skillful aspects of human cognition that enable the storage of task information beyond the temporary and unstable storage provided by short-term working memory (STWM). Its key postulate is called a retrieval structure an abstract, hierarchical knowledge representation built into long-term memory that can be utilized to encode, update, and retrieve products of cognitive processes carried out during skilled task performance. If certain criteria of practice and task processing are met, LTWM allows for the storage of large representations for long time periods, yet these representations can be accessed with the accuracy, reliability, and speed typical of STWM. The main thesis of the dissertation is that the ability to endure interruptions depends on the efficiency in which LTWM can be recruited for maintaing information. An observational study and a field experiment provide ecological evidence for this thesis. Mobile users were found to be able to carry out heavy interleaving and sequencing of tasks while interacting, and they exhibited several intricate time-sharing strategies to orchestrate interruptions in a way sensitive to both external and internal demands. Interruptions are inevitable, because they arise as natural consequences of the top-down and bottom-up control of multitasking. In this process the function of LTWM is to keep some representations ready for reactivation and others in a more passive state to prevent interference. The psychological reality of the main thesis received confirmatory evidence in a series of laboratory experiments. They indicate that after encoding into LTWM, task representations are safeguarded from interruptions, regardless of their intensity, complexity, or pacing. However, when LTWM cannot be deployed, the problems posed by interference in long-term memory and the limited capacity of the STWM surface. A major contribution of the dissertation is the analysis of when users must resort to poorer maintenance strategies, like temporal cues and STWM-based rehearsal. First, one experiment showed that task orientations can be associated with radically different patterns of retrieval cue encodings. Thus the nature of the processing of the interface determines which features will be available as retrieval cues and which must be maintained by other means. In another study it was demonstrated that if the speed of encoding into LTWM, a skill-dependent parameter, is slower than the processing speed allowed for by the task, interruption costs emerge. Contrary to the predictions of competing theories, these costs turned out to involve intrusions in addition to omissions. Finally, it was learned that in rapid visually oriented interaction, perceptual-procedural expectations guide task resumption, and neither STWM nor LTWM are utilized due to the fact that access is too slow. These findings imply a change in thinking about the design of interfaces. Several novel principles of design are presented, basing on the idea of supporting the deployment of LTWM in the main task.

Psychologically-Based and Content-Oriented Experience in Entertainment Virtual Environments

In daily life, rich experiences evolve in every environmental and social interaction. Because experience has a strong impact on how people behave, scholars in different fields are interested in understanding what constitutes an experience. Yet even if interest in conscious experience is on the increase, there is no consensus on how such experience should be studied. Whatever approach is taken, the subjective and psychologically multidimensional nature of experience should be respected. This study endeavours to understand and evaluate conscious experiences. First I intro-duce a theoretical approach to psychologically-based and content-oriented experience. In the experiential cycle presented here, classical psychology and orienting-environmental content are connected. This generic approach is applicable to any human-environment interaction. Here I apply the approach to entertainment virtual environments (VEs) such as digital games and develop a framework with the potential for studying experiences in VEs. The development of the methodological framework included subjective and objective data from experiences in the Cave Automatic Virtual Environment (CAVE) and with numerous digital games (N=2,414). The final framework consisted of fifteen factor-analytically formed subcomponents of the sense of presence, involvement and flow. Together, these show the multidimensional experiential profile of VEs. The results present general experiential laws of VEs and show that the interface of a VE is related to (physical) presence, which psychologically means attention, perception and the cognitively evaluated realness and spatiality of the VE. The narrative of the VE elicits (social) presence and involvement and affects emotional outcomes. Psychologically, these outcomes are related to social cognition, motivation and emotion. The mechanics of a VE affect the cognitive evaluations and emotional outcomes related to flow. In addition, at the very least, user background, prior experience and use context affect the experiential variation. VEs are part of many peoples lives and many different outcomes are related to them, such as enjoyment, learning and addiction, depending on who is making the evalua-tion. This makes VEs societally important and psychologically fruitful to study. The approach and framework presented here contribute to our understanding of experiences in general and VEs in particular. The research can provide VE developers with a state-of-the art method (www.eveqgp.fi) that can be utilized whenever new product and service concepts are designed, prototyped and tested.

ICT and the Shaping of Society: Exploring Human -ICT Relationships in Everyday Life (summary section only)

This thesis explores the relationship between humans and ICTs (information and communication technologies). As ICTs are increasingly penetrating all spheres of social life, their role as mediators – between people, between people and information, and even between people and the natural world – is expanding, and they are increasingly shaping social life. Yet, we still know little of how our life is affected by their growing role. Our understanding of the actors and forces driving the accelerating adoption of new ICTs in all areas of life is also fairly limited. This thesis addresses these problems by interpretively exploring the link between ICTs and the shaping of society at home, in the office, and in the community. The thesis builds on empirical material gathered in three research projects, presented in four separate essays. The first project explores computerized office work through a case study. The second is a regional development project aiming at increasing ICT knowledge and use in 50 small-town families. In the third, the second project is compared to three other longitudinal development projects funded by the European Union. Using theories that consider the human-ICT relationship as intertwined, the thesis provides a multifaceted description of life with ICTs in contemporary information society. By oscillating between empirical and theoretical investigations and balancing between determinist and constructivist conceptualisations of the human-ICT relationship, I construct a dialectical theoretical framework that can be used for studying socio-technical contexts in society. This framework helps us see how societal change stems from the complex social processes that surround routine everyday actions. For example, interacting with and through ICTs may change individuals’ perceptions of time and space, social roles, and the proper ways to communicate – changes which at some point in time result in societal change in terms of, for example, new ways of acting and knowing things.

Implications of co-twin dependence for twins' social interactions, mental health and alcohol use : A follow-up study of Finnish twins from adolescence to early adulthood

Objective: The aim of the present study was to examine co-twin dependence and its impact on twins' social contacts, leisure-time activities and psycho-emotional well-being. The role of co-twin dependence was also examined as a moderator of genetic and environmental influences on alcohol use in adolescence and in early adulthood. Methods: The present report is based on the Finnish Twin Cohort Study (FinnTwin16), a population-based study of five consecutive birth cohorts of Finnish twins born in the years 1975-1979. Baseline assessments were collected through mailed questionnaires, within two months of the twins' sixteenth birthday yielding replies from 5563 twin individuals. All respondent twins were sent follow-up questionnaires at ages of 17, 18½, and in early adulthood, when twins were 22-27 years old. Measures: The questionnaires included a survey of health habits and attitudes, a symptom checklist and questions about twins' relationships with parents, peers and co-twin. Measures used were twins' self-reports of their own dependence and their co-twin's dependence at age 16, reports of twins' leisure-time activities and social contacts, alcohol use, psychological distress and somatic symptoms both in adolescence and in early adulthood. Results: In the present study 25.6% of twins reported dependence on their co-twin. There were gender and zygosity differences in dependence, females and MZ twins were more likely to report dependence than males and DZ twins. Co-twin dependence can be viewed on one hand as an individual characteristic, but on the other hand as a pattern of dyadic interaction that is mutually regulated and reciprocal. Most of the twins (80.7%) were either concordantly co-twin dependent or concordantly co-twin independent. The associations of co-twin dependence with twins' social interactions and psycho-emotional characteristics were relatively consistent both in adolescence and in early adulthood. Dependence was related to higher contact frequency and a higher proportion of shared leisure-time activities between twin siblings at the baseline and the follow-up. Additionally co-twin dependence was associated with elevated levels of psycho-emotional distress and somatic complaints, especially in adolescence. In the framework of gene-environment interaction, these results suggest that the genetic contribution to individual differences in drinking patterns is dependent on the nature of the pair-wise relationship of twin siblings. Conclusions: The results of this study indicate that co-twin dependence is a genuine feature of the co-twin relationship and shows the importance of studying the impact of various features of co-twin relationships on individual twins' social and psycho-emotional life and well-being. Our study also offers evidence that differences in inter-personal relationships contribute to the effects of genetic propensities.

Rannansiirtyminen ja ihmisen toimintaympäristön muutos Mätäjokilaakson alueella esihistoriallisella ajalla

In this thesis, I study the changing ladscape and human environment of the Mätäjoki Valley, West-Helsinki, using reconstructions and predictive modelling. The study is a part of a larger project funded by the city of Helsinki aming to map the past of the Mätäjoki Valley. The changes in landscape from an archipelago in the Ancylus Lake to a river valley are studied from 10000 to 2000 years ago. Alongside shore displacement, we look at the changing environment from human perspective and predict the location of dwelling sitesat various times. As a result, two map series were produced that show how the landscape changed and where inhabitance is predicted. To back them up, we have also looked at what previous research says about the history of the waterways, climate, vegetation and archaeology. The changing landscape of the river valley is reconstructed using GIS methods. For this purpose, new laser point data set was used and at the same time tested in the context landscape modelling. Dwelling sites were modeled with logistic regression analysis. The spatial predictive model combines data on the locations of the known dwelling sites, environmental factors and shore displacement data. The predictions were visualised into raster maps that show the predictions for inhabitance 3000 and 5000 years ago. The aim of these maps was to help archaeologists map potential spots for human activity. The produced landscape reconstructions clarified previous shore displacement studies of the Mätäjoki region and provided new information on the location of shoreline. From the shore displacement history of the Mätäjoki Valley arise the following stages: 1. The northernmost hills of the Mätäjoki Valley rose from Ancylus Lake approximately 10000 years ago. Shore displacement was fast during the following thousand years. 2. The area was an archipelago with a relatively steady shoreline 9000 7000 years ago. 8000 years ago the shoreline drew back in the middle and southern parts of the river valley because of the transgression of the Litorina Sea. 3. Mätäjoki was a sheltered bay of the Litorina Sea 6000 5000 years ago. The Vantaanjoki River started to flow into the Mätäjoki Valley approximately 5000 years ago. 4. The sediment plains in the southern part of the river valley rose from the sea rather quickly 5000 3000 years ago. Salt water still pushed its way into the southermost part of the valley 4000 years ago. 5. The shoreline proceeded to Pitäjänmäki rapids where it stayed at least a thousand years 3000 2000 years ago. The predictive models managed to predict the locations of dwelling sites moderately well. The most accurate predictions were found on the eastern shore and Malminkartano area. Of the environment variables sand and aspect of slope were found to have the best predictive power. From the results of this study we can conclude that the Mätäjoki Valley has been a favorable location to live especially 6000 5000 years ago when the climate was mild and vegetation lush. The laser point data set used here works best in shore displacement studies located in rural areas or if further specific palaeogeographic or hydrologic analysis in the research area is not needed.

Cognitive Functioning in Alcohol and Other Substance Use Disorders in Young Adulthood : A Genetic Epidemiological Study

Alcohol and other substance use disorders (SUDs) result in great costs and suffering for individuals and families and constitute a notable public health burden. A multitude of factors, ranging from biological to societal, are associated with elevated risk of SUDs, but at the level of individuals, one of the best predictors is a family history of SUDs. Genetically informative twin and family studies have consistently indicated this familial risk to be mainly genetic. In addition, behavioral and temperamental factors such as early initiation of substance use and aggressiveness are associated with the development of SUDs. These familial, behavioral and temperamental risk factors often co-occur, but their relative importance is not well known. People with SUDs have also been found to differ from healthy controls in various domains of cognitive functioning, with poorer verbal ability being among the most consistent findings. However, representative population-based samples have rarely been used in neuropsychological studies of SUDs. In addition, both SUDs and cognitive abilities are influenced by genetic factors, but whether the co-variation of these traits might be partly explained by overlapping genetic influences has not been studied. Problematic substance use also often co-occurs with low educational level, but it is not known whether these outcomes share part of their underlying genetic influences. In addition, educational level may moderate the genetic etiology of alcohol problems, but gene-environment interactions between these phenomena have also not been widely studied. The incidence of SUDs peaks in young adulthood rendering epidemiological studies in this age group informative. This thesis investigated cognitive functioning and other correlates of SUDs in young adulthood in two representative population-based samples of young Finnish adults, one of which consisted of monozygotic and dizygotic twin pairs enabling genetically informative analyses. Using data from the population-based Mental Health in Early Adulthood in Finland (MEAF) study (n=605), the lifetime prevalence of DSM-IV any substance dependence or abuse among persons aged 21—35 years was found to be approximately 14%, with a majority of the diagnoses being alcohol use disorders. Several correlates representing the domains of behavioral and affective factors, parental factors, early initiation of substance use, and educational factors were individually associated with SUDs. The associations between behavioral and affective factors (attention or behavior problems at school, aggression, anxiousness) and SUDs were found to be largely independent of factors from other domains, whereas daily smoking and low education were still associated with SUDs after adjustment for behavioral and affective factors. Using a wide array of neuropsychological tests in the MEAF sample and in a subsample (n=602) of the population-based FinnTwin16 (FT16) study, consistent evidence of poorer verbal cognitive ability related to SUDs was found. In addition, participants with SUDs performed worse than those without disorders in a task assessing psychomotor processing speed in the MEAF sample, whereas no evidence of more specific cognitive deficits was found in either sample. Biometrical structural equation models of the twin data suggested that both alcohol problems and verbal ability had moderate heritabilities (0.54—0.72), and that their covariation could be explained by correlated genetic influences (genetic correlations -0.20 to -0.31). The relationship between educational level and alcohol problems, studied in the full epidemiological FT16 sample (n=4,858), was found to reflect both genetic correlation and gene-environment interaction. The co-occurrence of low education and alcohol problems was influenced by overlapping genetic factors. In addition, higher educational level was associated with increased relative importance of genetic influences on alcohol problems, whereas environmental influences played a more important role in young adults with lower education. In conclusion, SUDs, especially alcohol abuse and dependence, are common among young Finnish adults. Behavioral and affective factors are robustly related to SUDs independently of many other factors, and compared to healthy peers, young adults who have had SUDs during their life exhibit significantly poorer verbal cognitive ability, and possibly less efficient psychomotor processing. Genetic differences between individuals explain a notable proportion of individual differences in risk of alcohol dependence, verbal ability, and educational level, and the co-occurrence of alcohol problems with poorer verbal cognition and low education is influenced by shared genetic backgrounds. Finally, various environmental factors related to educational level in young adulthood moderate the relative importance of genetic factors influencing the risk of alcohol problems, possibly reflecting differences in social control mechanisms related to educational level.

Importance of COMT in the regulation of prefrontal dopamine

The prefrontal cortex (PFC), located in the anterior region of the frontal lobe, is considered to have several key roles in higher cognitive and executive functions. In general, the PFC can be seen as a coordinator of thought and action allowing subjects to behave in a goal-directed manner. Due to its anatomical connections with a variety of cortical and subcortical structures, several neurotransmitters, including dopamine, are involved in the regulation of PFC activity. In general, the majority of released dopamine is cleared by the dopamine transporter (DAT). In the PFC however, the number of presynaptic DAT is diminished, emphasizing the relative importance of catechol-O-methyltransferase (COMT) in dopamine metabolism. As a result, the role of COMT in the etiology of psychotic disorders is under constant debate. The present study investigated the role of COMT in prefrontal cortical dopamine metabolism by different neurochemical methods in COMT knockout (COMT-KO) mice. Pharmacological tools to inhibit other dopamine clearing mechanisms were also used for a more comprehensive and collective picture. In addition, this study investigated how a lack of the soluble (S-) COMT isoform affects the total COMT activity as well as the pharmacokinetics of orally administered L-dopa using mutant mice expressing only the membrane-bound (MB-) COMT isoform. Also the role of COMT in striatal and accumbal dopamine turnover during Δ9-tetrahydrocannabinol (THC) challenge was studied. We found markedly increased basal dopamine concentrations in the PFC, but not the striatum or nucleus accumbens (NAcc), of mice lacking COMT. Pharmacological inhibition of the noradrenaline transporter (NET) and monoamine oxidase (MAO) elevated prefrontal cortical dopamine levels several-fold, whereas inhibition of DAT did not. The lack of COMT doubled the dopamine raising effects of NET and MAO inhibition. No compensatory expression of either DAT or NET was found in the COMT-KO mice. The lack of S-COMT decreased the total COMT activity by 50-70 % and modified dopamine transmission and the pharmacokinetics of exogenous Ldopa in a sex and tissue specific manner. Finally, we found that subsequent tolcapone and THC increased dopamine levels in the NAcc, but not in the striatum. Conclusively, this study presents neurochemical evidence for the important role of COMT in the PFC and shows that COMT is responsible for about half of prefrontal cortical dopamine metabolism. This study also highlights the previously underestimated proportional role of MB-COMT and supports the clinical evidence of a gene x environment interaction between COMT and cannabis.