Studies of working memory in interrupted human-computer interaction

Distraction in the workplace is increasingly more common in the information age. Several tasks and sources of information compete for a worker's limited cognitive capacities in human-computer interaction (HCI). In some situations even very brief interruptions can have detrimental effects on memory. Nevertheless, in other situations where persons are continuously interrupted, virtually no interruption costs emerge. This dissertation attempts to reveal the mental conditions and causalities differentiating the two outcomes. The explanation, building on the theory of long-term working memory (LTWM; Ericsson and Kintsch, 1995), focuses on the active, skillful aspects of human cognition that enable the storage of task information beyond the temporary and unstable storage provided by short-term working memory (STWM). Its key postulate is called a retrieval structure an abstract, hierarchical knowledge representation built into long-term memory that can be utilized to encode, update, and retrieve products of cognitive processes carried out during skilled task performance. If certain criteria of practice and task processing are met, LTWM allows for the storage of large representations for long time periods, yet these representations can be accessed with the accuracy, reliability, and speed typical of STWM. The main thesis of the dissertation is that the ability to endure interruptions depends on the efficiency in which LTWM can be recruited for maintaing information. An observational study and a field experiment provide ecological evidence for this thesis. Mobile users were found to be able to carry out heavy interleaving and sequencing of tasks while interacting, and they exhibited several intricate time-sharing strategies to orchestrate interruptions in a way sensitive to both external and internal demands. Interruptions are inevitable, because they arise as natural consequences of the top-down and bottom-up control of multitasking. In this process the function of LTWM is to keep some representations ready for reactivation and others in a more passive state to prevent interference. The psychological reality of the main thesis received confirmatory evidence in a series of laboratory experiments. They indicate that after encoding into LTWM, task representations are safeguarded from interruptions, regardless of their intensity, complexity, or pacing. However, when LTWM cannot be deployed, the problems posed by interference in long-term memory and the limited capacity of the STWM surface. A major contribution of the dissertation is the analysis of when users must resort to poorer maintenance strategies, like temporal cues and STWM-based rehearsal. First, one experiment showed that task orientations can be associated with radically different patterns of retrieval cue encodings. Thus the nature of the processing of the interface determines which features will be available as retrieval cues and which must be maintained by other means. In another study it was demonstrated that if the speed of encoding into LTWM, a skill-dependent parameter, is slower than the processing speed allowed for by the task, interruption costs emerge. Contrary to the predictions of competing theories, these costs turned out to involve intrusions in addition to omissions. Finally, it was learned that in rapid visually oriented interaction, perceptual-procedural expectations guide task resumption, and neither STWM nor LTWM are utilized due to the fact that access is too slow. These findings imply a change in thinking about the design of interfaces. Several novel principles of design are presented, basing on the idea of supporting the deployment of LTWM in the main task.

Human brain networks of auditory attention and working memory

This thesis examines brain networks involved in auditory attention and auditory working memory using measures of task performance, brain activity, and neuroanatomical connectivity. Auditory orienting and maintenance of attention were compared with visual orienting and maintenance of attention, and top-down controlled attention was compared to bottom-up triggered attention in audition. Moreover, the effects of cognitive load on performance and brain activity were studied using an auditory working memory task. Corbetta and Shulman s (2002) model of visual attention suggests that what is known as the dorsal attention system (intraparietal sulcus/superior parietal lobule, IPS/SPL and frontal eye field, FEF) is involved in the control of top-down controlled attention, whereas what is known as the ventral attention system (temporo-parietal junction, TPJ and areas of the inferior/middle frontal gyrus, IFG/MFG) is involved in bottom-up triggered attention. The present results show that top-down controlled auditory attention also activates IPS/SPL and FEF. Furthermore, in audition, TPJ and IFG/MFG were activated not only by bottom-up triggered attention, but also by top-down controlled attention. In addition, the posterior cerebellum and thalamus were activated by top-down controlled attention shifts and the ventromedial prefrontal cortex (VMPFC) was activated by to-be-ignored, but attention-catching salient changes in auditory input streams. VMPFC may be involved in the evaluation of environmental events causing the bottom-up triggered engagement of attention. Auditory working memory activated a brain network that largely overlapped with the one activated by top-down controlled attention. The present results also provide further evidence of the role of the cerebellum in cognitive processing: During auditory working memory tasks, both activity in the posterior cerebellum (the crus I/II) and reaction speed increased when the cognitive load increased. Based on the present results and earlier theories on the role of the cerebellum in cognitive processing, the function of the posterior cerebellum in cognitive tasks may be related to the optimization of response speed.

Fast in-memory XPath search using compressed indexes

A large fraction of an XML document typically consists of text data. The XPath query language allows text search via the equal, contains, and starts-with predicates. Such predicates can be efficiently implemented using a compressed self-index of the document's text nodes. Most queries, however, contain some parts querying the text of the document, plus some parts querying the tree structure. It is therefore a challenge to choose an appropriate evaluation order for a given query, which optimally leverages the execution speeds of the text and tree indexes. Here the SXSI system is introduced. It stores the tree structure of an XML document using a bit array of opening and closing brackets plus a sequence of labels, and stores the text nodes of the document using a global compressed self-index. On top of these indexes sits an XPath query engine that is based on tree automata. The engine uses fast counting queries of the text index in order to dynamically determine whether to evaluate top-down or bottom-up with respect to the tree structure. The resulting system has several advantages over existing systems: (1) on pure tree queries (without text search) such as the XPathMark queries, the SXSI system performs on par or better than the fastest known systems MonetDB and Qizx, (2) on queries that use text search, SXSI outperforms the existing systems by 1-3 orders of magnitude (depending on the size of the result set), and (3) with respect to memory consumption, SXSI outperforms all other systems for counting-only queries.

Associations of interleukin-1 (IL-1) gene variation and IL-1 receptor antagonist phenotypes with immunological responses, metabolic dysregulation and type 2 diabetes

The upstream proinflammatory interleukin-1 (IL-1) cytokines, together with a naturally occurring IL-1 receptor antagonist (IL-1Ra), play a significant role in several diseases and physiologic conditions. The IL-1 proteins affect glucose homeostasis at multiple levels contributing to vascular injuries and metabolic dysregulations that precede diabetes. An association between IL-1 gene variations and IL-1Ra levels has been suggested, and genetic studies have reported associations with metabolic dysregulation and altered inflammatory responses. The principal aims of this study were to: 1) examine the associations of IL-1 gene variation and IL-1Ra expression in the development and persistence of thyroid antibodies in subacute thyroiditis; 2) investigate the associations of common variants in the IL-1 gene family with plasma glucose and insulin concentrations, glucose homeostasis measures and prevalent diabetes in a representative population sample; 3) investigate genetic and non-genetic determinants of IL-1Ra phenotypes in a cross-sectional setting in three independent study populations; 4) investigate in a prospective setting (a) whether variants of the IL-1 gene family are predictors for clinically incident diabetes in two population-based observational cohort studies; and (b) whether the IL-1Ra levels predict the progression of metabolic syndrome to overt diabetes during the median follow-up of 10.8 and 7.1 years. Results from on patients with subacte thyroiditis showed that the systemic IL-1Ra levels are elevated during a specific proinflammatory response and they correlated with C-reactive protein (CRP) levels. Genetic variation in the IL-1 family seemed to have an association with the appearance of thyroid peroxidase antibodies and persisting local autoimmune responses during the follow-up. Analysis of patients suffering from diabetes and metabolic traits suggested that genetic IL-1 variation and IL-1Ra play a role in glucose homeostasis and in the development of type 2 diabetes. The coding IL-1 beta SNP rs1143634 was associated with traits related to insulin resistance in cross-sectional analyses. Two haplotype variants of the IL-1 beta gene were associated with prevalent diabetes or incident diabetes in a prospective setting and both of these haplotypes were tagged by rs1143634. Three variants of the IL-1Ra gene and one of the IL-1 beta gene were consistently identified as significant, independent determinants of the IL-1Ra phenotype in two or three populations. The proportion of the phenotypic variation explained by the genetic factors was modest however, while obesity and other metabolic traits explained a larger part. Body mass index was the strongest predictor of systemic IL-1Ra concentration overall. Furthermore, the age-adjusted IL-1Ra concentrations were elevated in individuals with metabolic syndrome or diabetes when compared to those free of metabolic dysregulation. In prospective analyses the systemic IL-1Ra levels were found as independent predictors for the development of diabetes in people with metabolic syndrome even after adjustment for multiple other factors, including plasma glucose and CRP levels. The predictive power of IL-1Ra was better than that of CRP. The prospective results also provided some evidence for a role of common IL-1 alpha promoter SNP rs1800587 in the development of type 2 diabetes among men and suggested that the role may be gender specific. Likewise, common variations in the IL-1 beta coding region may have a gender specific association with diabetes development. Further research on the potential benefits of IL-1Ra measurements in identifying individuals at high risk for diabetes, who then could be targeted for specific treatment interventions, is warranted. It has been reported in the recent literature that IL-1Ra secreted from adipose tissue has beneficial effects on glucose homeostasis. Furthermore, treatment with recombinant human IL-1Ra has been shown to have a substantial therapeutic potential. The genetic results from the prospective analyses performed in this study remain inconclusive, but together with the cross-sectional analyses they suggest gender-specific effects of the IL-1 variants on the risk of diabetes. Larger studies with more extensive genotyping and resequencing may help to pinpoint the exact variants responsible and to further elucidate the biological mechanisms for the observed associations. This would improve our understanding of the pathways linking inflammation and obesity with glucose and insulin metabolism.