Studies of working memory in interrupted human-computer interaction

Distraction in the workplace is increasingly more common in the information age. Several tasks and sources of information compete for a worker's limited cognitive capacities in human-computer interaction (HCI). In some situations even very brief interruptions can have detrimental effects on memory. Nevertheless, in other situations where persons are continuously interrupted, virtually no interruption costs emerge. This dissertation attempts to reveal the mental conditions and causalities differentiating the two outcomes. The explanation, building on the theory of long-term working memory (LTWM; Ericsson and Kintsch, 1995), focuses on the active, skillful aspects of human cognition that enable the storage of task information beyond the temporary and unstable storage provided by short-term working memory (STWM). Its key postulate is called a retrieval structure an abstract, hierarchical knowledge representation built into long-term memory that can be utilized to encode, update, and retrieve products of cognitive processes carried out during skilled task performance. If certain criteria of practice and task processing are met, LTWM allows for the storage of large representations for long time periods, yet these representations can be accessed with the accuracy, reliability, and speed typical of STWM. The main thesis of the dissertation is that the ability to endure interruptions depends on the efficiency in which LTWM can be recruited for maintaing information. An observational study and a field experiment provide ecological evidence for this thesis. Mobile users were found to be able to carry out heavy interleaving and sequencing of tasks while interacting, and they exhibited several intricate time-sharing strategies to orchestrate interruptions in a way sensitive to both external and internal demands. Interruptions are inevitable, because they arise as natural consequences of the top-down and bottom-up control of multitasking. In this process the function of LTWM is to keep some representations ready for reactivation and others in a more passive state to prevent interference. The psychological reality of the main thesis received confirmatory evidence in a series of laboratory experiments. They indicate that after encoding into LTWM, task representations are safeguarded from interruptions, regardless of their intensity, complexity, or pacing. However, when LTWM cannot be deployed, the problems posed by interference in long-term memory and the limited capacity of the STWM surface. A major contribution of the dissertation is the analysis of when users must resort to poorer maintenance strategies, like temporal cues and STWM-based rehearsal. First, one experiment showed that task orientations can be associated with radically different patterns of retrieval cue encodings. Thus the nature of the processing of the interface determines which features will be available as retrieval cues and which must be maintained by other means. In another study it was demonstrated that if the speed of encoding into LTWM, a skill-dependent parameter, is slower than the processing speed allowed for by the task, interruption costs emerge. Contrary to the predictions of competing theories, these costs turned out to involve intrusions in addition to omissions. Finally, it was learned that in rapid visually oriented interaction, perceptual-procedural expectations guide task resumption, and neither STWM nor LTWM are utilized due to the fact that access is too slow. These findings imply a change in thinking about the design of interfaces. Several novel principles of design are presented, basing on the idea of supporting the deployment of LTWM in the main task.

Käsityksistä ajatuksen poluille : Ammattikorkeakoulun tutkimus- ja kehitystoiminnan kehittäminen

This study deals with the formation of the idea of research and development (r&d) activity at one particular university of applied sciences in Finland. In this study I proceed from examining the conceptions of management regarding r&d-activities to exploring the development of the complex concept that guides these r&d-activities. The aim of this study is, first, to describe conceptions of r&d-activities, and then, second, to describe the formation of a new concept for r&d-activities in one field of study at the university of applied sciences. I used phenomenographic analysis to elucidate the conceptions and collected the data in interviews of personnel (22) who belong to the management of the university of applied sciences. The data for analysing the obstacles faced and the ways of overcoming them during the formation process of the new concept consist of the video-recorded material from ten change laboratory sessions held for the specific field of study at the university of applied sciences. In researching the formation of the concept of the activity, such research and analysis methods are used in which the concept is understood as a material construction, and with the help of which one can work out the formation of the concept during the development process. When the systematic development of the r&d-work was underway, the management of the university of applied sciences held differing views regarding the content, target, factors and organisation of the r&d-activities, as well as regarding the position of dissertations as a part of r&d-activity. Obstacles for developing rd concerned the unclear object and outcomes of the new activity, not having the tools (such as adequate know-how) for the new activity and not having found the necessary solutions for the distribution of work. In addition the rules that quide the activities of the university of applied sciences did not support working according to the new way. To improve r&d-activity, the school’s management defined three development strategies to encourage adequate rd-activity to support working life, regional development and learning. The strategies were based on the expansion of existing methods, such as service activities, dissertation work and the research activities of the teachers. Of the three possible routes, the concept of dissertation in this study was expanded to integrate the services of organisation development and the occupational growth of the students. A group of teachers in the field of social and health studies participated in the development work. The change laboratory method was used as a tool for this work. Analysis of the cognitive trails indicated that, in addition to the cycle of expansive learning activities, microcycles with different purposes can exist. According to Cussins (1992), something already in existence in each microcycle is destabilised, and something else is stabilised to replace it. In this study three microcycles were identified, during which the teachers first destabilised the existing concepts of dissertation work that guided their thinking, and then began to use new concepts to structure their thinking. Secondly, they undermined the existing concepts with material structure that defined their practical work, and developed new practical models to replace them. Thirdly, the problems accumulating in researching and testing the new activities caused the developers to destabilise the r&d-strategies of the university of applied sciences and to define a new conceptual model for r&d-work in the field. During this third cycle, the teachers developed a research arena model, which was a significant expansive innovation. In the cognitive trails developing the new concept for the r&d-activity, the teachers indeed faced the obstacles the management had described as their conceptions. These obstacles manifested themselves as contradictions. During the development process, the nature of the obstacles (i.e. contradictions) changed as the development proceeded. Solving the first and second degree contradictions highlighted the third and fourth degree contradictions. To overcome the obstacles, the teachers had to to articulate the value and motive of the development work throughout the development process. Developing the new concept for r&d-activity required many reconfigurations of practical solutions to overcome the obstacles. Developing the new concept for r&d-activity, both at the level of representations and of new practices, requires universities of applied sciences to adopt new methods in which the actors are partake in construction of new concepts of activity through adequate discussion, analysis and debate. R&d -activity can progress, if instead of implementing partial solutions, the totality of the activities (i.e. the group of partial solutions acting together) will be constructed. The development of the activity system requires many simultaneous changes as well as wide-ranging know-how and discussion related to these changes. What is perhaps most important, however, is that the group of developers mature into a determined collective actor which can engage in many agentive actions. The development of the agency is fundamental to progress.

Cortical processing of musical pitch as reflected by behavioural and electrophysiological evidence

In a musical context, the pitch of sounds is encoded according to domain-general principles not confined to music or even to audition overall but common to other perceptual and cognitive processes (such as multiple pattern encoding and feature integration), and to domain-specific and culture-specific properties related to a particular musical system only (such as the pitch steps of the Western tonal system). The studies included in this thesis shed light on the processing stages during which pitch encoding occurs on the basis of both domain-general and music-specific properties, and elucidate the putative brain mechanisms underlying pitch-related music perception. Study I showed, in subjects without formal musical education, that the pitch and timbre of multiple sounds are integrated as unified object representations in sensory memory before attentional intervention. Similarly, multiple pattern pitches are simultaneously maintained in non-musicians' sensory memory (Study II). These findings demonstrate the degree of sophistication of pitch processing at the sensory memory stage, requiring neither attention nor any special expertise of the subjects. Furthermore, music- and culture-specific properties, such as the pitch steps of the equal-tempered musical scale, are automatically discriminated in sensory memory even by subjects without formal musical education (Studies III and IV). The cognitive processing of pitch according to culture-specific musical-scale schemata hence occurs as early as at the sensory-memory stage of pitch analysis. Exposure and cortical plasticity seem to be involved in musical pitch encoding. For instance, after only one hour of laboratory training, the neural representations of pitch in the auditory cortex are altered (Study V). However, faulty brain mechanisms for attentive processing of fine-grained pitch steps lead to inborn deficits in music perception and recognition such as those encountered in congenital amusia (Study VI). These findings suggest that predispositions for exact pitch-step discrimination together with long-term exposure to music govern the acquisition of the automatized schematic knowledge of the music of a particular culture that even non-musicians possess.

Constructing skilled images

When experts construct mental images, they do not rely only on perceptual features; they also access domain-specific knowledge and skills in long-term memory, which enables them to exceed the capacity limitations of the short-term working memory system. The central question of the present dissertation was whether the facilitating effect of long-term memory knowledge on working memory imagery tasks is primarily based on perceptual chunking or whether it relies on higher-level conceptual knowledge. Three domains of expertise were studied: chess, music, and taxi driving. The effects of skill level, stimulus surface features, and the stimulus structure on incremental construction of mental images were investigated. A method was developed to capture the chunking mechanisms that experts use in constructing images: chess pieces, street names, and visual notes were presented in a piecemeal fashion for later recall. Over 150 experts and non-experts participated in a total of 13 experiments, as reported in five publications. The results showed skill effects in all of the studied domains when experts performed memory and problem solving tasks that required mental imagery. Furthermore, only experts' construction of mental images benefited from meaningful stimuli. Manipulation of the stimulus surface features, such as replacing chess pieces with dots, did not significantly affect experts' performance in the imagery tasks. In contrast, the structure of the stimuli had a significant effect on experts' performance in every task domain. For example, taxi drivers recalled more street names from lists that formed a spatially continuous route than from alphabetically organised lists. The results suggest that the mechanisms of conceptual chunking rather than automatic perceptual pattern matching underlie expert performance, even though the tasks of the present studies required perception-like mental representations. The results show that experts are able to construct skilled images that surpass working memory capacity, and that their images are conceptually organised and interpreted rather than merely depictive.

Kehittämisen kompastuskivet - myytit kehittämishankkeen keskusteluissa

I studied discussions during development project. Aim of the study was to analyse, what way workers represented their work: how normalized way of interpretation myths appeared in discourse and what consequences these utterances caused to drift of discussion. Change laboratory, which is a development method, is based to developmental work research methodology. Development is designed to be successful by learning activity and learning acts. Preventing factors of learning have been studied widely. Research has leaned to concept of resistance to change. Phenomenon of learning has been interpreted to be successful only if everybody has an agreement about the situation. There is also a new kind of concept of resistance. Resistance can be seen as a part of learning, normal processing of the learning activity. Another preventing factor can be seen as disorders of discourse, which are verbal ways of telling something that aren t real. Theoretically I consider these verbal ways as myth interpretations, which can be used as argumentative tools. I used analysis of discourse as an analytical method. Results of analysis revealed four different myth interpretations in workers discussions. Character of work was been described with myths unforeseen situations and disturbances are normal . Work was also described to be functional with myths system works and workers cause disturbances . Change laboratory discussions can be described as different social languages, which caused diverse perspectives to workers and researchers representations. Social languages also affected the way people analysed disturbances and system. Critical phase of change laboratory method seems to be analysis of disturbances and planning new mode of action. Myth utterances were used to reject ways of developing, analysis of system level and need of development. Myth utterances worked three different ways: ineffective, active or passive.

Representation of functional dependencies in relational databases using linear graphs

Functional dependencies in relational databases are investigated. Eight binary relations, viz., (1) dependency relation, (2) equipotence relation, (3) dissidence relation, (4) completion relation, and dual relations of each of them are described. Any one of these eight relations can be used to represent the functional dependencies in a database. Results from linear graph theory are found helpful in obtaining these representations. The dependency relation directly gives the functional dependencies. The equipotence relation specifies the dependencies in terms of attribute sets which functionally determine each other. The dissidence relation specifies the dependencies in terms of saturated sets in a very indirect way. Completion relation represents the functional dependencies as a function, the range of which turns out to be a lattice. Depletion relation which is the dual of the completion relation can also represent functional dependencies and similarly can the duals of dependency, equipotence, and dissidence relations. The class of depleted sets, which is the dual of saturated sets, is defined and used in the study of depletion relations.

Verkko-oppimateriaalin multimodaalisuus : kohteena YLEn Kansalaisen ABC -verkko-oppimateriaalit

Today information and communication technology allows us to use multimedia more than ever before in e-learning materials. Multimedia though can increase cognitive load in learning process. Because of that it cannot be taken granted what kind of learning materials should be produced. This paper intended to study the diversity of e-learning materials and the factors related cognitive load. The main purpose was to study the multimodality of the multimedia learning materials. The subject of this study is the learning materials on the web site Kansalaisen ABC published by YLE. Learning materials in the web site were approached from three different perspectives. The specific questions were: (1) What kind of form features are used in the representations of the learning material? Are certain form features preferred over others? (2) How do the cognitive load factors take shape in learning materials and between the forms? (3) How does the multimodality phenomenon appear in the learning materials and in what ways are form features and cognitive load factors related to multimodality? In this case study a qualitative approach was used. Analysis of the form features and the cognitive load factors in learning materials were based on content analysis. Form features included the specification of a format, the structure, the interactivity type and the type of learning material. The results showed that the web sites include various representations of both verbal and visual forms. Cognitive load factors were related mostly to visual than verbal material. Material presented according to the principles of cognitive multimedia theory multimedia representations did not cause cognitive overload in the informants. Cognitive load was increased in the case of students needing to split their attention between the multimedia forms in time and place. The results indicated how different individual characteristics are reflected by the cognitive load factors.

Tarinakontekstin vaikutus sanojen muistamiseen kompleksisessa työmuistitehtävässä

Objectives. The sentence span task is a complex working memory span task used for estimating total working memory capacity for both processing (sentence comprehension) and storage (remembering a set of words). Several traditional models of working memory suggest that performance on these tasks relies on phonological short-term storage. However, long-term memory effects as well as the effects of expertise and strategies have challenged this view. This study uses a working memory task that aids the creation of retrieval structures in the form of stories, which have been shown to form integrated structures in longterm memory. The research question is whether sentence and story contexts boost memory performance in a complex working memory task. The hypothesis is that storage of the words in the task takes place in long-term memory. Evidence of this would be better recall for words as parts of sentences than for separate words, and, particularly, a beneficial effect for words as part of an organized story. Methods. Twenty stories consisting of five sentences each were constructed, and the stimuli in all experimental conditions were based on these sentences and sentence-final words, reordered and recombined for the other conditions. Participants read aloud sets of five sentences that either formed a story or not. In one condition they had to report all the last words at the end of the set, in another, they memorised an additional separate word with each sentence. The sentences were presented on the screen one word at a time (500 ms). After the presentation of each sentence, the participant verified a statement about the sentence. After five sentences, the participant repeated back the words in correct positions. Experiment 1 (n=16) used immediate recall, experiment 2 (n=21) both immediate recall and recall after a distraction interval (the operation span task). In experiment 2 a distracting mental arithmetic task was presented instead of recall in half of the trials, and an individual word was added before each sentence in the two experimental conditions when the participants were to memorize the sentence final words. Subjects also performed a listening span task (in exp.1) or an operation span task (exp.2) to allow comparison of the estimated span and performance in the story task. Results were analysed using correlations, repeated measures ANOVA and a chi-square goodness of fit test on the distribution of errors. Results and discussion. Both the relatedness of the sentences (the story condition) and the inclusion of the words into sentences helped memory. An interaction showed that the story condition had a greater effect on last words than separate words. The beneficial effect of the story was shown in all serial positions. The effects remained in delayed recall. When the sentences formed stories, performance in verification of the statements about sentence context was better. This, as well as the differing distributions of errors in different experimental conditions, suggest different levels of representation are in use in the different conditions. In the story condition, the nature of these representations could be in the form of an organized memory structure, a situation model. The other working memory tasks had only few week correlations to the story task. This could indicate that different processes are in use in the tasks. The results do not support short-term phonological storage, but instead are compatible with the words being encoded to LTM during the task.

Opetussuunnitelman mallin jäsennys : sisältö ja pedagogiikka kokonaisuuden rakentajina

Structuring of the Curriculum Design: Content and Pedagogy Constructing the Whole The object of this qualitative study is to structure curriculum design by drawing from the characteristics of subject content and pedagogy. The aim is to first outline the forms of content and pedagogy within the National Core Curriculum for Basic Education. By analysing these forms I then aim to construct a general view of the curriculum’s structure and its developmental potential as it relates to both current and future pedagogical and intellectual interests. The written curriculum is examined as part of the educational guidance system, which means that it is an administrative and juridical document that governs teacher action and has a pedagogical and intellectual character. Didactical schools, curriculum ideologies and curriculum-determinants are all discussed as means of approaching the curriculum model. Curriculum content itself is defined by the different forms and conceptions of knowledge. The representation of curriculum content can be defined to be either specific or integrated. Curriculum pedagogy is in turn defined on the basis of the prevailing conception of learning and teaching. The pedagogy within the curriculum can be open or closed depending on the extent of pedagogical freedom allowed. An examination of the pedagogical dimension also covers the subject of the interfaces between formal education and informal learning, which must be taken into consideration when developing school pedagogy and therefore also in the curriculum. The data of the study consists of two curriculum documents: The Finnish National Core Curriculum for Basic Education issued in 1994 and the present National core curriculum for basic education issued in 2004. The primary method used in the study is theory-based content analysis. On the one hand the aim of the analysis is to determine if the structure, i.e., model, of the curricula is built from unconnected, self-contained elements, or whether the separate parts make a coherent whole. On the other hand, the aim is also to examine the pedagogical features the two curricula contain. The basis of the study is not the systematic comparison of the curriculum documents, yet an analysis of two very distinct documents must also be based on an examination of their inherent differences. The results of the study show that the content in the analysed documents is not integrated. The boundaries between divisions are clearly defined and the curricula are subject-oriented and based on theoretical propositional knowledge. The pedagogy is mainly closed and based on strong guidance of content, structured student evaluation and measurable learning experiences. However, curriculum documents do have representations of integrated content: the themes covered early on in the core curriculum guidelines of 1994 permeate systematically the different divisions of the curriculum. The core curriculum guidelines of 2004 in turn reveal skills which create connections between subjects. The guidelines’ utilise out-of-school environments and accommodate learner experiences, and focus on flexible studying and emphasize individual learner needs. These characteristics reveal an open form of pedagogy. In light of these results, it is possible to reach an understanding of the content and pedagogical development possibilities of the curriculum. The essential viewpoints are then the setting of thematically-oriented aims as a basis for content development, the curriculum’s pedagogical structuring on the basis of the learning process and the enhancement of connections between curricular content and pedagogy in a purposeful way. Keywords: curriculum, curriculum theory, curriculum design, core curriculum guidelines, teaching content, pedagogy

Muusikon mentaaliharjoittelu : Konsertoivan ja opettavan pianistin mentaaliharjoittelu

This research explores the foci, methods and processes of mental training by pianists who are active as performers and teachers. The research is based on the concept of mental training as a solely mental mode of practising. Musician s mental training takes place without an instrument or the physical act of playing. The research seeks answers to questions: 1) What are the foci of a pianist s mental training? 2) How does a pianist carry out the mental training? 3) What does mental training in music entail as a process? The research approach is qualitative, and the materials were gathered from thematic interviews. The aim of practising is always an improved result both in the act of playing and the performance. Mental training by a pianist is collaboration between technical, auditory, visual, kinaesthetic and affective factors. Also interpretation, memory and overcoming stage fright are needed. Technical, cognitive and performance skills are involved. According to the results of this research, mental training is a goal-oriented activity which can have an impact on all of these factors. Without a musical inner ear and its functionality, true musicianship cannot exist. One particular result of this research is the conceptualisation of opening up the inner ear. Auditory exercises and internally playing mental images are essential elements of the mental practice of a musician. Visual images, such as a picture of music notation or a performance event, are the point of focus for musicians who find visual images to be the easiest to realise. When developing technical skills by using mental training, it is important to focus on the technically most difficult sections. It is also necessary to focus on the holistic experiencing of the performance situation. By building on positive energies and strengths, the so-called psyching up may be the most important element in mental training. Based on the results of this research, a synthesis is outlined of the music event as an activity process, built on representations and schemes. Mental training aims at the most ideal possible act of playing and the creation of a musical event; these are achieved by focussing on various mental images produced by the different senses, together with concrete practising. Mental training in sports and in music share common factors. Both modes of practising, mental as well as physical, involve three important elements: planning, realisation and evaluation of the practice. In music, however, the goal is an artistic end result which does not often apply to an athletic event. Keywords: Mental training in music, auditory imagining, visualisation, kinaesthetic-mental experience, mastery of the psyche

Integrating and evaluating neural word embeddings in information retrieval

Recent advances in neural language models have contributed new methods for learning distributed vector representations of words (also called word embeddings). Two such methods are the continuous bag-of-words model and the skipgram model. These methods have been shown to produce embeddings that capture higher order relationships between words that are highly effective in natural language processing tasks involving the use of word similarity and word analogy. Despite these promising results, there has been little analysis of the use of these word embeddings for retrieval. Motivated by these observations, in this paper, we set out to determine how these word embeddings can be used within a retrieval model and what the benefit might be. To this aim, we use neural word embeddings within the well known translation language model for information retrieval. This language model captures implicit semantic relations between the words in queries and those in relevant documents, thus producing more accurate estimations of document relevance. The word embeddings used to estimate neural language models produce translations that differ from previous translation language model approaches; differences that deliver improvements in retrieval effectiveness. The models are robust to choices made in building word embeddings and, even more so, our results show that embeddings do not even need to be produced from the same corpus being used for retrieval.

Pre-maps : An Educational Programme for Reading Tactile Maps

It is demanding for children with visual impairment to become aware of the world beyond their immediate experience. They need to learn to control spatial experiences as a whole and understand the relationships between objects, surfaces and themselves. Tactile maps can be an excellent source of information for depicting space and environment. By means of tactile maps children can develop their spatial understanding more efficiently than through direct travel experiences supplemented with verbal explanations. Tactile maps can help children when they are learning to understand environmental, spatial, and directional concepts. The ability to read tactile maps is not self-evident; it is a skill, which must be learned. The main research question was: can children who are visually impaired learn to read tactile maps at the preschool age if they receive structural teaching? The purpose of this study was to develop an educational program for preschool children with visual impairment, the aim of which was to teach them to read tactile maps in order to strengthen their orientation skills and to encourage them to explore the world beyond their immediate experience. The study is a multiple case study describing the development of the map program consisting of eight learning tasks. The program was developed with one preschooler who was blind, and subsequently the program was implemented with three other children. Two of the children were blind from birth, one child had lost her vision at the age of two, and one child had low vision. The program was implemented in a normal preschool. Another objective of the pre-map program was to teach the preschooler with visual impairment to understand the concept of a map. The teaching tools were simple, map-like representations called pre-maps. Before a child with visual impairment can read a comprehensive tactile map, it is important to learn to understand map symbols, and how a three-dimensional model changes to a two-dimensional tactile map. All teaching sessions were videotaped; the results are based on the analysis of the videotapes. Two of the children completed the program successfully, and learned to read a tactile map. The two other children felt happy during the sessions, but it was problematic for them to engage fully in the instruction. One of the two eventually completed the program, while the other developed predominantly emerging skills. The results of the children's performances and the positive feedback from the teachers, assistants and the parents proved that this pre-map program is appropriate teaching material for preschool children who are visually impaired. The program does not demand high-level expertise; also parents, preschool teachers, and school assistants can carry out the program.

On a linear steady-state system of equations in microcontinuum fluid mechanics

Galerkin representations and integral representations are obtained for the linearized system of coupled differential equations governing steady incompressible flow of a micropolar fluid. The special case of 2-dimensional Stokes flows is then examined and further representation formulae as well as asymptotic expressions, are generated for both the microrotation and velocity vectors. With the aid of these formulae, the Stokes Paradox for micropolar fluids is established.

Derivation of the decoupling relations for composite models from anomaly constraints and n-independence

It is shown, in the composite fermion models studied by 't Hooft and others, that the requirements of Adler-Bell-Jackiw anomaly matching and n-independence are sufficient to fix the indices of composite representations. The third requirement, namely that of decoupling relations, follows from these two constraints in such models and hence is inessential.

The navigation and visualisation of environmental audio using zooming spectrograms

Acoustic recordings play an increasingly important role in monitoring terrestrial and aquatic environments. However, rapid advances in technology make it possible to accumulate thousands of hours of recordings, more than ecologists can ever listen to. Our approach to this big-data challenge is to visualize the content of long-duration audio recordings on multiple scales, from minutes, hours, days to years. The visualization should facilitate navigation and yield ecologically meaningful information prior to listening to the audio. To construct images, we calculate acoustic indices, statistics that describe the distribution of acoustic energy and reflect content of ecological interest. We combine various indices to produce false-color spectrogram images that reveal acoustic content and facilitate navigation. The technical challenge we investigate in this work is how to navigate recordings that are days or even months in duration. We introduce a method of zooming through multiple temporal scales, analogous to Google Maps. However, the “landscape” to be navigated is not geographical and not therefore intrinsically visual, but rather a graphical representation of the underlying audio. We describe solutions to navigating spectrograms that range over three orders of magnitude of temporal scale. We make three sets of observations: 1. We determine that at least ten intermediate scale steps are required to zoom over three orders of magnitude of temporal scale; 2. We determine that three different visual representations are required to cover the range of temporal scales; 3. We present a solution to the problem of maintaining visual continuity when stepping between different visual representations. Finally, we demonstrate the utility of the approach with four case studies.