ATC-lab: An air traffic control simulator for the laboratory

Air Traffic Control Laboratory Simulator (ATC-lab) is a new low- and medium-fidelity task environment that simulates air traffic control. ATC-lab allows the researcher to study human performance of tasks under tightly controlled experimental conditions in a dynamic, spatial environment. The researcher can create standardized air traffic scenarios by manipulating a wide variety of parameters. These include temporal and spatial variables. There are two main versions of ATC-lab. The medium-fidelity simulator provides a simplified version of en route air traffic control, requiring participants to visually search a screen and both recognize and resolve conflicts so that adequate separation is maintained between all aircraft. The low-fidelity simulator presents pairs of aircraft in isolation, controlling the participant's focus of attention, which provides a more systematic measurement of conflict recognition and resolution performance. Preliminary studies have demonstrated that ATC-lab is a flexible tool for applied cognition research.

An analysis of relational complexity in an air traffic control conflict detection task

Theoretical analyses of air traffic complexity were carried out using the Method for the Analysis of Relational Complexity. Twenty-two air traffic controllers examined static air traffic displays and were required to detect and resolve conflicts. Objective measures of performance included conflict detection time and accuracy. Subjective perceptions of mental workload were assessed by a complexity-sorting task and subjective ratings of the difficulty of different aspects of the task. A metric quantifying the complexity of pair-wise relations among aircraft was able to account for a substantial portion of the variance in the perceived complexity and difficulty of conflict detection problems, as well as reaction time. Other variables that influenced performance included the mean minimum separation between aircraft pairs and the amount of time that aircraft spent in conflict.

Simulation of air traffic controllers' behaviour using the operator choice model

The Operator Choice Model (OCM) was developed to model the behaviour of operators attending to complex tasks involving interdependent concurrent activities, such as in Air Traffic Control (ATC). The purpose of the OCM is to provide a flexible framework for modelling and simulation that can be used for quantitative analyses in human reliability assessment, comparison between human computer interaction (HCI) designs, and analysis of operator workload. The OCM virtual operator is essentially a cycle of four processes: Scan Classify Decide Action Perform Action. Once a cycle is complete, the operator will return to the Scan process. It is also possible to truncate a cycle and return to Scan after each of the processes. These processes are described using Continuous Time Probabilistic Automata (CTPA). The details of the probability and timing models are specific to the domain of application, and need to be specified using domain experts. We are building an application of the OCM for use in ATC. In order to develop a realistic model we are calibrating the probability and timing models that comprise each process using experimental data from a series of experiments conducted with student subjects. These experiments have identified the factors that influence perception and decision making in simplified conflict detection and resolution tasks. This paper presents an application of the OCM approach to a simple ATC conflict detection experiment. The aim is to calibrate the OCM so that its behaviour resembles that of the experimental subjects when it is challenged with the same task. Its behaviour should also interpolate when challenged with scenarios similar to those used to calibrate it. The approach illustrated here uses logistic regression to model the classifications made by the subjects. This model is fitted to the calibration data, and provides an extrapolation to classifications in scenarios outside of the calibration data. A simple strategy is used to calibrate the timing component of the model, and the results for reaction times are compared between the OCM and the student subjects. While this approach to timing does not capture the full complexity of the reaction time distribution seen in the data from the student subjects, the mean and the tail of the distributions are similar.

Managing the airspace: A task analysis of Australian air traffic control

The aim of this study was to examine the way Australian air traffic controllers manage their airspace. Fourteen controllers ranging from 7 to 30 years experience were sampled from the Brisbane air traffic control centre. All had previously been endorsed for en route radar sectors. Five static pictures varying in workload level (low, medium and high) were presented to participants. Controllers were asked to work through the scenarios and describe aloud how they would resolve any potential conflicts between the aircraft. Following this controllers were asked a set of probe questions based on the critical decision method, to extract further information about the way they manage their airspace. A content analysis was used to assess patterns in the way controllers scan, strategies used in conflict detection and conflict resolution and the effect of workload on strategy choice. Findings revealed that controllers use specific strategies (such as working in a left to right scan or prioritising levels) when managing their airspace. Further analyses are still planned however a model based on the processes controllers used to resolve conflicts has been developed and will be presented as a summary of the results.

The influence of memory for prior instances on performance in a conflict detection task

In 3 experiments, the authors examined the role of memory for prior instances for making relative judgments in conflict detection. Participants saw pairs of aircraft either repeatedly conflict with each other or pass safely before being tested on new aircraft pairs, which varied in similarity to the training pairs. Performance was influenced by the similarity between aircraft pairs. Detection time was faster when a conflict pair resembled a pair that had repeatedly conflicted. Detection time was slower, and participants missed conflicts, when a conflict pair resembled a pair that had repeatedly passed safely. The findings identify aircraft features that are used as inputs into the memory decision process and provide an indication of the processes involved in the use of memory for prior instances to make relative judgments.

An examination of the dynamic relationship between self-efficacy and performance across levels of analysis and levels of specificity

This research used resource allocation theory to generate predictions regarding dynamic relationships between self-efficacy and task performance from 2 levels of analysis and specificity. Participants were given multiple trials of practice on an air traffic control task. Measures of task-specific self-efficacy and performance were taken at repeated intervals. The authors used multilevel analysis to demonstrate differential and dynamic effects. As predicted, task-specific self-efficacy was negatively associated with task performance at the within-person level. On the other hand, average levels of task-specific self-efficacy were positively related to performance at the between-persons level and mediated the effect of general self-efficacy. The key findings from this research relate to dynamic effects - these results show that self-efficacy effects can change over time, but it depends on the level of analysis and specificity at which self-efficacy is conceptualized. These novel findings emphasize the importance of conceptualizing self-efficacy within a multilevel and multispecificity framework and make a significant contribution to understanding the way this construct relates to task performance.

Benefits of all work and no play: The relationship between neuroticism and performance as a function of resource allocation

The authors evaluate a model suggesting that the performance of highly neurotic individuals, relative to their stable counterparts, is more strongly influenced by factors relating to the allocation of attentional resources. First, an air traffic control simulation was used to examine the interaction between effort intensity and scores on the Anxiety subscale of Eysenck Personality Profiler Neuroticism in the prediction of task performance. Overall effort intensity enhanced performance for highly anxious individuals more so than for individuals with low anxiety. Second, a longitudinal field study was used to examine the interaction between office busyness and Eysenck Personality Inventory Neuroticism in the prediction of telesales performance. Changes in office busyness were associated with greater performance improvements for highly neurotic individuals compared with less neurotic individuals. These studies suggest that highly neurotic individuals outperform their stable counterparts in a busy work environment or if they are expending a high level of effort.

Self-efficacy and task performance: An investigation from two levels of analysis and specificity

This research adopts a resource allocation theoretical framework to generate predictions regarding the relationship between self-efficacy and task performance from two levels of analysis and specificity. Participants were given multiple trials of practice on an air traffic control task. Measures of task-specific self-efficacy and performance were taken at repeated intervals. The authors used multilevel analysis to demonstrate dynamic main effects, dynamic mediation and dynamic moderation. As predicted, the positive effects of overall task specific self-efficacy and general self-efficacy on task performance strengthened throughout practice. In line with these dynamic main effects, the effect of general self-efficacy was mediated by overall task specific self-efficacy; however this pattern emerged over time. Finally, changes in task specific self-efficacy were negatively associated with changes in performance at the within-person level; however this effect only emerged towards the end of practice for individuals with high levels of overall task specific self-efficacy. These novel findings emphasise the importance of conceptualising self-efficacy within a multi-level and multi-specificity framework and make a significant contribution to understanding the way this construct relates to task performance.

A multilevel analysis of BIS sensitivity and negative affect during skill acquisition

This Study examined the muldlevel reladonships among negadve affect Behavioural Inhibidon System (BIS) Sensidvit)' and performance. It also invesdgated whether the reladonship among these variables changed across pracdce. Pardcipants performed muldple trials of a simulated air traffic control task, A single measure of BIS was taken before pracdce, while negadve affect and performance were measured at repeated intervals. As expected, negadve affect was detrimental to performance at both a between-person and withinperson level, BIS was also found to be detrimental to performance. Contrary' to expectadons, the reladonship between BIS and performance was not mediated by overall levels of negadve affect. As predicted, the effects of overall levels of negadve affect and BIS strengthened across pracdce as pardcipants gained task knowledge and skill. The findings of this study are interpreted using resource allocadon theor}' and the implicadons for skiU acquisidon discussed.

The moderating effects of goal orientations on reactions to goal-performance discrepancies

Due to the growing popularity of goal setting programs within organisations, an understanding of the mechanisms underlying the dynamic regulation of performance is paramount (Williams, Donovan, & Dodge, 2000). Goals serve as standards or referents by which behaviour is directed and evaluated. Whilst their importance is well established in the existing literature (e.g. Locke & Latham, 1990), more recent research has highlighted the potential importance of goal-performance discrepancies. Moreover, the relationship between goal-performance discrepancies and outcomes such as self-efficacy and personal goals appears to vary between people (Schmidt & Chambers, 2002). Of interest in the current study was how these relationships were impacted by goal orientation. Ninety-seven participants completed 30 two-minute trials of an Air Traffic Control task. Task specific goal orientation was measured prior to commencement of the task and measures of self-efficacy and personal task goals were taken at each trial to assess the within-person relationships between goal performance discrepancies and each of these dependant variables, as well as the moderating effects of goal orientations on these relationships. Analysis supported the existence of a positive relationship between goal-performance discrepancies and outcome variables, with performance-approach and –avoidance orientations significantly moderating these associations. Implications and future directions are discussed.

Formal analysis of human-computer interaction using model checking

Experiments with simulators allow psychologists to better understand the causes of human errors and build models of cognitive processes to be used in human reliability assessment (HRA). This paper investigates an approach to task failure analysis based on patterns of behaviour, by contrast to more traditional event-based approaches. It considers, as a case study, a formal model of an air traffic control (ATC) system which incorporates controller behaviour. The cognitive model is formalised in the CSP process algebra. Patterns of behaviour are expressed as temporal logic properties. Then a model-checking technique is used to verify whether the decomposition of the operator's behaviour into patterns is sound and complete with respect to the cognitive model. The decomposition is shown to be incomplete and a new behavioural pattern is identified, which appears to have been overlooked in the analysis of the data provided by the experiments with the simulator. This illustrates how formal analysis of operator models can yield fresh insights into how failures may arise in interactive systems.

Personality and goal orientation as predictors of performance in a learning context

The current study aimed to investigate and provide furthering evidence of individual differences as determinants of task performance. This research focused on the effects of the personality traits Openness to Experience and Neuroticism, and two goal orientation traits. Learning Orientation and Avoid Orientation, on task performance. The hypotheses addressed the predictability of the traits, the differential effects of personality and goal orientation traits, and the mediating effects of goal orientation on the relationship between personality and performance. The results were based on questionnaire responses completed by a sample of 103 students. Scores on a computerised Air Traffic Control (ATC) decision-making task were used as a measure of task performance. Learning Orientation was found to be a significant predictor of performance, whilst the effect of Neuroticism was 'approaching' significance. Results indicated strong support for the differential relationship between personality traits and corresponding goal orientation traits. The mediating relationship between Openness to Experience, Learning Orientation and performance was also found to be 'approaching' significance. Results were indicative of the influences of personality and goal orientation on consequent performance outcomes. Implications were discussed, as well as suggestions for possible future directions in research assessing the predictabilit)' of individual differences in learning contexts.