User dyads in software testing: bypassing the need for expert observers

This paper arises out of a research study into the online help facilities provided in popular software applications such as word processors. Its particular focus is on experimental methods of evaluating the effectiveness and usability of those facilities. Focus groups, questionnaires, and online surveys had already been used in other phases of the study, but it was judged that these approaches would be unsuitable for measuring effectiveness and usability because they are susceptible to respondents' subjectivity. Direct observation of people working on set word-processing tasks was ruled out initially because of a lack of trained observers; it would have taken too long for the investigator to observe a large enough sample by himself. Automatic recording of users' actions was also rejected, as it would have demanded equipment and/or software that was not available and seemed too expensive to acquire. The approach and techniques described here were an attempt to overcome these difficulties by using observers drawn from the same population of students that provided the test subjects; as a by-product, this may also have enhanced the acceptability (and hence possibly the validity) of the experiments by reducing the exam pressure perceived by participants.

A model of specification-based testing of interactive systems

In this paper we present a model of specification-based testing of interactive systems. This model provides the basis for a framework to guide such testing. Interactive systems are traditionally decomposed into a functionality component and a user interface component; this distinction is termed dialogue separation and is the underlying basis for conceptual and architectural models of such systems. Correctness involves both proper behaviour of the user interface and proper computation by the underlying functionality. Specification-based testing is one method used to increase confidence in correctness, but it has had limited application to interactive system development to date.

A framework for table driven testing of Java classes

With the advent of object-oriented languages and the portability of Java, the development and use of class libraries has become widespread. Effective class reuse depends on class reliability which in turn depends on thorough testing. This paper describes a class testing approach based on modeling each test case with a tuple and then generating large numbers of tuples to thoroughly cover an input space with many interesting combinations of values. The testing approach is supported by the Roast framework for the testing of Java classes. Roast provides automated tuple generation based on boundary values, unit operations that support driver standardization, and test case templates used for code generation. Roast produces thorough, compact test drivers with low development and maintenance cost. The framework and tool support are illustrated on a number of non-trivial classes, including a graphical user interface policy manager. Quantitative results are presented to substantiate the practicality and effectiveness of the approach. Copyright (C) 2002 John Wiley Sons, Ltd.

A case study in specification and implementation testing

Achieving consistency between a specification and its implementation is an important part of software development In previous work, we have presented a method and tool support for testing a formal specification using animation and then verifying an implementation of that specification. The method is based on a testgraph, which provides a partial model of the application under test. The testgraph is used in combination with an animator to generate test sequences for testing the formal specification. The same testgraph is used during testing to execute those same sequences on the implementation and to ensure that the implementation conforms to the specification. So far, the method and its tool support have been applied to software components that can be accessed through an application programmer interface (API). In this paper, we use an industrially-based case study to discuss the problems associated with applying the method to a software system with a graphical user interface (GUI). In particular, the lack of a standardised interface, as well as controllability and observability problems, make it difficult to automate the testing of the implementation. The method can still be applied, but the amount of testing that can be carried on the implementation is limited by the manual effort involved.

The BCD transient recorder revisited: firmware for the ISA-to-USB bridging card and software for the graphical user interface

This report describes recent updates to the custom-built data-acquisition hardware operated by the Center for Hypersonics. In 2006, an ISA-to-USB bridging card was developed as part of Luke Hillyard's final-year thesis. This card allows the hardware to be connected to any recent personal computers via a (USB or RS232) serial port and it provides a number of simple text-based commands for control of the hardware. A graphical user interface program was also updated to help the experimenter manage the data acquisition functions. Sampled data is stored in text files that have been compressed with the gzip for mat. To simplify the later archiving or transport of the data, all files specific to a shot are stored in a single directory. This includes a text file for the run description, the signal configuration file and the individual sampled-data files, one for each signal that was recorded.

User guide for shock and blast simulation with the OctVCE code (version 3.5+), Department of Mechanical Engineering Report 2007/13

OctVCE is a cartesian cell CFD code produced especially for numerical simulations of shock and blast wave interactions with complex geometries. Virtual Cell Embedding (VCE) was chosen as its cartesian cell kernel as it is simple to code and sufficient for practical engineering design problems. This also makes the code much more ‘user-friendly’ than structured grid approaches as the gridding process is done automatically. The CFD methodology relies on a finite-volume formulation of the unsteady Euler equations and is solved using a standard explicit Godonov (MUSCL) scheme. Both octree-based adaptive mesh refinement and shared-memory parallel processing capability have also been incorporated. For further details on the theory behind the code, see the companion report 2007/12.

Linearly-increasing-stress testing of carbon steel in 4 N NaNO3 and in Bayer liquor

This paper reports the application of linearly increasing stress testing (LIST) to the study of stress corrosion cracking (SCC) of carbon steel in 4 N NaNO3 and in Bayer liquor. LIST is similar to the constant extension-rate testing (CERT) methodology with the essential difference that the LIST is load controlled whereas the CERT is displacement controlled. The main conclusion is that LIST is suitable for the study of the SCC of carbon steels in 4 N NaNO3 and in Bayer liquor. The low crack velocity in Bayer liquor and a measured maximum stress close to that of the reference specimen in air both indicate that a low applied stress rate is required to study SCC in this system. (C) 1998 Chapman & Hall.

Improving wheat simulation capabilities in Australia from a cropping systems perspective - II. Testing simulation capabilities of wheat growth

To simulate cropping systems, crop models must not only give reliable predictions of yield across a wide range of environmental conditions, they must also quantify water and nutrient use well, so that the status of the soil at maturity is a good representation of the starting conditions for the next cropping sequence. To assess the suitability for this task a range of crop models, currently used in Australia, were tested. The models differed in their design objectives, complexity and structure and were (i) tested on diverse, independent data sets from a wide range of environments and (ii) model components were further evaluated with one detailed data set from a semi-arid environment. All models were coded into the cropping systems shell APSIM, which provides a common soil water and nitrogen balance. Crop development was input, thus differences between simulations were caused entirely by difference in simulating crop growth. Under nitrogen non-limiting conditions between 73 and 85% of the observed kernel yield variation across environments was explained by the models. This ranged from 51 to 77% under varying nitrogen supply. Water and nitrogen effects on leaf area index were predicted poorly by all models resulting in erroneous predictions of dry matter accumulation and water use. When measured light interception was used as input, most models improved in their prediction of dry matter and yield. This test highlighted a range of compensating errors in all modelling approaches. Time course and final amount of water extraction was simulated well by two models, while others left up to 25% of potentially available soil water in the profile. Kernel nitrogen percentage was predicted poorly by all models due to its sensitivity to small dry matter changes. Yield and dry matter could be estimated adequately for a range of environmental conditions using the general concepts of radiation use efficiency and transpiration efficiency. However, leaf area and kernel nitrogen dynamics need to be improved to achieve better estimates of water and nitrogen use if such models are to be use to evaluate cropping systems. (C) 1998 Elsevier Science B.V.

The Swiss heroin trials: testing alternative approaches

Over half a million heroin misusers receive oral methadone maintenance treatment world-wide1 but the maintenance prescription of injectable opioid drugs, like heroin, remains controversial. In 1992 Switzerland began a large scale evaluation of heroin and other injectable opiate prescribing that eventually involved 1035 misusers. 2 3 The results of the evaluation have recently been reported.4 These show that it was feasible to provide heroin by intravenous injection at a clinic, up to three times a day, for seven days a week. This was done while maintaining good drug control, good order, client safety, and staff morale. Patients were stabilised on 500 to 600 mg heroin daily without evidence of increasing tolerance. Retention in treatment was 89% at six months and 69% at 18 months.4 The self reported use of non-prescribed heroin fell signifianctly, but other drug use was minimally affected. The death rate was 1% per year, and there were no deaths from overdose among participants . . . [Full text of this article]

Formal derivation of finite state machines for class testing

Previous work on generating state machines for the purpose of class testing has not been formally based. There has also been work on deriving state machines from formal specifications for testing non-object-oriented software. We build on this work by presenting a method for deriving a state machine for testing purposes from a formal specification of the class under test. We also show how the resulting state machine can be used as the basis for a test suite developed and executed using an existing framework for class testing. To derive the state machine, we identify the states and possible interactions of the operations of the class under test. The Test Template Framework is used to formally derive the states from the Object-Z specification of the class under test. The transitions of the finite state machine are calculated from the derived states and the class's operations. The formally derived finite state machine is transformed to a ClassBench testgraph, which is used as input to the ClassBench framework to test a C++ implementation of the class. The method is illustrated using a simple bounded queue example.

Weathering of hydrocarbons in mangrove sediments: testing the effects of using dispersants to treat oil spills

This field study was a combined chemical and biological investigation of the relative effects of using dispersants to treat oil spills impacting mangrove habitats. The aim of the chemistry was to determine whether dispersant affected the short- or long-term composition of a medium range crude oil (Gippsland) stranded in a tropical mangrove environment in Queensland, Australia. Sediment cores from three replicate plots of each treatment (oil only and oil plus dispersant) were analyzed for total hydrocarbons and for individual molecular markers (alkanes, aromatics, triterpanes, and steranes). Sediments were collected at 2 days, then 1, 7, 13 and 22 months post-spill. Over this time, oil in the six treated plots decreased exponentially from 36.6 +/- 16.5 to 1.2 +/- 0.8 mg/g dry wt. There was no statistical difference in initial oil concentrations, penetration of oil to depth, or in the rates of oil dissipation between oiled or dispersed oil plots. At 13 months, alkanes were >50% degraded, aromatics were similar to 30% degraded based upon ratios of labile to resistant markers. However, there was no change in the triterpane or sterane biomarker signatures of the retained oil. This is of general forensic interest for pollution events. The predominant removal processes were evaporation (less than or equal to 27%) and dissolution (greater than or equal to 56%), with a lag-phase of 1 month before the start of significant microbial degradation (less than or equal to 7%). The most resistant fraction of the oil that remained after 7 months (the higher molecular weight hydrocarbons) correlated with the initial total organic carbon content of the soil. Removal rate in the Queensland mangroves was significantly faster than that observed in the Caribbean and was related to tidal flushing. (C) 1999 Elsevier Science Ltd. All rights reserved.