Evaluating the effectiveness of Z: The claims made about CICS and where we go from here

There have been few genuine success stories about industrial use of formal methods. Perhaps the best known and most celebrated is the use of Z by IBM (in collaboration with Oxford University's Programming Research Group) during the development of CICS/ESA (version 3.1). This work was rewarded with the prestigious Queen's Award for Technological Achievement in 1992 and is especially notable for two reasons: 1) because it is a commercial, rather than safety- or security-critical, system and 2) because the claims made about the effectiveness of Z are quantitative as well as qualitative. The most widely publicized claims are: less than half the normal number of customer-reported errors and a 9% savings in the total development costs of the release. This paper provides an independent assessment of the effectiveness of using Z on CICS based on the set of public domain documents. Using this evidence, we believe that the case study was important and valuable, but that the quantitative claims have not been substantiated. The intellectual arguments and rationale for formal methods are attractive, but their widespread commercial use is ultimately dependent upon more convincing quantitative demonstrations of effectiveness. Despite the pioneering efforts of IBM and PRG, there is still a need for rigorous, measurement-based case studies to assess when and how the methods are most effective. We describe how future similar case studies could be improved so that the results are more rigorous and conclusive.

Experimental study of the effectiveness of emergency signage

Signage systems play an important role in aiding occupants during both circulation and evacuation. Despite the fact that signage systems are an important component in building wayfinding systems, there is a lack of relevant data regarding how occupants detect, interpret and use the information conveyed by emergency signage. The effectiveness of signage systems is therefore difficult to assess. In this paper we address this issue through experimentation. The experiment involved measuring the impact of a signage system on a population of 68 test subjects who were instructed to individually vacate a building as quickly as possible via any means they thought appropriate. The evacuation path involved a number of decision points at which emergency signage was available to identify the appropriate path. Through analysis of video footage and data derived from questionnaires, the number of people who saw and utilised the signage information to assist their egress is determined. The results are then incorporated within the buildingEXODUS software and used in a demonstration of agent interaction with signage systems in a hypothetical evacuation scenario.

The impact of powder flowing properties on dosator filling system operation

Purpose: To study the impact of powder flow properties on dosator filling systems, with particular focus on improvements in dose weight accuracy and repeatability. Method: This study evaluates a range of critical powder flow properties such as: flow function, cohesion, wall friction, adhesion to wall surfaces, density/compressibility data, stress ratio “K” and gas permeability. The characterisations of the powders considered in this study were undertaken using an annular shear cell using a sample size of 0.5 litres. This tester also incorporated the facility to measure bed expansion during shear in addition to contraction under consolidation forces. A modified Jenike type linear wall friction tester was used to develop the failure loci for the powder sample in conjunction with multiple wall samples (representing a variety of material types and surface finishes). Measurements of the ratio of applied normal stress versus lateral stress were determined using a piece of test equipment specifically designed for the purpose. Results: The correct characterisation of powders and the incorporation of this data into the design of process equipment are recognised as critical for reliable and accurate operation. An example of one aspect of this work is the stress ratio “K”. This characteristic is not well understood or correctly interpreted in many cases – despite its importance. Fig 1 [Omitted] (illustrates a sample of test data. The slope of the line gives the stress ratio in a uniaxial compaction system – indicating the behaviour of the material under compaction during dosing processes. Conclusions: A correct assessment of the bulk powder properties for a given formulation can allow prediction of: cavity filling behaviour (and hence dosage), efficiency of release from dosator, and strength and stability of extruded dose en route to capsule filling Influences over the effectiveness of dosator systems have been shown to be impacted upon by: bed pre-compaction history, gas permeability in the bed (with respect to local density effects), and friction effects for materials of construction for dosators