Evaluating the effectiveness of Z: The claims made about CICS and where we go from here

There have been few genuine success stories about industrial use of formal methods. Perhaps the best known and most celebrated is the use of Z by IBM (in collaboration with Oxford University's Programming Research Group) during the development of CICS/ESA (version 3.1). This work was rewarded with the prestigious Queen's Award for Technological Achievement in 1992 and is especially notable for two reasons: 1) because it is a commercial, rather than safety- or security-critical, system and 2) because the claims made about the effectiveness of Z are quantitative as well as qualitative. The most widely publicized claims are: less than half the normal number of customer-reported errors and a 9% savings in the total development costs of the release. This paper provides an independent assessment of the effectiveness of using Z on CICS based on the set of public domain documents. Using this evidence, we believe that the case study was important and valuable, but that the quantitative claims have not been substantiated. The intellectual arguments and rationale for formal methods are attractive, but their widespread commercial use is ultimately dependent upon more convincing quantitative demonstrations of effectiveness. Despite the pioneering efforts of IBM and PRG, there is still a need for rigorous, measurement-based case studies to assess when and how the methods are most effective. We describe how future similar case studies could be improved so that the results are more rigorous and conclusive.

Experimental study of the effectiveness of emergency signage

Signage systems play an important role in aiding occupants during both circulation and evacuation. Despite the fact that signage systems are an important component in building wayfinding systems, there is a lack of relevant data regarding how occupants detect, interpret and use the information conveyed by emergency signage. The effectiveness of signage systems is therefore difficult to assess. In this paper we address this issue through experimentation. The experiment involved measuring the impact of a signage system on a population of 68 test subjects who were instructed to individually vacate a building as quickly as possible via any means they thought appropriate. The evacuation path involved a number of decision points at which emergency signage was available to identify the appropriate path. Through analysis of video footage and data derived from questionnaires, the number of people who saw and utilised the signage information to assist their egress is determined. The results are then incorporated within the buildingEXODUS software and used in a demonstration of agent interaction with signage systems in a hypothetical evacuation scenario.

A case study of the effectiveness of the electronic survey as a research tool for measuring students' experience of e-learning

This paper uses a case study approach to consider the effectiveness of the electronic survey as a research tool to measure the learner voice about experiences of e-learning in a particular institutional case. Two large scale electronic surveys were carried out for the Student Experience of e-Learning (SEEL) project at the University of Greenwich in 2007 and 2008, funded by the UK Higher Education Academy (HEA). The paper considers this case to argue that, although the electronic web-based survey is a convenient method of quantitative and qualitative data collection, enabling higher education institutions swiftly to capture multiple views of large numbers of students regarding experiences of e-learning, for more robust analysis, electronic survey research is best combined with other methods of in-depth qualitative data collection. The advantages and disadvantages of the electronic survey as a research method to capture student experiences of e-learning are the focus of analysis in this short paper, which reports an overview of large-scale data collection (1,000+ responses) from two electronic surveys administered to students using surveymonkey as a web-based survey tool as part of the SEEL research project. Advantages of web-based electronic survey design include flexibility, ease of design, high degree of designer control, convenience, low costs, data security, ease of access and guarantee of confidentiality combined with researcher ability to identify users through email addresses. Disadvantages of electronic survey design include the self-selecting nature of web-enabled respondent participation, which tends to skew data collection towards students who respond effectively to email invitations. The relative inadequacy of electronic surveys to capture in-depth qualitative views of students is discussed with regard to prior recommendations from the JISC-funded Learners' Experiences of e-Learning (LEX) project, in consideration of the results from SEEL in-depth interviews with students. The paper considers the literature on web-based and email electronic survey design, summing up the relative advantages and disadvantages of electronic surveys as a tool for student experience of e-learning research. The paper concludes with a range of recommendations for designing future electronic surveys to capture the learner voice on e-learning, contributing to evidence-based learning technology research development in higher education.

Reaching across organisational, sectoral and geographical boundaries: exploring the learning potential of an EU cross-border project

Research This paper outlines some of the key findings from an evaluation of the project and demonstrates that EC funded projects such as this, which seek to promote cross border collaboration and understanding (i.e. across organisational, sectoral and geographical boundaries) offer considerable learning potential – not least about variances in health politics across different communities. However, for this learning to be realised a comprehensive system of knowledge management needs to be an integral part of project planning alongside a system for sustaining embryonic professional networks. The concept of managing relationships was also a key part of the projects success. Executing a project funded by the EU demands the development of complex organisational skills to negotiate all the administrative challenges en route to successful completion and this project in particular relied for its success on the development of social relationships of trust and mutual respect across national, professional and social boundaries. Context A three–year European Commission funded project designed to exchange a wide range of staff (professional semiprofessional and voluntary staff in health and social care) project led by the University of Greenwich (UK) and the Université Catholique de Lille, France was completed this year (February 2008). The project was complex because it involved working in different national contexts, was multi-disciplinary, and demanded the negotiation of multiple boundaries. Theories A mixed method evaluation including written reports gathered immediately after each exchange visit and a post hoc series of individual interviews and focus groups was conducted in order to gain qualitative information (from the participants perspective) on their experiences and to identify any learning gained. Results Analysis of the data provided evidence of learning on a number of levels; personally, inter and intra professionally and organisationally as well as across sectors and also from a project management perspective. The learning crystallised around the extent of the differences noted by the participants between the UK and the French health and social care systems despite geographical proximity, common membership of the EU and many shared challenges in health and social care. The extent of these differences, noted at every level from policy to practice proved a rich source for reflection on organisational philosophies, ways of working, distribution of resources, professional roles and autonomy and professional registration and mobility - in short on health politics at ‘macro’ and ‘micro’ levels.

Relational dimensions of corporate governance in translation: networked governance in China and India

The effectiveness of corporate governance mechanisms has been a subject of academic research for many decades. Although the large majority of corporate governance studies prior to mid 1990s were based on data from developed market economies such as the U.S., U.K. and Japan, in recent years researchers have begun examining corporate governance in transition economies. A comparison of China and India offers a unique environment for analyzing the effectiveness of corporate governance. First, both countries state-owned enterprise (SOE) reform strategies hinges on the Modern Enterprise System characterized by the separation of ownership and control. Ownership of an SOE’s assets is distributed among the government, institutional investors, managers, employees, and private investors. Effective control rights are assigned to management, which generally has a very small, or even nonexistent ownership stake. This distinctive shareholding structure creates conflict of interest not only between management (insiders) and outside investors but also between large shareholders and minority investors. Moreover, because both governments desire to retain some control—in part through partial retained ownership of commercialized SOEs, further conflicts arise between politicians and firms. Second, directors in publicly listed firms in both countries are predominantly drawn from institutions with significant non-market objectives: the government and other state enterprises, particularly in China, and extended families, particularly in India. As a result, the effectiveness of internal governance mechanisms, such as the number of independent directors on the board and the number of independent supervisors on the supervisory committee, are likely to be quiet limited, although this has yet to be fully evaluated. Third, because of the political nature of the privatization process itself, typical external governance mechanisms, such as debt (in conjunction with appropriate bankruptcy procedures), takeover threats, legal protection of investors, product market competition, etc., have not been effective. Bank loans have traditionally been viewed as grants from the state designed to bail out failing firms. State-owned banks retain monopoly or quasi-monopoly positions in the banking sector and profit is not their overriding objective. If political favor is deemed appropriate, subsidized loans, rescheduling of overdue debt or even outright transfer of funds can be arranged with SOEs (soft budget constraints). In addition, a market for private, non-bank debt is limited in India and has yet to be established China. There is no active merger or takeover activity in Chinese stock markets to discipline management. Information available in the capital markets is insufficient to keep at arm’s length of the corporate decisions. In light of the above peculiarities, China and India share many of the typical institutional characteristics as a transition economy, including poor legal protection of creditors and investors, the absence of an effective takeover market, an underdeveloped capital market, a relative inefficient banking system and significant interference of politicians in firm management. Su (2005) finds that the extent of political interference, managerial entrenchment and institutional control can help explain corporate dividend policies and post-IPO financing choices in this situation. Allen et al. (2005) demonstrate that standard corporate governance mechanisms are weak and ineffective for publicly listed firms while alternative governance mechanisms based on reputation and relationship have been remarkably effective in the private sector. Because the peculiarities are significant in this context, the differences in the political-economies of the two countries are likely to be evident in such relational terms. In this paper we explore the peculiarities of corporate governance in this transitional environment through a systematic examination of certain aspects of these reputational and relationship dimensions. Utilising the methods of social network analysis we identify the inter-organisational relationships at board level formed by equity holdings and by shared directors. Using data drawn from the Orbis database we map these relations among the 3700 largest firms in India and China respectively and identify the roles played in these relational networks by the particularly characteristic institutions in each case. We find greatly different social network structures in each case with some support in these relational dimensions for their distinctive features of governance. Further, the social network metrics allow us to considerably refine proxies for political interference, managerial entrenchment and institutional control used in earlier econometric analysis.

Organisational whistleblowing policies: making employees responsible or liable?

This paper explores the possible impact of the recent legal developments on organizational whistleblowing on the autonomy and responsibility of whistleblowers. In the past thirty years numerous pieces of legislation have been passed to offer protection to whistleblowers from retaliation for disclosing organisational wrongdoing. An area that remains uncertain in relation to whistleblowing and its related policies in organisations, is whether these policies actually increase the individualisation of work, allowing employees to behave in accordance with their conscience and in line with societal expectations or whether they are another management tool to control employees and protect organisations from them. The assumptions of whistleblower protection with regard to moral autonomy are examined in order to clarify the purpose of whistleblower protection at work. The two extreme positions in the discourse of whistleblowing are that whistleblowing legislation and policies either aim to enable individual responsibility and moral autonomy at work, or they aim to protect organisations by allowing them to control employees and make them liable for ethics at work.