User dyads in software testing: bypassing the need for expert observers

This paper arises out of a research study into the online help facilities provided in popular software applications such as word processors. Its particular focus is on experimental methods of evaluating the effectiveness and usability of those facilities. Focus groups, questionnaires, and online surveys had already been used in other phases of the study, but it was judged that these approaches would be unsuitable for measuring effectiveness and usability because they are susceptible to respondents' subjectivity. Direct observation of people working on set word-processing tasks was ruled out initially because of a lack of trained observers; it would have taken too long for the investigator to observe a large enough sample by himself. Automatic recording of users' actions was also rejected, as it would have demanded equipment and/or software that was not available and seemed too expensive to acquire. The approach and techniques described here were an attempt to overcome these difficulties by using observers drawn from the same population of students that provided the test subjects; as a by-product, this may also have enhanced the acceptability (and hence possibly the validity) of the experiments by reducing the exam pressure perceived by participants.

Going up? Women in the public sector

Abstract: Purpose – This paper aims to document women's reflections on their careers over a ten-year period to provide quantitative baseline data on which to frame follow-up in-depth interviews. The participants work in the public service in Queensland (Australia) and had been recommended for, and participated in, women in management (WIM) courses conducted in the early 1990s. Design/methodology/approach – Data were collected by means of a survey (containing closed and open items) which gathered demographic data and data related to employment history, perceptions of success and satisfaction, and the women's future career expectations. Findings – Findings revealed that the percentage of women in middle and senior management had increased over the ten-year period, although not to the extent one might have anticipated, given that the women had been targeted as high flyers by their supervisors. While not content with their classification levels (i.e. seniority), the majority of the cohort viewed their careers as being successful. Practical implications – Questions arise from this study as to why women are still “not getting to the top”. There are also policy implications for the public service concerning women's possible “reinventive contribution” and training implications associated with women only courses. Originality/value – The study is part of an Australian longitudinal study on the careers of women who attended a prestigious women-only management course in the early 1990s in Queensland. This is now becoming a study of older women.

'Worldmarks': Web guidelines for socially and culturally responsive assessment in university classrooms

In the early 21st century, we need to prepare university students to navigate local and global cultures effectively and sensitively. These future professionals must develop comprehensive intercultural communication skills and understanding. Yet university assessment in Australia is often based on a western template of knowledge, which automatically places International, Indigenous, as well as certain groups of local students at a study disadvantage. It also ensures that Australian students from dominant groups are not given the opportunity to develop these vital intercultural skills. This paper explores the issues embedded in themes 1 and 4 of this conference and provides details of an innovative website developed at Queensland University of Technology in Brisbane, Australia, which encourages academic staff to investigate the hidden assumptions that can underpin their assessment practices. The website also suggests strategies academics can use to ensure that their assessment becomes more socially and culturally responsive.