Does calibration reduce variability in the assessment of accounting learning outcomes?

Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.

The calibration of student judgement through self-assessment: disruptive effects of assessment patterns

Can extended opportunities for self-assessment over time help students develop the capacity to make better judgements about their work? Using evidence gathered through students' voluntary self-assessment of their performance with respect to assessment tasks in two different disciplines at two Australian universities, the paper focuses on the effects of sequences of units of study and the use of different types of assessment task (written, oral, analysis, and project) in the development of student judgement. Convergence between student criteria-based gradings of their own performance in units of study and those allocated by tutors was analysed to explore the calibration of students' judgement over time. First, it seeks to replicate analyses from an earlier smaller-scale study to confirm that students' judgements can be calibrated through continuing opportunities for self-assessment and feedback. Second, it extends the analysis to coherently designed sequences of units of study and explores the effects of different types of assessment. It finds that disruptive patterns of assessment within a sequence of subjects can reduce convergence between student and tutor judgements.

Can written nursing practice standards improve documentation of initial assessment of ED patients?

Introduction: There is wide variation in emergency nursing practice in terms of initial patient assessment and the interventions implemented in response to these patient assessment findings. It is hypothesised that written ED nursing practice standards will reduce variability in documentation standards related to initial patient assessment.

Aim: This study aimed to examine the effect of written ED nursing practice standards augmented by an in-service education programme on the documentation of the initial nursing assessment.

Method: A pre-test/post-test design was used. Initial patient assessment was assessed using the Emergency Department Observation Chart. All adult patients (>18 years) who presented with chest pain and who were triaged to the general adult cubicles were eligible for inclusion in the study. Random sampling was used to select the patients for the pre-test (n = 78) and post-test groups (n = 74).

Results: There was significant improvement in documentation of all aspects of symptom assessment except quality and historical variables: pre-hospital care, cardiac risk factors, and past medical history. Improvements in documentation of elements of primary survey assessment were variable. There were significant increases in documentation of respiratory effort, chest auscultation findings, capillary refill and conscious state. There was a significant 18.3% decrease in the frequency of documentation of respiratory rate and no significant changes in documentation of oxygen saturation, heart rate or blood pressure.

Conclusion: Written ED nursing practice standards were effective in improving the documentation of some elements of initial nursing assessment for patients with chest pain. Active implementation strategies are important to ensure effective uptake of written practice standards and the relationship between nursing documentation and actual clinical practice warrants further consideration using a naturalistic approach in real practice settings.

A security evaluation criteria for baseline security standards

Recent advances in technology and new software applications are steadily transforming human civilization into what is called the Information Society. This is manifested by the new terminology appearing in our daily activities. E-Business, E-Government, E-Learning, E-Contracting, and E-Voting are just a few of the ever-growing list of new terms that are shaping the Information Society. Nonetheless, as "Information" gains more prominence in our society, the task of securing it against all forms of threats becomes a vital and crucial undertaking. Addressing the various security issues confronting our new Information Society, this volume is divided into 13 parts covering the following topics: Information Security Management; Standards of Information Security; Threats and Attacks to Information; Education and Curriculum for Information Security; Social and Ethical Aspects of Information Security; Information Security Services; Multilateral Security; Applications of Information Security; Infrastructure for Information Security Advanced Topics in Security; Legislation for Information Security; Modeling and Analysis for Information Security; Tools for Information Security. Security in the Information Society: Visions and Perspectives comprises the proceedings of the 17th International Conference on Information Security (SEC2002), which was sponsored by the International Federation for Information Processing (IFIP), and jointly organized by IFIP Technical Committee 11 and the Department of Electronics and Electrical Communications of Cairo University. The conference was held in May 2002 in Cairo, Egypt. This volume is essential reading for scholars, researchers, and practitioners interested inkeeping pace with the ever-growing field of Information Security.

Assessment as a strategic tool for enhancing learning in teacher education: a case study

This small exploratory case study describes an attempt to integrate the academic and practical aspects of a teacher education course in order to promote deep understanding of children's ways of understanding mathematics. The assessment regime of the course was used as a strategic tool for engaging students, and the assessment tasks themselves were used as the means of generating genuine integration, or case knowledge, of the content of the course. The results indicate that the approach was effective in achieving the aims of the course, and student reaction to the approach was extremely positive.

Teacher and peer assessment of creativity in technology education

This study, part of a PhD thesis, investigates a number of aspects relating to technology education, creativity and the assessment of creativity and aesthetics. Following tuitional sessions, panels of upper primary school children were involved in assessing the creative and aesthetic characteristics of technological products made by other children. Teachers assessed a selection of student drawings for creativity and these results were compared against the corresponding products assessed by the panels of Year 5 children. Subjects were administered a test on their knowledge of technology and these scores were compared to product creativity scores. The results showed high correlations between the assessor ranks for both creativity and aesthetics although there was generally more consistency with creativity. While some subjects produced both creative drawings and products, others showed creativity in only one outcome. A further finding of the investigation identified the relationship between students' knowledge of technology and the creative product constructed by the older children in the study.

Producing a GIS based multiple criteria analysis tool for regional sustainability assessment: the problem of weighting

Decision support tools will be useful in guiding regions to sustainability. These need to be simple but effective at identifying, for regional managers, areas most in need of initiatives to progress sustainability. Multiple criteria analysis (MCA) is often used as a decision support tool for a wide range of applications. This method allows many criteria to be considered at one time. It does this by giving a ranking of possible options based on how closely each option meets the criteria. Thus, it is suited to the assessment of regional sustainability as it can consider a number of indicators simultaneously and demonstrates how sustainability can vary at small scales across the region. Coupling MCA with GIS to produce maps, allows this analysis to become visual giving the manager a picture of sustainability across the region. To do this each indicator is standardised to a common scale so that it can be compared to other indicators. A weighting is then applied to each indicator to calculate weighted summation for each area in the region. This paper argues that this is the critical step in developing a useful decision support tool. A study being conducted in south west Victoria demonstrates that the weights chosen can have a dramatic impact on the results of the sustainability assessment. It is therefore imperative that careful consideration be given to determining indicator weights in a way that is objective and fully considers the impact of that indicator on regional sustainability.

Handbook of teacher education : globalization, standards and professionalism in times of change

This book provides an international review of the current state of teacher education, with chapters from an international group of teacher educators. It focuses on major issues that are confronting teacher educators now and in the next decade. These include the impact of globalization on the profession of teaching, and how teacher education must deal with changing accountability requirements from governments and establish a set of minimum standards acceptable to enable a person to teach. The work also considers aspects of the three major phases of teacher education: the period prior to commencing in the profession, successful induction into the profession, and the ongoing professional development of teachers. Finally, it identifies ways in which new technologies can be used to improve the training and ongoing development of teachers. Cases from different countries are used to provide a rich base of data to help us understand how the profession is moving onwards.

Academic assessment of arts management journals: a multidimensional rating survey

The authors report the results of a journal rating survey assessing 14 publications dedicated to arts management and related topics. Establishing a rating scheme for journals is an important step in the professionalization of an academic field. The authors argue that the development of a rating system in arts management is in the best interests of the discipline. Academics used weighted multidimensional perceptual ratings to evaluate each journal’s prestige, contribution to theory, contribution to practice and contribution to teaching. Cluster analysis using these four criteria identified three classes of journals: A, B+ and B. The setting of standards serves to identify quality goals for academics and journal editors alike, thus enhancing the standing of arts management as a subdiscipline of management.

Narrative and portfolio approaches to teacher professional standards

This paper analyses various uses of narrative in the exploration of teacher identity. It highlights the way many contemporary education writers use terminology such as ‘storying lives’ and ‘storied landscapes’ to describe teacher processes of reflection on practice. In this paper the authors discuss some recent approaches to narrative that incorporate or suggest systematic uses of narrative theory (Conle 2003, Kamler, 2001, Richardson, 2003). Consideration is also given to the links between critical ethnography and narrative in order to critique the use of teacher portfolios, as in a recent Australian initiative for the appraisal of beginning teachers. The authors conclude with an argument for the rehabilitation and refinement of narrative theory in the ‘writing’ of teacher identity.