Researching quality and equity in assessment for improved learner outcomes

Quality and equity issues as they relate to assessment practices and policy are becoming increasingly important as Australia introduces a national curriculum and achievement standards. In a context of high-stakes accountability, concerns regarding equity and quality have important implications for teachers‘ practice for the improvement of learner outcomes. This article is based on three research projects that were conducted over the past four years and were funded by the Australian Federal Government. The research focus, emergent questions, the educational contexts, and the rationale for the studies are discussed prior to the presentation of the analysis of the research findings and the implications for teachers‘ practice and policy reform.

The Development of Competency Standards for Specialist Critical Care Nurses

In defining the contemporary role of the specialist nurse it is necessary to challenge the concept of nursing as merely a combination of skills and knowledge. Nursing must be demonstrated and defined in the context of client care and include the broader notions of professional development and competence. This qualitative study sought to identify the competency standards for nurse specialists in critical care and to articulate the differences between entry-to-practice standards and the advanced practice of specialist nurses. Over 800 hours of specialist critical care nursing practice were observed and grouped into 'domains' or major themes of specialist practice using a constant comparison qualitative technique. These domains were further refined to describe attributes of the registered nurses which resulted in effective and/or superior performance (competency standards) and to provide examples of performance (performance criteria) which met the defined standard. Constant comparison of the emerging domains, competency standards and performance criteria to observations of specialist critical care practice, ensured the results provided a true reflection of the specialist nursing role. Data analysis resulted in 20 competency standards grouped into six domains: professional practice, reflective practice, enabling, clinical problem solving, teamwork, and leadership. Each of these domains is comprised of between two and seven competency standards. Each standard is further divided into component parts or 'elements' and the elements are illustrated with performance criteria. The competency standards are currently being used in several Australian critical care educational programmes and are the foundation for an emerging critical care credentialling process. They have been viewed with interest by a variety of non-critical care specialty groups and may form a common precursor from which further specialist nursing practice assessment will evolve.

Making a case for social impact assessment in urban development : social impacts and legal disputes in Queensland, Australia

Urban land use planning and policy decisions are often contested, with the multiple stakeholders (business, developers, residents, policymakers and the wider community) frequently holding opposing viewpoints about the issues and best solution. In recent years, however, the participatory process of social impact assessment (SIA) has received significant attention as a way to mitigate conflict, facilitating negotiation and conflict resolution. This paper examines how social impacts have informed development appeals in Australia, focussing on ten cases from the Queensland Planning and Environment Court (QPEC). Half are appeals from community members (typically neighbours) wanting to oppose approvals and half from organisations appealing against City Councils’ decisions to deny their development applications. While legal challenges do not necessarily reflect attitudes and practices, they provide a means to begin to assess how social impacts (although not often explicitly defined as such) inform development related disputes. Based on the nature and outcomes of 10 QPEC cases, we argue that many legal cases could have been avoided if SIA had been undertaken appropriately. First, the issues in each case are clearly social, incorporating impacts on amenity, the character of an area, the needs of different social groups, perceptions of risk and a range of other social issues. Second, the outcomes and recommendations from each case, such as negotiating agreements, modifying plans and accommodating community concerns would have been equally served thorough SIA. Our argument is that engagement at an early stage, utilising SIA, could have likely achieved the same result in a less adversarial and much less expensive and time-consuming environment than a legal case.

Reasonable adjustments in assessment : putting law and policy into practice in Australia

The Australian Disability Standards for Education 2005 (Cth) require education providers to make reasonable adjustments in educational assessment so that students with disability can participate on the same basis as other students and be able to demonstrate what they know and can do. Reasonableness is governed by a determination of the balance of interests, benefits and detriment to the parties involved. The Standards require providers to consult with students and associates on adjustments, although guidance on how consultation should occur and how the views of students and associates are to be taken into account is vague. In this article, we identify three principles to be considered in order to put appropriate and effective reasonable adjustments in assessment into practice. While Australian law and assessment contexts are used to examine intentions, expectations and practices in educational assessment for students with disability, we argue that these three principles must be considered in any national education system to ensure equitable assessment practices and achieve equitable educational inclusion for students with disability.

The assessment of students with disabilities : the Australian law as to reasonable adjustment and academic integrity

This paper explains the legislation which underpins the right to reasonable adjustment in education for students with disabilities in Australian schools. It gives examples of the kinds of adjustment which may be made to promote equality of opportunity in the area of assessment. It also considers how the law has constructed the border between reasonable adjustment and academic integrity.

Motorcycle Safety Research Project Interim Report 2 : Review of the Consistent Assessment Process (CAP)

Motorcycle trauma is a serious road safety issue in Queensland and throughout Australia. In 2009, Queensland Transport (later Transport and Main Roads or TMR) appointed CARRS-Q to provide a three-year program of Road Safety Research Services for Motorcycle Rider Safety. Funding for this research originated from the Motor Accident Insurance Commission. This program of research was undertaken to produce knowledge to assist TMR to improve motorcycle safety by further strengthening the licensing and training system to make learner riders safer by developing a pre-learner package (Deliverable 1), and by evaluating the Q-Ride CAP program to ensure that it is maximally effective and contributes to the best possible training for new riders (Deliverable 2), which is the focus of this report. Deliverable 3 of the program identified potential new licensing components that will reduce the incidence of risky riding and improve higher-order cognitive skills in new riders. This report provides a summary of Deliverables 2.1 through to 2.4.

Intercultural competence in engineering education : who are we teaching?

BACKGROUND There is little doubt that our engineering graduates’ ability to identify cultural differences and their potential to impact on engineering projects, and to work effectively with these differences is of key importance in the modern engineering practice. Within engineering degree programs themselves there is also a significant need to recognise the impact of changing student and staff profiles on what happens in the classroom. The research described in this paper forms part of a larger project exploring issues of intercultural competence in engineering. PURPOSE This paper presents an observational and survey study of undergraduate and postgraduate engineering students from four institutions working in groups on tasks with a purely technical focus, or with a cultural and humanitarian element. The study sought to explore how students rate their own intercultural competence and team process and whether any differences exist depending on the nature of the task they are working on. We also investigated whether any differences were evident between groups of first year, second year and postgraduate students. DESIGN/METHOD The study used the miniCQS instrument (Ang & Van Dyne, 2008) and a Bales Interaction Process Analysis based scale (Bales, 1950; Carney, 1976) to collect students self ratings of group process, task management, and cultural experience and behaviour. The Bales IPA was also used for coding video observations of students working in groups. Survey data were used to form descriptive variables to compare outcomes across the different tasks and contexts. Observations analysed in Nvivo were used to provide commentary and additional detail on the quantitative data. RESULTS The results of the survey indicated consistent mean scores on each survey item for each group of students, despite vastly different tasks, student backgrounds and educational contexts. Some small, statistically significant mean differences existed, offering some basic insights into how task and student group composition could affect self ratings. Overall though, the results suggest minimal shift in how students view group function and their intercultural experience, irrespective of differing educational experience. CONCLUSIONS The survey results, contrasted with group observations, indicate that either students are not translating their experience (in the group tasks) into critical self assessment of their cultural competence and teamwork, or that they become more critical of team performance and cultural competence as their competence in these areas grows, so their ratings remain consistent. Both outcomes indicate that students need more intensive guidance to build their critical self and peer assessment skills in these areas irrespective of their year level of study.

Security assessment of code refactoring rules

Refactoring is a common approach to producing better quality software. Its impact on many software quality properties, including reusability, maintainability and performance, has been studied and measured extensively. However, its impact on the information security of programs has received relatively little attention. In this work, we assess the impact of a number of the most common code-level refactoring rules on data security, using security metrics that are capable of measuring security from the viewpoint of potential information flow. The metrics are calculated for a given Java program using a static analysis tool we have developed to automatically analyse compiled Java bytecode. We ran our Java code analyser on various programs which were refactored according to each rule. New values of the metrics for the refactored programs then confirmed that the code changes had a measurable effect on information security.

Curriculum, assessment teaching and learning for all

This chapter explores how the culture of classrooms and schools can acknowledge diversity and meet all learning needs. Classroom and school culture can and should enhance the belonging and learning of all students. Understanding of learning, curriculum, pedagogy and assessment influences the ways teachers consider their expectations of student achievement and participation in school. We revisit the theory of social constructionism to emphasise the development of shared and valued curriculum, which meets all learner needs. Decisions about what to teach, how to teach and assess, and what supports student needs are important considerations discussed in this chapter. Key messages drawn from the Australian and New Zealand curriculum reinforce the need to ensure education responds to the diversity of students in classrooms. A range of models of pedagogy that have influenced education in Australia and New Zealand are presented, with a particular focus on meeting the needs of students who have disabilities. In addition, the issues related to student and teacher identity, the importance of respectful partnerships that acknowledge family knowledge, and respectful collaboration are discussed. Belonging to a community of learners is made possible through teachers forming authentic relationships with students and their families. In turn, these relationships support teachers to understand how the students in their classrooms learn, and to know their students’ strengths and interests.

The impact of surgical ward nurses practicing respiratory assessment on positive patient outcomes

Objective: A literature review to examine the incorporation of respiratory assessment into everyday surgical nursing practice; possible barriers to this; and the relationship to patient outcomes. Primary argument: Escalating demands on intensive care beds have led to highly dependent patients being cared for in general surgical ward areas. This change in patient demographics has meant the knowledge and skills required of registered nurses in these areas has expanded exponentially. The literature supported the notion that postoperative monitoring of vital signs should include the fundamental assessment of respiratory rate; depth and rhythm; work of breathing; use of accessory muscles and symmetrical chest movement; as well as auscultation of lung fields using a stethoscope. Early intervention in response to changes in a patient's respiratory health status impacts positively on patient health outcomes. Substantial support exists for the contention that technologically adept nurses who also possess competent respiratory assessment skills make a difference to respiratory care. Conclusions: Sub-clinical respiratory problems have been demonstrated to contribute to adverse events. There is a paucity of research knowledge as to whether respiratory education programs and associated inservice make a difference to nursing clinical practice. Similarly, the implications for associated respiratory educational needs are not well documented, nor has a research base been sufficiently developed to guide nursing practice. Further research has the potential to influence the future role and function of the registered nurse by determining the importance of respiratory education programs on post-operative patient outcomes.

Planning for transit system reliability using productive performance and risk assessment

Urban transit system performance may be quantified and assessed using transit capacity and productive capacity for planning, design and operational management. Bunker (4) defines important productive performance measures of an individual transit service and transit line. Transit work (p-km) captures transit task performed over distance. Transit productiveness (p-km/h) captures transit work performed over time. This paper applies productive performance with risk assessment to quantify transit system reliability. Theory is developed to monetize transit segment reliability risk on the basis of demonstration Annual Reliability Event rates by transit facility type, segment productiveness, and unit-event severity. A comparative example of peak hour performance of a transit sub-system containing bus-on-street, busway, and rail components in Brisbane, Australia demonstrates through practical application the importance of valuing reliability. Comparison reveals the highest risk segments to be long, highly productive on street bus segments followed by busway (BRT) segments and then rail segments. A transit reliability risk reduction treatment example demonstrates that benefits can be significant and should be incorporated into project evaluation in addition to those of regular travel time savings, reduced emissions and safety improvements. Reliability can be used to identify high risk components of the transit system and draw comparisons between modes both in planning and operations settings, and value improvement scenarios in a project evaluation setting. The methodology can also be applied to inform daily transit system operational management.

Planning for transit system reliability using productive performance and risk assessment

Urban transit system performance may be quantified and assessed using transit capacity and productive capacity for planning, design and operational management. Bunker (4) defines important productive performance measures of an individual transit service and transit line. Transit work (p-km) captures transit task performed over distance. Transit productiveness (p-km/h) captures transit work performed over time. This paper applies productive performance with risk assessment to quantify transit system reliability. Theory is developed to monetize transit segment reliability risk on the basis of demonstration Annual Reliability Event rates by transit facility type, segment productiveness, and unit-event severity. A comparative example of peak hour performance of a transit sub-system containing bus-on-street, busway, and rail components in Brisbane, Australia demonstrates through practical application the importance of valuing reliability. Comparison reveals the highest risk segments to be long, highly productive on street bus segments followed by busway (BRT) segments and then rail segments. A transit reliability risk reduction treatment example demonstrates that benefits can be significant and should be incorporated into project evaluation in addition to those of regular travel time savings, reduced emissions and safety improvements. Reliability can be used to identify high risk components of the transit system and draw comparisons between modes both in planning and operations settings, and value improvement scenarios in a project evaluation setting. The methodology can also be applied to inform daily transit system operational management.