Raising the stakes: the challenges for teacher assessment

These are changing times in Australia for teachers and their students, with the introduction of a national curriculum and standards driven reform. While countries in Europe such as England, and in Asia such as Singapore, are changing policy to use assessment in the support of and improvement of learning it appears that we in Australia are moving towards creating policy that will raise the assessment stakes for the putative purposes of transparency, accountability and fairness. What can be learnt from countries that have had years of high stakes testing? How can Australia avoid the mistakes of past curriculum and assessment reform efforts? And how can Australian teachers build their capacity to maximise their use of the learning power of assessment? These are the questions that are addressed in this article, with reference to innovative research from global networks that have maintained the assessment focus on learning rather than accountability practices.

Validity and reliability of instruments designed to measure factors influencing the overuse of antibiotics

Background: Antibiotic overuse is a global public health issue that is influenced by several factors. The degree and prevalence of antibiotic overuse is difficult to measure directly. A more practical approach, such as the use of a psycho-social measurement instrument, might allow for the observation and assessment of patterns of antibiotic use. Study objective: The aim of this paper is to review the nature, validity, and reliability of measurement scales designed to measure factors associated with antibiotic misuse/overuse. Design: This study is descriptive and includes a systematic integration of the measurement scales used in the literature to measure factors associated with antibiotic misuse/overuse. The review included 70 international scientific publications from 1992 to 2010. Main results: Studies have presented scales to measure antibiotic misuse. However, the workup of these instruments is often not mentioned, or the scales are used with only early-phase validation, such as content or face validity. Other studies have discussed the reliability of these scales. However, the full validation process has not been discussed in any of the reviewed measurement scales. Conclusion: A reliable, fully validated measurement scale must be developed to assess the factors associated with the overuse of antibiotics. Identifying these factors will help to minimize the misuse of antibiotics.

Modeling random effect and excess zeros in road traffic accident prediction

Poisson distribution has often been used for count like accident data. Negative Binomial (NB) distribution has been adopted in the count data to take care of the over-dispersion problem. However, Poisson and NB distributions are incapable of taking into account some unobserved heterogeneities due to spatial and temporal effects of accident data. To overcome this problem, Random Effect models have been developed. Again another challenge with existing traffic accident prediction models is the distribution of excess zero accident observations in some accident data. Although Zero-Inflated Poisson (ZIP) model is capable of handling the dual-state system in accident data with excess zero observations, it does not accommodate the within-location correlation and between-location correlation heterogeneities which are the basic motivations for the need of the Random Effect models. This paper proposes an effective way of fitting ZIP model with location specific random effects and for model calibration and assessment the Bayesian analysis is recommended.

Building prosperous knowledge cities : policies, plans and metrics

This unique book reveals the procedural aspects of knowledge-based urban planning, development and assessment. Concentrating on major knowledge city building processes, and providing state-of-the-art experiences and perspectives, this important compendium explores innovative models, approaches and lessons learnt from a number of key case studies across the world. Many cities worldwide, in order to brand themselves as knowledge cities, have undergone major transformations in the 21st century. This book provides a thorough understanding of these transformations and the key issues in building prosperous knowledge cities by focusing particularly on the policy-making, planning process and performance assessment aspects. The contributors reveal theoretical and conceptual foundations of knowledge cities and their development approach of knowledge-based urban development. They present best-practice examples from a number of key case studies across the globe. This important book provides readers with a thorough understanding of the key issues in planning and developing prosperous knowledge cities of the knowledge economy era, which will prove invaluable to national, state/regional and city governments’ planning and development departments. Academics, postgraduate and undergraduate students of regional and urban studies will also find this path-breaking book an intriguing read.

Teaching and assessing critical thinking : the interaction of student approaches to learning and teaching approaches

This study explored the relationship among student approaches to learning and teaching methods on critical thinking in two business units. Key findings included differences in critical thinking scores between student approaches to learning and some evidence of an interaction between student approaches to learning and critical thinking teach method (immersion vs. infusion). Possible explanations for the results are examined and implications for developing critical thinking skills across a degree discussed. What is apparent is that as Universities move towards program-wide level assessment of critical thinking, further work is required in terms of the design of critical thinking teaching interventions and assessment at the unit, school, and degree level. The session will discuss the challenges in developing critical thinking programs in individual units and at the Faculty level.

Sustaining teacher professionalism in the context of standards referenced assessment reform

Standards referenced reform, tied to reporting, engages directly with assessment issues related to accountability. Assessment is the key to good education and is inseparable from curriculum. In an accountability context, standards are used as a lever to improve the reliability and consistency of teacher judgement; and classroom evidence is used by education systems for reporting and tracking achievement over time. Assessment is thus a powerful driver for change and is at the heart of the teaching-learning dynamic. The relationship between the learner, learning and assessment needs to be kept central and the idea of teacher empowerment is fundamental. This chapter is a call to honour and sustain teacher professionalism through educative forms of school-based and teacher-led evaluation, assessment and communities of judgement practice. It supports the argument for a central place for classroom assessment in the role of assessment in educational accountability...

Orals ain’t orals : the role of prepared oral presentations in the classroom and beyond. How do instruction and feedback practices guide delivery choices?

Despite an ostensibly technology-driven society, the ability to communicate orally continues to feature as an essential ability for students at school and university, as it is for graduates in the workplace. Pedagogically, one rationale is that the need to develop effective oral communication skills is tied to life-long learning which includes successful participation in future work-related tasks. One tangible way that educators have assessed proficiency in the area of communication is through prepared oral presentations. While much of the literature uses the terms 'oral communication' and 'oral presentation' interchangeably, some writers question the role more formal presentations play in the overall development of oral communication skills. However, such formal speaking tasks continue to be a recognised assessment practice in both the secondary school and academy, and, therefore, worthy of further investigation. Adding to the discussion, this thesis explores the knowledge and skills students bring into the academy from previous educational experiences. It examines some of the teaching and assessment methods used in secondary schools to develop oral communication skills through the use of formal oral presentations. Specifically, it investigates criterion-referenced assessment sheets and how these tools are used as a form of instruction, as well as their role and effectiveness in the evaluation of student ability. The focus is on the student's perspective and includes 12 semi-structured interviews with school students. The purpose of this thesis is to explore key thematics underpinning oral communication and to identify tensions between expectations and practice. While acknowledging the breadth and depth of material available under the heading of 'communication theory', this study specifically draws on an expanded view of the rhetorical tradition to fully interrogate the assumptions supporting the practice of assessing oral presentations. Finally, this thesis recommends reconnecting with an updated understanding of rhetoric as a way of assisting in the development of expressive, articulate and discerning communicators.

An Assessment of Undergraduate Paramedic Students’ Empathy Levels

Abstract: Objectives Evidence suggests that improved empathy behaviours among healthcare professionals directly impacts on healthcare outcomes. However, the ‘nebulous’ properties of empathic behaviour often means that healthcare profession educators fail to incorporate the explicit teaching and assessment of empathy within the curriculum. The objective of this study was to assess the extent of empathy in paramedic students across seven Australian universities. Methods A cross-sectional study using a paper-based questionnaire employing a convenience sample of first, second, and third year undergraduate paramedic students. Student empathy levels were measured using the Medical Condition Regard Scale (MCRS). Results A total of 783 students participated in the study of which 57% were females. The medical conditions: intellectual disability, attempted suicide, and acute mental illness all produced mean scores above 50 suggesting good empathetic regard, while patients presenting with substance abuse produced the lowest mean score M= 41.57 (SD=12.29). There was a statistically significant difference between males (M= 49.79) and females (M=51.61) p=0.006, for patients with intellectual disability. Conclusions The findings from this study found that student reported poor empathetic regard for patients with substance abuse, while female students report higher levels of empathy than their male colleagues across each medical condition. The overall findings provide a framework for educators to begin constructing guidelines focusing on the need to incorporate, promote and instil empathy into paramedic students in order to better prepare them for future out-of-hospital healthcare practice.

Interpretations of formative assessment in the teaching of English at two Chinese universities : a sociocultural perspective

Formative assessment is increasingly being implemented through policy initiatives in Chinese educational contexts. As an approach to assessment, formative assessment derives many of its key principles from Western contexts, notably through the work of scholars in the UK, the USA and Australia. The question for this paper is the ways that formative assessment has been interpreted in the teaching of College English in Chinese Higher Education. The paper reports on a research study that utilised a sociocultural perspective on learning and assessment to analyse how two Chinese universities – an urban-based Key University and a regional-based Non-Key University – interpreted and enacted a China Ministry of Education policy on formative assessment in College English teaching. Of particular interest for the research were the ways in which the sociocultural conditions of the Chinese context mediated understanding of Western principles and led to their adaptation. The findings from the two universities identified some consistency in localised interpretations of formative assessment which included emphases on process and student participation. The differences related to the specific sociocultural conditions contextualising each university including geographical location, socioeconomic status, and teacher and student roles, expectations and beliefs about English. The findings illustrate the sociocultural tensions in interpreting, adapting and enacting formative assessment in Chinese College English classes and the consequent challenges to and questions about retaining the spirit of formative assessment as it was originally conceptualised.

Preface to special issue on digital human modelling for vehicle design and manufacturing

The automotive industry has been the focus of digital human modeling (DHM) research and application for many years. In the highly competitive marketplace for personal transportation, the desire to improve the customer’s experience has driven extensive research in both the physical and cognitive interaction between the vehicle and its occupants. Human models provide vehicle designers with tools to view and analyze product interactions before the first prototypes are built, potentially improving the design while reducing cost and development time. The focus of DHM research and applications began with prediction and representation of static postures for purposes of driver workstation layout, including assessments of seat adjustment ranges and exterior vision. Now DHMs are used for seat design and assessment of driver reach and ingress/egress. DHMs and related simulation tools are expanding into the cognitive domain, with computational models of perception and motion, and into the dynamic domain with models of physical responses to ride and vibration. Moreover, DHMs are now widely used to analyze the ergonomics of vehicle assembly tasks. In this case, the analysis aims to determine whether workers can be expected to complete the tasks safely and with good quality. This preface provides a review of the literature to provide context for the nine new papers presented in this special issue.

When does change begin following screening and brief intervention among depressed problem drinkers?

Brief interventions are effective for problem drinking and reductions are known to occur in association with screening and assessment. The present study sought to assess, among participants (N=202) in a clinical trial, how much change occurred between baseline assessment and a one-session brief intervention (S1), and the predictors of early change. The primary focus was on changes in the Beck Depression Inventory Fast Screen scores and alcohol consumption (standard drinks per week) prior to random allocation to nine further sessions addressing either depression, alcohol, or both problems. There were large and clinically significant reductions between baseline and S1, with the strongest predictors being baseline scores in the relevant domain and change in the other domain. Client engagement was also predictive of early depression changes. Monitoring progress in both domains from first contact, and provision of empathic care, followed by brief intervention appear to be useful for this high prevalence comorbidity.

Benefit cost analysis applied to behavioral and engineering safety countermeasures in San Francisco, California

The state of the practice in safety has advanced rapidly in recent years with the emergence of new tools and processes for improving selection of the most cost-effective safety countermeasures. However, many challenges prevent fair and objective comparisons of countermeasures applied across safety disciplines (e.g. engineering, emergency services, and behavioral measures). These countermeasures operate at different spatial scales, are funded often by different financial sources and agencies, and have associated costs and benefits that are difficult to estimate. This research proposes a methodology by which both behavioral and engineering safety investments are considered and compared in a specific local context. The methodology involves a multi-stage process that enables the analyst to select countermeasures that yield high benefits to costs, are targeted for a particular project, and that may involve costs and benefits that accrue over varying spatial and temporal scales. The methodology is illustrated using a case study from the Geary Boulevard Corridor in San Francisco, California. The case study illustrates that: 1) The methodology enables the identification and assessment of a wide range of safety investment types at the project level; 2) The nature of crash histories lend themselves to the selection of both behavioral and engineering investments, requiring cooperation across agencies; and 3) The results of the cost-benefit analysis are highly sensitive to cost and benefit assumptions, and thus listing and justification of all assumptions is required. It is recommended that a sensitivity analyses be conducted when there is large uncertainty surrounding cost and benefit assumptions.

Design and delivery of a distance education programme : educating Vietnamese nurse academics from Australia

In 2008 a move away from medical staff providing nursing education in Vietnam saw the employment of many new nurse academics. To assist in the instruction of these novice academics and provide them with sound teaching and learning practice as well as curriculum design and implementation skills, Queensland University of Technology (QUT) successfully tendered an international grant. One of QUT’s initiatives in educating the Vietnamese academics was a distance learning programme. Developed specifically for Vietnamese nurse academics, the programme was designed for Australian based delivery to academics in Vietnam. This paper will present an overview of why four separate modules were utilised for the delivery of content (modules were delivered at a rate of one per semester). It will address bilingual online discussion boards which were used in each of the modules and the process of moderating these given comments were posted in both Vietnamese and English. It will describe how content was scaffolded across four modules and how the modules themselves modelled new teaching delivery strategies. Lastly, it will discuss the considerations of programme delivery given the logistics of an Australian based delivery. Feedback from the Vietnamese nurse academics across their involvement in the programme (and at the conclusion of their fourth and final module) has been overwhelmingly positive. Feedback suggests the programme has altered teaching and assessment approaches used by some Vietnamese nurse academics. Additionally, Vietnamese nurse academics are reporting that they are engaging more with the application of their content indicating a cultural shift in the approach taken in Vietnamese nurse education.

Assessing performance and capability in the work place : focusing on essential skills and knowledge in student work placements

The determination of performance standards and assessment practices in regard to student work placements is an essential and important task. Inappropriate, inadequate, or excessively complex assessment tasks can influence levels of student engagement and the quality of learning outcomes. Critical to determining appropriate standards and assessment tasks is an understanding and knowledge of key elements of the learning environment and the extent to which opportunities are provided for students to engage in critical reflection and judgement of their own performance in the contexts of the work environment. This paper focuses on the development of essential skills and knowledge (capabilities) that provide evidence of learning in work placements by describing an approach taken in the science and technology disciplines. Assessment matrices are presented to illustrate a method of assessment for use within the context of the learning environment centred on work placements in science and technology. This study contributes to the debate on the meaning of professional capability, performance standards and assessment practices in work placement programs by providing evidence of an approach that can be adapted by other programs to achieve similar benefits. The approach may also be valuable to other learning contexts where capability and performance are being judged in situations that are outside a controlled teaching and learning environment i.e. in other life-wide learning contexts.

Learning and teaching reflection : developing capacities for lifelong learning

Reflection is an essential part of being an effective learner and working as a productive teacher. It enables the learner or teacher to deliberate about the factors that lead to successful learning and teaching for them and/or their students, in a particular place and for a specific purpose, so they can make reasoned and effective choices. This chapter introduces important frameworks that cover a century of thinking around reflection in education, and illustrates how preservice teachers can use these ideas across three phases. First, becoming a reflective learner as a university student to enhance learning and assessment outcomes; second, becoming a reflective teacher to improve classroom teaching and learning outcomes; and third, developing the reflective capacities of primary students so they can enhance their skills for lifelong learning.