Towards improving public understanding of judgement practice in standards-referenced assessment : an Australian perspective

Internationally there has been a move towards standards-referenced assessment with countries such as Australia developing a National Curriculum and Achievement Standards, New Zealand adopting National Standards for literacy and numeracy that involve schools making and reporting judgements about the reading, writing and mathematics achievement of children up to Year 8 (the end of primary school) and in Canada, classroom assessment standards aimed at the improvement of assessment practice of K-12 education are being formulated. Standards-driven reform has major implications for teachers’ work. The consequences of adopting a standards-driven approach to educational change by systems are often under-estimated with the unintended effects not fully understood by either the policy writers, and the public, including parents. It is for these reasons that the contention developed in this article relates to the teacher’s role, which it is argued remains central to policy focused on the improvement of the quality of education and educational standards.

Work-based assessment : qualitative perspectives of novice nutrition and dietetics educators

Background The assessment of competence for health professionals including nutrition and dietetics professionals in work-based settings is challenging. The present study aimed to explore the experiences of educators involved in the assessment of nutrition and dietetics students in the practice setting and to identify barriers and enablers to effective assessment. Methods A qualitative research approach using in-depth interviews was employed with a convenience sample of inexperienced dietitian assessors. Interviews explored assessment practices and challenges. Data were analysed using a thematic approach within a phenomenological framework. Twelve relatively inexperienced practice educators were purposefully sampled to take part in the present study. Results Three themes emerged from these data. (i) Student learning and thus assessment is hindered by a number of barriers, including workload demands and case-mix. Some workplaces are challenged to provide appropriate learning opportunities and environment. Adequate support for placement educators from the university, managers and their peers and planning are enablers to effective assessment. (ii) The role of the assessor and their relationship with students impacts on competence assessment. (iii) There is a lack of clarity in the tasks and responsibilities of competency-based assessment. Conclusions The present study provides perspectives on barriers and enablers to effective assessment. It highlights the importance of reflective practice and feedback in assessment practices that are synonymous with evidence from other disciplines, which can be used to better support a work-based competency assessment of student performance.

An experimental based assessment of the deviation of the bearing characteristic frequencies

Slippage in the contact roller-races has always played a central role in the field of diagnostics of rolling element bearings. Due to this phenomenon, vibrations triggered by a localized damage are not strictly periodic and therefore not detectable by means of common spectral functions as power spectral density or discrete Fourier transform. Due to the strong second order cyclostationary component, characterizing these signals, techniques such as cyclic coherence, its integrated form and square envelope spectrum have proven to be effective in a wide range of applications. An expert user can easily identify a damage and its location within the bearing components by looking for particular patterns of peaks in the output of the selected cyclostationary tool. These peaks will be found in the neighborhood of specific frequencies, that can be calculated in advance as functions of the geometrical features of the bearing itself. Unfortunately the non-periodicity of the vibration signal is not the only consequence of the slippage: often it also involves a displacement of the damage characteristic peaks from the theoretically expected frequencies. This issue becomes particularly important in the attempt to develop highly automated algorithms for bearing damage recognition, and, in order to correctly set thresholds and tolerances, a quantitative description of the magnitude of the above mentioned deviations is needed. This paper is aimed at identifying the dependency of the deviations on the different operating conditions. This has been possible thanks to an extended experimental activity performed on a full scale bearing test rig, able to reproduce realistically the operating and environmental conditions typical of an industrial high power electric motor and gearbox. The importance of load will be investigated in detail for different bearing damages. Finally some guidelines on how to cope with such deviations will be given, accordingly to the expertise obtained in the experimental activity.

Context-based assessment: Creating opportunities for resonance between classroom fields and societal fields

There is on-going international interest in the relationships between assessment instruments, students’ understanding of science concepts and context-based curriculum approaches. This study extends earlier research showing that students can develop connections between contexts and concepts – called fluid transitions – when studying context-based courses. We provide an in-depth investigation of one student’s experiences with multiple contextual assessment instruments that were associated with a context-based course. We analyzed the student’s responses to context-based assessment instruments to determine the extent to which contextual tests, reports of field investigations, and extended experimental investigations afforded her opportunities to make connections between contexts and concepts. A system of categorizing student responses was developed that can inform other educators when analyzing student responses to contextual assessment. We also refine the theoretical construct of fluid transitions that informed the study initially. Implications for curriculum and assessment design are provided in light of the findings.

A whole-life value based assessment and optimisation model for high-performance glazed facades'

Façade design is a complex and multi-disciplinary process. One major barrier to devising optimal façade solutions is the lack of a systematic way of evaluating the true social, economic and environmental impacts of a design. Another barrier is the lack of automated design aids to assist decision-making. In this paper, we present our on-going study in developing a whole-life value based multi-objective optimisation model for high-performance façades. The principal outcome of this paper is a multi-objective optimisation model for early-stage façade design. The optimisation technique coupled with other 3rd party software and/or specially developed scripts provide façade designers with an integrated design tool of wide applicability.

Patient safety and communication: A new assessment for doctors trained in countries where language differs from that of the host country: Results of a pilot using a domain-based assessment

Objective

Global migration of healthcare workers places responsibility on employers to comply with legal employment rights whilst ensuring patient safety remains the central goal. We describe the pilot of a communication assessment designed for doctors who trained and communicated with patients and colleagues in a different language from that of the host country. It is unique in assessing clinical communication without assessing knowledge.

A 14-station OSCE was developed using a domain-based marking scheme, covering professional communication and English language skills (speaking, listening, reading and writing) in routine, acute and emotionally challenging contexts, with patients, carers and healthcare teams. Candidates (n = 43), non-UK trained volunteers applying to the UK Foundation Programme, were provided with relevant station information prior to the exam.

The criteria for passing the test included achieving the pass score and passing 10 or more of the 14 stations. Of the 43 candidates, nine failed on the station criteria. Two failed the pass score and also the station criteria. The Cronbach's alpha coefficient was 0.866.

This pilot tested ‘proof of concept’ of a new domain-based communication assessment for non-UK trained doctors.

The test would enable employers and regulators to verify communication competence and safety in clinical contexts, independent of clinical knowledge, for doctors who trained in a language different from that of the host country.

A systematic review of evidence-based assessment practices by allied health practitioners for children with cerebral palsy

AIM: The routine use of psychometrically robust assessment tools is integral to best practice. This systematic review aims to determine the extent to which evidence-based assessment tools were used by allied health practitioners for children with cerebral palsy (CP).

METHOD: The Preferred Reporting Items for Systematic Reviews and Meta-Analysis protocols 2015 was employed. A search strategy applied the free text terms: 'allied health practitioner', 'assessment', and 'cerebral palsy', and related subject headings to seven databases. Included articles reported assessment practices of occupational therapists, physiotherapists, or speech pathologists working with children with CP aged 0 to 18 years, published from the year 2000.

RESULTS: Fourteen articles met the inclusion criteria. Eighty-eight assessment tools were reported, of which 23 were in high use. Of these, three tools focused on gross motor function and had acceptable validity for use with children with CP: Gross Motor Function Measure, Gross Motor Function Classification System, and goniometry. Validated tools to assess other activity components, participation, quality of life, and pain were used infrequently or not at all.

INTERPRETATION: Allied health practitioners used only a few of the available evidence-based assessment tools. Assessment findings in many areas considered important by children and families were rarely documented using validated assessment tools.

The Day Roads Became Rivers: A GIS-Based Assessment of Flash Floods in Worcester

In the last 4 years Worcester, UK has been hit by several intense convective rainstorms, which caused flash floods outside of existing surface drainage networks. This paper addresses two questions related to such events: Firstly to what extent can the occurrence of flash flood flow accumulation can be determined using only commonly available data and tools, assuming the rainfall events caused mainly surface runoff due to their tropical intensity and the relatively impermeable urban catchment surface? Secondly, are the flood in-cidents in Worcester aggravated by roads serving as preferential flow paths under these conditions? The as-sessment results indicated that roads do not have an influence on the flow path of flash flood rainfall in Worcester. Flow accumulation calculated with a 10m DEM, corresponds well with reported flood incidents. This basic assessment method can be used to inform the implementation of non structural flood mitigation and public awareness.