Assessment Understood as Enabling

This chapter outlines a perspective of educational assessment as enabling, whereby the learner is central and assessment is focused on supporting the knowledge, skills and dispositions necessary for lifelong learning. It argues that better education for young people is achievable when educational policy and practice give priority to learning improvement, thereby making assessment for accountability a related, though secondary, concern. The chapter describes how this work of internationally recognized scholars brings together diverse perspectives and theoretical frameworks and, in so doing, provides readers with a range of ways to consider their pathway through the book. A ‘map’ and summaries of chapters suggest a reading according to a thematic approach, geographical setting, author/s profile or content purposes depending on the reader’s own priorities. A section on assessment past, present, and futures calls for a rebalancing of improvement and accountability goals, and for countries to be careful to avoid privileging large-scale testing over other forms of data about learning and achievement.

Engineering social awareness in work environments

A growing interest is seen for designing intelligent environments that support personally meaningful, sociable and rich everyday experiences. In this paper we describe an intelligent, large screen display called Panorama that is aimed at supporting and enhancing social awareness within an academic work environment. Panorama is not intended to provide instrumental or other productivity related information. Rather, the goal of Panorama is to enhance social awareness by providing interpersonal and rich information related to co-workers and their everyday interactions in the department. A two-phase assessment of Panorama showed to promote curiosity and interest in exploring different activities in the environment.

Functional independence following subacute inpatient rehabilitation was not affected by age among older patients recovering from cardiac-related hospital admissions

Introduction Older people recovering from cardiac events requiring an acute hospital admission may experience a decline in physical function limiting their ability to return home to their previous accommodation. Subacute inpatient rehabilitation therapies have potential to assist recovery of physical functioning. However, it is unknown whether age influences the length of stay or physical functioning at discharge from subacute inpatient rehabilitation for this population. Objectives This study examined the outcomes of a cohort of older patients recovering from a cardiac event requiring hospitalisation to investigate the association between age and physical function at discharge, as well as age and length of rehabilitation stay. Methods Participants included 145 consecutive inpatient admissions to a subacute geriatric assessment and rehabilitation unit with a cardiac condition as their primary reason for hospital admission. Participants were required to complete a multi-disciplinary physical functioning assessment within 72 hours of admission to the unit, and again within 72 hours prior to discharge from the unit. The primary outcome measure was the Functional Independence Measure motor score. Demographic and clinical information, including length of stay and discharge destination, were also recorded. Results A total n=126 (87%) participants, with a mean (standard deviation) age of 79 (10) years, had both assessments completed and were included in analyses. Participants who had passed away (n=4, 3%), or did not have both assessments completed per protocol were excluded from analyses. Discharge destinations included home (n=101, 80%), residential aged care (n=17, 13%) and another hospital (n=8, 6%). The (median, interquartile range) Functional Independence Measure motor score was higher at discharge (79, 71 to 84) than admission (61, 48 to 71); z=7.75 p<0.001. Age was not associated with Functional Independence Measure motor score at discharge (t= -0.18, p=0.86), or length of stay in the rehabilitation unit (t= -0.52, 0.60). Conclusion Any perception that age may be associated with longer lengths of stay and reduced physical function outcomes among patients with cardiac conditions admitted for subacute inpatient rehabilitation for older adults is not supported data from this investigation. Older age should not be considered a disincentive when considering the suitability of patients with cardiac diagnoses for this type of inpatient rehabilitation or their potential physical functioning outcome.

Assessment of driving-related performance in chronic whiplash using an advanced driving simulator

Driving is often nominated as problematic by individuals with chronic whiplash associated disorders (WAD), yet driving-related performance has not been evaluated objectively. The purpose of this study was to test driving-related performance in persons with chronic WAD against healthy controls of similar age, gender and driving experience to determine if driving-related performance in the WAD group was sufficiently impaired to recommend fitness to drive assessment. Driving-related performance was assessed using an advanced driving simulator during three driving scenarios; freeway, residential and a central business district (CBD). Total driving duration was approximately 15 min. Five driving tasks which could cause a collision (critical events) were included in the scenarios. In addition, the effect of divided attention (identify red dots projected onto side or rear view mirrors) was assessed three times in each scenario. Driving performance was measured using the simulator performance index (SPI) which is calculated from 12 measures. z-Scores for all SPI measures were calculated for each WAD subject based on mean values of the control subjects. The z-scores were then averaged for the WAD group. A z-score of ≤−2 indicated a driving failing grade in the simulator. The number of collisions over the five critical events was compared between the WAD and control groups as was reaction time and missed response ratio in identifying the red dots. Seventeen WAD and 26 control subjects commenced the driving assessment. Demographic data were comparable between the groups. All subjects completed the freeway scenario but four withdrew during the residential and eight during the CBD scenario because of motion sickness. All scenarios were completed by 14 WAD and 17 control subjects. Mean z-scores for the SPI over the three scenarios was statistically lower in the WAD group (−0.3 ± 0.3; P < 0.05) but the score was not below the cut-off point for safe driving. There were no differences in the reaction time and missed response ratio in divided attention tasks between the groups (All P > 0.05). Assessment of driving in an advanced driving simulator for approximately 15 min revealed that driving-related performance in chronic WAD was not sufficiently impaired to recommend the need for fitness to drive assessment.

Assessment of antibiotic use in children by their parents in Saudi Arabia

This project assessed the factors influencing the parents' use of antibiotics in children in Saudi Arabia. It was conducted through the development and validation of the Parental Perceptions on Antibiotics (PAPA) Scales, which is the first valid and reliable instrument directed to measure these factors on a population-based level. This is also the first population-based study that measures the patterns of antibiotic use in children in Saudi Arabia, where a very high association was found between the use of antibiotics and the number of cold episodes a year, which suggests a potential of overuse of antibiotics in Saudi Arabia. Also, it was found that antibiotic use decreases significantly with parents having higher scores in knowledge and beleifs, behaviors, and eagerness to seek health-related information.

Blended delivery and online assessment : scaffolding student reflections in work-integrated learning

This paper documents a teaching innovation addressing the challenges of embedding and assessing reflective practice in work-integrated learning, specifically marketing internships. We identify four issues relating to this problem: lack of knowledge or skill for reflection, limitations of physical journals, facilitation of different forms of reflection, and suitable models for teaching and assessing reflection. The paper outlines a blended approach combining face-to-face workshops and online resources, and using online reflective journals and digital stories as assessment. The approach and assessment tasks can be implemented in a variety of marketing and business units.

Evaluation of assessment in the context of work-based learning: Qualitative perspectives of new graduates

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focussed on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians’ perceptions of these evaluations. This study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly-graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, with differing assessment experiences was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences whilst a student. Data was thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) Transparency and consistency are critical elements of work-based competency assessment. (ii) Students are willing to take greater responsibility in their assessment process. (iii) Work-based competency assessment prepares students for employment. (iv) The relationship between students and their assessors can impact on the student experience and their assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in designing valid competency-based assessment approaches.

The quik fix study : a randomised controlled trial of brief interventions for young people with alcohol-related injuries and illnesses accessing emergency department and crisis support care

Background: Alcohol is a major preventable cause of injury, disability and death in young people. Large numbers of young people with alcohol-related injuries and medical conditions present to hospital emergency departments (EDs). Access to brief, efficacious, accessible and cost effective treatment is an international health priority within this age group. While there is growing evidence for the efficacy of brief motivational interviewing (MI) for reducing alcohol use in young people, there is significant scope to increase its impact, and determine if it is the most efficacious and cost effective type of brief intervention available. The efficacy of personality-targeted interventions (PIs) for alcohol misuse delivered individually to young people is yet to be determined or compared to MI, despite growing evidence for school-based PIs. This study protocol describes a randomized controlled trial comparing the efficacy and cost-effectiveness of telephone-delivered MI, PI and an Assessment Feedback/Information (AF/I) only control for reducing alcohol use and related harm in young people. Methods/design: Participants will be 390 young people aged 16 to 25 years presenting to a crisis support service or ED with alcohol-related injuries and illnesses (including severe alcohol intoxication). This single blinded superiority trial randomized young people to (i) 2 sessions of MI; (ii) 2 sessions of a new PI or (iii) a 1 session AF/I only control. Participants are reassessed at 1, 3, 6 and 12 months on the primary outcomes of alcohol use and related problems and secondary outcomes of mental health symptoms, functioning, severity of problematic alcohol use, alcohol injuries, alcohol-related knowledge, coping self-efficacy to resist using alcohol, and cost effectiveness. Discussion: This study will identify the most efficacious and cost-effective telephone-delivered brief intervention for reducing alcohol misuse and related problems in young people presenting to crisis support services or EDs. We expect efficacy will be greatest for PI, followed by MI, and then AF/I at 1, 3, 6 and 12 months on the primary and secondary outcome variables. Telephone-delivered brief interventions could provide a youth-friendly, accessible, efficacious, cost-effective and easily disseminated treatment for addressing the significant public health issue of alcohol misuse and related harm in young people. Trial registration: This trial is registered with the Australian and New Zealand Clinical Trials Registry ACTRN12613000108718.

The impact of cataract surgery on vision-related quality of life for bilateral cataract patients in Ho Chi Minh City, Vietnam : a prospective study

Background To determine the impact of cataract surgery on vision-related quality of life (VRQOL) and examine the association between objective visual measures and change in VRQOL after surgery among bilateral cataract patients in Ho Chi Minh City, Vietnam. Methods A cohort of older patients with bilateral cataract was assessed one week before and one to three months after first eye or both eye cataract surgery. Visual measures including visual acuity, contrast sensitivity and stereopsis were obtained. Vision-related quality of life was assessed using the NEI VFQ-25. Descriptive analyses and a generalized linear estimating equation (GEE) analysis were undertaken to measure change in VRQOL after surgery. Results Four hundred and thirteen patients were assessed before cataract surgery and 247 completed the follow-up assessment one to three months after first or both eye cataract surgery. Overall, VRQOL significantly improved after cataract surgery (p < 0.001) particularly after both eye surgeries. Binocular contrast sensitivity (p < 0.001) and stereopsis (p < 0.001) were also associated with change in VRQOL after cataract surgery. Visual acuity was not associated with VRQOL. Conclusions Cataract surgery significantly improved VRQOL among bilateral cataract patients in Vietnam. Contrast sensitivity as well as stereopsis, rather than visual acuity significantly affected VRQOL after cataract surgery.

Improved nutritional status is related to improved quality of life in Parkinson’s disease

Background: Quality of life is poorer in Parkinson’s disease than in other conditions and in the general population without Parkinson’s disease. Malnutrition also results in poorer quality of life. This study aimed at determining the relationship between quality of life and nutritional status. Methods: Community-dwelling people with Parkinson’s disease >18 years old were recruited. The Patient-Generated Subjective Global Assessment (PG-SGA) assessed nutritional status. The Parkinson’s Disease Questionnaire 39 (PDQ-39) measured quality of life. Phase I was cross-sectional. The malnourished in Phase I were eligible for a nutrition intervention phase, randomised into 2 groups: standard care (SC) with provision of nutrition education materials only and intervention (INT) with individualised dietetic advice and regular weekly follow-up. Data were collected at baseline, 6 weeks, and 12 weeks. Results: Phase I consisted of 120 people who completed the PDQ-39. Phase II consisted of 9 in the SC group and 10 in the INT group. In Phase I, quality of life was poorer in the malnourished, particularly for mobility and activities of daily living domains. There was a significant correlation between PG-SGA and PDQ-39 scores (Phase I, rs = 0.445, p = .000; Phase II, rs = .426, p = .002). In Phase II, no significant difference in the PDQ-39 total or sub-scores was observed between the INT and SC groups; however, there was significant improvement in the emotional well-being domain for the entire group, X2(2) = 8.84, p = .012. Conclusions: Malnourished people with Parkinson’s disease had poorer quality of life than the well-nourished, and improvements in nutritional status resulted in quality of life improvements. Attention to nutritional status is an important component of quality of life and therefore the total care of people with Parkinson’s disease.

Development of an online role-play assessment initiative for nursing students in their bioscience studies

Devising assessment tasks for large units that embrace academic goals of authenticity and assessment variety can be a challenge. We developed an online Role-Play Assessment Initiative for first year nursing students in bioscience. Students responded to a case study by preparing two role-play dialogues: as a nurse with the patient, and between two nurses. The aims were to assess whether the students could: 1) understand the underlying disease process (pathophysiology) and relate it to clinical practice; 2) use language appropriate for lay and medical conversation; and 3) apply information using active learning. We conducted a student survey using quantitative questions (Likert scale: 1=strongly disagree to 5=strongly agree), and qualitative questions. 65 completed surveys were received. 80% of respondents agreed (includes agree or strongly agree) that it was a useful way to learn and understand pathophysiology of the case study. 86% agreed that it was useful to apply pathophysiology from lectures to a clinical setting. Overall, students found it enjoyable, which is beneficial for enhanced student engagement, and agreed that it allowed them to work well in a group (74% and 85%, respectively). Most qualitative suggestions for improvement related to group work, despite the encouraging response to group work in quantitative questions. Most positive comments surrounded different communication with a nurse compared with a patient. These results demonstrate that students developed deeper understanding of pathophysiology through active learning and were able to expand their nursing career skills during the role-play. Learning using role-play to simulate the workforce has fostered active learning.

Better health outcomes for people with physical disabilities in China through audits of mobility related access : a research and implementation need

China has 85 million people with disabilities, 30% of whom have a physical disability(1). Up to 2006, overall disability rates increased by 0.5% per year, more for males and in rural areas, and rates of physical disability increased by 11.2% per year(2). With population ageing the proportion of people with disability will increase even faster. In May 2014 the 67th World Health Assembly adopted a resolution endorsing the WHO Global Disability Action Plan 2014–2021. One of its three objectives is “to remove barriers and improve access to health services and programmes”. Access to transport contributes to positive health outcomes both directly and indirectly (e.g. access to economic opportunities, which is associated with better health)(3). However, once people with physical disabilities leave their dwellings they are confronted with physical barriers to their mobility, ranging from the condition/provision of paths to the cost/availability of transport and access to buildings. In addition, their mobility restrictions increase their vulnerability as road users, exposing them to a higher risk of injury through road crashes. QUT's School of Public Health and Social Work (PHSW) and and Centre for Accident Research and Road Safety-Queensland (CARRS-Q) CARRS-Q have been collaborating on development of a combined disability audit and road safety access tool that can identify transport barriers and safety issues along the routes taken by people with disabilities, to enable prioritisation of actions to address these issues. There are also spin-off benefits for other road users from addressing the rising toll of disability through road crashes in China(4). The tool has undergone initial proof-of-concept testing in India and Viet Nam, and is currently being assessed in Cambodia and Laos. Given the rapid development of China, increases in rates of physical disability and the impacts of an ageing population, it is proposed to establish collaborative research through the Australia-China Centre for Public Health to (1) tailor the combined road safety audit and disability access tool for use in China; (2) evaluate its use on a sample of routes; (3) develop plans for changes to the routes in consultation with local authorities; (4) evaluate the effectiveness of implemented changes in terms of access and health. 1. Zheng, Q, et al, 2014. Health and Quality of Life Outcomes, 12:25. 2. Zheng, X, et al, 2011. Bull World Health Org, 89:788–797. 3. Götschi, T & Kahlmeier, S, 2011. Integrated Transport, Health, and Sustainability Assessment (INTHESA): Final Report. Institute of Social and Preventive Medicine, University of Zurich. 4. Lin, T, et al, 2013. J Public Health, 35:541–547.

The primacy of vital signs – Acute care nurses’ and midwives’ use of physical assessment skills: A cross sectional study

BACKGROUND: Registered nurses and midwives play an essential role in detecting patients at risk of deterioration through ongoing assessment and action in response to changing health status. Yet, evidence suggests that clinical deterioration frequently goes unnoticed in hospitalised patients. While much attention has been paid to early warning and rapid response systems, little research has examined factors related to physical assessment skills. OBJECTIVES: To determine a minimum data set of core skills used during nursing assessment of hospitalised patients and identify nurse and workplace predictors of the use of physical assessment to detect patient deterioration. DESIGN: The study used a single-centre, cross-sectional survey design. SETTING and PARTICIPANTS: The study included 434 registered nurses and midwives (Grades 5-7) involved in clinical care of patients on acute care wards, including medicine, surgery, oncology, mental health and maternity service areas, at a 929-bed tertiary referral teaching hospital in Southeast Queensland, Australia. METHODS: We conducted a hospital-wide survey of registered nurses and midwives using the 133-item Physical Assessment Skills Inventory and the 58-item Barriers to Registered Nurses’ Use of Physical Assessment scale. Median frequency for each physical assessment skill was calculated to determine core skills. To explore predictors of core skill utilisation, backward stepwise general linear modelling was conducted. Means and regression coefficients are reported with 95% confidence intervals. A p value < .05 was considered significant for all analyses. RESULTS: Core skills used by most nurses every time they worked included assessment of temperature, oxygen saturation, blood pressure, breathing effort, skin, wound and mental status. Reliance on others and technology (F = 35.77, p < .001), lack of confidence (F = 5.52, p = .02), work area (F = 3.79, p = .002), and clinical role (F = 44.24, p < .001) were significant predictors of the extent of physical assessment skill use. CONCLUSIONS: The increasing acuity of the acute care patient plausibly warrants more than vital signs assessment; however, our study confirms nurses’ physical assessment core skill set is mainly comprised of vital signs. The focus on these endpoints of deterioration as dictated by early warning and rapid response systems may divert attention from and devalue comprehensive nursing assessment that could detect subtle changes in health status earlier in the patient's hospitalisation.

Valuable learning, unwelcome assessment : what LLB and JD students really think about group work

This article contributes to current debates about the appropriate role of group work in legal curricula by providing insights into the attitudes of Bachelor of Laws (‘LLB’) and Juris Doctor (‘JD’) students towards such tasks. It begins by reviewing arguments for incorporating group work in legal education, both as a result of the recognition of its educational benefits, and as a response to increasing regulatory expectations regarding student collaboration skills. The article then reports the findings of a UNSW Law School Student Assessment Survey designed to determine how law students perceive group work and its assessment in law. One of the most striking findings is that many of the law students surveyed recognise and appreciate the learning and skills development benefits of group tasks, but are resistant to summative assessment of group work. Moreover, there are marked differences in attitude between LLB and JD students, and across year cohorts within those degrees. These findings suggest that further thought needs to be directed towards the specific purposes underpinning the choice of group work as a pedagogical tool, and assessment that is congruent with those purposes, taking into account the varying needs and experiences of different cohorts of students. The article concludes by considering whether meaningful group work can exist without summative assessment.

Balancing the books : an assessment of financial stress associated with social work and human service student placements

This report presents the findings from a study of the financial impact of work-integrated learning commonly referred to as 'placement' among social work and human services students. Based on a survey of 214 respondants, 14 in-depth interviews and two focus groups, the findings indicate that two thirds of the surveyed group felt tired and anxious about their experience of balancing paid work and placement, with 2 in 5 reporting their learning experience was compromised as a result. The significant implications and potential solutions are also discussed.