Evaluating objective structured clinical assessment (OSCA) in undergraduate nursing

The aims of this mixed methods study were to gain insight into how individual assessors determine an Objective Structured Clinical Assessment (OSCA) result for undergraduate nursing students and identify whether individual assessor perceptions and professional characteristics have an impact on students' results. Results from 25 participants showed that although less than half (44%) of the participants were teaching in the course that they were assessing, the participants were highly experienced clinicians and nearly three-quarters (72%) had completed formal teaching qualifications. There were wide variations in pass rates (16.7–90%) between assessors. The widest disparity was observed between assessors with and those without critical care experience (66% versus 39%), as well as assessors who were teaching the course and those who were not (68% versus 49%). Qualitative analysis revealed three dominant themes within participants' transcripts. The themes focused on determining student safety, and the use of personal perceptions and clinical experience to determine competency. Findings indicate that assessors' individual perceptions and clinical experience have the potential to influence and determine undergraduate nursing students OSCA results. Development of criteria standards and objective assessment may be enhanced by greater involvement of assessors and thorough education and training within the context of student assessments.

A possible anatomical and biomechanical explanation of the 10% rule used in the clinical assessment of prehensile hand movements and handed dominance

Abstract
A current doctrine in the dynamometric approach to determine lateralization of hand function states that in 10% of cases, the non-dominant hand will be stronger than the dominant hand. In this study, a novel MRI based modelling approach was applied to the first dorsal introsseus muscle (FDI), to determine whether the 10% rule may be applied to the FDI and may be partially explained by the arrangement of the anatomical components of the FDI.

Methods
Initially the force generated by the thumb segment during an isometric pushing task in the horizontal plane was measured from 25 strongly right-handed young males. Nine of these participants then had structural magnetic resonance imaging (sMRI) of the thumb and index osseous compartment. A modelling technique was developed to extract the muscle data and quantify the muscle line of action onto to the first metacarpal bone segment in order to quantify the muscle force at the point of momentary rotation – equilibrium.

Results
Eight of 25 subjects exhibited stronger force from the left hand. Six out of nine subjects from the MRI possessed significantly greater angles of attachment of the index osseous compartment on the left (non-dominant) hand. These six subjects also generated greater maximal isometric forces from the FDI of the left side. There was a significantly greater muscle volume for the right FDI muscle as compared to the left as measured from the reconstructed MRI slice data.

Conclusions
The calculated force produced by the muscle is related to the angle of attachment of the muscle to bone in the index osseous compartment. The MRI findings indicate that the 10% rule may be anatomically and biomechanically explained.

Optimizing safety, fidelity and usability of an Intelligent Clinical Support Tool (ICST) for acute hospital care: an Australian case study using a multi-method Delphi Process

This research focuses on a major health priority for Australia by addressing existing gaps in the implementation of nursing informatics solutions in healthcare. It serves to inform the successful deployment of IT solutions designed to support patient-centered, frontline acute healthcare delivery by multidisciplinary care teams. The outcomes can guide future evaluations of the contribution of IT solutions to the efficiency, safety and quality of care delivery in acute hospital settings.

Optimising safety, fidelity and usability of an Intelligent Clinical Support Tool (ICST) for acute hospital care: an Australian case Study using a multi-method Delphi process

This research focuses on a major health priority for Australia by addressing existing gaps in the implementation of nursing informatics solutions in healthcare. It serves to inform the successful deployment of IT solutions designed to support patient-centered, frontline acute healthcare delivery by multidisciplinary care teams. The outcomes can guide future evaluations of the contribution of IT solutions to the efficiency, safety and quality of care delivery in acute hospital settings.

On the validity of measuring change over time in routine clinical assessment: a close examination of item-level response shifts in psychosomatic inpatients

Objective: Significant life events such as severe health status changes or intensive medical treatment often trigger response shifts in individuals that may hamper the comparison of measurements over time. Drawing from the Oort model, this study aims at detecting response shift at the item level in psychosomatic inpatients and evaluating its impact on the validity of comparing repeated measurements. Study design and setting: Complete pretest and posttest data were available from 1188 patients who had filled out the ICD-10 Symptom Rating (ISR) scale at admission and discharge, on average 24 days after intake. Reconceptualization, reprioritization, and recalibration response shifts were explored applying tests of measurement invariance. In the item-level approach, all model parameters were constrained to be equal between pretest and posttest. If non-invariance was detected, these were linked to the different types of response shift. Results: When constraining across-occasion model parameters, model fit worsened as indicated by a significant Satorra–Bentler Chi-square difference test suggesting potential presence of response shifts. A close examination revealed presence of two types of response shift, i.e., (non)uniform recalibration and both higher- and lower-level reconceptualization response shifts leading to four model adjustments. Conclusions: Our analyses suggest that psychosomatic inpatients experienced some response shifts during their hospital stay. According to the hierarchy of measurement invariance, however, only one of the detected non-invariances is critical for unbiased mean comparisons over time, which did not have a substantial impact on estimating change. Hence, the use of the ISR can be recommended for outcomes assessment in clinical routine, as change score estimates do not seem hampered by response shift effects.

The diagnostic validity and reliability of an internet-based clinical assessment program for mental disorders

BACKGROUND: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. OBJECTIVE: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. METHODS: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. RESULTS: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder: κ=.37) to strong (eg, panic disorder: κ=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia: κ=.54) to substantial (eg, bulimia nervosa: κ=.87). CONCLUSIONS: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders. TRIAL REGISTRATION: Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG).

A lower limb assessment tool for athletes at risk of developing patellar tendinopathy

PURPOSE: Patellar tendon abnormality (PTA) on diagnostic imaging is part of the diagnostic criteria for patellar tendinopathy. PTA and altered landing strategies are primary risk factors that increase the likelihood of asymptomatic athletes developing patellar tendinopathy. Therefore, the aim of this study was to examine the risk factors that are predictors of the presence and severity of a PTA in junior pre-elite athletes. METHODS: Ten junior pre-elite male basketball athletes with a PTA were matched with 10 athletes with normal patellar tendons. Participants had patellar tendon morphology, Victorian Institute of Sport Assessment (VISA) score, body composition, lower limb flexibility, and maximum vertical jump height measured before performing five successful stop-jump tasks. During each stop-jump task, both two-dimensional and three-dimensional kinematics and ground reaction forces were recorded. Multiple regression analyses were used to identify factors for estimating PTA presence and severity, and discriminate analysis was used to classify PTA presence. RESULTS: Sixty-eight percent of variance for presence of a PTA was accounted for by hip joint range of motion (ROM) and knee joint angle at initial foot-ground contact (IC) during stop-jump task and quadriceps flexibility, whereas hip joint ROM during stop-jump task and VISA score accounted for 62% of variance for PTA severity. Prediction of the presence of a PTA was achieved with 95% accuracy and 95% cross-validation. CONCLUSIONS: An easily implemented, reliable, and valid movement screening tool composed of three criteria enables coaches and/or clinicians to predict the presence and severity of a PTA in asymptomatic athletes. This enables identification of asymptomatic athletes at higher risk of developing patellar tendinopathy, which allows the development of effective preventative measures to aid in the reduction of patellar tendinopathy injury prevalence.

Assessment of simulated clinical skills and distance students: can we do it better?

Australian universities have traditionally been able to supplement clinical education, for undergraduate nursing courses, delivered on placement with weekly clinical teaching in the simulated environment. The Objective Structured Clinical Assessment (OSCA) tool has been used in this simulated environment to assess clinical skills. Recently, however, online delivery of undergraduate nursing courses has become more common. The move from an internal mode of teaching to an online external mode is seen worldwide and poses challenges to staff and students as well as changing the teaching and learning culture of institutions (Philip and Wozniak, 2009). This cultural shift and the resulting diminishing timeframe for students to acquire and practice simulated clinical skills imply that it may become necessary to rethink assessment forms such as the OSCA assessment. This study examines whether or not the OSCA tool developed by Bujack et al. (1991a) is the best tool to be used in this new context, where online teaching is supplemented by very short, annual, intensive periods of study. Skills acquisition theories dictate that time is required to produce an ideal skills acquisition environment (Quinn, 2000) but the time constraints placed on students in such intensive periods of study could influence skills acquisition. This cross-sectional qualitative study used semi-structured interviews and focus groups to collect data. 65% of the nursing faculty participated in the study. The teaching of the Bachelor of Nursing (BN) occurred on two campuses and staff from both areas participated. This group of nurse academics was employed across the range of academic levels (from lecturer to professor) at the University. Data analysis followed a generic thematic analysis framework. Findings in this study show that there are a variety of attitudes and underpinning beliefs amongst staff in relation to the OSCAs. Doubts were raised in regard to the suitability of the use of the OSCA tool in this setting. It also became apparent during this study that the OSCA tool possibly serves purposes other than an assessment tool.

Minimising post-operative risk using a Post-Anaesthetic Care Tool (PACT): protocol for a prospective observational study and cost-effectiveness analysis

Introduction: While the risk of adverse events following surgery has been identified, the impact of nursing care on early detection of these events is not well established. A systematic review of the evidence and an expert consensus study in post-anaesthetic care identified essential criteria for nursing assessment of patient readiness for discharge from the Post-Anaesthetic Care Unit. These criteria were included in a new nursing assessment tool, the Post-Anaesthetic Care Tool (PACT), and incorporated into the post-anaesthetic documentation at a large health service. The aim of this study is to test the clinical reliability of the PACT and evaluate whether use of PACT will i) enhance the recognition and response to patients at risk of deterioration in PACU; ii) improve documentation for handover from PACU nurse to ward nurse; iii) result in improved patient outcomes; and iv) reduce health care costs.

Methods and analysis: A prospective, non-randomised, pre- and post-implementation design comparing: (i) patients (n=750) who have surgery prior to the implementation of the PACT and (ii) patients (n=750) who have surgery after PACT. The study will examine the use of the tool through the observation of patient care and nursing handover. Patient outcomes and cost effectiveness will be determined from health service data and medical record audit. Descriptive statistics will be used to describe the sample and compare the two patient groups (pre- and post-intervention). Differences in patient outcomes between the two groups will be compared using the Cochran-Mantel-Haenszel test and regression analyses and reported as odds ratios with the corresponding 95% confidence intervals.

Conclusion: This study will test the clinical reliability and cost-effectiveness of the PACT. It is hypothesised that the PACT will enable nurses to recognise and respond to patients at risk of deterioration, improve handover to ward nurses, improve patient outcomes, and reduce health care costs.