Responding to our customers' needs: modifications to assessment in Obstetrics and Gynaecology over 20 years

Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.

Does health assessment improve health outcomes in Indigenous people? An RCT with 13 years of follow-up

Objective: To examine the impact of a multi-component health assessment on mortality and morbidity in Kimberley Aboriginal residents during a 13-year follow-up. Method. A population-based randomised controlled trial using linked hospital, cancer and death records to evaluate outcomes in 620 intervention and 6,736 control subjects. Results: The intervention group had a higher rate of first-time hospitalisation for any reason (IRR = 1.37; 95 % Cl 1.25-1.50), a higher rate of injury-related hospital episodes (IRR = 1.31; 95 % Cl 1.15-1.48) and a higher notification rate of alcohol-related cancers. There was a smaller difference in the rates of multiple hospitalisations (IRR = 1.14; 95 % Cl 0.751.74) and no improvement in overall mortality compared with controls (IRR = 1.08; 95 % Cl 0.91-1.29). Conclusions: There was no overall mortality benefit despite increased health service contact associated with the intervention. Implications: Although not influencing mortality rates, multi-component health assessment may result in a period of increased health service use in Aboriginal and Torres Strait Islander populations, thus constituting an 'intervention'. However, this should not be confused with systematic and sustained interventions and investment in community development to achieve better health outcomes.

Outcomes after stroke: Basic and instrumental activities of daily living, community reintegration and generic health status

This study describes the discharge destination, basic and instrumental activities of daily living (ADL), community reintegration and generic health status of people after stroke, and explored whether sociodemographic and clinical characteristics were associated with these outcomes. Participants were 51 people, with an initial stroke, admitted to an acute hospital and discharged to the community. Admission and discharge data were obtained by chart review. Follow-up status was determined by telephone interview using the Modified Barthel Index, the Assessment of Living Skills and Resources, the Reintegration to Normal Living Index, and the Short-Form Health Survey (SF-36). At follow up, 57% of participants were independent in basic ADL, 84% had a low risk of experiencing instrumental ADL difficulties, most had few concerns with community reintegration, and SF-36 physical functioning and vitality scores were lower than normative values. At follow up, poorer discharge basic ADL status was associated with poorer instrumental ADL and community reintegration status, and older participants had poorer instrumental ADL, community reintegration and physical functioning. Occupational therapists need to consider these outcomes when planning inpatient and post-discharge intervention for people after stroke.

A rapid microtitre plate screening method for in vitro assessment of fibrinolysis: a preliminary report

A novel and precise assay that facilitates high-throughput screening of fibrinolytic agents was developed based on the automated assessment of the euglobulin clot lysis time in microtitre plates. Euglobulin fractions from fresh plasma samples were assessed over 28 days to determine the inter-assay and intra-assay precision. The intra-assay (coefficient of variation range, 0.7-2.6%) and inter-assay precision (coefficient of variation range, 6.8-12.1%) was found to be well within limits required by the Food and Drug Administration. On day 1 and day 28, the results of the microtitre plate euglobulin clot lysis time method were compared with tissue plasminogen activator activity, plasminogen activator inhibitor activity and results produced on fibrin plates. All comparisons were found to correlate significantly. The validity of this method for assaying fibrinolytic agents was assessed by comparing dose-response curves for streptokinase produced using fibrin plates and this method. The critical influence of ambient temperature on the inter-assay reproducibility of this method was established by testing samples over a range of temperatures between 20degreesC and 40degreesC. (C) 2004 Lippincott Williams Wilkins.

Evaluation of clinically relevant changes in patient reported outcomes in knee and hip osteoarthritis: the minimal clinically important improvement

Background: In clinical trials, at the group level, results are usually reported as mean and standard deviation of the change in score, which is not meaningful for most readers. Objective: To determine the minimal clinically important improvement (MCII) of pain, patient's global assessment of disease activity, and functional impairment in patients with knee and hip osteoarthritis (OA). Methods: A prospective multicentre 4 week cohort study involving 1362 outpatients with knee or hip OA was carried out. Data on assessment of pain and patient's global assessment, measured on visual analogue scales, and functional impairment, measured on the Western Ontario McMaster Universities Osteoarthritis Index (WOMAC) function subscale, were collected at baseline and final visits. Patients assessed their response to treatment on a five point Likert scale at the final visit. An anchoring method based on the patient's opinion was used. The MCII was estimated in a subgroup of 814 patients ( 603 with knee OA, 211 with hip OA). Results: For knee and hip OA, MCII for absolute ( and relative) changes were, respectively, ( a) -19.9 mm (-40.8%) and -15.3 mm (-32.0%) for pain; ( b) -18.3 mm ( - 39.0%) and -15.2 mm ( -32.6%) for patient's global assessment; ( c) -9.1 ( -26.0%) and -7.9 ( -21.1%) for WOMAC function subscale score. The MCII is affected by the initial degree of severity of the symptoms but not by age, disease duration, or sex. Conclusion: Using criteria such as MCII in clinical trials would provide meaningful information which would help in interpreting the results by expressing them as a proportion of improved patients.

Evaluation of clinically relevant states in patient reported outcomes in knee and hip osteoarthritis: the patient acceptable symptom state

Background: The patient acceptable symptom state ( PASS) is the value beyond which patients can consider themselves well. This concept can help in interpreting results of clinical trials. Objective: To determine the PASS estimate for patients with knee and hip osteoarthritis (OA) by assessing pain, patient's global assessment of disease activity, and functional impairment. Methods: A 4 week prospective multicentre cohort study of 1362 outpatients with knee or hip OA was carried out. Data on assessment of pain and patient's global assessment of disease, measured on visual analogue scales, and functional impairment, measured on the Western Ontario McMaster Universities Osteoarthritis Index (WOMAC) function subscale, were collected at baseline and final visits. The patients assessed their satisfaction with their current state at the final visit. An anchoring method based on the patient's opinion was used. Results: For patients with knee and hip OA, the estimates of PASS were, respectively, 32.3 and 35.0 mm for pain, 32.0 and 34.6 mm for patient global assessment of disease activity, and 31.0 and 34.4 points for WOMAC function score. The PASS varied moderately across the tertiles of baseline scores but not across age, disease duration, or sex. Conclusion: The use of PASS in clinical trials would provide more meaningful results expressed as a proportion of patients in an acceptable symptom state.

Science of assessment

Psoriatic arthritis is a multisystem disorder which, from a measurement standpoint, demands consideration of its cutaneous manifestations and both axial and peripheral musculoskeletal involvement. Measurements of various aspects of impairment, ability/disability, and participation/ handicap are feasible using existing measurement techniques, which are for the most part valid, reliable, and responsive. Nevertheless, there remain opportunities for the further development of consensus around core set measures and responder criteria, as well as for instrument development and refinement, standardised assessor training, cross-cultural adaptation of health status questionnaires, electronic data capture, and the introduction of standardised quantitative measurement into routine clinical care.

Assessment of disease progression in motor neuron disease

Motor neuron disease (MND) is characterised by progressive deterioration of the corticospinal tract, brainstem, and anterior horn cells of the spinal cord. There is no pathognomonic test for the diagnosis of MND, and physicians rely on clinical criteria-upper and lower motor neuron signs-for diagnosis. The presentations, clinical phenotypes, and outcomes of MND are diverse and have not been combined into a marker of disease progression. No single algorithm combines the findings of functional assessments and rating scales, such as those that assess quality of life, with biological markers of disease activity and findings from imaging and neurophysiological assessments. Here, we critically appraise developments in each of these areas and discuss the potential of such measures to be included in the future assessment of disease progression in patients with MND.

Six-month outcome for dysphagia following traumatic brain injury: Radiological assessment

The coexistence of a swallowing impairment, or dysphagia, can severely impact upon the medical condition and recovery of a child with traumatic brain injury (TBI; Logemann, Pepe, & Mackay, 1994). Despite this fact, there is limited data that provide evidence of the progression or outcome of dysphagia in the pediatric population post-TBI (Rowe, 1999). The present study aimed to (1) provide a prospective radiologically based profile of swallowing outcome and (2) determine the clinical significance of any persistent physiological swallowing deficits by investigating the presence/absence of any coexistent respiratory complications. Seven children with moderate/severe TBI were evaluated via an initial videofluoroscopic swallowing assessment (VFSS) at an average of 24.1 days postinjury, during the acute phase of management. A follow-up VFSS was conducted at an average of 7 months, 3 weeks postinjury. The physiological impairment, swallowing safety, swallowing efficiency, and functional swallowing outcomes of the acute phase post-TBI were compared with reassessment results at 6 months post-TBI. The presence/absence of lower respiratory tract infection/respiratory complications in the past 6 months postinjury were recorded.VFSS revealed a number of residual physiological oropharyngeal swallowing impairments and reduced swallowing efficiency. However, all participants presented with clinically safe and functional swallowing outcomes at 6 months post-TBI, with no recent history of respiratory complication. This study indicates good functional swallowing and respiratory outcomes for patients at 6-months post-TBI despite the presence of persistent physiological swallowing impairment.

A review of the psychometric properties of the Health of the Nation Outcomes Scales (HoNOS) family of measures

BACKGROUND: The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each. METHOD: Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility. RESULTS: Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination. CONCLUSION: Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.

Objective and behavioural assessment of the emergence from post-traumatic amnesia (PTA)

Primary objective: To determine the profile of resolution of typical PTA behaviours and describe new learning and improvements in self-care during PTA. Research design: Prospective longitudinal study monitoring PTA status, functional learning and behaviours on a daily basis. Methods and procedures: Participants were 69 inpatients with traumatic brain injury who were in PTA. PTA was assessed using the Westmead or Oxford PTA assessments. Functional learning capability was assessed using a routine set of daily tasks and behaviour was assessed using an observational checklist. Data was analysed using descriptive statistics. Main outcomes and results: Challenging behaviours that are typically associated with PTA, such as agitation, aggression and wandering resolved in the early stages of PTA and incidence rates of these behaviours were less than 20%. Independence in self-care and bowel and bladder continence emerged later during resolution of PTA. New learning in functional situations was demonstrated by patients in PTA. Conclusions: It is feasible to begin active rehabilitation focused on functional skills-based learning with patients in the later stages of PTA. Formal assessment of typically observed behaviours during PTA may complement memory-based PTA assessments in determining emergence from PTA.

Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations

The focus of the discipline of neuropsychology is shifting towards a greater emphasis on understanding the relationship between assessment results and performance of everyday tasks (ecological validity). To date, the literature has highlighted the importance of this concept in the assessment of patients with brain injury or disease (e.g. in rehabilitation and forensic settings). This paper presents the argument that there is another important area in which the ecological validity of neuropsychological assessments should be considered: in clinical outcomes studies using neurologically intact participants. For example, determining the extent to which a medical procedure or intervention affects performance of everyday cognitive tasks can provide useful information that can potentially guide decision-making regarding treatment options. It is argued that tests designed with ecological validity in mind (the verisimilitude approach), as opposed to traditional tests, may be most effective at predicting everyday functioning. Explanations are proposed as to why researchers may be reluctant to use tests with verisimilitude in favor of more traditional measures. (c) 2006 National Academy of Neuropsychology. Published by Elsevier Ltd. All rights reserved.

A prospective assessment of SRS-24 scores after endoscopic anterior instrumentation for scoliosis

Study Design. Prospective clinical case series. Objective. To evaluate the clinical outcome of anterior endoscopic instrumention for scoliosis using the SRS-24 questionnaire and to examine how these scores change over a 2-year follow-up period. Summary of Background Data. Anterior endoscopic instrumentation correction has several advantages compared with open procedures. However, the clinical results of this technique using a validated outcome measure have rarely been reported in the literature. Methods. A total of 83 consecutive patients underwent endoscopic anterior instrumentation performed at a single unit. Patients completed the SRS-24 questionnaire before surgery and at 3, 6, 12, and 24 months after surgery. The SRS-24 scores were compared between each of the follow-up intervals. Results. The pain, general self-image, and function from back condition domains improved after surgery (P < 0.05). Activity level significantly improved between 3 and 6 months, and both function domains improved between 6 and 12 months (P < 0.05). None of the domains increased significantly after 1 year. Conclusions. Endoscopic anterior instrumentation for scoliosis significantly improved pain, self-image, and function. The greatest improvement in function occurred between 6 and 12 months after surgery. The SRS-24 scores at 1 year from surgery may provide a good indicator of patient outcome in the long-term.