Cautionary tales in the interpretation of systematic reviews of therapy trials

This is the second in a series of articles emphasizing the cautions in the interpretation of health-care studies. Systematic reviews are presented as comprehensive, unbiased summaries of evidence and are often referred to by clinicians, guideline developers and health policy-makers. Their strengths and limitations, and how their results can be subject to bias and misinterpretation, are discussed.

Assessing clinical reasoning: a method to monitor its development in a PBL curriculum

The aim of this study was to develop and trial a method to monitor the evolution of clinical reasoning in a PBL curriculum that is suitable for use in a large medical school. Termed Clinical Reasoning Problems (CRPs), it is based on the notion that clinical reasoning is dependent on the identification and correct interpretation of certain critical clinical features. Each problem consists of a clinical scenario comprising presentation, history and physical examination. Based on this information, subjects are asked to nominate the two most likely diagnoses and to list the clinical features that they considered in formulating their diagnoses, indicating whether these features supported or opposed the nominated diagnoses. Students at different levels of medical training completed a set of 10 CRPs as well as the Diagnostic Thinking Inventory, a self-reporting questionnaire designed to assess reasoning style. Responses were scored against those of a reference group of general practitioners. Results indicate that the CRPs are an easily administered, reliable and valid assessment of clinical reasoning, able to successfully monitor its development throughout medical training. Consequently, they can be employed to assess clinical reasoning skill in individual students and to evaluate the success of undergraduate medical schools in providing effective tuition in clinical reasoning.

How can experience in clinical and community settings contribute to early medical education? A BEME systematic review

Review date: Review period January 1992-December 2001. Final analysis July 2004-January 2005. Background and review context: There has been no rigorous systematic review of the outcomes of early exposure to clinical and community settings in medical education. Objectives of review: (1) Identify published empirical evidence of the effects of early experience in medical education, analyse it, and synthesize conclusions from it. (2) Identify the strengths and limitations of the research effort to date, and identify objectives for future research. Search strategy: Ovid search of. BEI, ERIC, Medline, CIATAHL and EMBASE Additional electronic searches of: Psychinfo, Timelit, EBM reviews, SIGLE, and the Cochrane databases. Hand-searches of: Medical Education, Medical Teacher, Academic Medicine, Teaching and Learning in Medicine, Advances in Health Sciences Education, Journal of Educational Psychology. Criteria: Definitions: Experience: Authentic (real as opposed to simulated) human contact in a social or clinical context that enhances learning of health, illness and/or disease, and the role of the health professional. Early: What would traditionally have been regarded as the preclinical phase, usually the first 2 years. Inclusions: All empirical studies (verifiable, observational data) of early experience in the basic education of health professionals, whatever their design or methodology, including papers not in English. Evidence from other health care professions that could be applied to medicine was included. Exclusions: Not empirical; not early; post-basic; simulated rather than 'authentic' experience. Data collection: Careful validation of selection processes. Coding by two reviewers onto an extensively modified version of the standard BEME coding sheet. Accumulation into an Access database. Secondary coding and synthesis of an interpretation. Headline results: A total of 73 studies met the selection criteria and yielded 277 educational outcomes; 116 of those outcomes (from 38 studies) were rated strong and important enough to include in a narrative synthesis of results; 76% of those outcomes were from descriptive studies and 24% from comparative studies. Early experience motivated and satisfied students of the health professions and helped them acclimatize to clinical environments, develop professionally, interact with patients with more confidence and less stress, develop self-reflection and appraisal skill, and develop a professional identity. It strengthened their learning and made it more real and relevant to clinical practice. It helped students learn about the structure and function of the healthcare system, and about preventive care and the role of health professionals. It supported the learning of both biomedical and behavioural/social sciences and helped students acquire communication and basic clinical skills. There were outcomes for beneficiaries other than students, including teachers, patients, populations, organizations and specialties. Early experience increased recruitment to primary care/rural medical practice, though mainly in US studies which introduced it for that specific purpose as part of a complex intervention. Conclusions: Early experience helps medical students socialize to their chosen profession. It. helps them acquire a range of subject matter and makes their learning more real and relevant. It has potential benefits for other stakeholders, notably teachers and patients. It can influence career choices.

The MMPI-2 Gender-Masculine and Gender-Feminine scales: Gender roles as predictors of psychological health in clinical patients

Previous research measuring various biosocial factors such as age, sex, and marital status has found them to be essentially unrelated to measures of psychological health. Recent empirical studies have revealed that personality constructs may be more significant than demographic variables in the prediction of psychological well-being. The present study assessed the personality constructs of masculinity and femininity and hypothesized that the Gender-Masculine ( GM) scale of the MMPI-2 would be more effective than the Gender-Feminine (GF) scale in predicting psychological well-being. This hypothesis stems from previous research that has indicated the dominance of the masculinity model. It is suggested that previous research supporting androgyny as a primary indicator of well-being was influenced by the masculinity component of this gender orientation. One hundred and seventy-seven psychiatric patients from Australia (N = 107) and Singapore ( N 5 70) completed the MMPI-2. Hierarchical multiple regression revealed significantly stronger masculinity effects, with significance achieved on measures of ego strength and low self-esteem. No significant relationship between psychological well-being and the GF variable was found. Similarly, androgyny did not add any further variance to the model when masculinity was controlled for. Overall, the results are consistent with an interpretation that GM is a better correlate of psychological well-being as compared to the GF scale.

Measurement of functional ability following traumatic brain injury using the Clinical Outcomes Variable Scale: A reliability study

This study determined the inter-tester and intra-tester reliability of physiotherapists measuring functional motor ability of traumatic brain injury clients using the Clinical Outcomes Variable Scale (COVS). To test inter-tester reliability, 14 physiotherapists scored the ability of 16 videotaped patients to execute the items that comprise the COVS. Intra-tester reliability was determined by four physiotherapists repeating their assessments after one week, and three months later. The intra-class correlation coefficients (ICC) were very high for both inter-tester reliability (ICC > 0.97 for total COVS scores, ICC > 0.93 for individual COVS items) and intra-tester reliability (ICC > 0.97). This study demonstrates that physiotherapists are reliable in the administration of the COVS.

The Rural Clinical Division: a student journey to rural medicine

Background: The University of Queensland has through an Australian Government initiative, established a Rural Clinical Division (RCD) at four regional sites in the southern and central Queensland. Over the fi rst four years of the existence of the RCD, an integrated package of innovative medical education has been developed. Method: The integrated aspects of the RCD program include: The Rural Medical Rotation: Every medical student undertakes an eight week rural rotation in Year 3. Year 3 and 4 MBBS - 100 students are currently spending one to two years in the rural school and demand is increasing. Interprofessional Education - Medical and Allied Health students attend lectures, seminars and workshops together and often share the same rural clinical placement. Rural health projects - allow students to undertake a project of benefi t to the rural community. Information Technology (IT) - the Clinical Discussion Board (CDB) and Personal Digital Assistants (PDA) demonstrate the importance of IT to medical students in the 21st century. Changing the Model of Medical Education - The Leichhardt Community Attachment Placement (LCAP), is a pilot study that resulted in the addition of three interns to the rural workforce. All aspects of the RCD are evaluated with surveys using both qualitative and quantitative free response questions, completed by all students regularly throughout the academic year. Results: Measures of impact include: Student satisfaction and quality of teaching surveys – 86-91% of students improved their clinical skills and understanding across all rotations. Academic results and progress – RCD students out-perform their urban colleagues. Intent to work in rural areas – 90% of students reported a greater interest in rural medicine. Intern numbers – rural / regional intern placements are increasing. Conclusions: The RCD proves to be a site for innovations all designed to help reach our primary goal of fostering increased recruitment of a rural medical workforce.

The Reflectance Signature of Canopy Components: Implications for the Interpretation of Remotely Sensed Images

The reflectance signatures of plantation pine canopy and understorey components were measured using a spectro-radiometer. The aim was to establish whether differences observed in the reflectance signature of stressed and unstressed pine needles were consistent with observed differences in the reflectance of multispectral Landsat Thematic Mapper (TM) images of healthy and stressed forest. Because overall scene reflectance includes the contribution of each scene component, needle reflectance may not be representative of canopy reflectance. In this investigation, a limited dataset of reflectance signatures from stressed and unstressed needles confirmed the negative relationship between pine needle health and reflectance which was observed in visible red wavelengths. However, the reflectance contribution from bushes, pine needle litter and bare soil tended to reinforce this relationship suggesting that in this instance, overall scene reflectance is comprised of the proportional reflectance of each scene component. In near infrared wavelengths, differences between healthy and stressed needle reflectance suggested a strong positive relationship between reflectance and tree health. For Landsat TM images, previous research had only observed a weak positive relationship between stand health and near infrared reflectance in these pine canopies. This suggests that for multispectral Landsat TM images, reflectance of near infrared light from pine canopies may be affected by other factors which may include the scattering of light within canopies. These results are seen as promising for the use of hyperspectral images to detect stand health, provided that pixel reflectance is not influenced by other scene components.

The treatment of tardive dyskinesia: A systematic review and meta-analysis

This systematic review aimed to collate randomized controlled trials (RCTs) of various interventions used to treat tardive dyskinesia (TD) and, where appropriate, to combine the data for mete-analysis, Clinical trials were identified by electronic searches, handsearches and contact with principal investigators. Data were extracted independently by two reviewers, for outcomes related to improvement, deterioration, side-effects and drop out rates. Data were pooled using the Mantel-Haenzel Odds Ratio (fixed effect model). For treatments that had significant effects, the number needed to treat (NNT) was calculated. From 296 controlled clinical trials, data were extracted from 47 trials. For most interventions, we could identify no RCT-derived evidence of efficacy. A meta-analysis showed that baclofen, deanol and diazepam were no more effective than a placebo. Single RCTs demonstrated a lack of evidence of any effect for bromocriptine, ceruletide, clonidine, estrogen, gamma linolenic acid, hydergine, lecithin, lithium, progabide, seligiline and tetrahydroisoxazolopyridinol. The meta-analysis found that five interventions were effective: L-dopa, oxypertine, sodium valproate, tiapride and vitamin E; neuroleptic reduction was marginally significant. Data from single RCTs revealed that insulin, alpha methyl dopa and reserpine were more effective than a placebo. There was a significantly increased risk of adverse events associated with baclofen, deanol, L-dopa, oxypertine and reserpine. Metaanalysis of the impact of placebo (n=485) showed that 37.3% of participants showed an improvement. Interpretation of this systematic review requires caution as the individual trials identified tended to have small sample sizes. For many compounds, data from only one trial were available, and where meta-analyses were possible, these were based on a small number of trials. Despite these concerns, the review facilitated the interpretation of the large and diverse range of treatments used for TD. Clinical recommendations for the treatment of TD are made, based on the availability of RCT-derived evidence, the strength of that evidence and the presence of adverse effects. (C) 1999 Elsevier Science B.V. All rights reserved.

Bioimpedance spectrometry in the determination of body water compartments: Accuracy and clinical significance

Bioelectrical impedance analysis (BIA) offers the potential for a simple, portable and relatively inexpensive technique for the in vivo measurement of total body water (TBW). The potential of BIA as a technique of body composition analysis is even greater when one considers that body water can be used as a surrogate measure of lean body mass. However, BIA has not found universal acceptance even with the introduction of multi-frequency BIA (MFBIA) which, potentially, may improve the predictive accuracy of the measurement. There are a number of reasons for this lack of acceptance, although perhaps the major reason is that no single algorithm has been developed which can be applied to all subject groups. This may be due, in part, to the commonly used wrist-to-ankle protocol which is not indicated by the basic theory of bioimpedance, where the body is considered as five interconnecting cylinders. Several workers have suggested the use of segmental BIA measurements to provide a protocol more in keeping with basic theory. However, there are other difficulties associated with the application of BIA, such as effects of hydration and ion status, posture and fluid distribution. A further putative advantage of MFBIA is the independent assessment not only of TBW but also of the extracellular fluid volume (ECW), hence heralding the possibility of,being able to assess the fluid distribution between these compartments. Results of studies in this area have been, to date, mixed. Whereas strong relationships of impedance values at low frequencies with ECW, and at high frequencies with TBW, have been reported, changes in impedance are not always well correlated with changes in the size of the fluid compartments (assessed by alternative and more direct means) in pathological conditions. Furthermore, the theoretical advantages of Cole-Cole modelling over selected frequency prediction have not always been apparent. This review will consider the principles, methodology and applications of BIA. The principles and methodology will,be considered in relation to the basic theory of BIA and difficulties experienced in its application. The relative merits of single and multiple frequency BIA will be addressed, with particular attention to the latter's role in the assessment of compartmental fluid volumes. (C) 1998 Elsevier Science Ltd. All rights reserved.