To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? – An observational cohort study

Background: Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity.A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Method. Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Results: Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks.In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. Conclusion: We found that none of our selection criteria strongly predict clinical and communication skills. The HPAT- Ireland appears to measures ability in domains different to those assessed by the Leaving Certificate Examination. While some significant associations did emerge in Year 2 between HPAT Ireland and total OSCE scores further evaluation is required to establish if this pattern continues during the senior years of the medical course.

Clinical skills and communication in nursing students

Abstract Background: Communication is a basic tool in nursing, a crucial element of care. The quality of the interactions that take place between the nurse and the user/family influence their satisfaction and security felt with the care received. Objectives: To identify the communication skills and interpersonal relationship of nursing students in health care; identify the sociodemographic and academic variables influencing communication skills and interpersonal relationship of nursing students in health care. Methodology: Quantitative study, cross-sectional, descriptive and correlational. The data collection instrument was a questionnaire with questions concerning the socio-demographic and academic characterization; basic skills of interview and clinical communication in health care; learning of clinical communication skills and range of communication skills and interpersonal relationship. The sample consisted of 374 nursing students from two Portuguese schools. Results: The majority were female (80.5%), in the age group of 18-21 years. The students recognize the importance of clinical communication skills and interpersonal relations in nursing practice (82.4%); agreed on the teaching methods of communicational skills (54.3%). Evaluated their training in the area as good (71.7%). Age, semester and school influenced communication skills and interpersonal relationship of students (p <0.5) Conclusion: The results obtained allow us to state that the education / training of nursing student in the relational context is of fundamental importance in building capacity for competent professional practice.

Sustained impact of a short small group course with systematic feedback in addition to regular clinical clerkship activities on musculoskeletal examination skills-a controlled study.

BACKGROUND The discrepancy between the extensive impact of musculoskeletal complaints and the common deficiencies in musculoskeletal examination skills lead to increased emphasis on structured teaching and assessment. However, studies of single interventions are scarce and little is known about the time-dependent effect of assisted learning in addition to a standard curriculum. We therefore evaluated the immediate and long-term impact of a small group course on musculoskeletal examination skills. METHODS All 48 Year 4 medical students of a 6 year curriculum, attending their 8 week clerkship of internal medicine at one University department in Berne, participated in this controlled study. Twenty-seven students were assigned to the intervention of a 6×1 h practical course (4-7 students, interactive hands-on examination of real patients; systematic, detailed feedback to each student by teacher, peers and patients). Twenty-one students took part in the regular clerkship activities only and served as controls. In all students clinical skills (CS, 9 items) were assessed in an Objective Structured Clinical Examination (OSCE) station, including specific musculoskeletal examination skills (MSES, 7 items) and interpersonal skills (IPS, 2 items). Two raters assessed the skills on a 4-point Likert scale at the beginning (T0), the end (T1) and 4-12 months after (T2) the clerkship. Statistical analyses included Friedman test, Wilcoxon rank sum test and Mann-Whitney U test. RESULTS At T0 there were no significant differences between the intervention and control group. At T1 and T2 the control group showed no significant changes of CS, MSES and IPS compared to T0. In contrast, the intervention group significantly improved CS, MSES and IPS at T1 (p < 0.001). This enhancement was sustained for CS and MSES (p < 0.05), but not for IPS at T2. CONCLUSIONS Year 4 medical students were incapable of improving their musculoskeletal examination skills during regular clinical clerkship activities. However, an additional small group, interactive clinical skills course with feedback from various sources, improved these essential examination skills immediately after the teaching and several months later. We conclude that supplementary specific teaching activities are needed. Even a single, short-lasting targeted module can have a long lasting effect and is worth the additional effort.

The Rural Clinical Division: a student journey to rural medicine

Background: The University of Queensland has through an Australian Government initiative, established a Rural Clinical Division (RCD) at four regional sites in the southern and central Queensland. Over the fi rst four years of the existence of the RCD, an integrated package of innovative medical education has been developed. Method: The integrated aspects of the RCD program include: The Rural Medical Rotation: Every medical student undertakes an eight week rural rotation in Year 3. Year 3 and 4 MBBS - 100 students are currently spending one to two years in the rural school and demand is increasing. Interprofessional Education - Medical and Allied Health students attend lectures, seminars and workshops together and often share the same rural clinical placement. Rural health projects - allow students to undertake a project of benefi t to the rural community. Information Technology (IT) - the Clinical Discussion Board (CDB) and Personal Digital Assistants (PDA) demonstrate the importance of IT to medical students in the 21st century. Changing the Model of Medical Education - The Leichhardt Community Attachment Placement (LCAP), is a pilot study that resulted in the addition of three interns to the rural workforce. All aspects of the RCD are evaluated with surveys using both qualitative and quantitative free response questions, completed by all students regularly throughout the academic year. Results: Measures of impact include: Student satisfaction and quality of teaching surveys – 86-91% of students improved their clinical skills and understanding across all rotations. Academic results and progress – RCD students out-perform their urban colleagues. Intent to work in rural areas – 90% of students reported a greater interest in rural medicine. Intern numbers – rural / regional intern placements are increasing. Conclusions: The RCD proves to be a site for innovations all designed to help reach our primary goal of fostering increased recruitment of a rural medical workforce.

Cancer knowledge and skills of interns in Australia and New Zealand in 2001: comparison with 1990, and between course types

Objective: To compare the cancer knowledge and skills of interns in 2001 who graduated from graduate medical program (GMP) courses with those from non-GMP courses, and to compare the cancer knowledge and skills of interns in 2001 with those who completed a similar survey in 1990. Design: Questionnaire survey of recently graduated interns in a random sample of Australian and New Zealand hospitals. The questionnaire was designed to allow direct comparison with the 1990 survey, and was guided by the Australian Cancer Society's Ideal Oncology Curriculum for Medical Schools. Results: 443 interns completed the survey (response rate, 62%; 42 were excluded, leaving 401 surveys for analysis: 118 from GMP courses and 283 from non-GMP courses). Interns from GMP courses felt more competent than those from non-GMP courses at discussing death (P= 0.02), breaking bad news (P= 0.04) and advising on smoking cessation (P= 0.02), but less competent at preparing a patient for a hazardous procedure (P= 0.02). Mote GMP interns would refer a breast cancer patient to a multidisciplinary clinic (83% versus 70%; P= 0.03). Knowledge about cancer risks and prognosis was significantly less in GMP interns, but GMP interns rated their clinical skills, such as taking a Pap smear, higher than non-GMP interns. The GMP and non-GMP groups did not differ in their exposure to cancer patients, but compared with 1990 interns recent graduates had less exposure to patients with cancer. Conclusions: GMP curricula appear to have successfully introduced new course material and new methods of teaching, but have not always succeeded in producing doctors with better knowledge about cancer. Recent graduates have less exposure to cancer patients than those who trained 10 years ago.

Haptics in medicine and clinical skill acquisition

THE clinical skills of medical professionals rely strongly on the sense of touch, combined with anatomical and diagnostic knowledge. Haptic exploratory procedures allow the expert to detect anomalies via gross and fine palpation, squeezing, and contour following. Haptic feedback is also key to medical interventions, for example when an anaesthetist inserts an epidural needle, a surgeon makes an incision, a dental surgeon drills into a carious lesion, or a veterinarian sutures a wound. Yet, current trends in medical technology and training methods involve less haptic feedback to clinicians and trainees. For example, minimally invasive surgery removes the direct contact between the patient and clinician that gives rise to natural haptic feedback, and furthermore introduces scaling and rotational transforms that confuse the relationship between movements of the hand and the surgical site. Similarly, it is thought that computer-based medical simulation and training systems require high-resolution and realistic haptic feedback to the trainee for significant training transfer to occur. The science and technology of haptics thus has great potential to affect the performance of medical procedures and learning of clinical skills. This special section is about understanding

Implementing the Objective Structured Clinical Examination in a Geriatrics Fellowship Program-A 3-Year Experience

The Objective Structured Clinical Examination (OSCE) appears to be an effective alternative for assessing not only medical knowledge, but also clinical skills, including effective communication and physical examination skills. The purpose of the current study was to implement an OSCE model in a geriatrics fellowship program and to compare the instrument with traditional essay examination. Seventy first- and second-year geriatric fellows were initially submitted to a traditional essay examination and scored from 0 to 10 by a faculty member. The same fellows subsequently underwent an OSCE with eight 10-minute stations covering a wide range of essential aspects of geriatric knowledge. Each OSCE station had an examiner responsible for its evaluation according to a predefined checklist. Checklist items were classified for analysis purposes as clinical knowledge items (CKI) and communication skills items (CSI); fellow responses were scored from 0 to 10.Although essay examinations took from 30 to 45 minutes to complete, 180200 minutes were required to evaluate fellows using the proposed OSCE method. Fellows scored an average of 6.2 +/- 1.2 on the traditional essay examination and 6.6 +/- 1.0 on the OSCE (P < .001). Subanalyses of OSCE scores indicated that average performance on CKI was lower than the average on CSI (6.4 +/- 1.1 vs. 8.4 +/- 1.1; P < .001). Fellow performance on the essay examination was similar to their performance on CKI (P = .13). Second-year fellows performed better than first-year fellows on the essay examination (P < .001) and CKI (P = .05), but not on CSI (P = .25).The OSCE was successfully implemented as an educational strategy during a geriatrics fellowship program. Combining different testing modalities may provide the best assessment of competence for various domains of knowledge, skills, and behavior.

Effect of a video on developing skills in undergraduate nursing students for the management of totally implantable central venous access ports

Background: Handling Totally Implantable Access Ports (TIAP) is a nursing procedure that requires skill and knowledge to avoid adverse events. No studies addressing this procedure with undergraduate students were identified prior to this study. Communication technologies, such as videos, have been increasingly adopted in the teaching of nursing and have contributed to the acquisition of competencies for clinical performance. Objective: To evaluate the effect of a video on the puncture and heparinization of TIAP in the development of cognitive and technical competencies of undergraduate nursing students. Method: Quasi-experimental study with a pretest-posttest design. Results: 24 individuals participated in the study. Anxiety scores were kept at levels 1 and 2 in the pretest and posttest. In relation to cognitive knowledge concerning the procedure, the proportion of correct answers in the pretest was 0.14 (SD=0.12) and 0.90 in the posttest (SD=0.05). After watching the video, the average score obtained by the participants in the mock session was 27.20. Conclusion: The use of an educational video with a simulation of puncture and heparinization of TIAP proved to be a strategy that increased both cognitive and technical knowledge. This strategy is viable in the teaching-learning process and is useful as a support tool for professors and for the development of undergraduate nursing students. (C) 2011 Elsevier Ltd. All rights reserved.

Self-assessment insufficiently predicts performance in emergency skills

Background: Residents demonstrate a broad range of performance levels for clinical skills, with some at an inadequate level. Adequate self-assessment is important for life long learning. However, its accuracy is questioned extensively. The aim of this study was to evaluate how far the residents’ self-assessment predicts their performance in an expert assessment of emergency skills. Summary of work: Twelve skills were identified as being relevant for the emergency duties of residents in smaller hospitals. Fifteen first-year residents from the departments of internal medicine and general surgery at a district hospital rated their performance on a questionnaire (self-assessment). This was followed by a structured, practical in vivo assessment by an anaesthesiologist (expert assessment). For both, a visual analogue scale from 0 to 10 was used, on which 0 stands for novice and 10 for expert. Predictive validity was described by Spearman’s correlation, which was significant in 3 out of 12 skills only. Median correlation (r) was 0.50 (range 0.16 to 0.93). Conclusion: At the beginning of postgraduate training, self-assessment alone is not sufficient to guide self-directed learning. Take-home message: At the beginning of their residency, physicians need structured feedback in emergency skills which can be offered by anaesthesiologists.

Comparative academic performance of medical students in rural and urban clinical settings

OBJECTIVE To determine whether the academic performance of medical students learning in rural settings differs from those learning in urban settings. DESIGN Comparison of results of assessment for 2 full cohorts and 1 part cohort of medical students learning in rural and urban settings in 2002 (209 students), 2003 (226 students) and 2004 (220 students), including results for each specialist rotation in the 3rd year and end-of-year examinations in the 2nd and 4th years. SETTING University of Queensland School of Medicine, Brisbane. Students spent the whole 3rd year (of a 4-year graduate entry programme) conducting 5 specialist 8-week rotations in either the rural clinical division (rural students) or in Brisbane (urban students), all following the same curriculum and taking the same examinations. RESULTS For the 2002 cohort there were no statistically significant differences in academic performance between rural and urban students. For the 2003 cohort the only significant difference was a higher score for rural students in the end of the 4th-year clinical skills examination (65.7 versus 62.3%, P = 0.025). For the 2004 cohort, rural students scored higher in the 3rd-year mental health rotation (79.3 versus 76.2%, P = 0.038) and lower in the medicine rotation (65.5 versus 68.6%, P = 0.037). CONCLUSION Academic performance among students studying in rural and urban settings is comparable.

How can experience in clinical and community settings contribute to early medical education? A BEME systematic review

Review date: Review period January 1992-December 2001. Final analysis July 2004-January 2005. Background and review context: There has been no rigorous systematic review of the outcomes of early exposure to clinical and community settings in medical education. Objectives of review: (1) Identify published empirical evidence of the effects of early experience in medical education, analyse it, and synthesize conclusions from it. (2) Identify the strengths and limitations of the research effort to date, and identify objectives for future research. Search strategy: Ovid search of. BEI, ERIC, Medline, CIATAHL and EMBASE Additional electronic searches of: Psychinfo, Timelit, EBM reviews, SIGLE, and the Cochrane databases. Hand-searches of: Medical Education, Medical Teacher, Academic Medicine, Teaching and Learning in Medicine, Advances in Health Sciences Education, Journal of Educational Psychology. Criteria: Definitions: Experience: Authentic (real as opposed to simulated) human contact in a social or clinical context that enhances learning of health, illness and/or disease, and the role of the health professional. Early: What would traditionally have been regarded as the preclinical phase, usually the first 2 years. Inclusions: All empirical studies (verifiable, observational data) of early experience in the basic education of health professionals, whatever their design or methodology, including papers not in English. Evidence from other health care professions that could be applied to medicine was included. Exclusions: Not empirical; not early; post-basic; simulated rather than 'authentic' experience. Data collection: Careful validation of selection processes. Coding by two reviewers onto an extensively modified version of the standard BEME coding sheet. Accumulation into an Access database. Secondary coding and synthesis of an interpretation. Headline results: A total of 73 studies met the selection criteria and yielded 277 educational outcomes; 116 of those outcomes (from 38 studies) were rated strong and important enough to include in a narrative synthesis of results; 76% of those outcomes were from descriptive studies and 24% from comparative studies. Early experience motivated and satisfied students of the health professions and helped them acclimatize to clinical environments, develop professionally, interact with patients with more confidence and less stress, develop self-reflection and appraisal skill, and develop a professional identity. It strengthened their learning and made it more real and relevant to clinical practice. It helped students learn about the structure and function of the healthcare system, and about preventive care and the role of health professionals. It supported the learning of both biomedical and behavioural/social sciences and helped students acquire communication and basic clinical skills. There were outcomes for beneficiaries other than students, including teachers, patients, populations, organizations and specialties. Early experience increased recruitment to primary care/rural medical practice, though mainly in US studies which introduced it for that specific purpose as part of a complex intervention. Conclusions: Early experience helps medical students socialize to their chosen profession. It. helps them acquire a range of subject matter and makes their learning more real and relevant. It has potential benefits for other stakeholders, notably teachers and patients. It can influence career choices.