The mini clinical evaluation exercise (mini-CEX) for assessing clinical performance of international medical graduates

Objective: To evaluate the feasibility, reliability and acceptability of the mini clinical evaluation exercise (mini-CEX) for performance assessment among international medical graduates (IMGs). Design, setting and participants: Observational study of 209 patient encounters involving 28 IMGs and 35 examiners at three metropolitan teaching hospitals in New South Wales, Victoria and Queensland, September-December 2006. Main outcome measures: The reliability of the mini-CEX was estimated using generatisability (G) analysis, and its acceptability was evaluated by a written survey of the examiners and IMGs. Results: The G coefficient for eight encounters was 0.88, suggesting that the reliability of the mini-CEX was 0.90 for 10 encounters. Almost half of the IMGs (7/16) and most examiners (14/18) were satisfied with the mini-CEX as a learning tool. Most of the IMGs and examiners enjoyed the immediate feedback, which is a strong component of the tool. Conclusion: The mini-CEX is a reliable tool for performance assessment of IMGs, and is acceptable to and well received by both learners and supervisors.

In-training assessment - Its potential in enhancing clinical teaching

Context In-training assessment (ITA) has established its place alongside formative and summative assessment at both the undergraduate and postgraduate level. In this paper the authors aimed to identify those characteristics of ITA that could enhance clinical teaching. Methods A literature review and discussions by an expert working group at the Ninth Cambridge Conference identified the aspects of ITA that could enhance clinical teaching. Results The features of ITA identified included defining the specific benefits to the learner, teacher and institution, and highlighting the patient as the context for ITA and clinical teaching. The ‘mapping’ of a learner’s progress towards the clinical teaching objectives by using multiple assessments over time, by multiple observers in both a systematic and opportunistic way correlates with the incremental nature of reaching clinical competence. Conclusions The importance of ITA based on both direct and indirect evidence of what the learner actually does in the real clinical setting is emphasized. Particular attention is given to addressing concerns in the more controversial areas of assessor training, ratings and documentation for ITA. Areas for future research are also identified.

Pilot study of an innovative model for clinical education in dietetics

Aim: To pilot and evaluate a new model of clinical dietetics education to address the sustainability of dietetic placements in the clinical setting.

Methods: Final-year dietetics students (n = 14) completed all nine weeks of clinical placement in the pilot program at two large tertiary referral and teaching health services in metropolitan Melbourne. Staff and students completed surveys about their experience within a week of completing placement. Data collected included paid and unpaid staff working hours, hours in clinical and teaching activity, hours of student attendance and student clinical work hours. Data for the last month of the placement programs in the preceding three years were used for comparison with the pilot program.

Results: Combined data for the two providers showed that the model reduced the amount of supervision hours per student hour on placement by 16% while maintaining quality indicators during the pilot compared with previous years. Students in the pilot program were more positive about their experience compared with students in the existing program. The overall trend of responses in the staff surveys was positive for the pilot program, but the trend was not as marked as that of student responses.

Conclusion: The new model of clinical dietetics education was successfully piloted and demonstrated the potential to increase student training capacity without a negative impact on student achievement or major resource demands. Refinements to the model and opportunities to enhance integration into the dietetics degree program were identified during the project. The learning needs of non-English-speaking background students require further scrutiny.

Innovative model for clinical education in dietetics

Aim: Professional practice placement programs in dietetics face a number of challenges in respect of quantity, quality and sustainability. The aim of the present study is to report on the development of an innovative placement model based on a variety of training and supervision approaches to address these aforementioned challenges.

Methods: The model was developed following an investigation of existing practice and the literature with approaches that were identified as important to the requirements and constraints of dietetics clinical training incorporated into the model.

Results: Although one-on-one supervision is the predominant approach in Australian dietetic education, the educational literature and the authors' experience showed that a variety of approaches are represented in some form. The model developed involves the pairing of two students with one supervisor with students changing peer partners and supervisors every three weeks during the nine-week placement to diversify exposure to working and learning styles. The model integrates four customised approaches: incremental exposure to tasks; use of a clinical reasoning framework to help structure student understanding of the methods and judgements involved in patient care; structured enquiry in group discussions; and peer observation and feedback.

Conclusions: The model has potential to achieve efficiencies in supervisors' involvement by coordinating the skill development activities of students as a group and promoting peer-assisted learning.

Bridging the gap : from simulation to clinical practice

There has been a shift from the initial learning of skills on patients in the clinical setting to initial learning in a simulated environment, using part-task models, with the risk of a task focus to the learning. We contend that quality learning in both the simulated and the clinical environment is crucial to enhance the transferability of skills to the clinical setting.

Evaluating a standardised clinical assessment tool for pre-registration midwifery students: a cross-sectional survey of midwifery students and midwives in Australia

Abstract
Background: Assessment of clinical competence is a core component of midwifery education. Clinical assessment tools have been developed to help increase consistency and overcome subjectivity of assessment.
Aim: The study had two main aims. The first was to explore midwifery students and educators/clinical midwives’ views and experiences of a common clinical assessment tool used for all preregistration midwifery programmes in Victoria and the University of South Australia. The Second was to assess the need for changes to the tool to align with developments in clinical practice and evidence-based care.
Methods: A cross-sectional, web-based survey including Likert-type scales and open-ended questions was utilised.
Setting: Students enrolled in all four entry pathways to midwifery at seven Victorian and one South Australian University and educators/clinical midwives across both states.
Findings: One hundred and ninety-one midwifery students’ and 86 educators/clinical midwives responded.
Overall, students and educators/clinical midwives were positive about the Clinical Assessment Tool with over 90% reporting that it covered the necessary midwifery skills. Students and educators/clinical midwives reported high levels of satisfaction with the content of the learning tools. Only 4% of educators/clinical midwives and 6% of students rated the Clinical Assessment Tool as poor overall. Changes to some learning tools were necessary in order to reflect recent practice and evidence.
Key conclusions and implications for practice: A common clinical assessment tool for evaluating midwifery students’ clinical practice may facilitate the provision of consistent, reliable and objective assessment of student skills and competency.

Understanding and choosing clinical performance measures for quality improvement : development of a typology : final report /

"Contract no. 282-92-0038, delivery order #3."

Monitoring & evaluation of clinical services : meeting the JCAHO challenge.

"Department of Veterans Affairs"--Cover.

Comparative academic performance of medical students in rural and urban clinical settings

OBJECTIVE To determine whether the academic performance of medical students learning in rural settings differs from those learning in urban settings. DESIGN Comparison of results of assessment for 2 full cohorts and 1 part cohort of medical students learning in rural and urban settings in 2002 (209 students), 2003 (226 students) and 2004 (220 students), including results for each specialist rotation in the 3rd year and end-of-year examinations in the 2nd and 4th years. SETTING University of Queensland School of Medicine, Brisbane. Students spent the whole 3rd year (of a 4-year graduate entry programme) conducting 5 specialist 8-week rotations in either the rural clinical division (rural students) or in Brisbane (urban students), all following the same curriculum and taking the same examinations. RESULTS For the 2002 cohort there were no statistically significant differences in academic performance between rural and urban students. For the 2003 cohort the only significant difference was a higher score for rural students in the end of the 4th-year clinical skills examination (65.7 versus 62.3%, P = 0.025). For the 2004 cohort, rural students scored higher in the 3rd-year mental health rotation (79.3 versus 76.2%, P = 0.038) and lower in the medicine rotation (65.5 versus 68.6%, P = 0.037). CONCLUSION Academic performance among students studying in rural and urban settings is comparable.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

Assessment of simulated clinical skills and distance students: can we do it better?

Australian universities have traditionally been able to supplement clinical education, for undergraduate nursing courses, delivered on placement with weekly clinical teaching in the simulated environment. The Objective Structured Clinical Assessment (OSCA) tool has been used in this simulated environment to assess clinical skills. Recently, however, online delivery of undergraduate nursing courses has become more common. The move from an internal mode of teaching to an online external mode is seen worldwide and poses challenges to staff and students as well as changing the teaching and learning culture of institutions (Philip and Wozniak, 2009). This cultural shift and the resulting diminishing timeframe for students to acquire and practice simulated clinical skills imply that it may become necessary to rethink assessment forms such as the OSCA assessment. This study examines whether or not the OSCA tool developed by Bujack et al. (1991a) is the best tool to be used in this new context, where online teaching is supplemented by very short, annual, intensive periods of study. Skills acquisition theories dictate that time is required to produce an ideal skills acquisition environment (Quinn, 2000) but the time constraints placed on students in such intensive periods of study could influence skills acquisition. This cross-sectional qualitative study used semi-structured interviews and focus groups to collect data. 65% of the nursing faculty participated in the study. The teaching of the Bachelor of Nursing (BN) occurred on two campuses and staff from both areas participated. This group of nurse academics was employed across the range of academic levels (from lecturer to professor) at the University. Data analysis followed a generic thematic analysis framework. Findings in this study show that there are a variety of attitudes and underpinning beliefs amongst staff in relation to the OSCAs. Doubts were raised in regard to the suitability of the use of the OSCA tool in this setting. It also became apparent during this study that the OSCA tool possibly serves purposes other than an assessment tool.