Assessing the clinical competence of psychology students through Objective Structured Clinical Examinations (OSCEs): student and staff views

Objective Structured Clinical Examinations (OSCEs) are a well-known, reliable, and valid assessment method used across the healthcare sector. In the present study, we applied OSCEs in three units within professional postgraduate psychology courses, with the broad aims of identifying staff and student perceptions of the assessment. At the conclusion of each OSCE, staff and students completed a feedback questionnaire that contained both scaled and open-ended questions. Results suggest that clinical psychology OSCEs can be stressful for students, but are also well regarded. Both staff and students felt that the OSCEs were realistic, valid, and aligned well with professional practice. Students reported differences in the way in which they prepared for the OSCEs compared with a written exam or other form of assessment, while staff noted that models of OSCE development must be flexible, to adequately assess the objectives of individual units. Further, because they can be a costly exercise, OSCEs need to be applied judiciously within the tertiary sector.

Registered nurses' perceptions of new nursing graduates' clinical competence: a systematic integrative review

Over the past decade, many questions have been raised about graduates' clinical competence and fitness for practice upon completion of their undergraduate education. Despite the significance of this issue, the perspectives of registered nurses have rarely been examined. This systematic review explores the perceptions of experienced registered nurses regarding the clinical competence of new nursing graduates. Original research studies published between 2004-2014 were identified using electronic databases, reference lists, and by searching "grey literature." Papers were critically reviewed and relevant data extracted and synthesized using an approach based on Preferred Reporting Items for Systematic Reviews and Meta-Analysis. From 153 studies initially identified, 15 original research papers were included. Four main research themes were identified: clinical/technical skills, critical thinking, interaction/communication, and overall readiness for practice. Areas of concern in relation to the clinical competence of new nursing graduates specifically related to two themes: critical thinking and clinical/technical skills. Further research is required on strategies identified within the literature with the ultimate aim of ensuring new nursing graduates are safe and competent practitioners.

The use of visual art in judging clinical competence in the operating suite

This research evolved out of the need to design and validate an instrument to assess nursing competencies in the operating suite. The study was an empirical investigation of the use of analytical and holistic rubrics to determine various levels of performance including inter-rater reliability. Three video clips that captured nurses performing as instrument nurses in the operating suite were recorded and used as prompts by the expert raters who judged the performance of the candidates in each video clip using the rubrics. Gaining consent for recording the video clips in the operating suite was difficult, creating a barrier to conducting this research. Ethical issues were addressed, which included editing of the video clips and removal of sound as stipulated by the Human Research and Ethics Committee. Despite the barriers to using visual art in research, this study produced acceptable inter-rater reliability in determining various levels of performance of the instrument nurse in the operating suite.

Pilot study of an innovative model for clinical education in dietetics

Aim: To pilot and evaluate a new model of clinical dietetics education to address the sustainability of dietetic placements in the clinical setting.

Methods: Final-year dietetics students (n = 14) completed all nine weeks of clinical placement in the pilot program at two large tertiary referral and teaching health services in metropolitan Melbourne. Staff and students completed surveys about their experience within a week of completing placement. Data collected included paid and unpaid staff working hours, hours in clinical and teaching activity, hours of student attendance and student clinical work hours. Data for the last month of the placement programs in the preceding three years were used for comparison with the pilot program.

Results: Combined data for the two providers showed that the model reduced the amount of supervision hours per student hour on placement by 16% while maintaining quality indicators during the pilot compared with previous years. Students in the pilot program were more positive about their experience compared with students in the existing program. The overall trend of responses in the staff surveys was positive for the pilot program, but the trend was not as marked as that of student responses.

Conclusion: The new model of clinical dietetics education was successfully piloted and demonstrated the potential to increase student training capacity without a negative impact on student achievement or major resource demands. Refinements to the model and opportunities to enhance integration into the dietetics degree program were identified during the project. The learning needs of non-English-speaking background students require further scrutiny.

Innovative model for clinical education in dietetics

Aim: Professional practice placement programs in dietetics face a number of challenges in respect of quantity, quality and sustainability. The aim of the present study is to report on the development of an innovative placement model based on a variety of training and supervision approaches to address these aforementioned challenges.

Methods: The model was developed following an investigation of existing practice and the literature with approaches that were identified as important to the requirements and constraints of dietetics clinical training incorporated into the model.

Results: Although one-on-one supervision is the predominant approach in Australian dietetic education, the educational literature and the authors' experience showed that a variety of approaches are represented in some form. The model developed involves the pairing of two students with one supervisor with students changing peer partners and supervisors every three weeks during the nine-week placement to diversify exposure to working and learning styles. The model integrates four customised approaches: incremental exposure to tasks; use of a clinical reasoning framework to help structure student understanding of the methods and judgements involved in patient care; structured enquiry in group discussions; and peer observation and feedback.

Conclusions: The model has potential to achieve efficiencies in supervisors' involvement by coordinating the skill development activities of students as a group and promoting peer-assisted learning.

Bridging the gap : from simulation to clinical practice

There has been a shift from the initial learning of skills on patients in the clinical setting to initial learning in a simulated environment, using part-task models, with the risk of a task focus to the learning. We contend that quality learning in both the simulated and the clinical environment is crucial to enhance the transferability of skills to the clinical setting.

Evaluating a standardised clinical assessment tool for pre-registration midwifery students: a cross-sectional survey of midwifery students and midwives in Australia

Abstract
Background: Assessment of clinical competence is a core component of midwifery education. Clinical assessment tools have been developed to help increase consistency and overcome subjectivity of assessment.
Aim: The study had two main aims. The first was to explore midwifery students and educators/clinical midwives’ views and experiences of a common clinical assessment tool used for all preregistration midwifery programmes in Victoria and the University of South Australia. The Second was to assess the need for changes to the tool to align with developments in clinical practice and evidence-based care.
Methods: A cross-sectional, web-based survey including Likert-type scales and open-ended questions was utilised.
Setting: Students enrolled in all four entry pathways to midwifery at seven Victorian and one South Australian University and educators/clinical midwives across both states.
Findings: One hundred and ninety-one midwifery students’ and 86 educators/clinical midwives responded.
Overall, students and educators/clinical midwives were positive about the Clinical Assessment Tool with over 90% reporting that it covered the necessary midwifery skills. Students and educators/clinical midwives reported high levels of satisfaction with the content of the learning tools. Only 4% of educators/clinical midwives and 6% of students rated the Clinical Assessment Tool as poor overall. Changes to some learning tools were necessary in order to reflect recent practice and evidence.
Key conclusions and implications for practice: A common clinical assessment tool for evaluating midwifery students’ clinical practice may facilitate the provision of consistent, reliable and objective assessment of student skills and competency.

Assessment of simulated clinical skills and distance students: can we do it better?

Australian universities have traditionally been able to supplement clinical education, for undergraduate nursing courses, delivered on placement with weekly clinical teaching in the simulated environment. The Objective Structured Clinical Assessment (OSCA) tool has been used in this simulated environment to assess clinical skills. Recently, however, online delivery of undergraduate nursing courses has become more common. The move from an internal mode of teaching to an online external mode is seen worldwide and poses challenges to staff and students as well as changing the teaching and learning culture of institutions (Philip and Wozniak, 2009). This cultural shift and the resulting diminishing timeframe for students to acquire and practice simulated clinical skills imply that it may become necessary to rethink assessment forms such as the OSCA assessment. This study examines whether or not the OSCA tool developed by Bujack et al. (1991a) is the best tool to be used in this new context, where online teaching is supplemented by very short, annual, intensive periods of study. Skills acquisition theories dictate that time is required to produce an ideal skills acquisition environment (Quinn, 2000) but the time constraints placed on students in such intensive periods of study could influence skills acquisition. This cross-sectional qualitative study used semi-structured interviews and focus groups to collect data. 65% of the nursing faculty participated in the study. The teaching of the Bachelor of Nursing (BN) occurred on two campuses and staff from both areas participated. This group of nurse academics was employed across the range of academic levels (from lecturer to professor) at the University. Data analysis followed a generic thematic analysis framework. Findings in this study show that there are a variety of attitudes and underpinning beliefs amongst staff in relation to the OSCAs. Doubts were raised in regard to the suitability of the use of the OSCA tool in this setting. It also became apparent during this study that the OSCA tool possibly serves purposes other than an assessment tool.

Multiple mini-interview : how long is long enough?

Objectives The multiple mini-interview (MMI) overcomes the limitations of the traditional panel interview by multiple sampling to provide improved objectivity and reliability. Reliability of the MMI is affected by number of stations; however, there are few data reporting the influence of interview duration on MMI outcome and reliability. We aimed to determine whether MMI stations can be shortened without affecting applicant rankings or compromising test reliability.
Methods A total of 175 applicants were interviewed and assessed at 10 8-minute stations. Applicants were scored once after 8 minutes at five control stations and twice after 5 minutes and 8 minutes at five experimental stations. Scores at 5 and 8 minutes were compared using t-tests and correlation coefficients. Rankings of applicants based on 5- and 8-minute scores were compared using Spearman's rank order coefficient. The reliability of the MMI was examined for 5- and 8-minute scores using generalisability theory.
Results Mean scores at 5 minutes were lower than mean scores at 8 minutes. Cumulative scores at 5 minutes were also lower. There were highly significant correlations between 5- and 8-minute scores at all experimental stations (0.82–0.91; P < 0.01) and between the cumulative scores at 5 and 8 minutes (0.92; P < 0.01). There was a strong correlation between applicant rankings based on cumulative 5- and 8-minute scores (Spearman's rank order coefficient 0.92). Reliability was not affected.
Conclusions Reducing the duration of MMI stations from 8 to 5 minutes conserves resources with minimal effect on applicant ranking and test reliability.

The evolution of a state-wide continuing education programme for allied health professionals

Allied health professionals require continuing education (CE) to maintain and improve competencies and standards of care. Research suggests that professional access to CE in rural areas can be difficult.

This article uses an action research framework to describe the development and implementation of a CE programme for allied health professionals in a rural area in Australia, and its subsequent evolution into a state-wide programme. To evaluate programme relevance, attendance and perceived clinical relevance, physiotherapists (n = 75) in southwest Victoria were surveyed 1year after commencement of a CE programme. A secondary outcome was the perceived effect on clinical practice.

More than two-thirds (68.6%) of physiotherapists attended at least one workshop, 57.2% attended four or more sessions and 22.9% attended at least one of the two conducted courses over the period. In addition, 20% of the physiotherapists perceived that attending the programme had a large positive effect on their therapeutic skills, whereas 68.6% reported some effect. From a regional CE programme for physiotherapists the programme evolved into a state-wide programme for 22 allied health professions.

What do general practitioners think depression is? A taxonomy of distress and depression for general practice

Objective:
To create a taxonomy of distress and depression for use in primary care, that mirrors the thinking and practice of experienced general practitioners.

Design:
Qualitative study, using an ethnomethodological approach, with observation of videotaped routine GP–patient consultations and in-depth interviews with GPs.

Setting and participants:
The study was conducted in metropolitan Melbourne in 2005. Fourteen GPs conducted 36 patient consultations where depression was a focus; nine GPs participated in in-depth interviews to elicit details of how they recognised and diagnosed depression in their patients.

Results:
GPs consider distress and depression in three steps. In the first step, a change in a group of symptoms and signs is observed (eg, facial expression, loss of drive). The second step categorises the syndrome according to whether or not there is an identifiable environmental cause (reactive or “endogenous”), with the final step categorising the reactive syndromes according to their most prominent symptoms: either anxiety and worry, or helplessness and hopelessness. The resulting taxonomy includes: endogenous depression (a chronic and perhaps characterological depression characterised by a lack of interest and motivation); anxious depressive reaction (stress or worry); and hopeless depressive reaction (demoralisation).

Conclusion:
This simple and parsimonious taxonomy has validity based on its derivation from within the primary care setting.

Barriers to care for depressed older people : perceptions of aged care among medical professionals

The current study evaluated barriers to detection of depression among older people. Focus groups were conducted with 21 professional carers, 4 nurses, 10 general practitioners, and 7 aged care managers. The results demonstrated that care for older people is primarily focused on physical care. Further, staff resources, a lack of continuity of care, multiple co-morbidities, reluctance by older people to discuss depression, negative attitudes among carers, as well as a lack of skills all contributed to a failure to detect and treat depression. The implications of these findings for training programs for professional carers are discussed.

Supervision among mental health workers in the ACT

There is a common perception among mental health professionals of the purpose of clinical supervision. However, only two-thirds of professionals in the ACT currently receive regular supervision with comparisons between nurses and allied health workers showing few differences in experience, training, access and barriers to supervision, both supervisees and supervisors.