Standardizing the assessment of clinical competence: an overview of intensive care course design.

Rationale for the development of the Certificate in Health Studies: Intensive Care and High Dependency for Adults course developed at Queens University Belfast, Northern Ireland. Structure and content of clinical module reviewed. Clinical assessment strategy discussed. Focus on the utilization of a standardized portfolio, individualized learning contract and objective structured clinical examination (OSCE) to evaluate clinical competence. Evaluation of OSCE as an assessment tool and of the course provision.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

Measuring the psychosocial characteristics of family caregivers of palliative care patients:psychometric properties of nine self-report instruments

Researchers and clinicians have experienced substantial difficulties locating measures that are suitable for use within palliative care settings. This article details the psychometric properties of nine instruments designed to assess the following psychosocial characteristics of family caregivers: competence, mastery, self-efficacy, burden, optimism, preparedness, social support, rewards, and mutuality. Results are based on the responses of 106 primary family caregivers caring for relatives dying of cancer. Principal components extraction with varimax rotation was used to explore the underlying structure of each measure. Following the exclusion of complex variables, suggested components for most measures comprised relatively homogenous items, which were good to excellent measures of each component. Some components comprised only two items; however, Cronbach's alphas typically indicated moderate to high levels of internal consistency. Overall, the results of this study suggest that most of the measures analyzed, excepting the mastery and mutuality scales, can be recommended to examine the family caregiver experience and test supportive interventions.

General Nurses’ Experiences of End-Of-Life Care in the Acute Hospital Setting

Approximately 90% of the UK population spend some time in hospital in their final year of life, and more than half of the population die in hospital. This review aims to explore the experiences of general nurses when providing end-of-life care to patients in the acute hospital setting. Nine studies were identified through a literature search, and each was then analysed and evaluated until themes emerged. Six themes were drawn from the literature: lack of education and knowledge, lack of time with patients, barriers arising in the culture of the health-care setting, communication barriers, symptom management, and nurses' personal issues. The themes cause concern about the quality of end-of-life care being provided in the acute care setting. The literature appears to be consistent in the view that terminally ill patients are best cared for in specialised care settings, such as palliative care units and hospices. However, increasing demands on health services will result in greater numbers of dying patients being admitted to the acute hospital setting. It is therefore paramount that general nurses' educational needs are met to ensure they develop clinical competence to provide high-quality holistic end-of-life care.

Integrating molecular diagnostics into histopathology training: the Belfast model

Molecular medicine is transforming modern clinical practice, from diagnostics to therapeutics. Discoveries in research are being incorporated into the clinical setting with increasing rapidity. This transformation is also deeply changing the way we practise pathology. The great advances in cell and molecular biology which have accelerated our understanding of the pathogenesis of solid tumours have been embraced with variable degrees of enthusiasm by diverse medical professional specialties. While histopathologists have not been prompt to adopt molecular diagnostics to date, the need to incorporate molecular pathology into the training of future histopathologists is imperative. Our goal is to create, within an existing 5-year histopathology training curriculum, the structure for formal substantial teaching of molecular diagnostics. This specialist training has two main goals: (1) to equip future practising histopathologists with basic knowledge of molecular diagnostics and (2) to create the option for those interested in a subspecialty experience in tissue molecular diagnostics to pursue this training. It is our belief that this training will help to maintain in future the role of the pathologist at the centre of patient care as the integrator of clinical, morphological and molecular information.

Have OSCEs come of age in nursing education?

This article is intended to contribute to the current debate as to whether the objective structured clinical examination (OSCE) should become a standard assessment tool for undergraduate nursing education as they currently are for medicine. The authors describe how one UK university developed an OSCE for a nursing undergraduate programme with the aim of emphasising the need for nursing students to be competent in clinical skills and offering a means of standardising the assessment of these skills. There has been an increasing number of research studies carried out in this area at international level and this article's main contribution to the literature is the description of the Angoff standard-setting procedure that was used to calibrate the OSCE at this University and which makes it the first nursing OSCE in the UK to incorporate a scientific standard-setting procedure.

Factors influencing the output of rural cataract surgical facilities in China: the SHARP study

Purpose: To identify factors associated prospectively with increased cataract surgical rate (CSR) in rural Chinese hospitals.

Methods: Annual cataract surgical output was obtained at baseline and 24 months later from operating room records at 42 rural, county-level hospitals. Total local CSR (cases/million population/y), and proportion of CSR from hospital and local competitors were calculated from government records. Hospital administrators completed questionnaires providing demographic and professional information, and annual clinic and outreach screening volume. Independent cataract surgeons provided clinical information and videotapes of cases for grading by two masked experts using the Ophthalmology Surgical Competency Assessment Rubric (OSCAR). Uncorrected vision was recorded for 10 consecutive cataract cases at each facility, and 10 randomly-identified patients completed hospital satisfaction questionnaires. Total value of international nongovernmental development organization (INGDO) investment in the previous three years and demographic information on hospital catchment areas were obtained. Main outcome was 2-year percentage change in hospital CSR.

Results: Among the 42 hospitals (median catchment population 530,000, median hospital CSR 643), 78.6% (33/42) were receiving INGDO support. Median change in hospital CSR (interquartile range) was 33.3% (-6.25%, 72.3%). Predictors of greater increase in CSR included higher INGDO investment (P = 0.02, simple model), reducing patient dissatisfaction (P = 0.03, simple model), and more outreach patient screening (P = 0.002, simple and multiple model).

Conclusions: Outreach cataract screening was the strongest predictor of increased surgical output. Government and INGDO investment in screening may be most likely to enhance output of county hospitals, a major goal of China's Blindness Prevention Plan.

Undergraduate interprofessional education using high-fidelity paediatric simulation

BACKGROUND: High-fidelity simulation is becoming increasingly important in the delivery of teaching and learning to health care professionals within a safe environment. Its use in an interprofessional context and at undergraduate level has the potential to facilitate the learning of good communication and teamworking, in addition to clinical knowledge and skills.

METHODS: Interprofessional teaching and learning workshops using high-fidelity paediatric simulation were developed and delivered to undergraduate medical and nursing students at Queen's University Belfast. Learning outcomes common to both professions, and essential in the clinical management of sick children, included basic competencies, communication and teamworking skills. Quantitative and qualitative evaluation was undertaken using published questionnaires.

RESULTS: Quantitative results - the 32-item questionnaire was analysed for reliability using spss. Responses were positive for both groups of students across four domains - acquisition of knowledge and skills, communication and teamworking, professional identity and role awareness, and attitudes to shared learning. Qualitative results - thematic content analysis was used to analyse open-ended responses. Students from both groups commented that an interprofessional education (IPE) approach to paediatric simulation improved clinical and practice-based skills, and provided a safe learning environment. Students commented that there should be more interprofessional and simulation learning opportunities.

DISCUSSION: High-fidelity paediatric simulation, used in an interprofessional context, has the potential to meet the requirements of undergraduate medical and nursing curricula. Further research is needed into the long-term benefits for patient care, and its generalisability to other areas within health care teaching and learning.

Improving allied health professionals' research implementation behaviours for children with cerebral palsy: protocol for a before-after study

BACKGROUND: Cerebral palsy is a permanent disorder of posture and movement caused by disturbances in the developing brain. It affects approximately 1 in every 500 children in developed countries and is the most common form of childhood physical disability. People with cerebral palsy may also have problems with speech, vision and hearing, intellectual difficulties and epilepsy. Health and therapy services are frequently required throughout life, and this care should be effective and evidence informed; however, accessing and adopting new research findings into day-to-day clinical practice is often delayed.

METHODS/DESIGN: This 3-year study employs a before and after design to evaluate if a multi-strategy intervention can improve research implementation among allied health professionals (AHPs) who work with children and young people with cerebral palsy and to establish if children's health outcomes can be improved by routine clinical assessment. The intervention comprises (1) knowledge brokering with AHPs, (2) access to an online research evidence library, (3) provision of negotiated evidence-based training and education, and (4) routine use of evidence-based measures with children and young people aged 3-18 years with cerebral palsy. The study is being implemented in four organisations, with a fifth organisation acting as a comparison site, across four Australian states. Effectiveness will be assessed using questionnaires completed by AHPs at baseline, 6, 12 and 24 months, and by monitoring the extent of use of evidence-based measures. Children's health outcomes will be evaluated by longitudinal analyses.

DISCUSSION: Government, policy makers and service providers all seek evidence-based information to support decision-making about how to distribute scarce resources, and families are seeking information to support intervention choices. This study will provide knowledge about what constitutes an efficient, evidence-informed service and which allied health interventions are implemented for children with cerebral palsy.

TRIAL REGISTRATION: Trial is not a controlled healthcare intervention and is not registered.

Evaluating the objective structured long examination record for nurse education

An objective structured long examination record (OSLER) is a modification of the long-case clinical examination and is mainly used in medical education. This study aims to obtain nursing students' views of the OSLER compared with the objective structured clinical examination (OSCE), which is used to assess discrete clinical skills. A sample of third-year undergraduate nursing students (n=21) volunteered to participate from a cohort of 230 students. Participants undertook the OSLER under examination conditions. Pre-and post-test questionnaires gathered the students' views on the assessments and these were analysed from a mainly qualitative perspective. Teachers' and simulated patient views were also used for data triangulation. The findings indicate that the OSLER ensures more holistic assessment of a student's clinical skills and particularly essential skills such as communication, and that the OSLER, together with the OSCE, should be used to supplement the assessment of clinical competence in nursing education.