Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

Evaluating the objective structured long examination record for nurse education

An objective structured long examination record (OSLER) is a modification of the long-case clinical examination and is mainly used in medical education. This study aims to obtain nursing students' views of the OSLER compared with the objective structured clinical examination (OSCE), which is used to assess discrete clinical skills. A sample of third-year undergraduate nursing students (n=21) volunteered to participate from a cohort of 230 students. Participants undertook the OSLER under examination conditions. Pre-and post-test questionnaires gathered the students' views on the assessments and these were analysed from a mainly qualitative perspective. Teachers' and simulated patient views were also used for data triangulation. The findings indicate that the OSLER ensures more holistic assessment of a student's clinical skills and particularly essential skills such as communication, and that the OSLER, together with the OSCE, should be used to supplement the assessment of clinical competence in nursing education.

Addressing the theory practice gap in nurse education: evaluating teaching through audit against NMC standards and final management placement

Introduction
This paper outlines an innovative approach to auditing and evaluating the content of a management and leadership module for undergraduate nursing students after their final management clinical placement. Normally evaluations of teaching in a module take place at the end of a teaching module and therefore do not properly reflect the value of the teaching in relation to practical clinical experience.
Aim
This audit and evaluation sought to explore both the practical value of the teaching and learning, and also the degree to which it the teaching reflected against the NMC Standards of Education and Learning (2010 domain 3).
Methods
Having piloted the evaluative tool with an earlier cohort of nursing students, this evaluation explored both a quantitative assessment employing a Personal Response System (n =172), together with a qualitative dimension (n=116), thus delivering paper-based comments and reflections from students on the value and practicality of the module teaching theory to their final clinical management experience. The quantitative audit data were analysed for frequencies and cross tabulation and the qualitative audit data were thematically analysed.
Results
Results suggest a significant proportion of the students, appreciated the quality of the standard of teaching, but more importantly, ‘valued or highly valued’ the teaching and learning in relation to how it helped to significantly inform their management placement experience. A smaller proportion of the students underlined limitations and areas in which further improvement can be made in teaching and learning to the module.
Conclusion
Significantly positive evaluation by the students of the practical value of teaching and learning, to the theoretical management module. This has proved a useful auditing approach in assessing the theoretical teaching to student’s Level 3 clinical experience, and facilitated significant recommendations as far as developing the teaching and learning to better reflect the practice needs of nursing students

Systematic evaluation of patient-reported outcome (PRO) protocol content and reporting in UK cancer clinical trials: the EPiC study protocol

Introduction Emerging evidence suggests that patient-reported outcome (PRO)-specific information may be omitted in trial protocols and that PRO results are poorly reported, limiting the use of PRO data to inform cancer care. This study aims to evaluate the standards of PRO-specific content in UK cancer trial protocols and their arising publications and to highlight examples of best-practice PRO protocol content and reporting where they occur. The objective of this study is to determine if these early findings are generalisable to UK cancer trials, and if so, how best we can bring about future improvements in clinical trials methodology to enhance the way PROs are assessed, managed and reported. Hypothesis: Trials in which the primary end point is based on a PRO will have more complete PRO protocol and publication components than trials in which PROs are secondary end points.

Methods and analysis Completed National Institute for Health Research (NIHR) Portfolio Cancer clinical trials (all cancer specialities/age-groups) will be included if they contain a primary/secondary PRO end point. The NIHR portfolio includes cancer trials, supported by a range of funders, adjudged as high-quality clinical research studies. The sample will be drawn from studies completed between 31 December 2000 and 1 March 2014 (n=1141) to allow sufficient time for completion of the final trial report and publication. Two reviewers will then review the protocols and arising publications of included trials to: (1) determine the completeness of their PRO-specific protocol content; (2) determine the proportion and completeness of PRO reporting in UK Cancer trials and (3) model factors associated with PRO protocol and reporting completeness and with PRO reporting proportion.

Ethics and dissemination The study was approved by the ethics committee at University of Birmingham (ERN_15-0311). Trial findings will be disseminated via presentations at local, national and international conferences, peer-reviewed journals and social media including the CPROR twitter account and UOB departmental website (http://www.birmingham.ac.uk/cpro0r).