Standardizing the assessment of clinical competence: an overview of intensive care course design.

Rationale for the development of the Certificate in Health Studies: Intensive Care and High Dependency for Adults course developed at Queens University Belfast, Northern Ireland. Structure and content of clinical module reviewed. Clinical assessment strategy discussed. Focus on the utilization of a standardized portfolio, individualized learning contract and objective structured clinical examination (OSCE) to evaluate clinical competence. Evaluation of OSCE as an assessment tool and of the course provision.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

How to promote professional competence and identity in social work students

Background: Field placement experiences are frequently cited in the literature as having most impact on a student social worker’s learning as they emerge into the profession. Placements are integral to the development of practice competence and in acquiring a sense of social work identity. However research on the effectiveness of educational strategies used to deliver learning and assess competence during placement are scarce. Internationally, pressures to meet increasing numbers of student enrolments have raised concerns about the potential impact on the quality of placements and practice teaching provided. These pressures may also impact on the appropriate transfer and application of learning to the student’s practice.
Aim: To identify learning activities rated most useful for developing professional practice competence and professional identity of social work students.
Method: Data were collected from 396 students who successfully completed their first or final placement during 2013-2014 and were registered at one of two Universities in Northern Ireland. Students completed a self-administered questionnaire which covered: placement setting and service user group; type of supervision model; frequency of undertaking specific learning activities; who provided the learning; which activities contributed to their developing professional competence and identity and their overall satisfaction.
Our findings confirmed the centrality of the supervisory relationship as the vehicle to enable quality student learning. Shadowing others, receiving regular supervision and receiving constructive feedback were the tasks that students reported as ‘most useful’ to developing professional identity, competence and readiness to practice. Disturbingly over 50% of students reported that linking practice to the professional codes, practice foci and key roles were not valued as ‘useful’ in terms of readiness to practice, feeling competent and developing professional social work identity. These results offer strong insights into how both the University and the practice placement environment needs to better prepare, assess and support students during practice placements in the field.