Implementation of a nursing competency assessment system in public hospitals

Numerous problems are frequently observed when nursing competency assessment systems (NCAS) are implemented. How to effectively implement a nursing competency assessment system, according to academic and practical contributions, is poorly reported in the literature. The purpose of this paper is to present a set of recommendations for public hospitals and nursing management in order to facilitate the implementation of a NCAS. To achieve this objective we have revised the existing literature and conducted a Delphi study with nursing managers and human resource managers of the public hospitals of the Basque Health Service. The results are that the implementation of a NCAS requires a well-planned strategy that managers must consider before implementing any NCAS. This strategy must include, at minimum, the following aspects: communication, training, leadership, and content where the NCAS is concerned. The context of the organisations and the cultural dimensions may also influence the results of the application of the system.

Work-based assessment : qualitative perspectives of novice nutrition and dietetics educators

Background The assessment of competence for health professionals including nutrition and dietetics professionals in work-based settings is challenging. The present study aimed to explore the experiences of educators involved in the assessment of nutrition and dietetics students in the practice setting and to identify barriers and enablers to effective assessment. Methods A qualitative research approach using in-depth interviews was employed with a convenience sample of inexperienced dietitian assessors. Interviews explored assessment practices and challenges. Data were analysed using a thematic approach within a phenomenological framework. Twelve relatively inexperienced practice educators were purposefully sampled to take part in the present study. Results Three themes emerged from these data. (i) Student learning and thus assessment is hindered by a number of barriers, including workload demands and case-mix. Some workplaces are challenged to provide appropriate learning opportunities and environment. Adequate support for placement educators from the university, managers and their peers and planning are enablers to effective assessment. (ii) The role of the assessor and their relationship with students impacts on competence assessment. (iii) There is a lack of clarity in the tasks and responsibilities of competency-based assessment. Conclusions The present study provides perspectives on barriers and enablers to effective assessment. It highlights the importance of reflective practice and feedback in assessment practices that are synonymous with evidence from other disciplines, which can be used to better support a work-based competency assessment of student performance.

OSCE online : making assessment of clinical competencies transparent, accountable & authentic

Creating an authentic assessment which at once assesses competencies, scene management, communication and overall patient care is challenging in the competitive tertiary education market. Increasing student numbers and the cost of evaluating scenario based competencies serve to ensure the need for consistent objectivity and need for timely feedback to students on their performance. Objective structured clinical examination (OSCE) is currently the most flexible approach to competency based formative and summative assessment and widely used within paramedic degree programs. Students are understandably compelled to perform well and can be frustrated by not receiving timely and appropriate feedback. Increasingly a number of products aimed at providing a more efficient and paperless approach have begun to enter the market. These products, it is suggested are aimed at medicine programs and not at allied health professions and limited to one operating system and therefore ignore issues surrounding equity and accessibility. OSCE Online aims to address this gap in the market and is tailored to these disciplines. The application will provide a service that can be both tailored and standardised from a pre-written bank, depending upon requirement to fit around the needs of clinical competency assessment. Delivering authentic assessments to address student milestones in their training to become paramedics is the cornerstone of OSCE Online. By not being restricted to a specific device it will address issues of functionality, adaptability, accessibility, authenticity and importantly: transparency and accountability by producing contemporaneous data allowing issues to be easily identified and rectified.

Evaluation of assessment in the context of work-based learning: Qualitative perspectives of new graduates

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focussed on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians’ perceptions of these evaluations. This study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly-graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, with differing assessment experiences was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences whilst a student. Data was thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) Transparency and consistency are critical elements of work-based competency assessment. (ii) Students are willing to take greater responsibility in their assessment process. (iii) Work-based competency assessment prepares students for employment. (iv) The relationship between students and their assessors can impact on the student experience and their assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in designing valid competency-based assessment approaches.

Competency measurements : testing convergent validity for two measures

Aim.  This paper is a report of a study to investigate whether the Australian National Competency Standards for Registered Nurses demonstrate correlations with the Finnish Nurse Competency Scale. Background.  Competency assessment has become popular as a key regulatory requirement and performance indicator. The term competency, however, does not have a globally accepted definition and this has the potential to create controversy, ambiguity and confusion. Variations in meaning and definitions adopted in workplaces and educational settings will affect the interpretation of research findings and have implications for the nursing profession. Method.  A non-experimental cross-sectional survey design was used with a convenience sample of 116 new graduate nurses in 2005. The second version of the Australian National Competency Standards and the Nurse Competency Scale was used to elicit responses to self-assessed competency in the transitional year (first year as a Registered Nurse). Findings.  Correlational analysis of self-assessed levels of competence revealed a relationship between the Australian National Competency Standards (ANCI) and the Nurse Competency Scale (NCS). The correlational relation between ANCI domains and NCS factors suggests that these scales are indeed used to measure related dimensions. A statistically significant relationship (r = 0·75) was found between the two competency measures. Conclusion.  Although the finding of convergent validity is insufficient to establish construct validity for competency as used in both measures in this study, it is an important step towards this goal. Future studies on relationships between competencies must take into account the validity and reliability of the tools.

Overview of international research in generic competence assessment

The competency assessment is a key issue for improving the quality of teaching and learning within the current European Higher Education Area (EHEA). The aim of this paper is to review the current research on assessment of generic competences, especially through online tools. It has conducted a search of the Web of Knowledge (Thomson Reuters) from keywords. It have been reviewed the abstracts and the results have been classified by time periods, countries and research area. It has selected a set of articles of the period 2010?2012, in which we have analyzed future trends. It is concluded that the research of assessment generic competences is been developing nowadays in educational area, although is still more important in the professional one. Additionally, it is surprising that appears most often used in preuniversity education levels. The academic context has increased research activities over the past five years, with different developments in the Anglo?Saxon countries over that those countries attached to the Bologna Process. The latest reports indicate that the learning competences must meet the individual reality of each person, so that the use of ICTs in their development and evaluation are essential given its immediacy and motivational ability. There is a clear trend towards an evaluation model that includes a 360º specific and generic competences analysis.

The Health Behavior Change Competency Checklist (HBCCC): Instrument development and psychometric evaluation.

More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.

Differences among undergraduate and graduate nursing students' cultural competency

This study examined differences in cultural competency levels between undergraduate and graduate nursing students (age, ethnicity, gender, language at home, education level, program standing, program track, diversity encounters, and previous diversity training). Participants were 83% women, aged 20 to 62; 50% Hispanic/Latino; with a Bachelor of Science in Nursing (n = 82) and a Master of Science in Nursing (n = 62). Degrees included high school diplomas, associate/diplomas, bachelors' degrees in or out of nursing, and medical doctorate degrees from outside the United States. Students spoke English (n = 82) or Spanish ( n = 54). The study used a cross-sectional design guided by the three-dimensional cultural competency model. The Cultural Competency Assessment (CCA) tool is composed of two subscales: Cultural Awareness and Sensitivity (CAS) and Culturally Competent Behaviors (CCB). Multiple regressions, Pearson's correlations, and ANOVAs determined relationships and differences among undergraduate and graduate students. Findings showed significant differences between undergraduate and graduate nursing students in CAS, p <.016. Students of Hispanic/White/European ethnicity scored higher on the CAS, while White/non-Hispanic students scored lower on the CAS, p < .05. One-way ANOVAs revealed cultural competency differences by program standing (grade-point averages), and by program tracks, between Master of Science in Nursing Advanced Registered Nurse Practitioners and both Traditional Bachelor of Science in Nursing and Registered Nurse-Bachelor of Science in Nursing. Univariate analysis revealed that higher cultural competency was associated with having previous diversity training and participation in diversity training as continuing education. After controlling for all predictors, multiple regression analysis found program level, program standing, and diversity training explained a significant amount of variance in overall cultural competency (p = .027; R2 = .18). Continuing education is crucial in achieving students' cultural competency. Previous diversity training, graduate education, and higher grade-point average were correlated with higher cultural competency levels. However, increased diversity encounters were not associated with higher cultural competency levels.^

Differences Among Undergraduate and Graduate Nursing Students’ Cultural Competency

This study examined differences in cultural competency levels between undergraduate and graduate nursing students (age, ethnicity, gender, language at home, education level, program standing, program track, diversity encounters, and previous diversity training). Participants were 83% women, aged 20 to 62; 50% Hispanic/Latino; with a Bachelor of Science in Nursing (n = 82) and a Master of Science in Nursing (n = 62). Degrees included high school diplomas, associate/diplomas, bachelors’ degrees in or out of nursing, and medical doctorate degrees from outside the United States. Students spoke English (n = 82) or Spanish (n = 54). The study used a cross-sectional design guided by the three-dimensional cultural competency model. The Cultural Competency Assessment (CCA) tool is composed of two subscales: Cultural Awareness and Sensitivity (CAS) and Culturally Competent Behaviors (CCB). Multiple regressions, Pearson’s correlations, and ANOVAs determined relationships and differences among undergraduate and graduate students. Findings showed significant differences between undergraduate and graduate nursing students in CAS, p <.016. Students of Hispanic/White/European ethnicity scored higher on the CAS, while White/non-Hispanic students scored lower on the CAS, p < .05. One-way ANOVAs revealed cultural competency differences by program standing (grade-point averages), and by program tracks, between Master of Science in Nursing Advanced Registered Nurse Practitioners and both Traditional Bachelor of Science in Nursing and Registered Nurse-Bachelor of Science in Nursing. Univariate analysis revealed that higher cultural competency was associated with having previous diversity training and participation in diversity training as continuing education. After controlling for all predictors, multiple regression analysis found program level, program standing, and diversity training explained a significant amount of variance in overall cultural competency (p = .027; R2 = .18). Continuing education is crucial in achieving students’ cultural competency. Previous diversity training, graduate education, and higher grade-point average were correlated with higher cultural competency levels. However, increased diversity encounters were not associated with higher cultural competency levels.

Trends in nurse-administered procedural sedation and analgesia across cardiac catheterisation laboratories in Australia and New Zealand : results of an electronic survey

Background Knowledge of current trends in nurse-administered procedural sedation and analgesia (PSA) in the cardiac catheterisation laboratory (CCL) may provide important insights into how to improve safety and effectiveness of this practice. Objective To characterise current practice as well as education and competency standards regarding nurse-administered PSA in Australian and New Zealand CCLs. Design A quantitative, cross-sectional, descriptive survey design was used. Methods Data were collected using a web-based questionnaire on practice, educational standards and protocols related to nurse-administered PSA. Descriptive statistics were used to analyse data. Results A sample of 62 nurses, each from a different CCL, completed a questionnaire that focused on PSA practice. Over half of the estimated total number of CCLs in Australia and New Zealand was represented. Nurse-administered PSA was used in 94% (n = 58) of respondents CCLs. All respondents indicated that benzodiazepines, opioids or a combination of both is used for PSA (n = 58). One respondent indicated that propofol was also used. 20% (n = 12) indicated that deep sedation is purposefully induced for defibrillation threshold testing and cardioversion without a second medical practitioner present. Sedation monitoring practices vary considerably between institutions. 31% (n = 18) indicated that comprehensive education about PSA is provided. 45% (n = 26) indicated that nurses who administer PSA should undergo competency assessment. Conclusion By characterising nurse-administered PSA in Australian and New Zealand CCLs, a baseline for future studies has been established. Areas of particular importance to improve include protocols for patient monitoring and comprehensive PSA education for CCL nurses in Australia and New Zealand.

Good practice report : clinical teaching

Clinical experience, or experience in the ‘real world’ of practice, is a fundamental component of many health professional courses. It often involves students undertaking practical experience in clinical workplace settings, typically referred to as clinical placements, under the supervision of health professionals. Broadly speaking, the role of clinical supervisors, or teachers, is aimed at assisting students to integrate the theoretical and skills based components of the curriculum within the context of patient/client care (Erstzen et al 2009). Clinical experience also provides students with the opportunity to assimilate the attitudes, values and skills which they require to become appropriately skilled professionals in the environments in which they will eventually practise. However, clinical settings are particularly challenging learning environments for students. Unlike classroom learning, students in the clinical setting frequently find themselves involved in unplanned and often complex activities with patients and other health care providers, being supervised by a variety of clinical staff who have very different methods and styles of teaching, and negotiating bureaucratic or hierarchical structures in busy clinical workplaces where they may only be spending a limited amount of time. Kilminster et al (2007) also draw attention to tensions that may exist between the learning needs of students and the provision of quality care or need to prevent harm to the patient (e.g. Elkind et al 2007). All of these factors complicate the realisation of clinical education goals and underscore the need for effective clinical teaching practices that maximise student learning in clinical environments. This report provides a summary of work that has been achieved in relation to ALTC projects and fellowships associated with clinical teaching, and a review of scholarly publications relevant to this field. The report also makes recommendations based on issues identified and/or where further work is indicated. The projects and fellowships reviewed cover a range of discipline areas including Biology, Paramedic Practice, Clinical Exercise Physiology, Occupational Therapy, Speech Pathology, Physiotherapy, Pharmacy, Nursing and Veterinary Science. The main areas of focus cover issues related to curriculum, particularly in relation to industry expectations of ‘work-ready’ graduates and the implications for theoretical and practical, or clinical preparation; development of competency assessment tools that are nationally applicable across discipline-specific courses; and improvement of clinical learning through strategies targeting the clinical learning environment, building the teaching capacity of clinical supervisors and/or enhancing the clinical learning/teaching process.

管理干部胜任特征评价方法的初步研究

Competency Assessment Method (CAM) is an important technique of Human Resource Management and Development in theory and practice, especially in personnel selection and training. Based on literatures of related fields, the thesis explored the feasibility of CAM in China. The main results found in this study are as follows: 1. Competencies scored in Behavioral Event Interviews (BEI) are not influenced by length of protocol, by performance in the preceding year. Average level and maximal level of complexity correlate significantly with length of protocol. Total competency frequency of outstanding executives is not significantly different from that of typical executives. These results support McCleland's view. But there is significant correlation between length of protocol and competency frequencies, which which is not agreed by McCleland. We found that competency scores using coding standard of average level and maximal level of complexity show more reliability than that using coding standard of competency frequencies. But this isn't confirmed by McCleland. 2. Inter-rater reliability was studied. The results indicated: total Category Agreement (CA) is 55.45%, over 70 percent of 20 competencies of the inter-rater reliability coefficients based on the classical test theory are significantly correlated. G coefficient based on the generalization theory is 0.85697. 3. Study of criterion sample shows that manager's competencies of China's communication enterprise are as follows: Impact and Influence, Organization Commitment, Information Seeking, Achievement Orientation, Team Leadership, Interpersonal Understanding, Initiative, Market Awareness, Self-confidence, Developing Others. This result in similar to the generic competency model of managers presented in Spencer's book. 4. CAM showed more advantages than the method of experts panel judgement.

Factors influencing the output of rural cataract surgical facilities in China: the SHARP study

Purpose: To identify factors associated prospectively with increased cataract surgical rate (CSR) in rural Chinese hospitals.

Methods: Annual cataract surgical output was obtained at baseline and 24 months later from operating room records at 42 rural, county-level hospitals. Total local CSR (cases/million population/y), and proportion of CSR from hospital and local competitors were calculated from government records. Hospital administrators completed questionnaires providing demographic and professional information, and annual clinic and outreach screening volume. Independent cataract surgeons provided clinical information and videotapes of cases for grading by two masked experts using the Ophthalmology Surgical Competency Assessment Rubric (OSCAR). Uncorrected vision was recorded for 10 consecutive cataract cases at each facility, and 10 randomly-identified patients completed hospital satisfaction questionnaires. Total value of international nongovernmental development organization (INGDO) investment in the previous three years and demographic information on hospital catchment areas were obtained. Main outcome was 2-year percentage change in hospital CSR.

Results: Among the 42 hospitals (median catchment population 530,000, median hospital CSR 643), 78.6% (33/42) were receiving INGDO support. Median change in hospital CSR (interquartile range) was 33.3% (-6.25%, 72.3%). Predictors of greater increase in CSR included higher INGDO investment (P = 0.02, simple model), reducing patient dissatisfaction (P = 0.03, simple model), and more outreach patient screening (P = 0.002, simple and multiple model).

Conclusions: Outreach cataract screening was the strongest predictor of increased surgical output. Government and INGDO investment in screening may be most likely to enhance output of county hospitals, a major goal of China's Blindness Prevention Plan.