Competency measurements : testing convergent validity for two measures

Aim.  This paper is a report of a study to investigate whether the Australian National Competency Standards for Registered Nurses demonstrate correlations with the Finnish Nurse Competency Scale. Background.  Competency assessment has become popular as a key regulatory requirement and performance indicator. The term competency, however, does not have a globally accepted definition and this has the potential to create controversy, ambiguity and confusion. Variations in meaning and definitions adopted in workplaces and educational settings will affect the interpretation of research findings and have implications for the nursing profession. Method.  A non-experimental cross-sectional survey design was used with a convenience sample of 116 new graduate nurses in 2005. The second version of the Australian National Competency Standards and the Nurse Competency Scale was used to elicit responses to self-assessed competency in the transitional year (first year as a Registered Nurse). Findings.  Correlational analysis of self-assessed levels of competence revealed a relationship between the Australian National Competency Standards (ANCI) and the Nurse Competency Scale (NCS). The correlational relation between ANCI domains and NCS factors suggests that these scales are indeed used to measure related dimensions. A statistically significant relationship (r = 0·75) was found between the two competency measures. Conclusion.  Although the finding of convergent validity is insufficient to establish construct validity for competency as used in both measures in this study, it is an important step towards this goal. Future studies on relationships between competencies must take into account the validity and reliability of the tools.

Development and psychometric testing of the clinical learning environment, supervision and nurse teacher evaluation scale (CLES+T): The Spanish version

Background: The Clinical Learning Environment, Supervision and Nurse Teacher scale is a reliable and valid instrument to evaluate the quality of the clinical learning process in international nursing education contexts. Objectives: This paper reports the development and psychometric testing of the Spanish version of the Clinical Learning Environment, Supervision and Nurse Teacher scale. Design: Cross-sectional validation study of the scale. Setting: 10 public and private hospitals in the Alicante area, and the Faculty of Health Sciences (University of Alicante, Spain). Participants: 370 student nurses on clinical placement (January 2011–March 2012). Methods: The Clinical Learning Environment, Supervision and Nurse Teacher scale was translated using the modified direct translation method. Statistical analyses were performed using PASW Statistics 18 and AMOS 18.0.0 software. A multivariate analysis was conducted in order to assess construct validity. Cronbach’s alpha coefficient was used to evaluate instrument reliability. Results: An exploratory factorial analysis identified the five dimensions from the original version, and explained 66.4% of the variance. Confirmatory factor analysis supported the factor structure of the Spanish version of the instrument. Cronbach’s alpha coefficient for the scale was .95, ranging from .80 to .97 for the subscales. Conclusion: This version of the Clinical Learning Environment, Supervision and Nurse Teacher scale instrument showed acceptable psychometric properties for use as an assessment scale in Spanish-speaking countries.

Competency Standards and Educational Requirements for Specialist Breast Nurses in Australia

There is substantial evidence that Specialist Breast Nurses (SBNs) make an important contribution to improved outcomes for women with breast cancer, by providing information and support and promoting continuity of care. However, a recent study has identified significant variation in how the role functions across individual nurses and settings, which is likely to contribute to varied outcomes for women with breast cancer. The project reported in this paper illustrates how a set of competency standards for SBNs were developed by the National Breast Cancer Centre. The competency standards were developed through a review of published literature and consultation with key stakeholders. The resulting SBN Competency Standards reflect the core domains and elements of SBN practice seen as integral to achieving optimal outcomes for women with breast cancer. This project identifies the SBN as a registered nurse who applies advanced knowledge of the health needs, preferences and circumstances of women with breast cancer to optimise the individual's health and well-being at various phases across the continuum of care, including diagnosis, treatment, rehabilitation, follow-up and palliative care. The five core domains of practice identified are: Supportive care; Collaborative care; Coordinated care; Information provision and education; and Clinical leadership. A variety of education programs are currently available for nurses who wish to learn about breast cancer nursing. The majority of stakeholders consulted in this project agreed that a Graduate Diploma level of education is required at minimum in order for an SBN to develop the minimum level of competence required to perform the role. The evidence supports the view that as an advanced role, nurses practising as SBNs require high-quality programs of sufficient depth and scope to achieve the required level of competence

Establishing content validity of a survey research instrument : the older patients in acute care survey - United States

Geriatric nursing competency in the acute care setting is a social mandate for the 21st century. This article reports on the content validation of an Australian research instrument, the Older Patients in Acute Care Survey (OPACS) that examines the attitudes, the knowledge, and the practices of nurses working with acute care patients. The OPACS tool was developed primarily to assist nurse educators to assess attitudes, knowledge, and practices of nursing staff in caring for older patients in the acute care setting; to evaluate the implementation of institution-specific educational interventions; and to improve quality of care given to older patients. An overall content validity index (CVI) for the OPACS was calculated (CVI = .918), revealing high content validity. Opinions (CVI = .92) and practices (CVI = .97) subconstructs revealed high content validity as well. Therefore, results indicate that the OPACS has high content validity in the U.S. acute care setting and could assist nurse educators in establishing and enhancing nurse competency in the care for geriatric patients in the future.

L’apprentissage du caring dans l’approche par compétences

Rapport de stage présenté à la Faculté des sciences infirmières en vue de l'obtention du grade de Maîtrise ès sciences (M. Sc.) en Sciences infirmières option formation

Investigating the impact of a leadership development program for nurse unit managers on the satisfaction of nursing staff

Background and significance: Nurses' job dissatisfaction is associated with negative nursing and patient outcomes. One of the most powerful reasons for nurses to stay in an organisation is satisfaction with leadership. However, nurses are frequently promoted to leadership positions without appropriate preparation for the role. Although a number of leadership programs have been described, none have been tested for effectiveness, using a randomised control trial methodology. Aims: The aims of this research were to develop an evidence based leadership program and to test its effectiveness on nurse unit managers' (NUMs') and nursing staff's (NS's) job satisfaction, and on the leader behaviour scores of nurse unit managers. Methods: First, the study used a comprehensive literature review to examine the evidence on job satisfaction, leadership and front-line manager competencies. From this evidence a summary of leadership practices was developed to construct a two component leadership model. The components of this model were then combined with the evidence distilled from previous leadership development programs to develop a Leadership Development Program (LDP). This evidence integrated the program's design, its contents, teaching strategies and learning environment. Central to the LDP were the evidence-based leadership practices associated with increasing nurses' job satisfaction. A randomised controlled trial (RCT) design was employed for this research to test the effectiveness of the LDP. A RCT is one of the most powerful tools of research and the use of this method makes this study unique, as a RCT has never been used previously to evaluate any leadership program for front-line nurse managers. Thirty-nine consenting nurse unit managers from a large tertiary hospital were randomly allocated to receive either the leadership program or only the program's written information about leadership. Demographic baseline data were collected from participants in the NUM groups and the nursing staff who reported to them. Validated questionnaires measuring job satisfaction and leader behaviours were administered at baseline, at three months after the commencement of the intervention and at six months after the commencement of the intervention, to the nurse unit managers and to the NS. Independent and paired t-tests were used to analyse continuous outcome variables and Chi Square tests were used for categorical data. Results: The study found that the nurse unit managers' overall job satisfaction score was higher at 3-months (p = 0.016) and at 6-months p = 0.027) post commencement of the intervention in the intervention group compared with the control group. Similarly, at 3-months testing, mean scores in the intervention group were higher in five of the six "positive" sub-categories of the leader behaviour scale when compared to the control group. There was a significant difference in one sub-category; effectiveness, p = 0.015. No differences were observed in leadership behaviour scores between groups by 6-months post commencement of the intervention. Over time, at three month and six month testing there were significant increases in four transformational leader behaviour scores and in one positive transactional leader behaviour scores in the intervention group. Over time at 3-month testing, there were significant increases in the three leader behaviour outcome scores, however at 6-months testing; only one of these leader behaviour outcome scores remained significantly increased. Job satisfaction scores were not significantly increased between the NS groups at three months and at six months post commencement of the intervention. However, over time within the intervention group at 6-month testing there was a significant increase in job satisfaction scores of NS. There were no significant increases in NUM leader behaviour scores in the intervention group, as rated by the nursing staff who reported to them. Over time, at 3-month testing, NS rated nurse unit managers' leader behaviour scores significantly lower in two leader behaviours and two leader behaviour outcome scores. At 6-month testing, over time, one leader behaviour score was rated significantly lower and the nontransactional leader behaviour was rated significantly higher. Discussion: The study represents the first attempt to test the effectiveness of a leadership development program (LDP) for nurse unit managers using a RCT. The program's design, contents, teaching strategies and learning environment were based on a summary of the literature. The overall improvement in role satisfaction was sustained for at least 6-months post intervention. The study's results may reflect the program's evidence-based approach to developing the LDP, which increased the nurse unit managers' confidence in their role and thereby their job satisfaction. Two other factors possibly contributed to nurse unit managers' increased job satisfaction scores. These are: the program's teaching strategies, which included the involvement of the executive nursing team of the hospital, and the fact that the LDP provided recognition of the importance of the NUM role within the hospital. Consequently, participating in the program may have led to nurse unit managers feeling valued and rewarded for their service; hence more satisfied. Leadership behaviours remaining unchanged between groups at the 6 months data collection time may relate to the LDP needing to be conducted for a longer time period. This is suggested because within the intervention group, over time, at 3 and 6 months there were significant increases in self-reported leader behaviours. The lack of significant changes in leader behaviour scores between groups may equally signify that leader behaviours require different interventions to achieve change. Nursing staff results suggest that the LDP's design needs to consider involving NS in the program's aims and progress from the outset. It is also possible that by including regular feedback from NS to the nurse unit managers during the LDP that NS's job satisfaction and their perception of nurse unit managers' leader behaviours may alter. Conclusion/Implications: This study highlights the value of providing an evidence-based leadership program to nurse unit managers to increase their job satisfaction. The evidence based leadership program increased job satisfaction but its effect on leadership behaviour was only seen over time. Further research is required to test interventions which attempt to change leader behaviours. Also further research on NS' job satisfaction is required to test the indirect effects of LDP on NS whose nurse unit managers participate in LDPs.

The Nurse Professional Competence (NPC) scale : self-reported competence among nursing students on the point of graduation

BACKGROUND: International organisations, e.g. WHO, stress the importance of competent registered nurses (RN) for the safety and quality of healthcare systems. Low competence among RNs has been shown to increase the morbidity and mortality of inpatients. OBJECTIVES: To investigate self-reported competence among nursing students on the point of graduation (NSPGs), using the Nurse Professional Competence (NPC) Scale, and to relate the findings to background factors. METHODS AND PARTICIPANTS: The NPC Scale consists of 88 items within eight competence areas (CAs) and two overarching themes. Questions about socio-economic background and perceived overall quality of the degree programme were added. In total, 1086 NSPGs (mean age, 28.1 [20-56]years, 87.3% women) from 11 universities/university colleges participated. RESULTS: NSPGs reported significantly higher scores for Theme I "Patient-Related Nursing" than for Theme II "Organisation and Development of Nursing Care". Younger NSPGs (20-27years) reported significantly higher scores for the CAs "Medical and Technical Care" and "Documentation and Information Technology". Female NSPGs scored significantly higher for "Value-Based Nursing". Those who had taken the nursing care programme at upper secondary school before the Bachelor of Science in Nursing (BSN) programme scored significantly higher on "Nursing Care", "Medical and Technical Care", "Teaching/Learning and Support", "Legislation in Nursing and Safety Planning" and on Theme I. Working extra paid hours in healthcare alongside the BSN programme contributed to significantly higher self-reported scores for four CAs and both themes. Clinical courses within the BSN programme contributed to perceived competence to a significantly higher degree than theoretical courses (93.2% vs 87.5% of NSPGs). SUMMARY AND CONCLUSION: Mean scores reported by NSPGs were highest for the four CAs connected with patient-related nursing and lowest for CAs relating to organisation and development of nursing care. We conclude that the NPC Scale can be used to identify and measure aspects of self-reported competence among NSPGs.

Nurse practitioner competency standards: findings from collaborative Australian and New Zealand research

Background: The title, Nurse Practitioner, is protected in most jurisdictions in Australia and New Zealand and the number of nurse practitioners is increasing in health services in both countries. Despite this expansion of the role, there is scant national or international research to inform development of nurse practitioner competency standards.

Objectives: The aim of this study was to research nurse practitioner practice to inform development of generic standards that could be applied for the education, authorisation and practice of nurse practitioners in both countries.

Design: The research used a multi-methods approach to capture a range of data sources including research of policies and curricula, and interviews with clinicians. Data were collected from relevant sources in Australia and New Zealand.

Settings: The research was conducted in New Zealand and the five states and territories in Australia where, at the time of the research, the title of nurse practitioner was legally protected.

Participants: The research was conducted with a purposeful sample of nurse practitioners from diverse clinical settings in both countries. Interviews and material data were collected from a range of sources and data were analysed within and across these data modalities.

Results: Findings included identification of three generic standards for nurse practitioner practice: namely, Dynamic Practice, Professional Efficacy and Clinical Leadership. Each of these standards has a number of practice competencies, each of these competencies with its own performance indicators.

Conclusions: Generic standards for nurse practitioner practice will support a standardised approach and mutual recognition of nurse practitioner authorisation across the two countries. Additionally, these research outcomes can more generally inform education providers, authorising bodies and clinicians on the standards of practice for the nurse practitioner whilst also contributing to the current international debate on nurse practitioner standards and scope of practice.

Competency and capability: imperative for nurse practitioner education

Objective:
The objective of this study was to conduct research to inform the development of standards for nurse practitioner education in Australia and New Zealand and to contribute to the international debate on nurse practitioner practice.
Setting:
The research was conducted in all states of Australia where the nurse practitioner is authorised and in New Zealand.
Subjects:
The research was informed by multiple data sources including nurse practitioner program curricula documents from all relevant universities in Australia and New Zealand, interviews with academic convenors of these programs and interviews with nurse practitioners.
Primary argument:
Findings from this research include support for master's level of education as preparation for the nurse practitioner. These programs need to have a strong clinical learning component and in-depth education for the sciences of specialty practice. Additionally an important aspect of education for the nurse practitioner is the centrality of student directed and flexible learning models. This approach is well supported by the literature on capability.
Conclusions:
There is agreement in the literature about the lack of consistent standards in nurse practitioner practice, education and nomenclature. The findings from this research contribute to the international debate in this area and bring research informed standards to nurse practitioner education in Australia and New Zealand.

Proving My Competency One Test at a Time: Internationally Educated Nurses and the Canadian English Language Benchmark Assessment for Nurses

Abstract Professional language assessment is a new concept that has great potential to benefit Internationally Educated Professionals and the communities they serve. This thesis reports on a qualitative study that examined the responses of 16 Canadian English Language Benchmark Assessment for Nurses (CELBAN) test-takers on the topic of their perceptions of the CELBAN test-taking experience in Ontario in the winter of 2015. An Ontario organization involved in registering participants distributed an e-mail through their listserv. Thematic analyses of focus group and interview transcripts identified 7 themes from the data. These themes were used to inform conclusions to the following questions: (1) How do IENs characterize their assessment experience? (2) How do IENs describe the testing constructs measured by the CELBAN? (3) What, if any, potential sources of construct irrelevant variance (CIV) do the test-takers describe based on their assessment experience? (4) Do IENs feel that the CELBAN tasks provide a good reflection of the types of communicative tasks required of a nurse? Overall, participants reported positive experiences with the CELBAN as an assessment of their language skills, and noted some instances in which they felt some factors external to the assessment impacted their demonstration of their knowledge and skill. Lastly, some test-takers noted the challenge of completing the CELBAN where the types of communicative nursing tasks included in the assessment differed from nursing tasks typical of an IENs country or origin. The findings are discussed in relation to literature on high-stakes large-scale assessment and IEPs, and a set of recommendations are offered to future CELBAN administration. These recommendations include (1) the provision of a webpage listing all licensure requirements (2) monitoring of CELBAN location and dates in relation to the wider certification timeline for applicants (3) The provision of additional CELBAN preparatory materials (4) Minor changes to the CELBAN administrative protocols. Given that the CELBAN is a relatively new assessment format and its widespread use for high-stakes decisions (a component of nursing certification and licensure), research validating IEN-test-taker responses to construct representation and construct irrelevant variance is critical to our understanding of the role of competency testing for IENs.

Neonatal palliative care attitude scale : development of an instrument to measure the barriers to and facilitators of palliative care in neonatal nursing

OBJECTIVE The aim of this research project was to obtain an understanding of the barriers to and facilitators of providing palliative care in neonatal nursing. This article reports the first phase of this research: to develop and administer an instrument to measure the attitudes of neonatal nurses to palliative care. METHODS The instrument developed for this research (the Neonatal Palliative Care Attitude Scale) underwent face and content validity testing with an expert panel and was pilot tested to establish temporal stability. It was then administered to a population sample of 1285 neonatal nurses in Australian NICUs, with a response rate of 50% (N 645). Exploratory factor-analysis techniques were conducted to identify scales and subscales of the instrument. RESULTS Data-reduction techniques using principal components analysis were used. Using the criteria of eigenvalues being 1, the items in the Neonatal Palliative Care Attitude Scale extracted 6 factors, which accounted for 48.1% of the variance among the items. By further examining the questions within each factor and the Cronbach’s of items loading on each factor, factors were accepted or rejected. This resulted in acceptance of 3 factors indicating the barriers to and facilitators of palliative care practice. The constructs represented by these factors indicated barriers to and facilitators of palliative care practice relating to (1) the organization in which the nurse practices, (2) the available resources to support a palliative model of care, and (3) the technological imperatives and parental demands. CONCLUSIONS The subscales identified by this analysis identified items that measured both barriers to and facilitators of palliative care practice in neonatal nursing. While establishing preliminary reliability of the instrument by using exploratory factor-analysis techniques, further testing of this instrument with different samples of neonatal nurses is necessary using a confirmatory factor-analysis approach.

The development of a clinical learning environment scale

Within nursing, there is a strong demand for high-quality, cost-effective clinical education experiences that facilitate student learning in the clinical setting The clinical learning environment (CLE) is the interactive network of forces within the clinical setting that influence the students'clinical learning outcomes The identification of factors that characterize CLE could lead to strategies that foster the factors most predictive of desirable student learning outcomes and ameliorate those which may have a negative impact on student outcomes The CLE scale is a 23-item instrument with five subscales staff–student relationships, nurse manager commitment, patient relationships, interpersonal relationships, and student satisfaction These factors have strong substantive face validity and construct validity, as determined by confirmatory factor analysis Reliability coefficients range from high (0 85) to marginal (0 63) The CLE scale provides the educator with a valid and reliable instrument to evaluate affectively relevant factors in the CLE, direct resources to areas where improvement may be required, and nurture those areas functioning well It will assist in the application of resources in a cost-effective, efficient, productive manner, and will ensure that the clinical learning experience offers the nursing student the best possible learning outcomes

The impact of Health Information Technology (I-HIT) scale : the Australian results

One of role of the nurse in the clinical setting is that of coordinating communication across the healthcare team. On a daily basis nurses interact with the person receiving care, their family members, and multiple care providers thus placing the nurse in the central position with access to a vast array of information on the person. Through this nurses have historically functioned as “information repositories”. With the advent of Health Information Technology (HIT) tools there is a potential that HIT could impact interdisciplinary communication, practice efficiency and effectiveness, relationships and workflow in acute care settings \[1]\[3]. In 2005, the HIMSS Nursing Informatics Community developed the IHITScale to measure the impact of HIT on the nursing role and interdisciplinary communication in USA hospitals. In 2007, nursing informatics colleagues from Australia, Finland, Ireland, New Zealand, Scotland and the USA formed a research collaborative to validate the IHIT in six additional countries. This paper will discuss the background, methodology, results and implications from the Australian IHIT survey of over 1100 nurses. The results are currently being analyzed and will be presented at the conference.

The core role of the nurse practitioner: practice, professionalism and clinical leadership.

AIM: To draw on empirical evidence to illustrate the core role of nurse practitioners in Australia and New Zealand. BACKGROUND: Enacted legislation provides for mutual recognition of qualifications, including nursing, between New Zealand and Australia. As the nurse practitioner role is relatively new in both countries, there is no consistency in role expectation and hence mutual recognition has not yet been applied to nurse practitioners. A study jointly commissioned by both countries' Regulatory Boards developed information on the core role of the nurse practitioner, to develop shared competency and educational standards. Reporting on this study's process and outcomes provides insights that are relevant both locally and internationally. METHOD: This interpretive study used multiple data sources, including published and grey literature, policy documents, nurse practitioner program curricula and interviews with 15 nurse practitioners from the two countries. Data were analysed according to the appropriate standard for each data type and included both deductive and inductive methods. The data were aggregated thematically according to patterns within and across the interview and material data. FINDINGS: The core role of the nurse practitioner was identified as having three components: dynamic practice, professional efficacy and clinical leadership. Nurse practitioner practice is dynamic and involves the application of high level clinical knowledge and skills in a wide range of contexts. The nurse practitioner demonstrates professional efficacy, enhanced by an extended range of autonomy that includes legislated privileges. The nurse practitioner is a clinical leader with a readiness and an obligation to advocate for their client base and their profession at the systems level of health care. CONCLUSION: A clearly articulated and research informed description of the core role of the nurse practitioner provides the basis for development of educational and practice competency standards. These research findings provide new perspectives to inform the international debate about this extended level of nursing practice. RELEVANCE TO CLINICAL PRACTICE: The findings from this research have the potential to achieve a standardised approach and internationally consistent nomenclature for the nurse practitioner role.