Measuring nursing competencies in the operating theatre: instrument development and psychometric analysis using Item Response Theory

BACKGROUND: Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. RESEARCH AIM: The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. RESEARCH METHOD: The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. RESULTS: Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. CONCLUSION: The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice.

Hospital in the home: constructions of the nursing role - a literature review

• Acute medical and nursing treatment in the home is increasingly seen as an alternative to hospitalization. Models such as hospital in the home (HITH) or acute home care are said to provide a safe, comfortable environment for patients that is conducive to healing.

• A review of the literature reveals the embryonic nature of the research and discussion related to this alternative care delivery model. In general, the benefits of hospital in the home programmes are presented in an uncritical manner.

• Medical practitioners have embraced the move to home care as a means of expanding the use of advanced technologies and improved drug regimes beyond the hospital walls.

• The nursing response has been mechanistic and recipe-like while advancing the HITH nursing role as an opportunity for speciality practice by virtue of the increased autonomy and independence required.

• This review demonstrates the influence of a professional mandate for specialization, and the ideological and scientific interests that have influenced the role of the nurse.

The trials and tribulations of team-nursing

Aim: The aim of this study was to review the team-nursing approach to care adopted by two general medical wards in a large private hospital. The delivery model of care was reviewed to determine the factors that enhance and/or hinder the timely delivery, continuity and communication of care.
Method: All nursing and ancillary staff who worked on two medical wards at a private teaching hospital were invited to participate in the study. Thirty eight participants from the two wards took part in focus group discussions, individual interviews and completed the Staff Continuity of Care Questionnaire. Findings: Findings indicated that achieving functionally sound teamwork is a complex task that is affected by the interplay of a number of organisational, patient and staff factors. Its smooth application is further affected by the uncertain and changing conditions on the wards, which are difficult to control and impact on the smooth delivery of patient care. The findings revealed strengths and weaknesses in teamwork, communication of care, documentation and discharge planning. The results also highlighted factors that enhance and hinder the smooth delivery of care. This paper details the factors that influence the delivery of care from the perspectives of nursing staff and makes recommendations to enhance the delivery of patient care using a team-nursing approach.

Knowledge and attitudes of ED staff before and after implementation of the emergency nurse practitioner role

Introduction
The Emergency Nurse Practitioner (ENP) role was implemented in the Emergency Department (ED) at The Northern Hospital (TNH) in April 2004. Implementation of the ENP role occurred as part of a Department of Human Services funded project to establish the ENP model as an effective and sustainable model of care delivery in Victorian EDs.

Aim
The aim of this study was to examine the attitudes and knowledge of ED medical and nursing staff prior to, and following, implementation of the ENP role.

Methods
The design was a pre-test/post-test design and the Northern Emergency Nurse Practitioner Staff Survey was used for data collection. A total of 104 ED staff completed the pre-test survey and the post-test survey was completed by 79 ED staff.

Results
The attitudes and knowledge of ED medical and nursing staff changed significantly during implementation of the ENP role. Pre-test data indicated that staff were generally supportive of the role but had a poor understanding of the requirements for endorsement and how the role would function in clinical practice. Post-test data showed significant increases in support for the ENP role, a greater understanding of the requirements to become an ENP and increased understanding of the logistics and functions of an ENP.

Conclusion
The implementation of the Nurse Practitioner role within the emergency department of The Northern Hospital, Victoria Australia has been a positive experience for both medical and nursing staff.

Nurses report a healthy culture: Results of the Practice Environment Scale (Australia) in an Australian hospital seeking Magnet recognition

The Magnet Recognition Program requires evidence that the nursing practice environment supports staff to provide optimal care, access professional development opportunities and participate in hospital affairs. This research aimed to assess clinical nurses’ work environment at a leading private hospital in Sydney, Australia using a version of the Practice Environment Scale of the Nursing Work Index modified for the Australian context. Our results were comparable to Magnet hospitals for two subscales and significantly higher than Magnet results for the remaining three subscales and the composite scale. This was especially pleasing in relation to the hospital's preparation for Magnet recognition. Hospitals across Australasia might find administration of the Practice Environment Scale (modified for use in the Australian context) a useful exercise both as a stimulus to preparation and an indicator of readiness for Magnet recognition.

Who, when and where? Identification of patients at risk of an in-hospital adverse event: Implications for nursing practice

Patients who suffer an adverse event (AE) are more likely to die or suffer permanent disability. Many AEs are preventable. Nurses have long played a pivotal role in the prevention of AEs. Much of the literature to date pertains to the role of nurses in the prevention of AEs such as falls, pressure areas and deep vein thrombosis. Prominent risk factors for AEs are the presence of physiological abnormality, failure to recognize or correct physiological abnormality, advanced patient age and location of patient room. Ongoing physiological assessment of patients is a nursing responsibility and the assessment findings of nurses underpin many patient care decisions. The early recognition and correction of physiological abnormality can improve patient outcomes by reducing the incidence of AEs, making nurses' ability to identify, interpret and act on physiological abnormality a fundamental factor in AE prediction and prevention. This paper will examine the role of nurses in AE prevention, using cardiac arrest as an example, from the perspective of physiological safety; that is, accurate physiological assessment and the early correction of physiological abnormality.

The language of subjective well-being

The Language of Depression project is a linguistic study of the language of Acute Care Hospital patients suffering depression with the ultimate aim of enabling medical and nursing staff to become more aware of their patients’ depression and immediately refer them for psychological or psychiatric help. As part of that larger project, and following recent developments in positive psychology (e.g. Seligman 2002) this paper will focus exclusively on the control group, that is, the language of those Acute Care Hospital patients deemed non-depressed. The data comprise 30 minute interviews between the patients and a Consultation-liaison psychiatrist. Prior to interview, the patients were screened using the Brief Case-find for Depression (Clarke et al. 1994). From the screening, patients were then deemed likely to be depressed and likely to be non-depressed. This paper reports on the analysis of 10 patients deemed as non-depressed. Using the linguistic theory of Systemic Functional Linguistics, the data were analysed for their Appraisal features (e.g. Martin and Rose 2003). Appraisal analysis provides a lexico-semantic analysis that is concerned with how speakers use language to evaluate as well as negotiate relationships. The Appraisal analysis has been used to identify in the language of non-depressed patients the types of attitudes that facilitate psychological well-being. This paper will present some analysed extracts from the interviews to show how key features of subjective well-being are realised in the language of non-depressed Acute Care Hospital patients.

Dying in hospital: medical failure or nature outcome?

The purpose of this study was to describe patterns of medical and nursing practice in the care of patients dying of oncological and hematological malignancies in the acute care setting in Australia. A tool validated in a similar American study was used to study the medical records of 100 consecutive patients who died of oncological or hematological malignancies before August 1999 at The Canberra Hospital in the Australian Capital Territory. The three major indicators of patterns of end-of-life care were documentation of Do Not Resuscitate (DNR) orders, evidence that the patient was considered dying, and the presence of a palliative care intention. Findings were that 88 patients were documented DNR, 63 patients' records suggested that the patient was dying, and 74 patients had evidence of a palliative care plan. Forty-six patients were documented DNR 2 days or less prior to death and, of these, 12 were documented the day of death. Similar patterns emerged for days between considered dying and death, and between palliative care goals and death. Sixty patients had active treatment in progress at the time of death. The late implementation of end-of-life management plans and the lack of consistency within these plans suggested that patients were subjected to medical interventions and investigations up to the time of death. Implications for palliative care teams include the need to educate health care staff and to plan and implement policy regarding the management of dying patients in the acute care setting. Although the health care system in Australia has cultural differences when compared to the American context, this research suggests that the treatment imperative to prolong life is similar to that found in American-based studies.

The impact of shift-work and organizational climate on health outcomes in nurses

Shift workers have a higher rate of negative health outcomes than day shift workers. Few studies however, have examined the role of difference in workplace environment between shifts itself on such health measures. This study investigated variation in organizational climate across different types of shift work and health outcomes in nurses. Participants (n = 142) were nursing staff from a metropolitan Melbourne hospital. Demographic items elicited the type of shift worked, while the Work Environment Scale and the General Health Questionnaire measured organizational climate and health respectively. Analysis supported the hypotheses that different organizational climates occurred across different shifts, and that different organizational climate factors predicted poor health outcomes. Shift work alone was not found to predict health outcomes. Specifically, permanent night shift workers had significantly lower coworker cohesion scores compared with rotating day and evening shift workers and significantly higher managerial control scores compared with day shift workers. Further, coworker cohesion and involvement were found to be significant predictors of somatic problems. These findings suggest that differences in organizational climate between shifts accounts for the variation in health outcomes associated with shift work. Therefore, increased workplace cohesion and involvement, and decreased work pressure, may mitigate the negative health outcomes of shift workers.

Qualitative analysis of the care of children in hospital in four countries : part 2

As part of a large study of the care of children in Australian, British, Indonesian, and Thai hospitals, qualitative methods were used to examine differences influenced by culture. Two groups were surveyed: parents of hospitalized children, and staff caring for them. Vignettes were used to invoke discussion, and content analysis was used to examine the data. Subjects were interviewed singly, or in focus groups. These interviews were audiotaped and transcribed for analysis. This article is the second of a two-part series, and includes results of the staff's interviews and discussion. The parents' results and discussion were published in Part 1 (Shields [amp ] King, 2001). Staff in all the countries considered communication with parents to be an important part of care of the hospitalized child, and this was consistent with the parents' responses. Staff were mindful of safe practices, though more so in Australia and Britain than Indonesia and Thailand. Cost of treatment for the parents was an important consideration for staff in Indonesia and Thailand when they were planning care for the child. Cultural constructions were more likely to be considered by the Australian and British staff than the Indonesian and Thai staff, and this may have been influenced by the prevailing culture of medical dominance in those countries.

Qualitative analysis of the care of children in hospital in four countries : part 1

As part of a large study of the care of children in Australian, British, Indonesian, and Thai hospitals, qualitative methods were used to examine differences influenced by culture. Two groups were surveyed: parents of hospitalized children, and staff caring for them. Vignettes were used to invoke discussion, and content analysis was used to examine the data. Subjects were interviewed singly, or in focus groups. These interviews were audiotaped and transcribed verbatim. The data were explored by using content analysis to extract themes of understanding of cultural experiences. This article is the first of a two-part series, and includes a review of the literature, description of the methods used, and results of the parents' interviews. The staff results and discussion will be published in Part 2. Analysis revealed that parents in all countries were primarily concerned with treating the child's illness and the child's recovery. Parents were concerned with their work (employment), but this was a much larger consideration in Indonesia and Thailand, where no social security systems exist, than in Australia and Britain. Communication with staff was the most commonly mentioned theme for parents, indicating that irrespective of the culture in which the care was given, good communication between parents and staff was of paramount importance.

Staff perceptions on the use of a sedation protocol in the intensive care setting

Sedation protocols are increasingly being investigated as a method of achieving improved patient outcomes whilst guiding the decision making of both nursing and medical practitioners. However, only a limited number of studies have investigated the perceptions of staff towards a sedation protocol during its implementation. This study was designed to survey the perceptions of staff regarding the implementation of a sedation protocol in an Australian intensive care unit (ICU). Questionnaires were distributed to all multidisciplinary team members who had used the sedation protocol. The response rate was 50% (n=70). The questionnaire combined the use of visual analogue scales plus a comments section to obtain qualitative data.

The results revealed that staff perceived sedation management to be enhanced with the use of a protocol and therefore should be incorporated into routine clinical practice. Staff perceived that providing clear guidelines that facilitated decision making and assisted beginner practitioners enhanced sedation management. In addition, there was a perceived improvement in the patient outcomes, including a decrease in the frequency of over-sedation resulting in a reduced ICU stay.

Positive perceptions may assist in the introduction of other interventional protocols. Other protocols may target areas where variability in clinical decision making exists, despite research evidence that supports specific therapeutic interventions. Further studies addressing protocol implementation for clinical interventions are warranted in other ICU settings.

Recognition by medical and nursing professionals of malnutrition and risk of malnutrition in elderly hospitalised patients

Objective: To determine the prevalence of malnutrition in a population of elderly hospitalised patients and to explore health professionals' perceptions and awareness of signs and risks of malnutrition and treatment options available.

Subjects and design: One hundred elderly patients and 57 health professionals from medical wards of a tertiary teaching hospital. Quantitative and qualitative study design using a validated malnutrition assessment tool (Mini Nutritional Assessment) and researcher-designed questionnaire to assess health professionals' knowledge of nutrition risk factors.

Main outcome measures: Mini Nutritional Assessment score, nutrition risk category and themes in health professionals' knowledge and awareness of malnutrition and its risk factors.

Results: Thirty per cent of patients were identified as malnourished while 61% were at risk of malnutrition. Documentation by health professionals of two major risk factors for malnutrition—recent loss of weight and appetite—were poor with only 19% and 53% of patients with actual loss of weight or appetite, respectively, identified by staff and only 7% and 9% of these patients, respectively, referred for dietetic assessment. While health professionals' knowledge of important medical risk factors for malnutrition was good, their knowledge of malnutrition risk factors such as recent loss of weight and loss of appetite was poor. Medical staff focused on biochemical factors when assessing nutrition status, while nursing staff focused on skin integrity and turgor.

Conclusion: Malnutrition in elderly hospitalised patients remains a significant problem with low rates of recognition and referral by medical and nursing staff. Considerable scope exists to develop training and education tools and to implement an appropriate nutrition screening policy to improve referral rates to dietitians.

Nursing handover : it's time for a change

Nursing handover is a common part of nursing practice that is fundamental to safe patient care. Despite this, the literature provides little direction on the best way to conduct handover. This project aimed to examine nurses' perceptions of handover and to determine the strengths and limitations of the handover process. A staff survey was distributed to nurses in all inpatient wards at a metropolitan tertiary hospital. A total of 176 nurses responded to the staff survey. The findings revealed conflicting opinions about the effectiveness of the handover process; although a number of nurses were positive about current handover practice, indicating they were provided with sufficient information about patients and given opportunity to clarify patient care information, other nurses identified aspects of handover that could be improved. These included: the subjectivity of handover information, the time taken to conduct handover, repetition of information that could be found in the patients' care plans, and handing over of information by a nurse who has not cared for the patient. Some attention needs to given to addressing the perceived weaknesses associated with the handover process.

Design-related bias in hospital fall risk screening tool predictive accuracy evaluations: systematic review and meta-analysis.

Introduction: Fall risk screening tools are frequently used as a part of falls prevention programs in hospitals. Design-related bias in evaluations of tool predictive accuracy could lead to overoptimistic results, which would then contribute to program failure in practice.

Methods: A systematic review was undertaken. Two blind reviewers assessed the methodology of relevant publications into a four-point classification system adapted from multiple sources. The association between study design classification and reported results was examined using linear regression with clustering based on screening tool and robust variance estimates with point estimates of Youden Index (= sensitivity + specificity - 1) as the dependent variable. Meta-analysis was then performed pooling data from prospective studies.

Results: Thirty-five publications met inclusion criteria, containing 51 evaluations of fall risk screening tools. Twenty evaluations were classified as retrospective validation evaluations, 11 as prospective (temporal) validation evaluations, and 20 as prospective (external) validation evaluations. Retrospective evaluations had significantly higher Youden Indices (point estimate [95% confidence interval]: 0.22 [0.11, 0.33]). Pooled Youden Indices from prospective evaluations demonstrated the STRATIFY, Morse Falls Scale, and nursing staff clinical judgment to have comparable accuracy.

Discussion: Practitioners should exercise caution in comparing validity of fall risk assessment tools where the evaluation has been limited to retrospective classifications of methodology. Heterogeneity between studies indicates that the Morse Falls Scale and STRATIFY may still be useful in particular settings, but that widespread adoption of either is unlikely to generate benefits significantly greater than that of nursing staff clinical judgment.