Development, reliability and validity of an instrument measuring the attitudes and knowledge of emergency department staff regarding the emergency nurse practitioner role

Introduction: The Emergency Department (ED) at The Northern Hospital is currently participating in the Victorian Department of Human Services funded Emergency Nurse Practitioner Project. This project aims to develop, implement and evaluate the Emergency Nurse Practitioner role in Victorian EDs. This led to a need to develop a specific data collection tool called The Northern Emergency Nurse Practitioner Staff Survey to examine the knowledge and attitudes of ED medical and nursing staff. This paper describes the development of The Northern Emergency Nurse Practitioner Staff Survey and presents the results of reliability and validity studies. Method: Twenty-five items were developed and piloted on a sample of 58 ED medical and nursing staff. Content and face validity were established by expert panel review. Reliability was established by tests of unidimensionality, exploratory factor analysis and internal consistency. Results: Four items were discarded because of low item to total correlation. Exploratory factor analysis of the remaining items revealed five factors with eigenvalues >1 and acceptable correlation coefficients that explained 76.7% of the variance. Cronbach’s coefficent α for these items was 0.926 indicating a high degree of internal consistency. The factors were titled to reflect the content domain of the items in each factor and the factors arranged in a logical sequence to form the final version of The Northern Emergency Nurse Practitioner Survey.

Construct validity of the Dutch version of the 12-item Partners in Health scale : measuring self-management behaviour and knowledge in COPD patients

The 12-item Partner in Health (PIH) scale was developed in Australia to measure self-management behaviour and knowledge in patients with chronic diseases. The scale has undergone several changes since first published. Our study aim was to validate the latest PIH in Dutch COPD patients.The 12 items of the PIH are scored on a self-rated 9-point Likert scale (range: 0-8; higher scores indicate better self-management), providing total and subscale scores (knowledge, coping, recognition and management of functions, adherence to treatment).We used forward-backward translation of the latest version of the Australian PIH. Dimensionality and reliability analyses were performed to investigate the psychometric properties, and to determine whether the Dutch PIH replicated the same four subscales of self-management as the original PIH.Reanalysis of the original PIH validation study (186 Australian patients with chronic diseases) showed a single scale. Two scales (1. knowledge and coping; 2. recognition and management of symptoms, adherence to treatment) were found for the Dutch PIH (118 Dutch COPD patients). The correlation between the two Dutch scales was 0.43. The lower-bound of the reliability of the total scale was 0.81 (Australian PIH) and 0.84 (Dutch PIH).Different scale structures were found for the original Australian and the Dutch PIH. Our results did not support the 4-scale structure reported previously. To increase comparability and generalisability of our findings, the scale structure of the revised Australian PIH needs to be investigated further. Meanwhile, we advise using the PIH total score or two subscale scores when assessing COPD patients.

Construct validity of the Dutch version of the 12-item Partners in Health scale: measuring patient self-management behaviour and knowledge in patients with Chronic Obstructive Pulmonary Disease

Objective The 12-item Partners in Health scale (PIH) was developed in Australia to measure self-management behaviour and knowledge in patients with chronic diseases, and has undergone several changes. Our aim was to assess the construct validity and reliability of the latest PIH version in Dutch COPD patients.

Methods The 12 items of the PIH, scored on a self-rated 9-point Likert scale, are used to calculate total and subscale scores (knowledge; coping; recognition and management of symptoms; and adherence to treatment). We used forward-backward translation of the latest version of the Australian PIH to define a Dutch PIH (PIH(Du)). Mokken Scale Analysis and common Factor Analysis were performed on data from a Dutch COPD sample to investigate the psychometric properties of the Dutch PIH; and to determine whether the four-subscale solution previously found for the original Australian PIH could be replicated for the Dutch PIH.

Results Two subscales were found for the Dutch PIH data (n = 118); 1) knowledge and coping; 2) recognition and management of symptoms, adherence to treatment. The correlation between the two Dutch subscales was 0.43. The lower-bound of the reliability of the total scale equalled 0.84. Factor analysis indicated that the first two factors explained a larger percentage of common variance (39.4% and 19.9%) than could be expected when using random data (17.5% and 15.1%).

Conclusion We recommend using two PIH subscale scores when assessing self-management in Dutch COPD patients. Our results did not support the four-subscale structure as previously reported for the original Australian PIH.

The development of the nutrition and activity knowledge scale for use with people with an intellectual disability

Background Obesity is an increasing health problem for many Australians, no less so among people with an intellectual disability. Behaviour change aimed at improving nutritional intake and increasing levels of physical activity is a requirement for the reduction of obesity. An essential part of this process is to first ascertain the level of knowledge and beliefs people with an intellectual disability have about these behaviours.

Methods The aim of this study was to develop and psychometrically evaluate a scale to assess levels of nutritional and physical activity knowledge among people with an intellectual disability.

Results Seventy-three people with an intellectual disability completed the interview-rated scale at time 1 and 66 of them completed it again at a 3-week re-test.

Conclusions The scale demonstrated strong factorial construct validity, high internal consistency and good temporal stability. The applications of this scale in future research and in intervention programmes are discussed.

Pretend play and parents' view of social competence: the construct validity of the Child-Initiated Pretend Play Assessment.

Background and Aims: Play is the primary means through which children develop skills and socially interact with other children. The aim of this study was to investigate the relationship between pretend play and social competence in 4–5-year-old typically developing children, thereby adding further knowledge to the construct validity of the Child-Initiated Pretend Play Assessment (ChIPPA). Procedure: The pretend play ability of 35 preschool children aged 4–5 years was assessed using the ChIPPA. Parent/guardians of the children were interviewed regarding their child's social competence using the Vineland Social–Emotional Early Childhood Scales (Vineland SEEC Scales). Main Findings: No significant correlations were found between the children's play scores and their Vineland SEEC Scales scores. A significant and negative relationship was found between cooperation and sharing and elaborate play scores, suggesting that children who scored poorly on the play assessment were rated as cooperative by parents. Principal Conclusions: Parent report of social competence cannot be inferred from play scores. Reasons for the negative and significant finding are put forward and clinical implications of the findings are discussed. Additional investigations are necessary to further explore the construct validity of inferring social competence using the ChIPPA.

Commercialisation of new knowledge within universities : exploring performance disparities

This paper finds that vast disparities exist in new technology commercialisation outputs between a small percentage of high performing universities, and the remaining bulk of under-performers. Theoretical explanations for these findings are as follows. First, high performing universities attract resources, both human and financial, with a much stronger pull than lower performing universities. Second, this study confronts a gap in the literature with regard to the prominence of entrepreneurship within the innovation and technology development process. Third, this study brings new light to bear on the reliability and validity of evaluative tools (variables) currently accepted as indicators of innovation in the university technology transfer context.

Towards the improved treatment of generalization of knowledge claims in IS research : drawing general conclusions from samples

This paper presents a framework for justifying generalization in information systems (IS) research. First, using evidence from an analysis of two leading IS journals, we show that the treatment of generalization in many empirical papers in leading IS research journals is unsatisfactory. Many quantitative studies need clearer definition of populations and more discussion of the extent to which ‘significant’ statistics and use of non-probability sampling affect support for their knowledge claims. Many qualitative studies need more discussion of boundary conditions for their sample-based general knowledge claims. Second, the proposed new framework is presented. It defines eight alternative logical pathways for justifying generalizations in IS research. Three key concepts underpinning the framework are the need for researcher judgment when making any claim about the likely truth of sample-based knowledge claims in other settings; the importance of sample representativeness and its assessment in terms of the knowledge claim of interest; and the desirability of integrating a study’s general knowledge claims with those from prior research. Finally, we show how the framework may be applied by researchers and reviewers. Observing the pathways in the framework has potential to improve both research rigour and practical relevance for IS research.

International comparisons of mathematics classrooms and curricula: the validity-comparability compromise

The pursuit of commensurability in international comparative research by imposing general classificatory frameworks can misrepresent valued performances, school knowledge and classroom practice as these are actually conceived by each community and sacrifice validity in the interest of comparability. The “validity-comparability compromise” is proposed as a theoretical concern with significant implications for international cross-cultural research. We draw on current international research to illustrate a variety of aspects of the issue and its consequences for the manner in which international research is conducted and its results interpreted. The effects extend to data generation and analysis and constitute essential contingencies on the interpretation and application of international comparative research.

The internal consistency and construct validity of the partners in health scale : validation of a patient rated chronic condition self-management measure

PURPOSE: The purpose of this study was to test the internal consistency and construct validity of the revised 12-item self-rated Partners in Health (PIH) scale used to assess patients' chronic condition self-management knowledge and behaviours. METHODS: Baseline PIH data were collected for a total of 294 patients with a range of co-morbid chronic conditions including diabetes, cardiovascular disease and arthritis. Scale data for the initial sample of 176 patients were analysed for internal consistency and construct validity using Reliability Analysis and Factor Analysis. Construct validity was tested in a separate sample of 118 patients using confirmatory factor analysis and a structural equation model. RESULTS: Good internal consistency was indicated with a Cronbach's alpha coefficient of 0.82 in the initial sample. Factor analysis for this sample revealed four key factors (knowledge, coping, management of condition and adherence to treatment) across the twelve items of the scale. These four key factors were then confirmed by applying the exploratory structural equation model to the separate sample. CONCLUSION: The PIH scale exhibits construct validity and internal consistency. It therefore is both a generic self-rated clinical tool for assessing self-management in a range of chronic conditions as well as an outcome measure to compare populations and change in patient self-management knowledge and behaviour over time. The four domains of self-management provide a valid measure of patient competency in relation to the self-management of their chronic condition(s).