Developing sustainable IT-related capabilities : instrument development and test

Research has established that firms' IT-related capabilities at a point in time explain IT-related performance differences across firms. IT resources, however, are dynamic, and evolve at an exponential rate. This means we need to understand how to sustain firms' existing capabilities to leverage opportunities offered by new IT resources. Wet suggests a higher-level resource that can sustain firms' existing IT-related capabilities. Second, we report on the development of a valid and reliable measurement instrument for measuring this higher-level resource in four stages, which includes expert feedback and a field test. The validated instrument would be useful in extending the IT business value studies to investigate how firms can sustain their IT-related capabilities. This effort will provide a deeper understanding of how firms can secure sustainable IT-related business value from their acquired IT resources.

ISPCAN child abuse screening tool children's version (ICAST-C): Instrument development and multi-national pilot testing

Objective To develop a child victimization survey among a diverse group of child protection experts and examine the performance of the instrument through a set of international pilot studies. Methods The initial draft of the instrument was developed after input from scientists and practitioners representing 40 countries. Volunteers from the larger group of scientists participating in the Delphi review of the ICAST P and R reviewed the ICAST C by email in 2 rounds resulting in a final instrument. The ICAST C was then translated and back translated into six languages and field tested in four countries using a convenience sample of 571 children 12–17 years of age selected from schools and classrooms to which the investigators had easy access. Results The final ICAST C Home has 38 items and the ICAST C Institution has 44 items. These items serve as screeners and positive endorsements are followed by queries for frequency and perpetrator. Half of respondents were boys (49%). Endorsement for various forms of victimization ranged from 0 to 51%. Many children report violence exposure (51%), physical victimization (55%), psychological victimization (66%), sexual victimization (18%), and neglect in their homes (37%) in the last year. High rates of physical victimization (57%), psychological victimization (59%), and sexual victimization (22%) were also reported in schools in the last year. Internal consistency was moderate to high (alpha between .685 and .855) and missing data low (less than 1.5% for all but one item). Conclusions In pilot testing, the ICAST C identifies high rates of child victimization in all domains. Rates of missing data are low, and internal consistency is moderate to high. Pilot testing demonstrated the feasibility of using child self-report as one strategy to assess child victimization. Practice implications The ICAST C is a multi-national, multi-lingual, consensus-based survey instrument. It is available in six languages for international research to estimate child victimization. Assessing the prevalence of child victimization is critical in understanding the scope of the problem, setting national and local priorities, and garnering support for program and policy development aimed at child protection.

The Health Behavior Change Competency Checklist (HBCCC): Instrument development and psychometric evaluation.

More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.

Quality in palliative care from the patient perspective : Instrument development, perceptions of care received and the importance of care

The overall aim was to investigate the quality of palliative care from the patient perspective, to adapt and psychometrically evaluate the Quality from Patients’ Perspective instrument specific to palliative care (QPP-PC) and investigate the relationship between the combination of person- and organization-related conditions and patients’ perceptions of care quality. Methods: In the systematic literature review (I), 23 studies from 6 databases and reference lists in 2014 were synthesized by integrative thematic analysis. The quantitative studies (II–IV) had cross-sectional designs including 191 patients (73% RR) from hospice inpatient care, hospice day care, palliative units in nursing homes and home care in 2013–2014. A modified version of QPP was used. Additionally, person- and organization-related conditions were assessed. Psychometric evaluation, descriptive and inferential statistics were used. Main findings: Patients’ preferences for palliative care included living a meaningful life and responsive healthcare personnel, care environment and organization of care (I). The QPP-PC was developed, comprising 12 factors (49 items), 3 single items and 4 dimensions: medical–technical competence, physical–technical conditions, identity–oriented approach, and socio-cultural atmosphere (II). QPP-PC measured patients’ perceived reality (PR) and subjective importance (SI) of care quality. PR differed across settings, but SI did not (III). All settings exhibited areas of strength and for improvement (II, III). Person-related conditions seemed to be related to SI, and person- and organization-related conditions to PR, explaining 18–30 and 22-29% respectively of the variance (IV). Conclusions: The patient perspective of care quality (SI and PR) should be integrated into daily care and improvement initiatives in palliative care. The QPP-PC can measure patients’ perceptions of care quality. Registered nurses and other healthcare personnel need awareness of person- and organization-related conditions to provide high-quality person-centred care.

Neonatal palliative care attitude scale : development of an instrument to measure the barriers to and facilitators of palliative care in neonatal nursing

OBJECTIVE The aim of this research project was to obtain an understanding of the barriers to and facilitators of providing palliative care in neonatal nursing. This article reports the first phase of this research: to develop and administer an instrument to measure the attitudes of neonatal nurses to palliative care. METHODS The instrument developed for this research (the Neonatal Palliative Care Attitude Scale) underwent face and content validity testing with an expert panel and was pilot tested to establish temporal stability. It was then administered to a population sample of 1285 neonatal nurses in Australian NICUs, with a response rate of 50% (N 645). Exploratory factor-analysis techniques were conducted to identify scales and subscales of the instrument. RESULTS Data-reduction techniques using principal components analysis were used. Using the criteria of eigenvalues being 1, the items in the Neonatal Palliative Care Attitude Scale extracted 6 factors, which accounted for 48.1% of the variance among the items. By further examining the questions within each factor and the Cronbach’s of items loading on each factor, factors were accepted or rejected. This resulted in acceptance of 3 factors indicating the barriers to and facilitators of palliative care practice. The constructs represented by these factors indicated barriers to and facilitators of palliative care practice relating to (1) the organization in which the nurse practices, (2) the available resources to support a palliative model of care, and (3) the technological imperatives and parental demands. CONCLUSIONS The subscales identified by this analysis identified items that measured both barriers to and facilitators of palliative care practice in neonatal nursing. While establishing preliminary reliability of the instrument by using exploratory factor-analysis techniques, further testing of this instrument with different samples of neonatal nurses is necessary using a confirmatory factor-analysis approach.

A measurement instrument for process modeling research : development, test and procedural model

Process modeling is an emergent area of Information Systems research that is characterized through an abundance of conceptual work with little empirical research. To fill this gap, this paper reports on the development and validation of an instrument to measure user acceptance of process modeling grammars. We advance an extended model for a multi-stage measurement instrument development procedure, which incorporates feedback from both expert and user panels. We identify two main contributions: First, we provide a validated measurement instrument for the study of user acceptance of process modeling grammars, which can be used to assist in further empirical studies that investigate phenomena associated with the business process modeling domain. Second, in doing so, we describe in detail a procedural model for developing measurement instruments that ensures high levels of reliability and validity, which may assist fellow scholars in executing their empirical research.

Factors influencing the provision of end-of-life care in critical care settings : development and testing of a survey instrument

Aim. To develop and psychometrically test a survey instrument to identify the factors influencing the provision of end-of-life care by critical care nurses. Background. Following a decision to withdraw life-sustaining treatment, critical care nurses remain with the patient and their family providing end-of-life care. Identification of factors influencing the provision of this care can give evidence to inform practice development and support nurses. Design. A cross-sectional survey of critical care nurses. Method. An online survey was developed, reviewed by an expert panel and pilot tested to obtain preliminary evidence of its reliability and validity. In May 2011, a convenience sample of critical care nurses (n = 392, response rate 25%) completed the survey. The analytical approach to data obtained from the 58 items measured on a Likert scale included exploratory factor analysis and descriptive statistics. Results. Exploratory factor analysis identified eight factors influencing the provision of end-of-life care: emotional support for nurses, palliative values, patient and family preferences, resources, organizational support, care planning, knowledge and preparedness. Internal consistency of each latent construct was deemed satisfactory. The results of descriptive statistics revealed a strong commitment to the inclusion of families in end-of-life care and the value of this care in the critical care setting. Conclusion. This paper reports preliminary evidence of the psychometric properties of a new survey instrument. The findings may inform practice development opportunities to support critical care nurses in the provision of endof- life care and improve the care that patients and their families receive.

The development and preliminary testing of an instrument for assessing fatigue self-management outcomes in patients with advanced cancer

Background: Fatigue is one of the most distressing and commonly experienced symptoms in patients with advanced cancer. Although the self-management (SM) of cancer-related symptoms has received increasing attention, no research instrument assessing fatigue SM outcomes for patients with advanced cancer is available. Objectives: to describe the development and preliminary testing of an interviewer administered instrument for assessing the frequency, and perceived levels of effectiveness and self-efficacy associated with fatigue SM behaviors in patients with advanced cancer. Methods: The development and testing of the Self-efficacy in Managing Symptoms Scale- Fatigue Subscale for Patients with Advanced Cancer (SMSFS-A) involved a number of procedures: item-generation using a comprehensive literature review and semi-structured interviews, content validity evaluation using expert panel reviews, and face validity and test-retest reliability evaluation using pilot testing. Results: Initially, 23 items (22 specific behaviors with one global item) were generated from the literature review and semi-structured interviews. After two rounds of expert panel review, the final scale was reduced to 17 items (16 behaviors with one global item). Participants in the pilot test (n=10) confirmed that the questions in this scale were clear and easy to understand. Bland-Altman analysis showed agreement of results over a one-week interval. Conclusions: The SMSFS-A items were generated using multiple sources. This tool demonstrated preliminary validity and reliability. Implications for practice: The SMSFS-A has the potential to be used for clinical and research purposes. Nurses can use this instrument for collecting data to inform the initiation of appropriate fatigue SM support for this population.

Development and psychometric evaluation of the spirituality instrument (SpI-27) in a sample of people with chronic illness

Background: Spirituality is fundamental to all human beings, existing within a person, and developing until death. This research sought to operationalise spirituality in a sample of individuals with chronic illness. A review of the conceptual literature identified three dimensions of spirituality: connectedness, transcendence, and meaning in life. A review of the empirical literature identified one instrument that measures the three dimensions together. Yet, recent appraisals of this instrument highlighted issues with item formulation and limited evidence of reliability and validity. Aim: The aim of this research was to develop a theoretically-grounded instrument to measure spirituality – the Spirituality Instrument-27 (SpI-27). A secondary aim was to psychometrically evaluate this instrument in a sample of individuals with chronic illness (n=249). Methods: A two-phase design was adopted. Phase one consisted of the development of the SpI-27 based on item generation from a concept analysis, a literature review, and an instrument appraisal. The second phase established the psychometric properties of the instrument and included: a qualitative descriptive design to establish content validity; a pilot study to evaluate the mode of administration; and a descriptive correlational design to assess the instrument’s reliability and validity. Data were analysed using SPSS (Version 18). Results: Results of exploratory factor analysis concluded a final five-factor solution with 27 items. These five factors were labelled: Connectedness with Others, Self-Transcendence, Self-Cognisance, Conservationism, and Connectedness with a Higher Power. Cronbach’s alpha coefficients ranged from 0.823 to 0.911 for the five factors, and 0.904 for the overall scale, indicating high internal consistency. Paired-sample t-tests, intra-class correlations, and weighted kappa values supported the temporal stability of the instrument over 2 weeks. A significant positive correlation was found between the SpI-27 and the Spirituality Index of Well-Being, providing evidence for convergent validity. Conclusion: This research addresses a call for a theoretically-grounded instrument to measure spirituality.

Use of cognitive interviewing in the development of a Spanish language genetic knowledge instrument

Study purpose. Genetic advances are significantly impacting healthcare, yet recent studies of ethnic group participation in genetic services demonstrate low utilization rates by Latinos. Limited genetic knowledge is a major barrier. The purpose of this study was to field test items in a Spanish-language instrument that will be used to measure genetic knowledge relevant to type 2 diabetes among members of the ethnically heterogeneous U.S. Latino community. Accurate genetic knowledge measurement can provide the foundation for interventions to enhance genetic service utilization. ^ Design. Three waves of cognitive interviews were conducted in Spanish to field test 44 instrument items Thirty-six Latinos, with 12 persons representative of Mexican, Central and South American, and Cuban heritage participated, including 7 males and 29 females between 22 and 60 years of age; 17 participants had 12 years or less of education. ^ Methods. Text narratives from transcriptions of audiotaped interviews were qualitatively analyzed using a coding strategy to indicate potential sources of response error. Through an iterative process of instrument refinement, codes that emerged from the data were used to guide item revisions at the conclusion of each phase; revised items were examined in subsequent interview waves. ^ Results. Inter-cultural and cross-cultural themes associated with difficulties in interpretation and grammatical structuring of items were identified; difficulties associated with comprehension reflected variations in educational level. Of the original 44 items, 32 were retained, 89% of which were revised. Six additional items reflective of cultural knowledge were constructed, resulting in a 38-item instrument. ^ Conclusions. Use of cognitive interviewing provided a valuable tool for detecting both potential sources of response error and cultural variations in these sources. Analysis of interview data guided successive instrument revisions leading to improved item interpretability and comprehension. Although testing in a larger sample will be essential to test validity and reliability, the outcome of field testing suggests initial content validity of a Spanish-language instrument to measure genetic knowledge relative to type 2 diabetes. ^ Keywords. Latinos, genetic knowledge, instrument development, cognitive interviewing ^

Development of an instrument measuring the quality of residential care facilities for older people

Aims. To validate the Swedish version of the Sheffield Care Environment Assessment Matrix (S-SCEAM). The instrument’s items measure environmental elements important for supporting the needs of older people, and conceptualized within eight domains. Methods. Item relevance was assessed by a group of experts and measured using content validity index (CVI). Test-retest and inter-rater reliability tests were performed.  The domain structure was assessed by the inter-rater agreement of a second group of experts, and measured using Fleiss kappa. Results. All items attained a CVI above 0.78, the suggested criteria for excellent content validity. Test-retest reliability showed high stability (96% and 95% for two independent raters respectively), and inter-rater reliability demonstrated high levels of agreement (95% and 94% on two separate rating occasions). Kappa values were very good for test-retest (κ = 0.903 and 0.869) and inter-rater reliability (κ = 0.851 and 0.832). Domain structure was good,  Fleiss’ kappa was 0.63 (range 0.45 to 0.75).    Conclusion. The S-SCEAM of 210 items and eight domains showed good content validity and construct validity. The instrument is suggested for use in measuring of the quality of the physical environment in residential care facilities for older persons.

Development and evaluation of the Clinician Suicide Risk Assessment Checklist

This paper describes the development and evaluation of a new instrument - the Clinician Suicide Risk Assessment Checklist (CSRAC). The instrument assesses the clinician's competency in three areas: clinical interviewing, assessment of specific suicide risk factors, and formulating a management plan. A draft checklist was constructed by integrating information from 1) literature review 2) expert clinician focus group and 3) consultation with experts. It was utilised in a simulated clinical scenario with clinician trainees and a trained actor in order to test for inter-rater agreement. Agreement was calculated and the checklist was re-drafted with the aim of maximising agreement. A second phase of simulated clinical scenarios was then conducted and inter-rater agreement was calculated for the revised checklist. In the first phase of the study, 18 of 35 items had inadequate inter-rater agreement (60%>), while in the second phase, using the revised version, only 3 of 39 items failed to achieve adequate inter-rater agreement. Further evidence of reliability and validity are required. Continued development of the CSRAC will be necessary before it can be utilised to assess the effectiveness of risk assessment training programs.

Development of self-efficacy questionnaire for Chinese family caregivers

The purpose of this study was to develop a Self-Efficacy Questionnaire for Chinese Family Caregivers. Semi-structured interviews with 10 family caregivers of people with dementia were conducted to explore how Chinese caregivers manage caregiving and what difficulties they face. The findings of the study assisted in the development of the instrument. Five categories of caregiver behaviours were identified from the qualitative data: gathering information about treatment, symptoms, and health care; obtaining support; responding to behaviour disturbances; managing household, personal, and medical care; and managing distress associated with caregiving. The challenges of caregiving were also identified, including deterioration of care recipients, particularly their behaviour disturbances, a shortage of supportive resources, stigmatization of dementia among the general population, as well as increased distress and decreased social activities due to increased care demand. The findings were used to develop the Self-Efficacy Questionnaire for Chinese Family Caregivers, and 35 items comprising five subscales (representing the above five categories of caregiver behaviour) were generated.