The Health Behavior Change Competency Checklist (HBCCC): Instrument development and psychometric evaluation.

More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.

Quality in palliative care from the patient perspective : Instrument development, perceptions of care received and the importance of care

The overall aim was to investigate the quality of palliative care from the patient perspective, to adapt and psychometrically evaluate the Quality from Patients’ Perspective instrument specific to palliative care (QPP-PC) and investigate the relationship between the combination of person- and organization-related conditions and patients’ perceptions of care quality. Methods: In the systematic literature review (I), 23 studies from 6 databases and reference lists in 2014 were synthesized by integrative thematic analysis. The quantitative studies (II–IV) had cross-sectional designs including 191 patients (73% RR) from hospice inpatient care, hospice day care, palliative units in nursing homes and home care in 2013–2014. A modified version of QPP was used. Additionally, person- and organization-related conditions were assessed. Psychometric evaluation, descriptive and inferential statistics were used. Main findings: Patients’ preferences for palliative care included living a meaningful life and responsive healthcare personnel, care environment and organization of care (I). The QPP-PC was developed, comprising 12 factors (49 items), 3 single items and 4 dimensions: medical–technical competence, physical–technical conditions, identity–oriented approach, and socio-cultural atmosphere (II). QPP-PC measured patients’ perceived reality (PR) and subjective importance (SI) of care quality. PR differed across settings, but SI did not (III). All settings exhibited areas of strength and for improvement (II, III). Person-related conditions seemed to be related to SI, and person- and organization-related conditions to PR, explaining 18–30 and 22-29% respectively of the variance (IV). Conclusions: The patient perspective of care quality (SI and PR) should be integrated into daily care and improvement initiatives in palliative care. The QPP-PC can measure patients’ perceptions of care quality. Registered nurses and other healthcare personnel need awareness of person- and organization-related conditions to provide high-quality person-centred care.

Development and initial validation of the Parental PELICAN Questionnaire (PaPEQu) - an instrument to assess parental experiences and needs during their child's end-of-life care.

AIM: To develop and test the Parental PELICAN Questionnaire, an instrument to retrospectively assess parental experiences and needs during their child's end-of-life care. BACKGROUND: To offer appropriate care for dying children, healthcare professionals need to understand the illness experience from the family perspective. A questionnaire specific to the end-of-life experiences and needs of parents losing a child is needed to evaluate the perceived quality of paediatric end-of-life care. DESIGN: This is an instrument development study applying mixed methods based on recommendations for questionnaire design and validation. METHOD: The Parental PELICAN Questionnaire was developed in four phases between August 2012-March 2014: phase 1: item generation; phase 2: validity testing; phase 3: translation; phase 4: pilot testing. Psychometric properties were assessed after applying the Parental PELICAN Questionnaire in a sample of 224 bereaved parents in April 2014. Validity testing covered the evidence based on tests of content, internal structure and relations to other variables. RESULTS: The Parental PELICAN Questionnaire consists of approximately 90 items in four slightly different versions accounting for particularities of the four diagnostic groups. The questionnaire's items were structured according to six quality domains described in the literature. Evidence of initial validity and reliability could be demonstrated with the involvement of healthcare professionals and bereaved parents. CONCLUSION: The Parental PELICAN Questionnaire holds promise as a measure to assess parental experiences and needs and is applicable to a broad range of paediatric specialties and settings. Future validation is needed to evaluate its suitability in different cultures.

Use of cognitive interviewing in the development of a Spanish language genetic knowledge instrument

Study purpose. Genetic advances are significantly impacting healthcare, yet recent studies of ethnic group participation in genetic services demonstrate low utilization rates by Latinos. Limited genetic knowledge is a major barrier. The purpose of this study was to field test items in a Spanish-language instrument that will be used to measure genetic knowledge relevant to type 2 diabetes among members of the ethnically heterogeneous U.S. Latino community. Accurate genetic knowledge measurement can provide the foundation for interventions to enhance genetic service utilization. ^ Design. Three waves of cognitive interviews were conducted in Spanish to field test 44 instrument items Thirty-six Latinos, with 12 persons representative of Mexican, Central and South American, and Cuban heritage participated, including 7 males and 29 females between 22 and 60 years of age; 17 participants had 12 years or less of education. ^ Methods. Text narratives from transcriptions of audiotaped interviews were qualitatively analyzed using a coding strategy to indicate potential sources of response error. Through an iterative process of instrument refinement, codes that emerged from the data were used to guide item revisions at the conclusion of each phase; revised items were examined in subsequent interview waves. ^ Results. Inter-cultural and cross-cultural themes associated with difficulties in interpretation and grammatical structuring of items were identified; difficulties associated with comprehension reflected variations in educational level. Of the original 44 items, 32 were retained, 89% of which were revised. Six additional items reflective of cultural knowledge were constructed, resulting in a 38-item instrument. ^ Conclusions. Use of cognitive interviewing provided a valuable tool for detecting both potential sources of response error and cultural variations in these sources. Analysis of interview data guided successive instrument revisions leading to improved item interpretability and comprehension. Although testing in a larger sample will be essential to test validity and reliability, the outcome of field testing suggests initial content validity of a Spanish-language instrument to measure genetic knowledge relative to type 2 diabetes. ^ Keywords. Latinos, genetic knowledge, instrument development, cognitive interviewing ^

Development of an instrument measuring the quality of residential care facilities for older people

Aims. To validate the Swedish version of the Sheffield Care Environment Assessment Matrix (S-SCEAM). The instrument’s items measure environmental elements important for supporting the needs of older people, and conceptualized within eight domains. Methods. Item relevance was assessed by a group of experts and measured using content validity index (CVI). Test-retest and inter-rater reliability tests were performed.  The domain structure was assessed by the inter-rater agreement of a second group of experts, and measured using Fleiss kappa. Results. All items attained a CVI above 0.78, the suggested criteria for excellent content validity. Test-retest reliability showed high stability (96% and 95% for two independent raters respectively), and inter-rater reliability demonstrated high levels of agreement (95% and 94% on two separate rating occasions). Kappa values were very good for test-retest (κ = 0.903 and 0.869) and inter-rater reliability (κ = 0.851 and 0.832). Domain structure was good,  Fleiss’ kappa was 0.63 (range 0.45 to 0.75).    Conclusion. The S-SCEAM of 210 items and eight domains showed good content validity and construct validity. The instrument is suggested for use in measuring of the quality of the physical environment in residential care facilities for older persons.

Development and validation of the Neuro Symptom Inventory in the primary brain tumor patient population

Symptoms has been shown to predict quality of life, treatment course and survival in solid tumor patients. Currently, no instrument exists that measures both cancer-related symptoms and the neurologic symptoms that are unique to persons with primary brain tumors (PBT). The aim of this study was to develop and validate an instrument to measure symptoms in patients who have PBT. A conceptual analysis of symptoms and symptom theories led to defining the symptoms experience as the perception of the frequency, intensity, distress, and meaning that occurs as symptoms are produced, perceived, and expressed. The M.D. Anderson Symptom Inventory (MDASI) measures both symptoms and how they interfere with daily functioning in patients with cancer, which is similar to the situational meaning defined in the analysis. A list of symptoms pertinent to the PBT population was added to the core MDASI and reviewed by a group of experts for validity. As a result, 18 items were added to the core MDASI (the MDASI-BT) for the next phase of instrument development, establishing validity and reliability through a descriptive, cross-sectional approach with PBT patients. Data were collected with a patient completed demographic data sheet, an investigator completed clinician checklist, and the MDASI-BT. Analysis evaluated the reliability and validity of the MDASI-BT in PBT patients. Data were obtained from 201 patients. The number of items was reduced to 22 by evaluation of symptom severity as well as cluster analysis. Regression analysis showed more than half (56%) of the variability in symptom severity was explained by the brain tumor module items. Factor analysis confirmed that the 22 item MDASI-BT measured six underlying constructs: (a) affective; (b) cognitive; (c) focal neurologic deficits; (d) constitutional symptoms; (e) treatment-related symptoms; and (f) gastrointestinal symptoms. The MDASI-BT was sensitive to disease severity and if the patient was hospitalized. The MDASI-BT is the first instrument to measure symptoms in PBT patients that has demonstrated reliability and validity. It is the first step in a program of research to evaluate the occurrence of symptoms and plan and evaluate interventions for PBT patients. ^

Development and evaluation of the Clinician Suicide Risk Assessment Checklist

This paper describes the development and evaluation of a new instrument – the Clinician Suicide Risk Assessment Checklist (CSRAC). The instrument assesses the clinician’s competency in three areas: clinical interviewing, assessment of specific suicide risk factors, and formulating a management plan. A draft checklist was constructed by integrating information from 1) literature review 2) expert clinician focus group and 3) consultation with experts. It was utilised in a simulated clinical scenario with clinician trainees and a trained actor in order to test for inter-rater agreement. Agreement was calculated and the checklist was re-drafted with the aim of maximising agreement. A second phase of simulated clinical scenarios was then conducted and inter-rater agreement was calculated for the revised checklist. In the first phase of the study, 18 of 35 items had inadequate inter-rater agreement (60%>), while in the second phase, using the revised version, only 3 of 39 items failed to achieve adequate inter-rater agreement. Further evidence of reliability and validity are required. Continued development of the CSRAC will be necessary before it can be utilised to assess the effectiveness of risk assessment training programs.

Developing a process to create and validate an instrument assessing student attainment of competencies at an intercultural university in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students' attainment of competencies in one of the IU's majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students' research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as "functional capabilities" (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric's validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study's instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

Developing a Process to Create and Validate an Instrument Assessing Student Attainment of Competencies at an Intercultural University in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students’ attainment of competencies in one of the IU’s majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students’ research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as “functional capabilities” (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric’s validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study’s instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

Impacto funcional con el uso de clavo telescopico tipo Fassier Duval en pacientes con osteogénesis imperfecta

Introducción: la osteogénesis es una patología de origen genético caracterizada por fragilidad ósea, en su curso natural los pacientes que la padecen se enfrentan a múltiples fracturas y múltiples intervenciones quirúrgicas, este tipo de pacientes por ser de alto riesgo necesitan técnicas quirúrgicas que aumenten el tiempo entre cada intervención y que demuestren un mayor impacto en el estado funcional. Objetivo: Determinar el impacto en el estado funcional de los pacientes con osteogénesis imperfecta llevados a tratamiento quirúrgico con clavos telescopados tipo Fassier Duval. Diseño: Estudio descriptivo prospectivo en el que se incluyeron 8 pacientes con diagnóstico de osteogénesis imperfecta, llevados a tratamiento quirúrgico con clavos telescopados tipo Fassier Duval desde el 2009 al 2013 a los cuales se les realizó seguimiento menor de 1 año del post operatorio. Resultados: La respuesta encontrada fue satisfactoria en la mayoría de los pacientes analizados 6 de 8, con cercanía a un estado funcional normal; un riesgo de caída bajo, incorporación y deambulación adecuada y una valoración funcional motora gruesa con valores cercanos al 100% identificando un buen nivel de independencia funcional. Se pudo demostrar que existieron cambios en los valores de la escala y que estos fueron estadísticamente significativos con p=0,028 indicando que el aumento dichos valores en el posoperatorio están relacionados con el procedimiento quirúrgico al utilizado en este grupo de pacientes. Conclusión: El tratamiento quirúrgico con el clavo telescopado de Fassier Duval en nuestra experiencia demostró tener una mejoría en el estado funcional de los pacientes del presente estudio, por lo tanto se sugiere la posibilidad de implementar su uso según este indicado con el fin de obtener un mejor resultado quirúrgico y funcional. Palabras clave: Osteogénesis Imperfecta, Clavo de Fassier Duval, Valoración Funcional Motora

Content validation for level of use of feature rich systems: a Delphi study of electronic medical records systems

Introduction. Feature usage is a pre-requisite to realising the benefits of investments in feature rich systems. We propose that conceptualising the dependent variable 'system use' as 'level of use' and specifying it as a formative construct has greater value for measuring the post-adoption use of feature rich systems. We then validate the content of the construct as a first step in developing a research instrument to measure it. The context of our study is the post-adoption use of electronic medical records (EMR) by primary care physicians. Method. Initially, a literature review of the empirical context defines the scope based on prior studies. Having identified core features from the literature, they are further refined with the help of experts in a consensus seeking process that follows the Delphi technique. Results.The methodology was successfully applied to EMRs, which were selected as an example of feature rich systems. A review of EMR usage and regulatory standards provided the feature input for the first round of the Delphi process. A panel of experts then reached consensus after four rounds, identifying ten task-based features that would be indicators of level of use. Conclusions. To study why some users deploy more advanced features than others, theories of post-adoption require a rich formative dependent variable that measures level of use. We have demonstrated that a context sensitive literature review followed by refinement through a consensus seeking process is a suitable methodology to validate the content of this dependent variable. This is the first step of instrument development prior to statistical confirmation with a larger sample.

Är organisationen mogen för evidensbaserad vård? : översättning och validering av Alberta Context Tool och beskrivning av sjuksköterskors skattning av kontextuella faktorer inom ortopedisk vård

Syftet med denna studie var att reliabilitetstesta Alberta Context Tool (ACT) i svensk hälso- och sjukvård och beskriva ortopedsjuksköterskors skattning av kontextuella faktorer såsom ledarskap, arbetskultur, återkoppling, utvecklingsmöjligheter och forskningsanvändning, som kan påverka möjligheten att omsätta forskningsresultat i vårdarbetet. Urvalet bestod av 119 sjuksköterskor som arbetade på ortopediska vårdavdelningar på sex olika sjukhus i mellersta Sverige. ACT är ett frågeformulär framtaget utifrån de senaste årens forskning om vilka faktorer i kontexten som har betydelse för sjuksköterskors forskningsanvändning. Reliabilitetstest gjordes enligt analys med Chronbach`s Alpa och innehållsvaliditet. Resultatet visade att ACT var relevant att användas för sjuksköterskor som arbetar på ortopedisk vårdavdelning i Sverige. Reliabilitetstesten med Chronbach´s Alpa gav värden nära 0,7 för de åtta frågeområden som behandlar kontexten.Sjuksköterskorna rapporterade att det fanns brister i många av de delar av kontexten som enligt forskning visat sig ha betydelse för möjligheten att implementera evidensbaserad vård. Sjuksköterskorna trivdes med sitt arbete och kände att deras kunskaper värderades högt i vårdteamet. Resultatet visade dock att det inte fanns tillräckligt stöd från ledningen för att utveckla vården. De rapporterade att de nästan inte alls fick återkoppling i vårdarbetet. Det saknades stödfunktioner och strategier för att implementering av forskningsresultat skulle vara möjligt att implementera i vårdarbetet. Majoriteten av sjuksköterskorna såg positivt på forskningsanvändning.

Cross-cultural adaptation and psychometric properties of the Brazilian-Portuguese version of the Duke Anticoagulation Satisfaction Scale

Aim. The aim of this study was to evaluate the internal reliability and validity of the BrazilianPortuguese version of Duke Anticoagulation Satisfaction Scale (DASS) among cardiovascular patients. Background. Oral anticoagulation is widely used to prevent and treat thromboembolic events in several conditions, especially in cardiovascular diseases; however, this therapy can induce dissatisfaction and reduce the quality of life. Design. Methodological and cross-sectional research design. Methods. The cultural adaptation of the DASS included the translation and back-translation, discussions with healthcare professionals and patients to ensure conceptual equivalence, semantic evaluation and instrument pretest. The BrazilianPortuguese version of the DASS was tested among subjects followed in a university hospital anticoagulation outpatient clinic. The psychometric properties were assessed by construct validity (convergent, known groups and dimensionality) and internal consistency/reliability (Cronbachs alpha). Results. A total of 180 subjects under oral anticoagulation formed the baseline validation population. DASS total score and SF-36 domain correlations were moderate for General health (r = -0.47, p < 0.01), Vitality (r = -0.44, p < 0.01) and Mental health (r = -0.42, p < 0.01) (convergent). Age and length on oral anticoagulation therapy (in years) were weakly correlated with total DASS score and most of the subscales, except Limitation (r = -0.375, p < 0.01) (Known groups). The Cronbachs alpha coefficient was 0.79 for the total scale, and it ranged from 0.76 (hassles and burdens)0.46 (psychological impact) among the domains, confirming the internal consistency reliability. Conclusions. The BrazilianPortuguese version of the DASS has shown levels of reliability and validity comparable with the original English version. Relevance to clinical practice. Healthcare practitioners and researchers need internationally validated measurement tools to compare outcomes of interventions in clinical management and research tools in oral anticoagulation therapy.

Cancer patients' attitudes toward cancer trials

Background. Accurate measurement of attitudes toward participation in cancer treatment trials (CTs) and cancer prevention trials (CPTs) across varied groups could assist health researchers and educators when addressing attitudinal barriers to participation in these trials. ^ Methods. The Attitudes toward Cancer Trials Scales (ACTS) instrument development was based on a conceptual model developed from research literature, clinical practice experience, and empirical testing of items with a sample of 312 respondents. The ACTS contains two scales, the Cancer Trials (CT) scale (4 components; 18 items) and the Cancer Prevention Trials (CPT) scale (3 components; 16 items). Cronbach's alpha values for the CT and CPT scales, respectively, were 0.86 and 0.89. These two scales along with sociodemographic and cancer trial history variables were distributed in a mail survey of former patients of a large cancer research center. The disproportionate stratified probability sampling procedure yielded 925 usable responses (54% response rate). ^ Results. Prevalence of favorable attitudes toward CTs and CPTs was 66% and 69%, respectively. There were no significant differences in mean scale scores by cancer site or gender, but African Americans had more favorable attitudes toward CTs than European Americans. Multiple regression analysis indicated that older age, lower education level, and prior CT participation history were associated with more favorable attitudes toward CTs. Prior CT participation and prior CPT participation were associated with more favorable attitudes toward CPTs. Results also provided evidence of reliability and construct validity for both scales. ^ Conclusions. Middle age, higher education, and European American ethnicity are associated with less positive attitudes about participating in cancer treatment trials. Availability of a psychometrically sound instrument to measure attitudes may facilitate a better understanding decision making regarding participation in CTs and CPTs. It is this author's intention that the ACTS' scales will be used by other investigators to measure attitudes toward CTs and CPTs in various groups of persons, and that the many issues regarding participation in trials might become more explicit. ^