Use of cognitive interviewing in the development of a Spanish language genetic knowledge instrument

Study purpose. Genetic advances are significantly impacting healthcare, yet recent studies of ethnic group participation in genetic services demonstrate low utilization rates by Latinos. Limited genetic knowledge is a major barrier. The purpose of this study was to field test items in a Spanish-language instrument that will be used to measure genetic knowledge relevant to type 2 diabetes among members of the ethnically heterogeneous U.S. Latino community. Accurate genetic knowledge measurement can provide the foundation for interventions to enhance genetic service utilization. ^ Design. Three waves of cognitive interviews were conducted in Spanish to field test 44 instrument items Thirty-six Latinos, with 12 persons representative of Mexican, Central and South American, and Cuban heritage participated, including 7 males and 29 females between 22 and 60 years of age; 17 participants had 12 years or less of education. ^ Methods. Text narratives from transcriptions of audiotaped interviews were qualitatively analyzed using a coding strategy to indicate potential sources of response error. Through an iterative process of instrument refinement, codes that emerged from the data were used to guide item revisions at the conclusion of each phase; revised items were examined in subsequent interview waves. ^ Results. Inter-cultural and cross-cultural themes associated with difficulties in interpretation and grammatical structuring of items were identified; difficulties associated with comprehension reflected variations in educational level. Of the original 44 items, 32 were retained, 89% of which were revised. Six additional items reflective of cultural knowledge were constructed, resulting in a 38-item instrument. ^ Conclusions. Use of cognitive interviewing provided a valuable tool for detecting both potential sources of response error and cultural variations in these sources. Analysis of interview data guided successive instrument revisions leading to improved item interpretability and comprehension. Although testing in a larger sample will be essential to test validity and reliability, the outcome of field testing suggests initial content validity of a Spanish-language instrument to measure genetic knowledge relative to type 2 diabetes. ^ Keywords. Latinos, genetic knowledge, instrument development, cognitive interviewing ^

Development and validation of the Neuro Symptom Inventory in the primary brain tumor patient population

Symptoms has been shown to predict quality of life, treatment course and survival in solid tumor patients. Currently, no instrument exists that measures both cancer-related symptoms and the neurologic symptoms that are unique to persons with primary brain tumors (PBT). The aim of this study was to develop and validate an instrument to measure symptoms in patients who have PBT. A conceptual analysis of symptoms and symptom theories led to defining the symptoms experience as the perception of the frequency, intensity, distress, and meaning that occurs as symptoms are produced, perceived, and expressed. The M.D. Anderson Symptom Inventory (MDASI) measures both symptoms and how they interfere with daily functioning in patients with cancer, which is similar to the situational meaning defined in the analysis. A list of symptoms pertinent to the PBT population was added to the core MDASI and reviewed by a group of experts for validity. As a result, 18 items were added to the core MDASI (the MDASI-BT) for the next phase of instrument development, establishing validity and reliability through a descriptive, cross-sectional approach with PBT patients. Data were collected with a patient completed demographic data sheet, an investigator completed clinician checklist, and the MDASI-BT. Analysis evaluated the reliability and validity of the MDASI-BT in PBT patients. Data were obtained from 201 patients. The number of items was reduced to 22 by evaluation of symptom severity as well as cluster analysis. Regression analysis showed more than half (56%) of the variability in symptom severity was explained by the brain tumor module items. Factor analysis confirmed that the 22 item MDASI-BT measured six underlying constructs: (a) affective; (b) cognitive; (c) focal neurologic deficits; (d) constitutional symptoms; (e) treatment-related symptoms; and (f) gastrointestinal symptoms. The MDASI-BT was sensitive to disease severity and if the patient was hospitalized. The MDASI-BT is the first instrument to measure symptoms in PBT patients that has demonstrated reliability and validity. It is the first step in a program of research to evaluate the occurrence of symptoms and plan and evaluate interventions for PBT patients. ^

Cancer patients' attitudes toward cancer trials

Background. Accurate measurement of attitudes toward participation in cancer treatment trials (CTs) and cancer prevention trials (CPTs) across varied groups could assist health researchers and educators when addressing attitudinal barriers to participation in these trials. ^ Methods. The Attitudes toward Cancer Trials Scales (ACTS) instrument development was based on a conceptual model developed from research literature, clinical practice experience, and empirical testing of items with a sample of 312 respondents. The ACTS contains two scales, the Cancer Trials (CT) scale (4 components; 18 items) and the Cancer Prevention Trials (CPT) scale (3 components; 16 items). Cronbach's alpha values for the CT and CPT scales, respectively, were 0.86 and 0.89. These two scales along with sociodemographic and cancer trial history variables were distributed in a mail survey of former patients of a large cancer research center. The disproportionate stratified probability sampling procedure yielded 925 usable responses (54% response rate). ^ Results. Prevalence of favorable attitudes toward CTs and CPTs was 66% and 69%, respectively. There were no significant differences in mean scale scores by cancer site or gender, but African Americans had more favorable attitudes toward CTs than European Americans. Multiple regression analysis indicated that older age, lower education level, and prior CT participation history were associated with more favorable attitudes toward CTs. Prior CT participation and prior CPT participation were associated with more favorable attitudes toward CPTs. Results also provided evidence of reliability and construct validity for both scales. ^ Conclusions. Middle age, higher education, and European American ethnicity are associated with less positive attitudes about participating in cancer treatment trials. Availability of a psychometrically sound instrument to measure attitudes may facilitate a better understanding decision making regarding participation in CTs and CPTs. It is this author's intention that the ACTS' scales will be used by other investigators to measure attitudes toward CTs and CPTs in various groups of persons, and that the many issues regarding participation in trials might become more explicit. ^

THE DESIGN AND DEVELOPMENT OF A SURVEY INSTRUMENT FOR THE ASSESSMENT OF OCCUPATIONAL STRESS

Using stress and coping as a unifying theoretical concept, a series of five models was developed in order to synthesize the survey questions and to classify information. These models identified the question, listed the research study, described measurements, listed workplace data, and listed industry and national reference data.^ A set of 38 instrument questions was developed within the five coping correlate categories. In addition, a set of 22 stress symptoms was also developed. The study was conducted within two groups, police and professors, on a large university campus. The groups were selected because their occupations were diverse, but they were a part of the same macroenvironment. The premise was that police officers would be more highly stressed than professors.^ Of a total study group of 80, there were 37 respondents. The difference in the mean stress responses was observable between the two groups. Not only were the responses similar within each group, but the stress level of response was also similar within each group. While the response to the survey instrument was good, only 3 respondents answered the stress symptom survey properly. It was determined that none of the 37 respondents believed that they were ill. This perception of being well was also evidenced by the grand mean of the stress scores of 2.76 (3.0 = moderate stress). This also caused fewer independent variables to be entered in the multiple regression model.^ The survey instrument was carefully designed to be universal. Universality is the ability to transcend occupational or regional definitions as applied to stress. It is the ability to measure responses within broad categories such as physiological, emotional, behavioral, social, and cognitive functions without losing the ability to measure the detail within the individual questions, or the relationships between questions and categories.^ Replication is much easier to achieve with standardized categories, questions, and measurement procedures such as those developed for the universal survey instrument. Because the survey instrument is universal it can be used as an analytical device, an assessment device, a basic tool for planning and a follow-up instrument to measure individual response to planned reductions in occupational stress. (Abstract shortened with permission of author.) ^

Measuring health state preferences for hemophilia: Development of a disease-specific utility instrument

Research has shown that disease-specific health related quality of life (HRQoL) instruments are more responsive than generic instruments to particular disease conditions. However, only a few studies have used disease-specific instruments to measure HRQoL in hemophilia. The goal of this project was to develop a disease-specific utility instrument that measures patient preferences for various hemophilia health states. The visual analog scale (VAS), a ranking method, and the standard gamble (SG), a choice-based method incorporating risk, were used to measure patient preferences. Study participants (n = 128) were recruited from the UT/Gulf States Hemophilia and Thrombophilia Center and stratified by age: 0–18 years and 19+. ^ Test retest reliability was demonstrated for both VAS and SG instruments: overall within-subject correlation coefficients were 0.91 and 0.79, respectively. Results showed statistically significant differences in responses between pediatric and adult participants when using the SG (p = .045). However, no significant differences were shown between these groups when using the VAS (p = .636). When responses to VAS and SG instruments were compared, statistically significant differences in both pediatric (p < .0001) and adult (p < .0001) groups were observed. Data from this study also demonstrated that persons with hemophilia with varying severity of disease, as well as those who were HIV infected, were able to evaluate a range of health states for hemophilia. This has important implications for the study of quality of life in hemophilia and the development of disease-specific HRQoL instruments. ^ The utility measures obtained from this study can be applied in economic evaluations that analyze the cost/utility of alternative hemophilia treatments. Results derived from the SG indicate that age can influence patients' preferences regarding their state of health. This may have implications for considering treatment options based on the mean age of the population under consideration. Although both instruments independently demonstrated reliability and validity, results indicate that the two measures may not be interchangeable. ^

Development and preliminary validation of the cancer family impact scale for colorectal cancer

This study aimed to develop and validate The Cancer Family Impact Scale (CFIS), an instrument for use in studies investigating relationships among family factors and colorectal cancer (CRC) screening when family history is a risk factor. We used existing data to develop the measure from 1,285 participants (637 families) across the United States who were in the Johns Hopkins Colon Cancer Genetic Testing study. Participants were 94% white with an average age of 50.1 years, and 60% were women. None had a personal CRC history, and eighty percent had 1 FDR with CRC and 20% had more than one FDR with CRC. The study had three aims: (1) to identify the latent factors underlying the CFIS via exploratory factor analysis (EFA); (2) to confirm the findings of the EFA via confirmatory factor analysis (CFA); and (3) to assess the reliability of the scale via Cronbach's alpha. Exploratory analyses were performed on a split half of the sample, and the final model was confirmed on the other half. The EFA suggested the CFIS was an 18-item measure with 5 latent constructs: (1) NEGATIVE: negative effects of cancer on the family; (2) POSITIVE: positive effects of cancer on the family; (3) COMMUNICATE: how families communicate about cancer; (4) FLOW: how information about cancer is conveyed in families; and (5) NORM: how individuals react to family norms about cancer. CFA on the holdout sample showed the CFIS to have a reasonably good fit (Chi-square = 389.977, df = 122, RMSEA= 0.058 (.052-.065), CFI=.902, TLI=.877, GF1=.939). The overall reliability of the scale was α=0.65. The reliability of the subscales was: (1) NEGATIVE α = 0.682; (2) POSITIVE α = 0.686; (3) COMMUNICATE α = 0.723; (4) FLOW α = 0.467; and (5) NORM α = 0.732. ^ We concluded the CFIS to be a good measure with most fit levels over 0.90. The CFIS could be used to compare theoretically driven hypotheses about the pathways through which family factors could influence health behavior among unaffected individuals at risk due to family history, and also aid in the development and evaluation of cancer prevention interventions including a family component. ^

THE DEVELOPMENT OF COMMUNITY COMPETENCE THROUGH A NEIGHBORHOOD ORGANIZATION (LOS ANGELES, MEXICAN-AMERICAN)

This investigation focused on how people cope with the demands of their environment in a competent manner. It sought to assess the effects of learning competent coping behaviors on self-reported well-being. The study chose a community-evolved, organized effort on the part of a group of neighborhoods to build competence in the Mexican-American community of East Los Angeles. This network was a citizen-action organization called the United Neighborhoods Organization. UNO was selected because it concentrated on developing community leaders by using spiritual beliefs and family values as shared community resources. Neighborhood leaders were encouraged to engage in risk-taking and confrontation maneuvers. They were also taught problem-solving skills and provided with social support.^ A survey instrument was developed to assess sociodemographic characteristics, acculturation history and status, willingness to engage in risk-taking and confrontation and self-perceived general well-being. The study relied on eight months of daily participant-observation of the organization, the East Los Angeles environment and the interaction between the two. At the end of the observation period, a sample of 150 UNO participants were given the survey questionnaire as was a matched group of 150 non-UNO participants who were ELA residents.^ The study sample was mostly women, in their middle age years who had lived in the area from 5 to more than 30 years. Significantly more single persons were found in the UNO group. The sample was almost equally divided into English and Spanish speaking respondents. Acculturatively almost all the sample fell in the Very Mexican and Mostly Mexican types. The survey found a trend of association between participating in UNO and reporting feeling well. A statistically significant association was found among UNO participants between taking risks and reporting feeling well, regardless of a tendency for all the sample to minimize risk. A trend was seen for married UNO participants to report feeling well. Slightly more UNO participants were willing to engage in confrontation and a substantial proportion of the participants who were confronters reported feeling well in comparison to their counterparts. Ethnic pride was positively associated with participation in UNO and showed a trend in the expected direction with reported self-perceived well-being. ^

Development and evaluation of a video-based modeling strategy for the dissemination phase of a school health tobacco -use prevention program

Even the best school health education programs will be unsuccessful if they are not disseminated effectively in a manner that encourages classroom adoption and implementation. This study involved two components: (1) the development of a videotape intervention to be used in the dissemination phase of a 4-year, NCI-funded diffusion study and (2) the evaluation of that videotape intervention strategy in comparison with a print (information transfer) strategy. Conceptualization has been guided by Social Learning Theory, Diffusion Theory, and communication theory. Additionally, the PRECEDE Framework has been used. Seventh and 8th grade classroom teachers from Spring Branch Independent School District in west Houston participated in the evaluation of the videotape and print interventions using a 57-item preadoption survey instrument developed by the UT Center for Health Promotion Research and Development. Two-way ANOVA was used to study individual score differences for five outcome variables: Total Scale Score (comprised of 57 predisposing, enabling, and reinforcing items), Adoption Characteristics Subscale, Attitude Toward Innovation Subscale, Receptivity Toward Innovation, and Reinforcement Subscale. The aim of the study is to compare the effect upon score differences of video and print interventions alone and in combination. Seventy-three 7th and 8th grade classroom teachers completed the study providing baseline and post-intervention measures on factors related to the adoption and implementation of tobacco-use prevention programs. Two-way ANOVA, in relation to the study questions, found significant scoring differences for those exposed to the videotape intervention alone for both the Attitude Toward Innovation Subscale and the Receptivity to Adopt Subscale. No significant results were found to suggest that print alone influences favorable scoring differences between baseline and post-intervention testing. One interaction effect was found suggesting video and print combined are more effective for influencing favorable scoring differences for the Reinforcement for the Adoption Subscale.^ This research is unique in that it represents a newly emerging field in health promotion communications research with implications for Social Learning Theory, Diffusion Theory, and communication science that are applicable to the development of improved school health interventions. ^