Construct Validity of the Pig Intestine Model in the Simulation of Laparoscopic Urethrovesical Anastomosis

Introduction: Laparoscopic training models are increasingly important in urology to allow trainees to improve their laparoscopic skills prior to going to the operating room. For a training model to be valid, it must correlate with performance in a real case. The model must also discriminate between experienced and inexperienced subjects. [See PDF for complete abstract]

An examination of the cross-cultural reliability and construct validity of a measure of loneliness

Loneliness is a pervasive, rather common experience in American culture, particularly notable among adolescents. However, the phenomenon is not well documented in the cross-cultural psychiatric literature. For psychiatric epidemiology to encompass a wide array of psychopathologic phenomena, it is important to develop useful measures to characterize and classify both non-clinical and clinical dysfunction in diverse subgroups and cultures.^ The goal of this research was to examine the cross-cultural reliability and construct validity of a scale designed to measure loneliness. The Roberts Loneliness Scale (RLS-8) was administered to 4,060 adolescents ages 10-19 years enrolled in high schools along either side of the Texas-Tamaulipas border region between the U.S. and Mexico. Data collected in 1988 from a study focusing on substance use and psychological distress among adolescents in these regions were used to examine the operating characteristics of the RLS-8. A sample stratified by nationality and language, age, gender, and grade was used for analysis.^ Results indicated that in general the RLS-8 has moderate reliability in the U.S. sample, but not in the Mexican sample. Validity analyses demonstrated that there was evidence for convergent validity of the RLS-8 in the U.S. sample, but none in the Mexican sample. Discriminant validity of the measures in neither sample could be established. Based on the factor structure of the RLS-8, two subscales were created and analyzed for construct validity. Evidence for convergent validity was established for both subscales in both national samples. However, the discriminant validity of the measure remains unsubstantiated in both national samples. Also, the dimensionality of the scale is unresolved.^ One primary goal for future cross-cultural research would be to develop and test better defined culture-specific models of loneliness within the two cultures. From such scientific endeavor, measures of loneliness can be developed or reconstructed to classify the phenomenon in the same manner across cultures. Since estimates of prevalence and incidence are contingent upon reliable and valid screening or diagnostic measures, this objective would serve as an important foundation for future psychiatric epidemiologic inquiry into loneliness. ^

Mistreatment and self-neglect in community dwelling older adults: Studies of construct validity, measurement invariance and latent classes

Mistreatment and self-neglect significantly increase the risk of dying in older adults. It is estimated that 1 to 2 million older adults experience elder mistreatment and self-neglect every year in the United States. Currently, there are no elder mistreatment and self-neglect assessment tools with construct validity and measurement invariance testing and no studies have sought to identify underlying latent classes of elder self-neglect that may have differential mortality rates. Using data from 11,280 adults with Texas APS substantiated elder mistreatment and self-neglect 3 studies were conducted to: (1) test the construct validity and (2) the measurement invariance across gender and ethnicity of the Texas Adult Protective Services (APS) Client Assessment and Risk Evaluation (CARE) tool and (3) identify latent classes associated with elder self-neglect. Study 1 confirmed the construct validity of the CARE tool following adjustments to the initial hypothesized CARE tool. This resulted in the deletion of 14 assessment items and a final assessment with 5 original factors and 43 items. Cross-validation for this model was achieved. Study 2 provided empirical evidence for factor loading and item-threshold invariance of the CARE tool across gender and between African-Americans and Caucasians. The financial status domain of the CARE tool did not function properly for Hispanics and thus, had to be deleted. Subsequent analyses showed factor loading and item-threshold invariance across all 3 ethnic groups with the exception of some residual errors. Study 3 identified 4-latent classes associated with elder self-neglect behaviors which included individuals with evidence of problems in the areas of (1) their environment, (2) physical and medical status, (3) multiple domains and (4) finances. Overall, these studies provide evidence supporting the use of APS CARE tool for providing unbiased and valid investigations of mistreatment and neglect in older adults with different demographic characteristics. Furthermore, the findings support the underlying notion that elder self-neglect may not only occur along a continuum, but that differential types may exist. All of which, have very important potential implications for social and health services distributed to vulnerable mistreated and neglected older adults.^

Validity assessment of the Breast Cancer Risk Reduction Health Belief scale.

BACKGROUND: : Women at increased risk of breast cancer (BC) are not widely accepting of chemopreventive interventions, and ethnic minorities are underrepresented in related trials. Furthermore, there is no validated instrument to assess the health-seeking behavior of these women with respect to these interventions. METHODS: : By using constructs from the Health Belief Model, the authors developed and refined, based on pilot data, the Breast Cancer Risk Reduction Health Belief (BCRRHB) scale using a population of 265 women at increased risk of BC who were largely medically underserved, of low socioeconomic status (SES), and ethnic minorities. Construct validity was assessed using principal components analysis with oblique rotation to extract factors, and generate and interpret summary scales. Internal consistency was determined using Cronbach alpha coefficients. RESULTS: : Test-retest reliability for the pilot and final data was calculated to be r = 0.85. Principal components analysis yielded 16 components that explained 64% of the total variance, with communalities ranging from 0.50-0.75. Cronbach alpha coefficients for the extracted factors ranged from 0.45-0.77. CONCLUSIONS: : Evidence suggests that the BCRRHB yields reliable and valid data that allows for the identification of barriers and enhancing factors associated with use of breast cancer chemoprevention in the study population. These findings allow for tailoring treatment plans and intervention strategies to the individual. Future research is needed to validate the scale for use in other female populations. Cancer 2009. (c) 2009 American Cancer Society.

Adolescent tobacco use: Studies of prevalence, factorial validity, and factorial invariance between African Americans and Whites

In the last thirty years, increasing efforts have been made to reduce the prevalence of adolescent tobacco use in the United States. Although the prevalence has declined dramatically over the past decade, there are still sharp differences in adolescent smoking-initiation rates across racial/ethnic groups. Large-scale surveys frequently assess smoking-related attitudes, self-efficacy, and intentions to explain the differences in smoking rates between African Americans and Whites. However, there is little agreement about which constructs are significant. Moreover, the psychometric properties of smoking-related attitude, self-efficacy, and intention constructs have not been fully examined. More studies are needed to understand existing patterns of tobacco use and to validate and fully exploit the constructs' relationship to adolescent smoking initiation across racial/ethnic groups. ^ This dissertation reports on a secondary analysis of data from a large multi-ethnic convenience sample of sixth- through eighth-grade students in 22 schools in East Texas and the city of Houston. The specific aims of this dissertation were to (1) describe smoking and alternate tobacco product use rates by race/ethnicity, gender, age, and grade level (Article 1); (2) test the factorial validity of smoking-related attitudes, self-efficacy, and intentions using confirmatory factor analysis techniques (Article 2); and (3) test the factorial invariance of smoking-related attitudes, self-efficacy, and intentions between African Americans and Whites (Article 3). ^ The prevalence findings confirm the disparities in tobacco use among African American, Hispanic, and White adolescents that other surveys have reported (Article 1). This study also demonstrates the usefulness of examining use patterns of not only cigarettes but also alternative tobacco products in younger multiethnic populations, as well as of providing epidemiological data estimates about different phases of smoking. The confirmatory factor analysis provides evidence of construct validity of attitude, self-efficacy, and intention scales for the multiethnic sample (Article 2). Finally, the factorial invariance analyses indicates that some measures representing smoking-related attitudes, self-efficacy, and intentions may not be appropriate for use among both African Americans and Whites (Article 3). Additional research is needed to further our understanding of the patterns and predictors of youth tobacco use initiation. ^

Affect and cognition measures in preference-based decisions: Validity testing of the Ottawa Decisional Conflict Scale and a decision-specific anxiety measure with men eligible for prostate cancer screening

Background. At present, prostate cancer screening (PCS) guidelines require a discussion of risks, benefits, alternatives, and personal values, making decision aids an important tool to help convey information and to help clarify values. Objective: The overall goal of this study is to provide evidence of the reliability and validity of a PCS anxiety measure and the Decisional Conflict Scale (DCS). Methods. Using data from a randomized, controlled PCS decision aid trial that measured PCS anxiety at baseline and DCS at baseline (T0) and at two-weeks (T2), four psychometric properties were assessed: (1) internal consistency reliability, indicated by factor analysis intraclass correlations and Cronbach's α; (2) construct validity, indicated by patterns of Pearson correlations among subscales; (3) discriminant validity, indicated by the measure's ability to discriminate between undecided men and those with a definite screening intention; and (4) factor validity and invariance using confirmatory factor analyses (CFA). Results. The PCS anxiety measure had adequate internal consistency reliability and good construct and discriminant validity. CFAs indicated that the 3-factor model did not have adequate fit. CFAs for a general PCS anxiety measure and a PSA anxiety measure indicated adequate fit. The general PCS anxiety measure was invariant across clinics. The DCS had adequate internal consistency reliability except for the support subscale and had adequate discriminate validity. Good construct validity was found at the private clinic, but was only found for the feeling informed subscale at the public clinic. The traditional DCS did not have adequate fit at T0 or at T2. The alternative DCS had adequate fit at T0 but was not identified at T2. Factor loadings indicated that two subscales, feeling informed and feeling clear about values, were not distinct factors. Conclusions. Our general PCS anxiety measure can be used in PCS decision aid studies. The alternative DCS may be appropriate for men eligible for PCS. Implications: More emphasis needs to be placed on the development of PCS anxiety items relating to testing procedures. We recommend that the two DCS versions be validated in other samples of men eligible for PCS and in other health care decisions that involve uncertainty. ^

Cancer patients' attitudes toward cancer trials

Background. Accurate measurement of attitudes toward participation in cancer treatment trials (CTs) and cancer prevention trials (CPTs) across varied groups could assist health researchers and educators when addressing attitudinal barriers to participation in these trials. ^ Methods. The Attitudes toward Cancer Trials Scales (ACTS) instrument development was based on a conceptual model developed from research literature, clinical practice experience, and empirical testing of items with a sample of 312 respondents. The ACTS contains two scales, the Cancer Trials (CT) scale (4 components; 18 items) and the Cancer Prevention Trials (CPT) scale (3 components; 16 items). Cronbach's alpha values for the CT and CPT scales, respectively, were 0.86 and 0.89. These two scales along with sociodemographic and cancer trial history variables were distributed in a mail survey of former patients of a large cancer research center. The disproportionate stratified probability sampling procedure yielded 925 usable responses (54% response rate). ^ Results. Prevalence of favorable attitudes toward CTs and CPTs was 66% and 69%, respectively. There were no significant differences in mean scale scores by cancer site or gender, but African Americans had more favorable attitudes toward CTs than European Americans. Multiple regression analysis indicated that older age, lower education level, and prior CT participation history were associated with more favorable attitudes toward CTs. Prior CT participation and prior CPT participation were associated with more favorable attitudes toward CPTs. Results also provided evidence of reliability and construct validity for both scales. ^ Conclusions. Middle age, higher education, and European American ethnicity are associated with less positive attitudes about participating in cancer treatment trials. Availability of a psychometrically sound instrument to measure attitudes may facilitate a better understanding decision making regarding participation in CTs and CPTs. It is this author's intention that the ACTS' scales will be used by other investigators to measure attitudes toward CTs and CPTs in various groups of persons, and that the many issues regarding participation in trials might become more explicit. ^

Structural equation modeling of the medical outcome study: Short Form 36 (SF-36)

The factorial validity of the SF-36 was evaluated using confirmatory factor analysis (CFA) methods, structural equation modeling (SEM), and multigroup structural equation modeling (MSEM). First, the measurement and structural model of the hypothesized SF-36 was explicated. Second, the model was tested for the validity of a second-order factorial structure, upon evidence of model misfit, determined the best-fitting model, and tested the validity of the best-fitting model on a second random sample from the same population. Third, the best-fitting model was tested for invariance of the factorial structure across race, age, and educational subgroups using MSEM.^ The findings support the second-order factorial structure of the SF-36 as proposed by Ware and Sherbourne (1992). However, the results suggest that: (a) Mental Health and Physical Health covary; (b) general mental health cross-loads onto Physical Health; (c) general health perception loads onto Mental Health instead of Physical Health; (d) many of the error terms are correlated; and (e) the physical function scale is not reliable across these two samples. This hierarchical factor pattern was replicated across both samples of health care workers, suggesting that the post hoc model fitting was not data specific. Subgroup analysis suggests that the physical function scale is not reliable across the "age" or "education" subgroups and that the general mental health scale path from Mental Health is not reliable across the "white/nonwhite" or "education" subgroups.^ The importance of this study is in the use of SEM and MSEM in evaluating sample data from the use of the SF-36. These methods are uniquely suited to the analysis of latent variable structures and are widely used in other fields. The use of latent variable models for self reported outcome measures has become widespread, and should now be applied to medical outcomes research. Invariance testing is superior to mean scores or summary scores when evaluating differences between groups. From a practical, as well as, psychometric perspective, it seems imperative that construct validity research related to the SF-36 establish whether this same hierarchical structure and invariance holds for other populations.^ This project is presented as three articles to be submitted for publication. ^

Translation and cultural adaptation of the Stigma-Devaluation scale for use among family caregivers of mentally ill relatives in Jordan

Background/significance. Mental illness stigma is a matter of great concern to family caregivers. Few research studies have been conducted in the Arab World on family caregivers' perception of stigma associated with caring for a mentally ill relative. Review of the literature on measurement of the concept of stigma related to caring for a mentally ill relative yielded no instrument appropriate for use in a Jordanian sample. Reliable and valid instruments to measure stigma perception among family caregivers are needed for research and practice, particularly in Arabic speaking populations. ^ Purpose. The purposes of this study were: (1) translate the Stigma-Devaluation scale (SDS) into Arabic, modifying it to accurately reflect the cultural parameters specific to Jordan, and (2) test the reliability, the content and construct validity of the Arabic version of the SDS for use among a sample of family members of mentally ill relatives in Jordan. ^ Design. Methodologic, cross-sectional. ^ Methods. The SDS was translated into Arabic language, modified and culturally adapted to the Jordanian culture by a translation model which incorporates a cultural adaptation process. The Arabic SDS was evaluated in a sample of 164 family caregivers in the outpatient mental health clinic in Irbid-Jordan. Cronbach's alpha estimation of internal consistency was used to assess the reliability of the SDS. Construct validity was determined by confirmatory factor analysis (CFA). Measurements of content validity and reading level of the Arabic SDS were included. ^ Findings. Content Validity Index was determined to be 1.0. Reading level of the Arabic SDS was considered at a 6th grade or lower Cronbach's alpha coefficient of the modified Arabic SDS total scale was .87. Initial results of CFA did not fully support the proposed factor structures of the SDS or its subscales. After modifications, the indices indicated that the modified model of each subscale had satisfactory fit. ^ Conclusion. This study provided psychometric evidence that the modified Arabic SDS translated and culturally adapted instrument, is valid and conceptually consistent with the content of the original English SDS in measuring stigma perception among families of mentally ill relatives in Jordan. ^

An epidemiologic evaluation of a worksite based intervention

The healthcare industry spends billions on worker injury and employee turnover. Hospitals and healthcare settings have one of the highest rates of lost days due to injuries. The occupational hazards for healthcare workers can be classified into biological, chemical, ergonomic, physical, organizational, and psychosocial. Therefore, interventions addressing a range of occupational health risks are needed to prevent injuries and reduce turnover and reduce costs. ^ The Sacred Vocation Program (SVP) seeks to change the content of work, i.e., the meaningfulness of work, to improve work environments. The SVP intervenes at both the individual and organizational level. First the SVP attempts to connect healthcare workers with meaning from their work through a series of 5 self-discovery group sessions. In a sixth session the graduates take an oath recommitting them to do their work as a vocation. Once motivated to connect with meaning in their work, a representative employee group meets in a second set of five meetings. This representative group suggests organizational changes to create a culture that supports employees in their calling. The employees present their plan in the twelfth session to management beginning a new phase in the existing dialogue between employees and management. ^ The SVP was implemented in a large Dallas hospital (almost 1000 licensed beds). The Baylor University Medical Center (BUMC) Pastoral Care department invited front-line caregivers (primarily Patient Care Assistants, PCAs, or Patient Care Technicians, PCTs) to participate in the SVP. Participants completed SVP questionnaires at the beginning and following SVP implementation. Following implementation, employer records were collected on injury, absence and turnover to further evaluate the program's effectiveness on metrics that are meaningful to managers in assessing organizational performance. This provided an opportunity to perform an epidemiological evaluation of the intervention using the two sources of information: employee self-reports and employer administrative data. ^ The ability to evaluate the effectiveness of the SVP on program outcomes could be limited by the strength of the measures used. An ordinal CFA performed on baseline SVP questionnaire measurements examined the construct validity and reliability of the SVP scales. Scales whose item-factor structure was confirmed in ordinal CFA were evaluated for their psychometric properties (i.e., reliability, mean, ceiling and floor effects). CFA supported the construct validity of six of the proposed scales: blocks to spirituality, meaning at work, work satisfaction, affective commitment, collaborative communication, and MHI-5. Five of the six scales confirmed had acceptable measures of reliability (all but MHI-5 had α>0.7). All six scales had a high percentage (>30%) of the scores at the ceiling. These findings supported the use of these items in the evaluation of change although strong ceiling effects may hinder discerning change. ^ Next, the confirmed SVP scales were used to evaluate whether the intervention improved program constructs. To evaluate the SVP a one group pretest-posttest design compared participants’ self-reports before and after the intervention. It was hypothesized that measurements of reduced blocks to spirituality (α = 0.76), meaning at work (α = 0.86), collaborative communication (α = 0.67) and SVP job tasks (α = 0.97) would improve following SVP implementation. The SVP job tasks scale was included even though it was not included in the ordinal CFA analysis due to a limited sample and high inter-item correlation. Changes in scaled measurements were assessed using multilevel linear regression methods. All post-intervention measurements increased (increases <0.28 points) but only reduced blocks to spirituality was statistically significant (0.22 points on a scale from 1 to 7, p < 0.05) after adjustment for covariates. Intensity of the intervention (stratifying on high participation units) strengthened effects; but were not statistically significant. The findings provide preliminary support for the hypothesis that meaning in work can be improved and, importantly, lend greater credence to any observed improvements in the outcomes. (Abstract shortened by UMI.)^

A methodologic study of pain assessment in Anglo and Hispanic children with cancer

There is growing clinical evidence that even young children experience pain and accompanying anxiety. Few instruments have been validated to assess pain characteristics in children. The study of related demographic, illness, psychologic and parental factors in children has also been limited. This study examines the reliability and validity of pain assessment tools in an outpatient pediatric cancer population. A total of 78 children from three to fifteen years of age were observed and interviewed about the pain of invasive procedures. The effect of cultural factors and the stress of acculturation were examined by comparing data from two cultural groups, Anglo and Hispanic.^ Spielberger State-Trait Anxiety Scales were administered to children and parents prior to an invasive procedure. The Procedure Behavioral Checklist (PBCL) was used for observation of the child's response during the procedure. The Children's Procedural Interview (CPI) which contains items on the PBCL and visual analogues (scales of faces indicating varying degrees of pain and anxiety) was administered following the procedure.^ Reliability coefficients for Anglos were.78 on the PBCL,.79 on the CPI and.85 on the visual analogue scales. For Hispanics, the reliability for the PBCL was.54, while the CPI had a reliability of.72 and the visual analogue scales,.87. Construct validity was demonstrated by high correlations between the PBCL and CPI scores for both ethnic groups (.66 for Anglos and.64 for Hispanics) and by the significant correlation of State anxiety scores with both PBCL and CPI scores. Age was inversely correlated with PBCL and CPI scores for both ethnic groups. Hispanic parents' anxiety scores were higher than Anglo parents, but were not highly correlated with their child's PBCL, CPI or State-Trait anxiety scores. Caregivers' ratings were correlated with the PBCL scores for Anglos but not for Hispanics.^ The findings of this study indicate that pain responses may be reliably assessed using both observational and self-report methods in children, though differences in Anglo and Hispanic cultures exist. Differences in pain symptomatology and assessment in the two cultural groups warrant further study. ^

Self -management behavior in patients with cystic fibrosis

Self-management is being promoted in cystic fibrosis (CF). However, it has not been well studied. Principal aims of this research were (1) to evaluate psychometric properties of a CF disease status measure, the NIH Clinical Score; (2) to develop and validate a measure of self-management behavior, the SMQ-CF scale, and (3) to examine the relation between self-management and disease status in CF patients over two years.^ In study 1, NIH Clinical Scores for 200 patients were used. The scale was examined for internal consistency, interrater reliability, and content validity using factor analysis. The Cronbach's alpha (.81) and interrater reliability (.90) for the total scale were high. General scale items were less reliable. Factor analysis indicated that most of the variance in disease status is accounted for by Factor 1 which consists of pulmonary disease items.^ The SMQ-CF measures the performance of CF self-management. Pilot testing was done with 98 CF primary caregivers. Internal consistency reliability, social desirability bias, and content validity using factor analysis were examined. Internal consistency was good (alpha =.95). Social desirability correlation was low (r =.095). Twelve factors identified were consistent with conceptual groupings of behaviors. Around two hundred caregivers from two CF centers were surveyed and multivariate analysis of variance was used to assess construct validity. Results confirmed expected relations between self-management, patient age, and disease status. Patient age accounted for 50% and disease status 18% of the variance in the SMQ-CF scale.^ It was hypothesized that self-management would positively affect future disease status. Data from 199 CF patients (control and education intervention groups) were examined. Models of hypothesized relations were tested using LISREL structural equation modeling. Results indicated that the relations between baseline self-management and Time 1 disease status were not significant. Significant relations were observed in self-management behaviors from time 1 to time 2 and patterns of significant relations differed between the two groups.^ This research has contributed to refinements in the ability to measure self-management behavior and disease status outcomes in cystic fibrosis. In addition, it provides the first steps in exploratory behavioral analysis with regard to self-management in this disease. ^

Comparing the factorial structure, invariance, and predictive validity of transtheoretical model constructs for alcohol use across restricted and unrestricted settings

With substance abuse treatment expanding in prisons and jails, understanding how behavior change interacts with a restricted setting becomes more essential. The Transtheoretical Model (TTM) has been used to understand intentional behavior change in unrestricted settings, however, evidence indicates restrictive settings can affect the measurement and structure of the TTM constructs. The present study examined data from problem drinkers at baseline and end-of-treatment from three studies: (1) Project CARE (n = 187) recruited inmates from a large county jail; (2) Project Check-In (n = 116) recruited inmates from a state prison; (3) Project MATCH, a large multi-site alcohol study had two recruitment arms, aftercare (n = 724 pre-treatment and 650 post-treatment) and outpatient (n = 912 pre-treatment and 844 post-treatment). The analyses were conducted using cross-sectional data to test for non-invariance of measures of the TTM constructs: readiness, confidence, temptation, and processes of change (Structural Equation Modeling, SEM) across restricted and unrestricted settings. Two restricted (jail and aftercare) and one unrestricted group (outpatient) entering treatment and one restricted (prison) and two unrestricted groups (aftercare and outpatient) at end-of-treatment were contrasted. In addition TTM end-of-treatment profiles were tested as predictors of 12 month drinking outcomes (Profile Analysis). Although SEM did not indicate structural differences in the overall TTM construct model across setting types, there were factor structure differences on the confidence and temptation constructs at pre-treatment and in the factor structure of the behavioral processes at the end-of-treatment. For pre-treatment temptation and confidence, differences were found in the social situations factor loadings and in the variance for the confidence and temptation latent factors. For the end-of-treatment behavioral processes, differences across the restricted and unrestricted settings were identified in the counter-conditioning and stimulus control factor loadings. The TTM end-of-treatment profiles were not predictive of drinking outcomes in the prison sample. Both pre and post-treatment differences in structure across setting types involved constructs operationalized with behaviors that are limited for those in restricted settings. These studies suggest the TTM is a viable model for explicating addictive behavior change in restricted settings but calls for modification of subscale items that refer to specific behaviors and caution in interpreting the mean differences across setting types for problem drinkers. ^