Factorial validity and invariance of questionnaires measuring social-cognitive determinants of physical activity among adolescent girls

Background There are few theoretically derived questionnaires of physical activity determinants among youth, and the existing questionnaires have not been subjected to tests of factorial validity and invariance, The present study employed confirmatory factor analysis (CFA) to test the factorial validity and invariance of questionnaires designed to be unidimensional measures of attitudes, subjective norms, perceived behavioral control, and self-efficacy about physical activity. Methods Adolescent girls in eighth grade from two cohorts (N = 955 and 1,797) completed the questionnaires at baseline; participants from cohort 1 (N = 845) also completed the questionnaires in ninth grade (i.e., 1-year follow-up). Factorial validity and invariance were tested using CFA with full-information maximum likelihood estimation in AMOS 4.0, Initially, baseline data from cohort 1 were employed to test the fit and, when necessary, to modify the unidimensional models. The models were cross-validated using a multigroup analysis of factorial invariance on baseline data from cohorts 1 and 2, The models then were subjected to a longitudinal analysis of factorial invariance using baseline and follow-up data from cohort i, Results The CFAs supported the fit of unidimensional models to the four questionnaires, and the models were cross-validated, as indicated by evidence of multigroup factorial invariance, The models also possessed evidence of longitudinal factorial invariance. Conclusions Evidence was provided for the factorial validity and the invariance of the questionnaires designed to be unidimensional measures of attitudes, subjective norms, perceived behavioral control, and self-efficacy about physical activity among adolescent girls, (C) 2000 American Health Foundation and academic Press.

Reliability and factorial validity of Adolescent Time Inventory-Time Attitude (ATI-TA) Scores in Scottish and Northern Irish adolescents

The contemporary literature investigating the construct broadly known as time perspective is replete with methodological and conceptual concerns. These concerns focus on the reliability and factorial validity of measurement tools, and the sample-specific modification of scales. These issues continue to hamper the development of this potentially useful psychological construct. An emerging body of evidence has supported the six-factor structure of scores on the Adolescent Time Inventory-Time Attitudes Scale, as well as their reliability. The present study utilized data from the first wave of a longitudinal study in the United Kingdom to examine the reliability, validity, and cross-cultural invariance of the scale. Results showed that the hypothesized six-factor model provided the best fit for the data; all alpha and omega estimates were >. .70; scores on ATI-TA factors related meaningfully to self-efficacy scores; and the factor structure was invariant across both research sites. Results are discussed in the context of the extant temporal literature.

The factorial validity of emotional intelligence : an unresolved issue

An unresolved but pertinent issue in the field of emotional intelligence (EI) is factorial validity. Numerous studies have investigated this issue (Gignac, 2005; Mayer, Salovey, Caruso, & Sitarenios, 2003; Petrides & Furnham, 2000; Saklofske, Austin, & Minski, 2003), but most are based on correlations among subscale scores from relevant measures, making the implicit assumption that subscale scores are unidimensional, rather than questioning the structure of subscales themselves. Accordingly, the present study adopts the Anderson and Gerbing (1988) two-step strategy of first considering the structure within subscales before examining the relationship between subscales. An evaluation was undertaken using the Emotional Intelligence Scale (EIS, Schutte et al., 1998), the Work Profile Questionnaire – Emotional Intelligence Version (WQPei, Cameron, 1999) and the Mayer–Salovey–Caruso Emotional Intelligence Test (MSCEIT V.2., Mayer, Salovey, & Caruso, 1999b). Results were characterised by instability, heterogeneity and inconsistency. Specifically, the EIS was not found to form the homogenous structure postulated by authors. Similarly, support was not found for the seven factor model of the WPQei. Large discrepancies exist between the one, two and four factor models described by Mayer et al. (2003) for the MSCEIT V.2. and the 21 components revealed at the primary level in the current analyses. Additionally, reliability statistics for the MSCEIT V.2. were less than optimal. Questions remain regarding the clarity, reliability and validity of the instruments examined.

Adolescent tobacco use: Studies of prevalence, factorial validity, and factorial invariance between African Americans and Whites

In the last thirty years, increasing efforts have been made to reduce the prevalence of adolescent tobacco use in the United States. Although the prevalence has declined dramatically over the past decade, there are still sharp differences in adolescent smoking-initiation rates across racial/ethnic groups. Large-scale surveys frequently assess smoking-related attitudes, self-efficacy, and intentions to explain the differences in smoking rates between African Americans and Whites. However, there is little agreement about which constructs are significant. Moreover, the psychometric properties of smoking-related attitude, self-efficacy, and intention constructs have not been fully examined. More studies are needed to understand existing patterns of tobacco use and to validate and fully exploit the constructs' relationship to adolescent smoking initiation across racial/ethnic groups. ^ This dissertation reports on a secondary analysis of data from a large multi-ethnic convenience sample of sixth- through eighth-grade students in 22 schools in East Texas and the city of Houston. The specific aims of this dissertation were to (1) describe smoking and alternate tobacco product use rates by race/ethnicity, gender, age, and grade level (Article 1); (2) test the factorial validity of smoking-related attitudes, self-efficacy, and intentions using confirmatory factor analysis techniques (Article 2); and (3) test the factorial invariance of smoking-related attitudes, self-efficacy, and intentions between African Americans and Whites (Article 3). ^ The prevalence findings confirm the disparities in tobacco use among African American, Hispanic, and White adolescents that other surveys have reported (Article 1). This study also demonstrates the usefulness of examining use patterns of not only cigarettes but also alternative tobacco products in younger multiethnic populations, as well as of providing epidemiological data estimates about different phases of smoking. The confirmatory factor analysis provides evidence of construct validity of attitude, self-efficacy, and intention scales for the multiethnic sample (Article 2). Finally, the factorial invariance analyses indicates that some measures representing smoking-related attitudes, self-efficacy, and intentions may not be appropriate for use among both African Americans and Whites (Article 3). Additional research is needed to further our understanding of the patterns and predictors of youth tobacco use initiation. ^

The reliability and factorial validity of the Adolescent Alcohol Involvement Scale in a large sample in the United Kingdom

The assessment of adolescent drinking behavior is a complex task, complicated by variability in drinking patterns, the transitory and developmental nature of the behavior and the reliance (for large scale studies) on self-report questionnaires. The Adolescent Alcohol Involvement Scale (Mayer & Filstead, 1979) is a 14-item screening tool designed to help to identify alcohol misusers or more problematic drinkers. The present study utilized a large sample (n = 4066) adolescents from Northern Ireland. Results of Confirmatory Factor Analyses and reliability estimates revealed that the 14-items share sufficient common variance that scores can be considered to be reliable and that the 14 items can be scored to provide a composite alcohol use score.

Extending the validity of the Feeding Practices and Structure Questionnaire

Background Feeding practices are commonly examined as potentially modifiable determinants of children’s eating behaviours and weight status. Although a variety of questionnaires exist to assess different feeding aspects, many lack thorough reliability and validity testing. The Feeding Practices and Structure Questionnaire (FPSQ) is a tool designed to measure early feeding practices related to non-responsive feeding and structure of the meal environment. Face validity, factorial validity, internal reliability and cross-sectional correlations with children’s eating behaviours have been established in mothers with 2-year-old children. The aim of the present study was to further extend the validity of the FPSQ by examining factorial, construct and predictive validity, and stability. Methods Participants were from the NOURISH randomised controlled trial which evaluated an intervention with first-time mothers designed to promote protective feeding practices. Maternal feeding practices (FP) and child eating behaviours were assessed when children were aged 2 years and 3.7 years (n=388). Confirmatory Factor analysis, group differences, predictive relationships, and stability were tested. Results The original 9-factor structure was confirmed when children were aged 3.7±0.3 years. Cronbach’s alpha was above the recommended 0.70 cut-off for all factors except Structured Meal Timing, Over Restriction and Distrust in Appetite which were 0.58, 0.67 and 0.66 respectively. Allocated group differences reflected behaviour consistent with intervention content and all feeding practices were stable across both time points (range of r= 0.45-0.70). There was some evidence for the predictive validity of factors with 2 FP showing expected relationships, 2 FP showing expected and unexpected relationships and 5 FP showing no relationship. Conclusions Reliability and validity was demonstrated for most subscales of the FPSQ. Future validation is warranted with culturally diverse samples and with fathers and other caregivers. The use of additional outcomes to further explore predictive validity is recommended as well as testing construct validity and test-retest reliability of the questionnaire.

Cross-validation of the factorial structure of the Neighborhood Environment Walkability Scale (NEWS) and its abbreviated form (NEWS-A)

Background : The Neighborhood Environment Walkability Scale (NEWS) and its abbreviated form (NEWS-A) assess perceived environmental attributes believed to influence physical activity. A multilevel confirmatory factor analysis (MCFA) conducted on a sample from Seattle, WA showed that, at the respondent level, the factor-analyzable items of the NEWS and NEWS-A measured 11 and 10 constructs of perceived neighborhood environment, respectively. At the census blockgroup (used by the US Census Bureau as a subunit of census tracts) level, the MCFA yielded five factors for both NEWS and NEWS-A. The aim of this study was to cross-validate the individual- and blockgroup-level measurement models of the NEWS and NEWS-A in a geographical location and population different from those used in the original validation study.

Methods : A sample of 912 adults was recruited from 16 selected neighborhoods (116 census blockgroups) in the Baltimore, MD region. Neighborhoods were stratified according to their socio-economic status and transport-related walkability level measured using Geographic Information Systems. Participants self-completed the NEWS. MCFA was used to cross-validate the individual- and blockgroup-level measurement models of the NEWS and NEWS-A.

Results : The data provided sufficient support for the factorial validity of the original individual-level measurement models, which consisted of 11 (NEWS) and 10 (NEWS-A) correlated factors. The original blockgroup-level measurement model of the NEWS and NEWS-A showed poor fit to the data and required substantial modifications. These included the combining of aspects of building aesthetics with safety from crime into one factor; the separation of natural aesthetics and building aesthetics into two factors; and for the NEWS-A, the separation of presence of sidewalks/walking routes from other infrastructure for walking.

Conclusion : This study provided support for the generalizability of the individual-level measurement models of the NEWS and NEWS-A to different urban geographical locations in the USA. It is recommended that the NEWS and NEWS-A be scored according to their individual-level measurement models, which are relatively stable and correspond to constructs commonly used in the urban planning and transportation fields. However, prior to using these instruments in international and multi-cultural studies, further validation work across diverse non-English speaking countries and populations is needed.

Validity and reliability of the Portuguese version of Mandibular Function Impairment Questionnaire

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

The Short-EMBU in Australia, Spain, and Venezuela - Factorial invariance, and associations with sex roles, self-esteem, and Eysenckian personality dimensions

The short(s)-EMBU (Swedish acronym for Egna Minnen Betraffande Uppfostran [My memories of upbringing]) consists of 23 items, is based on the early 81-item EMBU, and was developed out of the necessity of having a brief measure of perceived parental rearing practices when the clinical and/or research context does not adequately permit application of time-consuming test batteries. The s-EMBU comprises three subscales: Rejection., Emotional Warmth, and (Over)Protection. The factorial and/or construct validity and reliability of the s-EMBU were examined in samples comprising a total of 1950 students from Australia, Spain, and Venezuela. The data were presented for the three national groups separately. Findings confirmed the cross-national validity of the factorial structure underlying the s-EMBU. Rejection by fathers and mothers was consistently associated with high trait-neuroticism and low self-esteem in recipients of both sexes in each nation, as was high parental emotional warmth with high femininity (humility). The findings on factorial validity are in keeping with previous ones obtained in East Germany, Greece, Guatemala, Hungary, Italy, and Sweden. The s-EMBU is again recommended for use in several different countries as. a reliable, functional equivalent to the original 81-item EMBU.

Validity and reliability of the Cyber-aggression Questionnaire for Adolescents (CYBA)

Cybercrime is a growing and worrisome problem, particularly when it involves minors. Cyber-aggression among adolescents in particular can result in negative legal and psychological consequences for people involved. Therefore, it is important to have instruments to detect these incidents early and understand the problem to propose effective measures for prevention and treatment. This paper aims to design a new self-report, the Cyber-Aggression Questionnaire for Adolescents (CYBA), to evaluate the extent to which the respondent conducts aggressions through a mobile phone or the internet and analyse the factorial and criterion validity and reliability of their scores in a sample of adolescents from Asturias, Spain. The CYBA was administered to 3,148 youth aged between 12 and 18 years old along with three self-reports to measure aggression at school, impulsivity, and empathy. Regarding factorial validity, the model that best represents the structure of the CYBA consists of three factors (Impersonation, Visual-sexual Cyber-aggression, and Verbal Cyber-aggression and Exclusion) and four additional indicators of Visual Cyber-aggression-Teasing/Happy Slapping. Regarding criterion validity, the score on the CYBA correlates positively with aggression at school and impulsivity and negatively with empathy. That is the way cyber-aggression correlates with these three variables, according to previous empirical evidence. The reliability of the scores on each item and factor of the CYBA are adequate. Therefore, the CYBA offers a valid and reliable measure of cyber-aggression in adolescents.

Validity and reliability of questionnaires measuring physical activity self-efficacy, enjoyment, social support among Hong Kong Chinese children

BACKGROUND: Physical activity (PA) correlates have not been extensively studied in Hong Kong children.

OBJECTIVE: The aim of this study is to assess the validity and reliability of translated scales to measure PA related self-efficacy, enjoyment and social support in Hong Kong Chinese children.

METHODS: Sample 1 (n = 273, aged 8-12 years) was recruited (May-June, 2013) from two primary schools. Confirmatory factor analyses (CFA) were conducted to assess factorial validity. Criterion validity was assessed by correlating measured constructs with self-reported PA. Cronbach's alpha was computed to assess scale internal consistency. The intraclass correlation coefficient (ICC) was performed to assess scale test-retest reliability. Criterion validity was further examined in Sample 2 (n = 84, aged 8-12 years) from a third school by correlating measured constructs with objectively measured PA collected in September 2013 and February 2014.

RESULTS: The CFA results supported the one-factor structure of the scales. All PA correlates were significantly (p < 0.01) associated with self-reported PA in Sample 1. Self-efficacy and enjoyment were significantly (p < 0.05) correlated with objectively measured PA in Sample 2. All the scales demonstrated acceptable internal consistency. All ICC values of the scales suggested acceptable test-retest reliability.

CONCLUSION: The results provide psychometric support for using the scales to measure PA correlates among Hong Kong Chinese children.

The Melbourne Decision-Making Questionnaire : an instrument for measuring patterns for coping with decisional conflict

A study was conducted to examine the factorial validity of the Flinders Decision Making Questionnaire (Mann, 1982), a 31-item self-report inventory designed to measure tendencies to use three major coping patterns identified in the conflict theory of decision making (Janis and Mann, 1977): vigilance, hypervigilance, and defensive avoidance (procrastination, buck-passing, and rationalization). A sample of 2051 university students, comprising samples from Australia (n=262), New Zealand (n=260), the USA (n=475), Japan (n=359), Hong Kong (n=281) and Taiwan (n=414) was administered the DMQ. Factorial validity of the instrument was tested by confirmatory factor analysis with LISREL. Five different substantive models, representing different structural relationships between the decision-coping patterns had unsatisfactory fit to the data and could not be validated. A shortened instrument, containing 22 items, yielded a revised model comprising four identifiable factors-vigilance, hypervigilance, buck-passing, and procrastination. The revised model had adequate fit with data for each country sample and for the total sample, and was confirmed. It is recommended that the 22-item instrument, named the Melbourne DMQ, replace the Flinders DMQ for measurement of decision-coping patterns.

A confirmatory factor analysis of the Toronto Alexithymia Scale (TAS-20) in an alcohol-dependent sample

Confirmatory factor analyses were conducted to evaluate the factorial validity of the Toronto Alexithymia Scale in an alcohol-dependent sample. Several factor models were examined, but all models were rejected given their poor fit. A revision of the TAS-20 in alcohol-dependent populations may be needed.

Safety in occupational driving : development of a driver behaviour scale for the workplace context

International statistics indicate that occupational, or work-related driving, crashes are the most common cause of workplace injury, death, and absence from work. The majority of research examining unsafe driver behavior in the workplace has relied on general road safety questionnaires. However, past research has failed to consider the organizational context in the use of these questionnaires, and as such, there is ambiguity in the dimensions constituting occupational driving. Using a theoretical model developed by Hockey (1993, 1997), this article proposes and validates a new scale of occupational driver behavior. This scale incorporates four dimensions of driver behavior that are influenced by demanding workplace conditions; speeding, rule violation, inattention, and driving while tired. Following a content validation process, three samples of occupational drivers in Australia were used to assess the scale. Data from the first sample (n=145) were used to reduce the number of scale items and provide an assessment of the factorial validity of the scale. Data from the second sample (n=645) were then used to confirm the factor structure and psychometric properties of the scale including reliability and construct validity. Finally, data from the third sample (n=248) were used to establish criterion validity. The results indicated that the scale is a reliable and valid measure of occupational driver behavior.