EVIDENCE OF VALIDITY OF THE LSB-50: CROSS-VALIDATION, FACTORIAL INVARIANCE AND EXTERNAL CRITERION ANALYSIS

The aim of this paper was to obtain evidence of the validity of the LSB-50 (de Rivera & Abuín, 2012), a screening measure of psychopathology, in Argentinean adolescents. The sample consisted of 1002 individuals (49.7% male; 50.3% female) between 12 and 18 years-old (M = 14.98; SD = 1.99). A cross-validation study and factorial invariance studies were performed in samples divided by sex and age to test if a seven-factor structure that corresponds to seven clinical scales (Hypersensitivity, Obsessive-Compulsive, Anxiety, Hostility, Somatization, Depression, and Sleep disturbance) was adequate for the LSB-50. The seven-factor structure proved to be suitable for all the subsamples. Next, the fit of the seven-factor structure was studied simultaneously? in the aforementioned subsamples through hierarchical models that imposed different constrains of equivalency?. Results indicated the invariance of the seven clinical dimensions of the LSB-50. Ordinal alphas showed good internal consistency for all the scales. Finally, the correlations with a diagnostic measure of psychopathology (PAI-A) indicated moderate convergence. It is concluded that the analyses performed provide robust evidence of construct validity for the LSB-50

Satisfaction with Life Scale among adolescents and young adults in Portugal: extending evidence of construct validity

The paper presents three empirical studies designed to extend the test of the construct validity of the Satisfaction With Life Scale (SWLS) among Portuguese students. In the first study, the responses of 461 elementary and secondary education students were submitted to a principal component analysis. A solution of one single factor was chosen, accounting for 55.7 % of the total variance, with Cronbach alpha coefficient and inter-item correlation above .70 and .20, respectively. The second study used a sample of 317 undergraduate students and registered a similar factor solution for SWLS (/pq = 0.99), which accounted for 65.6 % of the total variance (Cronbach alpha .89 and inter-item correlation above .20). A test–retest analysis registered coefficients of .70 (T2) and .77 (T3) and no significant statistically differences between T2, T3 and T1. The third study used a sample of 107 foster care youths from elementary and secondary education. Confirmatory factor analysis results indicate adequate fit indexes for the one-factor solution (v2/df = 2.70, GFI = .96, CFI = .96), which showed convergent validity, reliability and homogeneity. In conclusion, there is psychometric evidence for the one-factor structure of the SWLS in Portugal.

Evidence for validity and reliability of a french version of the FAAM.

BACKGROUND: The Foot and Ankle Ability Measure (FAAM) is a self reported questionnaire for patients with foot and ankle disorders available in English, German, and Persian. This study plans to translate the FAAM from English to French (FAAM-F) and assess the validity and reliability of this new version.METHODS: The FAAM-F Activities of Daily Living (ADL) and sports subscales were completed by 105 French-speaking patients (average age 50.5 years) presenting various chronic foot and ankle disorders. Convergent and divergent validity was assessed by Pearson's correlation coefficients between the FAAM-F subscales and the SF-36 scales: Physical Functioning (PF), Physical Component Summary (PCS), Mental Health (MH) and Mental Component Summary (MCS). Internal consistency was calculated by Cronbach's Alpha (CA). To assess test re-test reliability, 22 patients filled out the questionnaire a second time to estimate minimal detectable changes (MDC) and intraclass correlation coefficients (ICC).RESULTS: Correlations for FAAM-F ADL subscale were 0.85 with PF, 0.81 with PCS, 0.26 with MH, 0.37 with MCS. Correlations for FAAM-F Sports subscale were 0.72 with PF, 0.72 with PCS, 0.21 with MH, 0.29 with MCS. CA estimates were 0.97 for both subscales. Respectively for the ADL and Sports subscales, ICC were 0.97 and 0.94, errors for a single measure were 8 and 10 points at 95% confidence and the MDC values at 95% confidence were 7 and 18 points.CONCLUSION: The FAAM-F is valid and reliable for the self-assessment of physical function in French-speaking patients with a wide range of chronic foot and ankle disorders.

Premières évidences de la validité de l'échelle de désengagement moral pour des actes discriminatoires (Initial evidence of the validity of a scale on moral disengagement in discriminatory behavior)

De nombreuses études ont mis en évidence le fait que les individus étaient prêts à commettre des actes discriminatoires pour autant qu'ils puissent les justifier (Crandall & Eshleman, 2003). Nous proposons de contribuer à la compréhension de ce phénomène grâce au concept de désengagement moral pour des actes discriminatoires (DMD). Nous définissons le désengagement moral comme le fait de justifier ses propres actes immoraux de manière à les rendre acceptable. Ce concept trouve ses origines dans les travaux de Bandura et al. (1996) portant sur les comportements agressifs chez des enfants. Il se compose de huit mécanismes (p.ex. le déplacement de responsabilité). Notre recherche dépasse le cadre théorique développé par Bandura et al. pour inscrire le désengagement moral dans le champ de la discrimination intergroupe. De plus, en conceptualisant le désengagement moral comme une différence individuelle, nous proposons également de présenter les premières étapes du développement d'une échelle permettant de mesurer le DMD. L'échelle de DMD a été développée en trois étapes en suivant la procédure proposée par Hinkin (1998). Tout d'abord, une liste de 72 items a été générée suivant une méthode déductive. Puis, suite à une étude (n = 13) portant sur la cohérence des items vis-à-vis du concept et de ses mécanismes, cette liste a été réduite à 40 items (5 par mécanisme). Enfin, 118 étudiants universitaires ont participé à une étude dans le but de mener des analyses factorielles (exploratoire et confirmatoire), ainsi que de tester les validités convergente, divergente et prédictive de l'échelle. La première partie de cette étude se composait de différentes échelles (p.ex. mesure de personnalité, préjugés anti-immigrés, etc.). La seconde partie de l'étude était une expérience portant sur l'évaluation d'idées de méthodes de sélection (discriminatoire versus méritocratique) des étudiants suisses et étrangers à l'université, ayant pour but de réduire la surpopulation dans les salles de cours. Les résultats obtenus sont prometteurs pour le développement de l'échelle, autant du point de vue de sa structure (p.ex. α = .82) que de sa validité. Par exemple, plus le niveau de DMD des participants était élevé, plus ils étaient favorables à une méthode de sélection discriminatoire des étudiants à l'université. L'ensemble des résultats sera présenté durant la conférence. Nous discuterons également des potentielles contributions de cette échelle pour de futurs projets de recherche. Référence : Bandura, A., Barbaranelli, C., Caprara, G. V., & Pastorelli, C. (1996). Mechanisms of moral disengagement of the exercise of moral agency. Journal of Personality and Social Psychology, 71 (2), 364-374. Crandall, C. S., & Eshleman, A. (2003). The Justification-suppression model of the expression and experience of prejudice. Psychological Bulletin, 129 (3), 414-446. Hinkin, T. R. (1998). A brief tutorial on the development of measures for use un survey questionnaires. Organizational Research Methods, 1 (1), 104.121.

Further validity evidence of the Behavioral Inhibition Observation System (BIOS)

Resumen tomado de la publicaci??n

Evidence of reliability and validity of IPAQ for Mexican-American adults

Physical activity is a key component of life-style modification process which helps to reduce the risk of developing chronic diseases. It is important to have accurate estimates of physical activity to identify sedentary populations where interventions might be helpful. The International Physical Activity Questionnaire (IPAQ) short version has been used to estimate physical activity in diverse populations. However, there is little literature depicting the use of the IPAQ short version in Mexican America population. This study addressed the predictive validity and test-retest reliability of the IPAQ short version in Mexican American adults. The analysis was performed on 97 participants enrolled in the Cameron County Hispanic Cohort. Individuals selected in this study were 18 years of age or older. The predictive validity was evaluated by studying the relationship between physical activity and biomarkers known to be correlated with physical activity, namely, TNF-α, Adiponectin, and HDL. Multiple linear regression analysis was performed to delineate predictive validity. To assess test-retest reliability, two IPAQ-short last seven days questionnaires were interviewer administered to the participants on the same day, approximately two hours apart. Test-Retest reliability of IPAQ was estimated by performing intraclass correlations between the readings at two different time periods. The study showed that the IPAQ – short version used in the above study had acceptable test-retest reliability in the Mexican American population. This study showed that the IPAQ – short version did not have acceptable predictive validity when looking at physical activity and TNF-α, Adiponectin, and HDL in this sample.^

Reliability and Validity Evidence of Scores on the French Version of the Questionnaire about Interpersonal Difficulties for Adolescents

This study examined the reliability and validity evidence drawn from the scores of the French version of the Questionnaire about Interpersonal Difficulties for Adolescents (QIDA) in a sample of 957 adolescents (48.5% boys) ranging in age from 11 to 18 years (M = 14.48, SD = 1.85). A principal axis factoring (PAF) and confirmatory factor analyses (CFA) were performed to determine the fit of the factor structure of scores on the QIDA. PAF and CFA replicated the previously identified correlated five-factor structure of the QIDA: Assertiveness, Heterosexual Relationships, Public Speaking, Family Relationships, and Close Friendships. The QIDA yielded acceptable reliability scores for French adolescents. Validity evidence of QIDA was also established through correlations with scores on the School Anxiety Inventory and the Social Anxiety Scale for Adolescents. Most of the correlations were positive and exceeded the established criteria of statistical significance, but the magnitude of these varied according to the scales of the QIDA. Results supported the reliability and validity evidence drawn from the scores of the French version of the QIDA.

Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review.

BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias and outcome reporting bias have been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. METHODOLOGY/PRINCIPAL FINDINGS: In this update, we review and summarise the evidence from cohort studies that have assessed study publication bias or outcome reporting bias in randomised controlled trials. Twenty studies were eligible of which four were newly identified in this update. Only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Fifteen of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: This update does not change the conclusions of the review in which 16 studies were included. Direct empirical evidence for the existence of study publication bias and outcome reporting bias is shown. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.

Face and content validity of smoking-related and matched control pictures

Smoking-related pictures and matched controls are useful tools in experimental tasks of attentional bias. Noteworthy the procedures used to produce and validate these pairs of pictures are poorly reported. This study aimed to describe the production and evidence of validity of a set of smoking-related pictures and their matched controls. Two studies were conducted to assess validity. An online internet-based survey was used to assess face validity of 12 pictures related to smoking behavior and 12 matched controls. All pictures were colored and were 95mm length x 130mm width. Participants were asked if the pictures were related or not to the smoking behavior and also rated how much each picture was related to smoking behavior. The second study investigated attentional bias in smokers (n = 47) and non-smokers (n = 50), and examined how they assessed all pictures in terms of pleasantness and the 12 smoking-related pictures in terms of relevance to their own smoking behavior. Craving was assessed before and after the experiment. Results indicate that this set of pictures are valid since smoking-related pictures were considered more related to smoking behavior compared to their matched controls. Moreover, smokers showed greater attentional bias for smoking-related pictures than non-smokers. Craving and relevance of the smoking-related pictures were higher in smokers than in non-smokers. Smokers considered smoking-related pictures them less unpleasant than non-smokers. These findings provide evidence of face and content validity of this set of pictures, which will be available to researchers, contributing to maximize the standardization of future investigations.

Evidence of dispersion relations for the nonlinear response of the Lorenz 63 system

Along the lines of the nonlinear response theory developed by Ruelle, in a previous paper we have proved under rather general conditions that Kramers-Kronig dispersion relations and sum rules apply for a class of susceptibilities describing at any order of perturbation the response of Axiom A non equilibrium steady state systems to weak monochromatic forcings. We present here the first evidence of the validity of these integral relations for the linear and the second harmonic response for the perturbed Lorenz 63 system, by showing that numerical simulations agree up to high degree of accuracy with the theoretical predictions. Some new theoretical results, showing how to derive asymptotic behaviors and how to obtain recursively harmonic generation susceptibilities for general observables, are also presented. Our findings confirm the conceptual validity of the nonlinear response theory, suggest that the theory can be extended for more general non equilibrium steady state systems, and shed new light on the applicability of very general tools, based only upon the principle of causality, for diagnosing the behavior of perturbed chaotic systems and reconstructing their output signals, in situations where the fluctuation-dissipation relation is not of great help.

Construct validity of a figure rating scale for Brazilian adolescents

Background: Figure rating scales were developed as a tool to determine body dissatisfaction in women, men, and children. However, it lacks in the literature the validation of the scale for body silhouettes previously adapted. We aimed to obtain evidence for construct validity of a figure rating scale for Brazilian adolescents.Methods: The study was carried out with adolescent students attending three public schools in an urban region of the municipality of Florianopolis in the State of Santa Catarina (SC). The sample comprised 232 10-19-year-old students, 106 of whom are boys and 126 girls, from the 5th series (i.e. year) of Primary School to the 3rd year of Secondary School. Data-gathering involved the application of an instrument containing 8 body figure drawings representing a range of children's and adolescents' body shapes, ranging from very slim (contour 1) to obese (contour 8). Weights and heights were also collected, and body mass index (BMI) was calculated later. BMI was analyzed as a continuous variable, using z-scores, and as a dichotomous categorical variable, representing a diagnosis of nutritional status (normal and overweight including obesity).Results: Results showed that both males and females with larger BMI z-scores chose larger body contours. Girls with higher BMI z-scores also show higher values of body image dissatisfaction.Conclusion: We provided the first evidence of validity for a figure rating scale for Brazilian adolescents.

Systematic review of the empirical evidence of study publication bias and outcome reporting bias

BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias has been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. Until recently, outcome reporting bias has received less attention. METHODOLOGY/PRINCIPAL FINDINGS: We review and summarise the evidence from a series of cohort studies that have assessed study publication bias and outcome reporting bias in randomised controlled trials. Sixteen studies were eligible of which only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Eleven of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: Recent work provides direct empirical evidence for the existence of study publication bias and outcome reporting bias. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.

Comparing the validity and output of the GT1M and GT3X accelerometer in 5- to 9-year-old children

The purpose of this study was to compare the validity and output of the biaxial ActiGraph GT1M and the triaxial GT3X (ActiGraph, LLC, Pensacola, FL, USA)accelerometer in 5- to 9-year-old children. Thirty-two children wore the two monitors while their energy expenditure was measured with indirect calorimetry. They performed four locomotor and four play activities in an exercise laboratory and were further measured during 12 minutes of a sports lesson. Validity evidence in relation to indirect calorimetry was examined with linear regression equations applied to the laboratory data. During the sports lessons predicted energy expenditure according to the regression equations was compared to measured energy expenditure with the Wilcoxon-signed rank test and the Spearman correlation. To compare the output, agreement between counts of the two monitors during the laboratory activities was assessed with Bland-Altman plots. The evidence of validity was similar for both monitors. Agreement between the output of the two monitors was good for vertical counts (mean bias = −14 ± 22 counts) but not for horizontal counts (−17 ± 32 counts). The current results indicate that the two accelerometer models are able to estimate energy expenditure of a range of physical activities equally well in young children. However, they show output differences for movement in the horizontal direction.

Evidence of the presence of bias in subjective metrics: analysis within a family of experiments

Context: Measurement is crucial and important to empirical software engineering. Although reliability and validity are two important properties warranting consideration in measurement processes, they may be influenced by random or systematic error (bias) depending on which metric is used. Aim: Check whether, the simple subjective metrics used in empirical software engineering studies are prone to bias. Method: Comparison of the reliability of a family of empirical studies on requirements elicitation that explore the same phenomenon using different design types and objective and subjective metrics. Results: The objectively measured variables (experience and knowledge) tend to achieve more reliable results, whereas subjective metrics using Likert scales (expertise and familiarity) tend to be influenced by systematic error or bias. Conclusions: Studies that predominantly use variables measured subjectively, like opinion polls or expert opinion acquisition.