Paving the way for the use of the SDQ in economic evaluations of school-based population health interventions: an empirical analysis of the external validity of SDQ mapping algorithms to the CHU9D in an educational setting

Purpose
The Strengths and Difficulties Questionnaire (SDQ) is a behavioural screening tool for children. The SDQ is increasingly used as the primary outcome measure in population health interventions involving children, but it is not preference based; therefore, its role in allocative economic evaluation is limited. The Child Health Utility 9D (CHU9D) is a generic preference-based health-related quality of-life measure. This study investigates the applicability of the SDQ outcome measure for use in economic evaluations and examines its relationship with the CHU9D by testing previously published mapping algorithms. The aim of the paper is to explore the feasibility of using the SDQ within economic evaluations of school-based population health interventions.
Methods
Data were available from children participating in a cluster randomised controlled trial of the school-based roots of empathy programme in Northern Ireland. Utility was calculated using the original and alternative CHU9D tariffs along with two SDQ mapping algorithms. t tests were performed for pairwise differences in utility values from the preference-based tariffs and mapping algorithms.
Results
Mean (standard deviation) SDQ total difficulties and prosocial scores were 12 (3.2) and 8.3 (2.1). Utility values obtained from the original tariff, alternative tariff, and mapping algorithms using five and three SDQ subscales were 0.84 (0.11), 0.80 (0.13), 0.84 (0.05), and 0.83 (0.04), respectively. Each method for calculating utility produced statistically significantly different values except the original tariff and five SDQ subscale algorithm.
Conclusion
Initial evidence suggests the SDQ and CHU9D are related in some of their measurement properties. The mapping algorithm using five SDQ subscales was found to be optimal in predicting mean child health utility. Future research valuing changes in the SDQ scores would contribute to this research.

On the external validity of laboratory experiments

Thèse numérisée par la Division de la gestion de documents et des archives de l'Université de Montréal

Sociality and external validity in experimental economics

It is sometimes argued that experimental economists do not have to worry about external validity so long as the design sticks closely to a theoretical model. This position mistakes the model for the theory. As a result, applied economics designs often study phenomena distinct from their stated objects of inquiry. Because the implemented models are abstract, they may provide improbable analogues to their stated subject matter. This problem is exacerbated by the relational character of the social world, which also sets epistemic limits for the social science laboratory more generally.

Diabetes prevention research: a systematic review of external validity in lifestyle interventions

Context

Type 2 diabetes is a major contributor to disease burden globally. A number of systematic reviews support the efficacy of lifestyle interventions in preventing Type 2 diabetes in adults; however, relatively little attention has been paid to the generalizability of study findings. This study systematically reviews the reporting of external validity components and generalizability of diabetes prevention studies.

Evidence acquisition

Lifestyle intervention studies for the prevention of Type 2 diabetes in adults with at least 6 months' follow-up, published between 1990 and 2011, were identified through searches of major electronic databases. External validity reporting was rated using an assessment tool, and all analysis was undertaken in 2011.

Evidence synthesis

A total of 31 primary studies (n=95 papers) met the selection criteria. All studies lacked full reporting on external validity elements. Description of the study sample, intervention, delivery agents, and participant attrition rates were reported by most studies. However, few studies reported on the representativeness of individuals and settings, methods for recruiting settings and delivery agents, costs, and how interventions could be institutionalized into routine service delivery. It is uncertain to what extent the findings of diabetes prevention studies apply to men, socioeconomically disadvantaged individuals, those living in rural and remote communities, and to low- and middle-income countries.

Conclusions

Reporting of external validity components in diabetes prevention studies needs to be enhanced to improve the evidence base for the translation and dissemination of these programs into policy and practice.

How to assess the external validity of therapeutic trials: a conceptual approach

Background External validity of study results is an important issue from a clinical point of view. From a methodological point of view, however, the concept of external validity is more complex than it seems to be at first glance. Methods Methodological review to address the concept of external validity. Results External validity refers to the question whether results are generalizable to persons other than the population in the original study. The only formal way to establish the external validity would be to repeat the study for that specific target population. We propose a three-way approach for assessing the external validity for specified target populations. (i) The study population might not be representative for the eligibility criteria that were intended. It should be addressed whether the study population differs from the intended source population with respect to characteristics that influence outcome. (ii) The target population will, by definition, differ from the study population with respect to geographical, temporal and ethnical conditions. Pondering external validity means asking the question whether these differences may influence study results. (iii) It should be assessed whether the study's conclusions can be generalized to target populations that do not meet all the eligibility criteria. Conclusion Judging the external validity of study results cannot be done by applying given eligibility criteria to a single target population. Rather, it is a complex reflection in which prior knowledge, statistical considerations, biological plausibility and eligibility criteria all have place.

The 12-Item General Health Questionnaire (GHQ-12): Reliability,external validity and factor structure in the Spanish population

The purpose of this study was to analyze the internal consistency and the external and structure validity of the 12-Item General Health Questionnaire (GHQ-12) in the Spanish general population. A stratified sample of 1001 subjects, ages between 25 and 65 years, taken from the general Spanish population was employed. The GHQ-12 and the Inventory of Situations and Responses of Anxiety-ISRA were administered. A Cronbach’s alpha of .76 (Standardized Alpha: .78) and a 3-factor structure (with oblique rotation and maximum likelihood procedure) were obtained. External validity of Factor I (Successful Coping) with the ISRA is very robust (.82; Factor II, .70; Factor III, .75). The GHQ-12 shows adequate reliability and validity in the Spanish population. Therefore, the GHQ-12 can be used with efficacy to assess people’s overall psychological well-being and to detect non-psychotic psychiatric problems. Additionally, our results confirm that the GHQ-12 can best be thought of as a multidimensional scale that assesses several distinct aspects of distress, rather than just a unitary screening measure.

Evaluating the external validity of comorbid disorders in youth using rating scales and behavior observations

To evaluate the theoretical underpinnings of current categorical approaches to classify childhood psychopathological conditions, this dissertation examined whether children with a single diagnosis of an anxiety disorder (ANX only) and children with an anxiety diagnosis comorbid with other diagnoses (i.e., anxiety + anxiety disorder [ANX + ANX], anxiety + depressive disorder [ANX + DEP], and anxiety + disruptive disorder [ANX + EXT]) could be differentiated using external validation criteria of clinical phenomenology (i.e., levels of anxiety, depression, and internalizing, externalizing and total behavior problems). This study further examined whether the four groups could be differentiated in terms of their interaction patterns with their parents and peers, respectively. The sample consisted of 129 youth and their parents who presented to the Child Anxiety and Phobia Program (CAPP) housed within the Child and Family Psychosocial Research Center at Florida International University, Miami. Youth were between the ages of 8 and 14 years old. A battery of questionnaires was used to assess participants' clinical presentation in terms of levels of anxiety, depression, and internalizing and externalizing symptoms. Family and peer interaction were evaluated through rating scales and through behavior observation tasks. Statistics based on the parameter estimates of the structured equation models indicated that all the comorbid groups were significantly different from the pure anxiety disorder group when it came to depression indices of clinical phenomenology. Further, significant differences appeared mainly in terms of the ANX + DEP comorbid group relative to the other comorbid groups. In terms of Parent-child interaction the ANX + EXT and the ANX + DEP comorbid groups were differentiated from the pure anxiety disorder and ANX + ANX comorbid group when it came to the appraisal of the parent/child relationship by the parent, and the acceptance subscale according to the mother report. In terms of peer-child interaction the ANX + EXT and the ANX + DEP comorbid groups were statistically significantly different from the pure anxiety disorder only when it came to the positive interactions and the social skills as rated by mother. Limitations and future research recommendations are discussed.

The internal validity of web-based studies

Honing and Ladinig (2008) make the assertion that while the internal validity of web-based studies may be reduced, this is offset by an increase in external validity possible when experimenters can sample a wider range of participants and experimental settings. In this paper, the issue of internal validity is more closely examined, and it is agued that there is no necessary reason why internal validity of a web-based study should be worse than that of a lab-based one. Errors of measurement or inconsistencies of manipulation will typically balance across conditions of the experiment, and thus need not necessarily threaten the validity of a study’s findings.

Quantitative data collection and study validity

The quality of data collection methods selected and the integrity of the data collected are integral tot eh success of a study. This chapter focuses on data collection and study validity. After reading the chapter, readers should be able to define types of data collection methods in quantitative research; list advantages and disadvantages of each method; discuss factors related to internal and external validity; critically evaluate data collection methods and discuss the need to operationalise variables of interest for data collection.

External validation study of a clinical prediction rule for ambulation outcomes after traumatic spinal cord injury

The main objective of this study was to determine the external validity of a clinical prediction rule developed by the European Multicenter Study on Human Spinal Cord Injury (EM-SCI) to predict the ambulation outcomes 12 months after traumatic spinal cord injury. Data from the North American Clinical Trials Network (NACTN) data registry with approximately 500 SCI cases were used for this validity study. The predictive accuracy of the EM-SCI prognostic model was evaluated using calibration and discrimination based on 231 NACTN cases. The area under the receiver-operating-characteristics curve (ROC) curve was 0.927 (95% CI 0.894 – 0.959) for the EM-SCI model when applied to NACTN population. This is lower than the AUC of 0.956 (95% CI 0.936 – 0.976) reported for the EM-SCI population, but suggests that the EM-SCI clinical prediction rule distinguished well between those patients in the NACTN population who were able to achieve independent ambulation and those who did not achieve independent ambulation. The calibration curve suggests that higher the prediction score is, the better the probability of walking with the best prediction for AIS D patients. In conclusion, the EM-SCI clinical prediction rule was determined to be generalizable to the adult NACTN SCI population.^

Development of the benefit finding in multiple sclerosis (MS) caregiving scale: A longitudinal study of relations between benefit finding and adjustment

Benefit finding is a meaning making construct that has been shown to be related to adjustment in people with MS and their carers. This study investigated the dimensions, stability and potency of benefit finding in predicting adjustment over a 12 month interval using a newly developed Benefit Finding in Multiple Sclerosis Scale (BFiMSS). Usable data from 388 persons with MS and 232 carers was obtained from questionnaires completed at Time 1 and 12 months later (Time 2). Factor analysis of the BFiMSS revealed seven psychometrically sound factors: Compassion/Empathy, Spiritual Growth, Mindfulness, Family Relations Growth, Life Style Gains, Personal Growth, New Opportunities. BFiMSS total and factors showed satisfactory internal and retest reliability coefficients, and convergent, criterion and external validity. Results of regression analyses indicated that the Time 1 BFiMSS factors accounted for significant amounts of variance in each of the Time 2 adjustment outcomes (positive states of mind, positive affect, anxiety, depression) after controlling for Time 1 adjustment, and relevant demographic and illness variables. Findings delineate the dimensional structure of benefit finding in MS, the differential links between benefit finding dimensions and adjustment and the temporal unfolding of benefit finding in chronic illness.