Guidelines on how to assess the validity of results presented in subgroup analysis of clinical trials

In observational studies, identification of associations within particular subgroups is the usual method of investigation. As an exploratory method, it is the bread and butter of epidemiological research. Nearly everything that has been learned in epidemiology has been derived from the analysis of subgroups. In a randomized clinical trial, the entire purpose is the comparison of the test subjects and the controls, and when there is particular interest in the results of treatment in a certain section of trial participants, a subgroup analysis is performed. These subgroups are examined to see if they are liable to a greater benefit or risk from treatment. Thus, analyzing patient subsets is a natural part of the process of improving therapeutic knowledge through clinical trials. Nevertheless, the reliability of subgroup analysis can often be poor because of problems of multiplicity and limitations in the numbers of patients studied. The naive interpretation of the results of such examinations is a cause of great confusion in the therapeutic literature. We emphasize the need for readers to be aware that inferences based on comparisons between subgroups in randomized clinical trials should be approached more cautiously than those based on the main comparison. That is, subgroup analysis results derived from a sound clinical trial are not necessarily valid; one must not jump to conclusions and accept the validity of subgroup analysis results without an appropriate judgment.

Satisfaction with Life Scale among adolescents and young adults in Portugal: extending evidence of construct validity

The paper presents three empirical studies designed to extend the test of the construct validity of the Satisfaction With Life Scale (SWLS) among Portuguese students. In the first study, the responses of 461 elementary and secondary education students were submitted to a principal component analysis. A solution of one single factor was chosen, accounting for 55.7 % of the total variance, with Cronbach alpha coefficient and inter-item correlation above .70 and .20, respectively. The second study used a sample of 317 undergraduate students and registered a similar factor solution for SWLS (/pq = 0.99), which accounted for 65.6 % of the total variance (Cronbach alpha .89 and inter-item correlation above .20). A test–retest analysis registered coefficients of .70 (T2) and .77 (T3) and no significant statistically differences between T2, T3 and T1. The third study used a sample of 107 foster care youths from elementary and secondary education. Confirmatory factor analysis results indicate adequate fit indexes for the one-factor solution (v2/df = 2.70, GFI = .96, CFI = .96), which showed convergent validity, reliability and homogeneity. In conclusion, there is psychometric evidence for the one-factor structure of the SWLS in Portugal.

Validity of the Brazilian Portuguese version of the bipolar spectrum diagnostic scale

OBJECTIVE: Bipolar spectrum disorders (BSDs) are prevalent and frequently unrecognized and undertreated. This report describes the development and validation of the Brazilian version of the bipolar spectrum diagnostic scale (B-BSDS), a screening instrument for bipolar disorders, in an adult psychiatric population. METHOD: 114 consecutive patients attending an outpatient psychiatric clinic completed the B-BSDS. A research psychiatrist, blind to the B-BSDS scores, interviewed patients by means of a modified version of the mood module of the Structured Clinical Interview for DSM-IV ("gold standard"). Subthreshold bipolar disorders were defined as recurrent hypomania without a major depressive episode or with fewer symptoms than those required for threshold hypomania. RESULTS: The internal consistency of the B-BSDS evaluated with Cronbach's alpha coefficient was 0.89 (95% CI; 0.86-0.91). On the basis of the modified SCID, 70 patients (61.4%) of the sample received a diagnosis of BSDs. A B-BSDS screening score of 16 or more items yielded: sensitivity of 0.79 (95% CI; 0.72-0.85), specificity of 0.77 (95% CI; 0.70-0.83), a positive predictive value of 0.85 (95% CI; 0.78-0.91) and a negative predictive value of 0.70 (95% CI; 0.63-0.75). CONCLUSION: The present data demonstrate that the B-BSDS is a valid instrument for the screening of BSDs.

Reliability and convergent validity of the Childhood Anxiety Sensitivity Index in children and adolescents

OBJECTIVE: The purpose of this study was to examine the reliability and the convergent validity of the Children Anxiety Sensitivity Index (CASI) with DSM-IV anxiety disorder symptoms, by comparison with the Screen for Child Anxiety Related Emotional Disorders (SCARED), in a community sample of Brazilian children and adolescents. METHODS: Children and adolescents from five schools were selected from a larger study that aimed to assess different aspects of childhood anxiety disorders. All participants completed the CASI and the SCARED. RESULTS: This study supported the reliability of the CASI total score. Girls reported higher total anxiety sensitivity scores than boys and there were no differences in total anxiety sensitivity scores between children and adolescents. This study showed moderate to high correlations between the CASI scores with SCARED scores, all correlations coefficients being positive and significant. CONCLUSIONS: Our findings demonstrate an appropriate reliability and evidence of convergent validity in the CASI in a sample of Brazilian children and adolescents.

Escalas de Avaliação da Interação Mãe-Bebé: versão portuguesa das Interaction Rating Scales

As Escalas de Avaliação da Interação Mãe-Bebé constituem a versão portuguesa das Interaction Rating Scales, propostas por Field (1980), e têm por objetivo avaliar a interação mãe-bebé, aos 3 meses de idade do bebé. As Escalas de Avaliação da Interação Mãe-Bebé foram administradas a 51 díades mãe-bebé aos 3, 6 e 12 meses pós-parto. A versão portuguesa das escalas mostrou elevados índices de consistência interna – Alfa de Cronbach 0,85 (IRSff bebé), 0,91 (IRSff mãe), 0,87 (IRSal bebé), 0,82 (IRSal mãe), assim como elevada fidelidade e validade concorrente e preditiva. As Escalas de Avaliação da Interação Mãe-Bebé assume-se, assim, como um instrumento robusto na avaliação da interação mãe-bebé, na situação de interação face-a-face e na situação de interação alimentar, podendo ser utilizadas em diferentes amostras e contextos, clínicos e de investigação.

Sistemas de Tipos para Verificación de Programas Concurrentes. Type Systems for Concurrent Programs Verification.

La programación concurrente es una tarea difícil aún para los más experimentados programadores. Las investigaciones en concurrencia han dado como resultado una gran cantidad de mecanismos y herramientas para resolver problemas de condiciones de carrera de datos y deadlocks, problemas que surgen por el mal uso de los mecanismos de sincronización. La verificación de propiedades interesantes de programas concurrentes presenta dificultades extras a los programas secuenciales debido al no-determinismo de su ejecución, lo cual resulta en una explosión en el número de posibles estados de programa, haciendo casi imposible un tratamiento manual o aún con la ayuda de computadoras. Algunos enfoques se basan en la creación de lenguajes de programación con construcciones con un alto nivel de abstración para expresar concurrencia y sincronización. Otros enfoques tratan de desarrollar técnicas y métodos de razonamiento para demostrar propiedades, algunos usan demostradores de teoremas generales, model-checking o algortimos específicos sobre un determinado sistema de tipos. Los enfoques basados en análisis estático liviano utilizan técnicas como interpretación abstracta para detectar ciertos tipos de errores, de una manera conservativa. Estas técnicas generalmente escalan lo suficiente para aplicarse en grandes proyectos de software pero los tipos de errores que pueden detectar es limitada. Algunas propiedades interesantes están relacionadas a condiciones de carrera y deadlocks, mientras que otros están interesados en problemas relacionados con la seguridad de los sistemas, como confidencialidad e integridad de datos. Los principales objetivos de esta propuesta es identificar algunas propiedades de interés a verificar en sistemas concurrentes y desarrollar técnicas y herramientas para realizar la verificación en forma automática. Para lograr estos objetivos, se pondrá énfasis en el estudio y desarrollo de sistemas de tipos como tipos dependientes, sistema de tipos y efectos, y tipos de efectos sensibles al flujo de datos y control. Estos sistemas de tipos se aplicarán a algunos modelos de programación concurrente como por ejemplo, en Simple Concurrent Object-Oriented Programming (SCOOP) y Java. Además se abordarán propiedades de seguridad usando sistemas de tipos específicos. Concurrent programming has remained a dificult task even for very experienced programmers. Concurrency research has provided a rich set of tools and mechanisms for dealing with data races and deadlocks that arise of incorrect use of synchronization. Verification of most interesting properties of concurrent programs is a very dificult task due to intrinsic non-deterministic nature of concurrency, resulting in a state explosion which make it almost imposible to be manually treat and it is a serious challenge to do that even with help of computers. Some approaches attempts create programming languages with higher levels of abstraction for expressing concurrency and synchronization. Other approaches try to develop reasoning methods to prove properties, either using general theorem provers, model-checking or specific algorithms on some type systems. The light-weight static analysis approach apply techniques like abstract interpretation to find certain kind of bugs in a conservative way. This techniques scale well to be applied in large software projects but the kind of bugs they may find are limited. Some interesting properties are related to data races and deadlocks, while others are interested in some security problems like confidentiality and integrity of data. The main goals of this proposal is to identify some interesting properties to verify in concurrent systems and develop techniques and tools to do full automatic verification. The main approach will be the application of type systems, as dependent types, type and effect systems, and flow-efect types. Those type systems will be applied to some models for concurrent programming as Simple Concurrent Object-Oriented Programming (SCOOP) and Java. Other goals include the analysis of security properties also using specific type systems.

Quality of Life on Arterial Hypertension: Validity of Known Groups of MINICHAL

Introductions: In the care of hypertension, it is important that health professionals possess available tools that allow evaluating the impairment of the health-related quality of life, according to the severity of hypertension and the risk for cardiovascular events. Among the instruments developed for the assessment of health-related quality of life, there is the Mini-Cuestionario of Calidad de Vida en la Hipertensión Arterial (MINICHAL) recently adapted to the Brazilian culture. Objective: To estimate the validity of known groups of the Brazilian version of the MINICHAL regarding the classification of risk for cardiovascular events, symptoms, severity of dyspnea and target-organ damage. Methods: Data of 200 hypertensive outpatients concerning sociodemographic and clinical information and health-related quality of life were gathered by consulting the medical charts and the application of the Brazilian version of MINICHAL. The Mann-Whitney test was used to compare health-related quality of life in relation to symptoms and target-organ damage. The Kruskal-Wallis test and ANOVA with ranks transformation were used to compare health-related quality of life in relation to the classification of risk for cardiovascular events and intensity of dyspnea, respectively. Results: The MINICHAL was able to discriminate health-related quality of life in relation to symptoms and kidney damage, but did not discriminate health-related quality of life in relation to the classification of risk for cardiovascular events. Conclusion: The Brazilian version of the MINICHAL is a questionnaire capable of discriminating differences on the health‑related quality of life regarding dyspnea, chest pain, palpitation, lipothymy, cephalea and renal damage.

Validity, reliability and responsiveness of the French language translation of the Western Ontario Shoulder Instability Index (WOSI).

BACKGROUND: The WOSI (Western Ontario Shoulder Instability Index) is a self-administered quality of life questionnaire designed to be used as a primary outcome measure in clinical trials on shoulder instability, as well as to measure the effect of an intervention on any particular patient. It is validated and is reliable and sensitive. As it is designed to measure subjective outcome, it is important that translation should be methodologically rigorous, as it is subject to both linguistic and cultural interpretation. OBJECTIVE: To produce a French language version of the WOSI that is culturally adapted to both European and North American French-speaking populations. MATERIALS AND METHODS: A validated protocol was used to create a French language WOSI questionnaire (WOSI-Fr) that would be culturally acceptable for both European and North American French-speaking populations. Reliability and responsiveness analyses were carried out, and the WOSI-Fr was compared to the F-QuickDASH-D/S (Disability of the Arm, Shoulder and Hand-French translation), and Walch-Duplay scores. RESULTS: A French language version of the WOSI (WOSI-Fr) was accepted by a multinational committee. The WOSI-Fr was then validated using a total of 144 native French-speaking subjects from Canada and Switzerland. Comparison of results on two WOSI-Fr questionnaires completed at a mean interval of 16 days showed that the WOSI-Fr had strong reliability, with a Pearson and interclass correlation of r=0.85 (P=0.01) and ICC=0.84 [95% CI=0.78-0.88]. Responsiveness, at a mean 378.9 days after surgical intervention, showed strong correlation with that of the F-QuickDASH-D/S, with r=0.67 (P<0.01). Moreover, a standardized response means analysis to calculate effect size for both the WOSI-Fr and the F-QuickDASH-D/S showed that the WOSI-Fr had a significantly greater ability to detect change (SRM 1.55 versus 0.87 for the WOSI-Fr and F-QuickDASH-D/S respectively, P<0.01). The WOSI-Fr showed fair correlation with the Walch-Duplay. DISCUSSION: A French-language translation of the WOSI questionnaire was created and validated for use in both Canadian and Swiss French-speaking populations. This questionnaire will facilitate outcome assessment in French-speaking settings, collaboration in multinational studies and comparison between studies performed in different countries. TYPE OF STUDY: Multicenter cohort study. LEVEL OF EVIDENCE: II.

Qualités psychométriques de la version française de la TAS-20 et prévalence de l'alexithymie chez 264 adolescents tout-venant [The 20-item Toronto alexithymia scale: structural validity, internal consistency and prevalence of alexithymia in a Swiss adolescent sample]

L'objectif de cette étude est d'examiner la structure factorielle et la consistance interne de la TAS-20 sur un échantillon d'adolescents (n = 264), ainsi que de décrire la distribution des caractéristiques alexithymiques dans cet échantillon. La structure à trois facteurs de la TAS-20 a été confirmée par notre analyse factorielle confirmatoire. La consistance interne, mesurée à l'aide d'alpha de Cronbach, est acceptable pour le premier facteur (difficulté à identifier les sentiments (DIF)), bonne pour le second (difficulté à verbaliser les sentiments (DDF)), mais en revanche, faible pour le troisième facteur (pensées orientées vers l'extérieur (EOT)). Les résultats d'une Anova mettent en évidence une tendance linéaire indiquant que plus l'âge augmente plus le niveau d'alexithymie (score total TAS-20), la difficulté à identifier les sentiments et les pensées orientées vers l'extérieur diminuent. En ce qui concerne la prévalence de l'alexithymie, on remarque en effet que 38,5 % des adolescents de moins de 16 ans sont considérés comme alexithymiques, contre 30,1 % des 16-17 ans et 22 % des plus de 17 ans. Notre étude indique donc que la TAS-20 est un instrument adéquat pour évaluer l'alexithymie à l'adolescence, tout en suggérant quelques précautions étant donné l'aspect développemental de cette période.

Detecting and measuring deprivation in primary care: development, reliability and validity of a self-reported questionnaire: the DiPCare-Q.

OBJECTIVES: Advances in biopsychosocial science have underlined the importance of taking social history and life course perspective into consideration in primary care. For both clinical and research purposes, this study aims to develop and validate a standardised instrument measuring both material and social deprivation at an individual level. METHODS: We identified relevant potential questions regarding deprivation using a systematic review, structured interviews, focus group interviews and a think-aloud approach. Item response theory analysis was then used to reduce the length of the 38-item questionnaire and derive the deprivation in primary care questionnaire (DiPCare-Q) index using data obtained from a random sample of 200 patients during their planned visits to an ambulatory general internal medicine clinic. Patients completed the questionnaire a second time over the phone 3 days later to enable us to assess reliability. Content validity of the DiPCare-Q was then assessed by 17 general practitioners. Psychometric properties and validity of the final instrument were investigated in a second set of patients. The DiPCare-Q was administered to a random sample of 1898 patients attending one of 47 different private primary care practices in western Switzerland along with questions on subjective social status, education, source of income, welfare status and subjective poverty. RESULTS: Deprivation was defined in three distinct dimensions: material (eight items), social (five items) and health deprivation (three items). Item consistency was high in both the derivation (Kuder-Richardson Formula 20 (KR20) =0.827) and the validation set (KR20 =0.778). The DiPCare-Q index was reliable (interclass correlation coefficients=0.847) and was correlated to subjective social status (r(s)=-0.539). CONCLUSION: The DiPCare-Q is a rapid, reliable and validated instrument that may prove useful for measuring both material and social deprivation in primary care.

Skeletal Muscle Mitochondrial and Lipid Droplet Volume Density: Validity of Electron Microscopy Point-counting Measurements

Mitochondrial (M) and lipid droplet (L) volume density (vd) are often used in exercise research. Vd is the volume of muscle occupied by M and L. The means of calculating these percents are accomplished by applying a grid to a 2D image taken with transmission electron microscopy; however, it is not known which grid best predicts these values. PURPOSE: To determine the grid with the least variability of Mvd and Lvd in human skeletal muscle. METHODS: Muscle biopsies were taken from vastus lateralis of 10 healthy adults, trained (N=6) and untrained (N=4). Samples of 5-10mg were fixed in 2.5% glutaraldehyde and embedded in EPON. Longitudinal sections of 60 nm were cut and 20 images were taken at random at 33,000x magnification. Vd was calculated as the number of times M or L touched two intersecting grid lines (called a point) divided by the total number of points using 3 different sizes of grids with squares of 1000x1000nm sides (corresponding to 1µm2), 500x500nm (0.25µm2) and 250x250nm (0.0625µm2). Statistics included coefficient of variation (CV), 1 way-BS ANOVA and spearman correlations. RESULTS: Mean age was 67 ± 4 yo, mean VO2peak 2.29 ± 0.70 L/min and mean BMI 25.1 ± 3.7 kg/m2. Mean Mvd was 6.39% ± 0.71 for the 1000nm squares, 6.01% ± 0.70 for the 500nm and 6.37% ± 0.80 for the 250nm. Lvd was 1.28% ± 0.03 for the 1000nm, 1.41% ± 0.02 for the 500nm and 1.38% ± 0.02 for the 250nm. The mean CV of the three grids was 6.65% ±1.15 for Mvd with no significant differences between grids (P>0.05). Mean CV for Lvd was 13.83% ± 3.51, with a significant difference between the 1000nm squares and the two other grids (P<0.05). The 500nm squares grid showed the least variability between subjects. Mvd showed a positive correlation with VO2peak (r = 0.89, p < 0.05) but not with weight, height, or age. No correlations were found with Lvd. CONCLUSION: Different size grids have different variability in assessing skeletal muscle Mvd and Lvd. The grid size of 500x500nm (240 points) was more reliable than 1000x1000nm (56 points). 250x250nm (1023 points) did not show better reliability compared with the 500x500nm, but was more time consuming. Thus, choosing a grid with square size of 500x500nm seems the best option. This is particularly relevant as most grids used in the literature are either 100 points or 400 points without clear information on their square size.

Validity of impedance-based equations for the prediction of total body water as measured by deuterium dilution in African women.

BACKGROUND: Little information is available on the validity of simple and indirect body-composition methods in non-Western populations. Equations for predicting body composition are population-specific, and body composition differs between blacks and whites. OBJECTIVE: We tested the hypothesis that the validity of equations for predicting total body water (TBW) from bioelectrical impedance analysis measurements is likely to depend on the racial background of the group from which the equations were derived. DESIGN: The hypothesis was tested by comparing, in 36 African women, TBW values measured by deuterium dilution with those predicted by 23 equations developed in white, African American, or African subjects. These cross-validations in our African sample were also compared, whenever possible, with results from other studies in black subjects. RESULTS: Errors in predicting TBW showed acceptable values (1.3-1.9 kg) in all cases, whereas a large range of bias (0.2-6.1 kg) was observed independently of the ethnic origin of the sample from which the equations were derived. Three equations (2 from whites and 1 from blacks) showed nonsignificant bias and could be used in Africans. In all other cases, we observed either an overestimation or underestimation of TBW with variable bias values, regardless of racial background, yielding no clear trend for validity as a function of ethnic origin. CONCLUSIONS: The findings of this cross-validation study emphasize the need for further fundamental research to explore the causes of the poor validity of TBW prediction equations across populations rather than the need to develop new prediction equations for use in Africa.

Bilateral symmetry of radial pulse in high-level tennis players: implications for the validity of central aortic pulse wave analysis.

BACKGROUND: Reconstruction of the central aortic pressure wave from the noninvasive recording of the radial pulse with applanation tonometry has become a standard tool in the field of hypertension. It is not presently known whether recording the radial pulse on the dominant or the nondominant side has any effect on such reconstruction. METHOD: We carried out radial applanation tonometry on both forearms in young, healthy, male volunteers, who were either sedentary (n = 11) or high-level tennis players (n = 10). The purpose of including tennis players was to investigate individuals with extreme asymmetry between the dominant and nondominant upper limb. RESULTS: In the sedentary individuals, forearm circumference and handgrip strength were slightly larger on the dominant (mean +/- SD respectively 27.9 +/- 1.5 cm and 53.8 +/- 10 kg) than on nondominant side (27.3 +/- 1.6 cm, P < 0.001 vs. dominant, and 52.1 +/- 11 kg, P = NS). In the tennis players, differences between sides were more conspicuous (forearm circumference: dominant 28.0 +/- 1.7 cm nondominant 26.4 +/- 1.5 cm, P < 0.001; handgrip strength 61.4 +/- 10.8 vs. 53.4 +/- 9.7 kg, P < 0.001). We found that in both sedentary individuals and tennis players, the radial pulse had identical shape on both sides and, consequently, the reconstructed central aortic pressure waveforms, as well as derived indices of central pulsatility, were not dependent on the side where applanation tonometry was carried out. CONCLUSION: Evidence from individuals with maximal asymmetry of dominant vs. nondominant upper limb indicates that laterality of measurement is not a methodological issue for central pulse wave analysis carried out with radial applanation tonometry.