Non-response bias in randomized control experiments in criminology : putting the Queensland Community Engagement Trial (QCET) under a microscope

Objectives The goal of this article is to examine whether or not the results of the Queensland Community Engagement Trial (QCET)-a randomized controlled trial that tested the impact of procedural justice policing on citizen attitudes toward police-were affected by different types of nonresponse bias. Method We use two methods (Cochrane and Elffers methods) to explore nonresponse bias: First, we assess the impact of the low response rate by examining the effects of nonresponse group differences between the experimental and control conditions and pooled variance under different scenarios. Second, we assess the degree to which item response rates are influenced by the control and experimental conditions. Results Our analysis of the QCET data suggests that our substantive findings are not influenced by the low response rate in the trial. The results are robust even under extreme conditions, and statistical significance of the results would only be compromised in cases where the pooled variance was much larger for the nonresponse group and the difference between experimental and control conditions was greatly diminished. We also find that there were no biases in the item response rates across the experimental and control conditions. Conclusion RCTs that involve field survey responses-like QCET-are potentially compromised by low response rates and how item response rates might be influenced by the control or experimental conditions. Our results show that the QCET results were not sensitive to the overall low response rate across the experimental and control conditions and the item response rates were not significantly different across the experimental and control groups. Overall, our analysis suggests that the results of QCET are robust and any biases in the survey responses do not significantly influence the main experimental findings.

Estimating equations with nonignorably missing response data

Troxel, Lipsitz, and Brennan (1997, Biometrics 53, 857-869) considered parameter estimation from survey data with nonignorable nonresponse and proposed weighted estimating equations to remove the biases in the complete-case analysis that ignores missing observations. This paper suggests two alternative modifications for unbiased estimation of regression parameters when a binary outcome is potentially observed at successive time points. The weighting approach of Robins, Rotnitzky, and Zhao (1995, Journal of the American Statistical Association 90, 106-121) is also modified to obtain unbiased estimating functions. The suggested estimating functions are unbiased only when the missingness probability is correctly specified, and misspecification of the missingness model will result in biases in the estimates. Simulation studies are carried out to assess the performance of different methods when the covariate is binary or normal. For the simulation models used, the relative efficiency of the two new methods to the weighting methods is about 3.0 for the slope parameter and about 2.0 for the intercept parameter when the covariate is continuous and the missingness probability is correctly specified. All methods produce substantial biases in the estimates when the missingness model is misspecified or underspecified. Analysis of data from a medical survey illustrates the use and possible differences of these estimating functions.

Personality, health and lifestyle in a questionnaire family study: A comparison between highly cooperative and less cooperative families

The effect of nonresponse on health and lifestyle measures has received extensive study, showing at most relatively modest effects. Nonresponse bias with respect to personality has been less thoroughly investigated. The present study uses data from responding individuals as a proxy for the missing data of their nonresponding family members to examine the presence of nonresponse bias for personality traits and disorders as well as health and lifestyle traits. We looked at the Big Five personality traits, borderline personality disorder (BPD) features, attention-deficit/hyperactivity disorder, Anger, and several measures of health (Body Mass Index, migraine) and lifestyle (smoking, alcohol use). In general, outcomes tend to be slightly more favorable for individuals from highly cooperative families compared to individuals from less cooperative families. The only significant difference was found for BPD features (p = .001). However, the absolute difference in mean scores is very small, less than 1 point for a scale ranging from 0 to 72. In conclusion, survey data on personality, health and lifestyle are relatively unbiased with respect to nonresponse.

Four essays on the empirical analysis of political ideology

This thesis examines four distinct facets and methods for understanding political ideology, and so it includes four distinct chapters with only moderate connections between them. Chapter 2 examines how reactions to emotional stimuli vary with political opinion, and how the stimuli can produce changes in an individuals political preferences. Chapter 3 examines the connection between self-reported fear and item nonresponse on surveys. Chapter 4 examines the connection between political and moral consistency with low-dimensional ideology, and Chapter 5 develops a technique for estimating ideal points and salience in a low-dimensional ideological space.

Equal IgG antibody response to pneumococcal vaccination in all stages of human immunodeficiency virus disease.

To evaluate the immunogenicity and safety of a 23-valent pneumococcal vaccine in human immunodeficiency virus (HIV)-seropositive patients, 80 men and 18 women received 1 dose of the vaccine (Pneumo 23; Pasteur Mérieux MSD, Brussels). The total IgG antibody response against all 23 Streptococcus pneumoniae capsular antigens was measured. Antibody levels were expressed in arbitrary units per microliter, referring to a standard curve. Geometric mean titers of the total IgG capsular antibodies on the day of vaccination and 30-45 days later were compared. The ratios of titers after and before vaccination in patients with > 500, 200-500, and < 200 CD4 lymphocytes/microL were 10, 10, and 12.6, respectively. Nonresponse (ratio < 4) occurred in 17% of patients and was unrelated to CD4 cell count. The vaccine was well tolerated; no serious side effects occurred. In 83% of the patients with HIV infection, the total antipneumococcal IgG level was higher after vaccination.

CD133 expression predicts for non-response to chemotherapy in colorectal cancer

The cancer stem cell hypothesis may explain why conventional chemotherapies are unable to fully eradicate cancers. In this study, we examined both the prognostic and predictive significance of putative cancer stem cell markers in colorectal cancer. In this study, immunohistochemistry for three candidate cancer stem cell markers (CD133, Oct-4 and Sox-2) and for six other postulated prognostic markers (CK7, CK20, Cox-2, Ki-67, p27 and p53) were performed using tissue microarrays containing 501 primary colorectal cancer cases. Receiver-operating characteristic analysis was used to determine cut-off scores for positive protein expression. Multivariate analysis revealed that positive expression for CD133 and Oct-4 was associated with significantly worse survival in patients treated by surgery alone (P=0.023 and P

Characterization and clinical evaluation of CD10+ stroma cells in the breast cancer microenvironment.

PURPOSE: There is growing evidence that interaction between stromal and tumor cells is pivotal in breast cancer progression and response to therapy. Based on earlier research suggesting that during breast cancer progression, striking changes occur in CD10(+) stromal cells, we aimed to better characterize this cell population and its clinical relevance. EXPERIMENTAL DESIGN: We developed a CD10(+) stroma gene expression signature (using HG U133 Plus 2.0) on the basis of the comparison of CD10 cells isolated from tumoral (n = 28) and normal (n = 3) breast tissue. We further characterized the CD10(+) cells by coculture experiments of representative breast cancer cell lines with the different CD10(+) stromal cell types (fibroblasts, myoepithelial, and mesenchymal stem cells). We then evaluated its clinical relevance in terms of in situ to invasive progression, invasive breast cancer prognosis, and prediction of efficacy of chemotherapy using publicly available data sets. RESULTS: This 12-gene CD10(+) stroma signature includes, among others, genes involved in matrix remodeling (MMP11, MMP13, and COL10A1) and genes related to osteoblast differentiation (periostin). The coculture experiments showed that all 3 CD10(+) cell types contribute to the CD10(+) stroma signature, although mesenchymal stem cells have the highest CD10(+) stroma signature score. Of interest, this signature showed an important role in differentiating in situ from invasive breast cancer, in prognosis of the HER2(+) subpopulation of breast cancer only, and potentially in nonresponse to chemotherapy for those patients. CONCLUSIONS: Our results highlight the importance of CD10(+) cells in breast cancer prognosis and efficacy of chemotherapy, particularly within the HER2(+) breast cancer disease.

Inférence doublement robuste en présence de données imputées dans les enquêtes

L'imputation est souvent utilisée dans les enquêtes pour traiter la non-réponse partielle. Il est bien connu que traiter les valeurs imputées comme des valeurs observées entraîne une sous-estimation importante de la variance des estimateurs ponctuels. Pour remédier à ce problème, plusieurs méthodes d'estimation de la variance ont été proposées dans la littérature, dont des méthodes adaptées de rééchantillonnage telles que le Bootstrap et le Jackknife. Nous définissons le concept de double-robustesse pour l'estimation ponctuelle et de variance sous l'approche par modèle de non-réponse et l'approche par modèle d'imputation. Nous mettons l'emphase sur l'estimation de la variance à l'aide du Jackknife qui est souvent utilisé dans la pratique. Nous étudions les propriétés de différents estimateurs de la variance à l'aide du Jackknife pour l'imputation par la régression déterministe ainsi qu'aléatoire. Nous nous penchons d'abord sur le cas de l'échantillon aléatoire simple. Les cas de l'échantillonnage stratifié et à probabilités inégales seront aussi étudiés. Une étude de simulation compare plusieurs méthodes d'estimation de variance à l'aide du Jackknife en terme de biais et de stabilité relative quand la fraction de sondage n'est pas négligeable. Finalement, nous établissons la normalité asymptotique des estimateurs imputés pour l'imputation par régression déterministe et aléatoire.

Imputation en présence de données contenant des zéros

L’imputation simple est très souvent utilisée dans les enquêtes pour compenser pour la non-réponse partielle. Dans certaines situations, la variable nécessitant l’imputation prend des valeurs nulles un très grand nombre de fois. Ceci est très fréquent dans les enquêtes entreprises qui collectent les variables économiques. Dans ce mémoire, nous étudions les propriétés de deux méthodes d’imputation souvent utilisées en pratique et nous montrons qu’elles produisent des estimateurs imputés biaisés en général. Motivé par un modèle de mélange, nous proposons trois méthodes d’imputation et étudions leurs propriétés en termes de biais. Pour ces méthodes d’imputation, nous considérons un estimateur jackknife de la variance convergent vers la vraie variance, sous l’hypothèse que la fraction de sondage est négligeable. Finalement, nous effectuons une étude par simulation pour étudier la performance des estimateurs ponctuels et de variance en termes de biais et d’erreur quadratique moyenne.

Estimation de la variance en présence de données imputées pour des plans de sondage à grande entropie

Les travaux portent sur l’estimation de la variance dans le cas d’une non- réponse partielle traitée par une procédure d’imputation. Traiter les valeurs imputées comme si elles avaient été observées peut mener à une sous-estimation substantielle de la variance des estimateurs ponctuels. Les estimateurs de variance usuels reposent sur la disponibilité des probabilités d’inclusion d’ordre deux, qui sont parfois difficiles (voire impossibles) à calculer. Nous proposons d’examiner les propriétés d’estimateurs de variance obtenus au moyen d’approximations des probabilités d’inclusion d’ordre deux. Ces approximations s’expriment comme une fonction des probabilités d’inclusion d’ordre un et sont généralement valides pour des plans à grande entropie. Les résultats d’une étude de simulation, évaluant les propriétés des estimateurs de variance proposés en termes de biais et d’erreur quadratique moyenne, seront présentés.

Inferential Implications of Over-Parametrization: A Case Study in Incomplete Categorical Data

P>In the context of either Bayesian or classical sensitivity analyses of over-parametrized models for incomplete categorical data, it is well known that prior-dependence on posterior inferences of nonidentifiable parameters or that too parsimonious over-parametrized models may lead to erroneous conclusions. Nevertheless, some authors either pay no attention to which parameters are nonidentifiable or do not appropriately account for possible prior-dependence. We review the literature on this topic and consider simple examples to emphasize that in both inferential frameworks, the subjective components can influence results in nontrivial ways, irrespectively of the sample size. Specifically, we show that prior distributions commonly regarded as slightly informative or noninformative may actually be too informative for nonidentifiable parameters, and that the choice of over-parametrized models may drastically impact the results, suggesting that a careful examination of their effects should be considered before drawing conclusions.Resume Que ce soit dans un cadre Bayesien ou classique, il est bien connu que la surparametrisation, dans les modeles pour donnees categorielles incompletes, peut conduire a des conclusions erronees. Cependant, certains auteurs persistent a negliger les problemes lies a la presence de parametres non identifies. Nous passons en revue la litterature dans ce domaine, et considerons quelques exemples surparametres simples dans lesquels les elements subjectifs influencent de facon non negligeable les resultats, independamment de la taille des echantillons. Plus precisement, nous montrons comment des a priori consideres comme peu ou non-informatifs peuvent se reveler extremement informatifs en ce qui concerne les parametres non identifies, et que le recours a des modeles surparametres peut avoir sur les conclusions finales un impact considerable. Ceci suggere un examen tres attentif de l`impact potentiel des a priori.

Missing data mechanisms and their implications on the analysis of categorical data

We review some issues related to the implications of different missing data mechanisms on statistical inference for contingency tables and consider simulation studies to compare the results obtained under such models to those where the units with missing data are disregarded. We confirm that although, in general, analyses under the correct missing at random and missing completely at random models are more efficient even for small sample sizes, there are exceptions where they may not improve the results obtained by ignoring the partially classified data. We show that under the missing not at random (MNAR) model, estimates on the boundary of the parameter space as well as lack of identifiability of the parameters of saturated models may be associated with undesirable asymptotic properties of maximum likelihood estimators and likelihood ratio tests; even in standard cases the bias of the estimators may be low only for very large samples. We also show that the probability of a boundary solution obtained under the correct MNAR model may be large even for large samples and that, consequently, we may not always conclude that a MNAR model is misspecified because the estimate is on the boundary of the parameter space.

Estimating non-response bias in a web-based survey of technology acceptance : a case study of unit guide information systems

Surveys are mostly challenged by response rates. Among the various types of survey research, web-based (internet-based/electronic/online) surveys are commonly used for data collection for a geographically diverse population. In surveys with high/low response rates, non-response bias can be a major concern. While it is not always possible to measure the actual bias due to non-response there are different approaches and techniques that help to identify reasons of non-response bias. The aims of this paper are twofold. (1) To provide an appropriate, interesting and important non-response bias case study for future web-based surveys that will provide guidance to other Information Systems researchers. The case-study concerns an online-survey to evaluate a technology acceptance model for Unit Guide Information systems (UGIS). (2) To discuss how nonresponse bias in a web-based technology acceptance study of an information system (UGIS in this case) can be contained and managed.

Validation of patient health questionnaire (PHQ) for major depression in Chinese outpatients with multiple somatic symptoms: A multicenter cross-sectional study

Background: Despite the high co-morbidity of depressive symptoms in patients with multiple somatic symptoms, the validity of the 9-item Patient Health Questionnaire (PHQ-9) has not yet been investigated in Chinese patients with multiple somatic symptoms. Methods: The multicenter cross-sectional study was conducted in ten outpatient departments located in four cities in China. The psychometric properties of the PHQ-9 were examined by confirmative factor analysis (CFA). Criterion validation was undertaken by comparing results with depression diagnoses obtained from the Mini International Neuropsychiatric Interview (MINI) as the gold standard. Results: Overall, 491 patients were recruited of whom 237 had multiple somatic symptoms (SOM+ group, PHQ-15 ≥ 10). Cronbach's α of the PHQ-9 was 0.87, 0.87, and 0.90 for SOM+ patients, SOM- patients, and total sample respectively. All items and the total score were moderately correlated. The factor models of PHQ-9 tested by CFA yielded similar diagnostic performance when compared to sum score estimation. Multi-group confirmatory factor analysis based on unidimensional model showed similar psychometric properties over the groups with low and high somatic symptom burden. The optimal cut-off point to detect depression in Chinese outpatients was 10 for PHQ-9 (sensitivity=0.77, specificity=0.76) and 3 for PHQ-2 (sensitivity=0.77, specificity=0.74). Limitations: Potential selection bias and nonresponse bias with applied sampling method. Conclusions: PHQ-9 (cut-off point=10) and PHQ-2 (cut-off point=3) were reliable and valid to detect major depression in Chinese patients with multiple somatic symptoms.

Análise da não resposta em surveys políticos

Este artigo analisa a estrutura social dos entrevistados que apontam o item não resposta em um survey sobre assuntos políticos. Para isso foi realizado um survey com 2.110 jovens eleitores da rede pública de ensino em Belém (PA). Os dados indicam que a quota da não resposta aumenta com a mudança de um ciclo de vida para outro ou com a própria experiência obtida pelos efeitos das políticas públicas, o que deixa o entrevistado em dúvida em relação aos valores e opiniões estabelecidos.