Using register data to assess the impact of response enhancement methods on the risk of nonresponse bias and survey costs

The pursuit of high response rates to minimise the threat of nonresponse bias continues to dominate decisions about resource allocation in survey research. Yet a growing body of research has begun to question this practice. In this study, we use previously unavailable data from a new sampling frame based on population registers to assess the value of different methods designed to increase response rates on the European Social Survey in Switzerland. Using sampling data provides information about both respondents and nonrespondents, making it possible to examine how changes in response rates resulting from the use of different fieldwork methods relate to changes in the composition and representativeness of the responding sample. We compute an R-indicator to assess representativity with respect to the sampling register variables, and find little improvement in the sample composition as response rates increase. We then examine the impact of response rate increases on the risk of nonresponse bias based on Maximal Absolute Bias (MAB), and coefficients of variation between subgroup response rates, alongside the associated costs of different types of fieldwork effort. The results show that increases in response rate help to reduce MAB, while only small but important improvements to sample representativity are gained by varying the type of effort. These findings lend further support to research that has called into question the value of extensive investment in procedures aimed at reaching response rate targets and the need for more tailored fieldwork strategies aimed both at reducing survey costs and minimising the risk of bias.

Identifying Pertinent Variables for Nonresponse Follow-Up Surveys : Lessons Learned from 4 Cases in Switzerland

All social surveys suffer from different types of errors, of which one of the most studied is non-response bias. Non-response bias is a systematic error that occurs because individuals differ in their accessibility and propensity to participate in a survey according to their own characteristics as well as those from the survey itself. The extent of the problem heavily depends on the correlation between response mechanisms and key survey variables. However, non-response bias is difficult to measure or to correct for due to the lack of relevant data about the whole target population or sample. In this paper, non-response follow-up surveys are considered as a possible source of information about non-respondents. Non-response follow-ups, however, suffer from two methodological issues: they themselves operate through a response mechanism that can cause potential non-response bias, and they pose a problem of comparability of measure, mostly because the survey design differs between main survey and non-response follow-up. In order to detect possible bias, the survey variables included in non-response surveys have to be related to the mechanism of participation, but not be sensitive to measurement effects due to the different designs. Based on accumulated experience of four similar non-response follow-ups, we studied the survey variables that fulfill these conditions. We differentiated socio-demographic variables that are measurement-invariant but have a lower correlation with non-response and variables that measure attitudes, such as trust, social participation, or integration in the public sphere, which are more sensitive to measurement effects but potentially more appropriate to account for the non-response mechanism. Our results show that education level, work status, and living alone, as well as political interest, satisfaction with democracy, and trust in institutions are pertinent variables to include in non-response follow-ups of general social surveys. - See more at: https://ojs.ub.uni-konstanz.de/srm/article/view/6138#sthash.u87EeaNG.dpuf

A Validation Study on Voter Turnout Bias in Switzerland

Surveys on voting behavior typically overestimate turnout rates substantially. To disentangle different sources of bias - coverage error, nonresponse bias, and overreporting - we conducted a validation study in which respondents' self-reported voting behavior was compared to administrative voting records (N = 2000). Our results show that all three sources of error inflate the survey estimate of the turnout rate and also bias estimates from political participation models, although coverage error is only moderate compared to the more pronounced biases due to nonresponse and overreporting. Furthermore, results from a wording experiment do not provide evidence that revised wording reduces measurement bias.

Health and demographic characteristics of respondents in an Australian national sexuality survey: comparison with population norms

Study objective: To assess the representativeness of survey participants by systematically comparing volunteers in a national health and sexuality survey with the Australian population in terms of self reported health status (including the SF-36) and a wide range of demographic characteristics. Design: A cross sectional sample of Australian residents were compared with demographic data from the 1996 Australian census and health data from the 1995 National Health Survey. Setting: The Australian population. Participants: A stratified random sample of adults aged 18-59 years drawn from the Australian electoral roll, a compulsory register of voters. Interviews were completed with 1784 people, representing 40% of those initially selected (58% of those for whom a valid telephone number could be located). Main results: Participants were of similar age and sex to the national population. Consistent with prior research, respondents had higher socioeconomic status, more education, were more likely to be employed, and less likely to be immigrants. The prevalence estimates, means, and variances of self reported mental and physical health measures (for example, SF-36 subscales, women's health indicators, current smoking status) were similar to population norms. Conclusions: These findings considerably strengthen inferences about the representativeness of data on health status from volunteer samples used in health and sexuality surveys.

Determinants of non- response to a second assessment of lifestyle factors and body weight in the EPIC-PANACEA study.

BACKGROUND This paper discusses whether baseline demographic, socio-economic, health variables, length of follow-up and method of contacting the participants predict non-response to the invitation for a second assessment of lifestyle factors and body weight in the European multi-center EPIC-PANACEA study. METHODS Over 500.000 participants from several centers in ten European countries recruited between 1992 and 2000 were contacted 2-11 years later to update data on lifestyle and body weight. Length of follow-up as well as the method of approaching differed between the collaborating study centers. Non-responders were compared with responders using multivariate logistic regression analyses. RESULTS Overall response for the second assessment was high (81.6%). Compared to postal surveys, centers where the participants completed the questionnaire by phone attained a higher response. Response was also high in centers with a short follow-up period. Non-response was higher in participants who were male (odds ratio 1.09 (confidence interval 1.07; 1.11), aged under 40 years (1.96 (1.90; 2.02), living alone (1.40 (1.37; 1.43), less educated (1.35 (1.12; 1.19), of poorer health (1.33 (1.27; 1.39), reporting an unhealthy lifestyle and who had either a low (<18.5 kg/m2, 1.16 (1.09; 1.23)) or a high BMI (>25, 1.08 (1.06; 1.10); especially ≥30 kg/m2, 1.26 (1.23; 1.29)). CONCLUSIONS Cohort studies may enhance cohort maintenance by paying particular attention to the subgroups that are most unlikely to respond and by an active recruitment strategy using telephone interviews.

Presentation and detection of invasive melanoma in a high-risk population

Background: Early detection of melanoma has been encouraged in Queensland for many years, yet little is known about the patterns of detection and the way in which they relate to tumor thickness. Objective: Our purpose was to describe current patterns of melanoma detection in Queensland. Methods: This was a population-based study, comprising 3772 Queensland residents diagnosed with a histologically confirmed melanoma between 2000 and 2003. Results: Almost half (44.0%) of the melanomas were detected by the patients themselves, with physicians detecting one fourth (25.3%) and partners one fifth (18.6%). Melanomas detected by doctors were more likely to be thin (\0.75 mm) than those detected by the patient or other layperson. Melanomas detected during a deliberate skin examination were thinner than those detected incidentally. Limitations: Although a participation rate of 78% was achieved, as in any survey, nonresponse bias cannot be completely excluded, and the ability of the results to be generalized to other geographical areas is unknown. Conclusion: There are clear differences in the depth distribution of melanoma in terms of method of detection and who detects the lesions that are consistent with, but do not automatically lead to, the conclusion that promoting active methods of detection may be beneficial. ( J Am Acad Dermatol 2006;54:783-92.)

Predictors of nonresponse in a questionnaire-based outcome study of vocational rehabilitation patients.

OBJECTIVE: To identify predictors of nonresponse to a self-report study of patients with orthopedic trauma hospitalized for vocational rehabilitation between November 15, 2003, and December 31, 2005. The role of biopsychosocial complexity, assessed using the INTERMED, was of particular interest. DESIGN: Cohort study. Questionnaires with quality of life, sociodemographic, and job-related questions were given to patients at hospitalization and 1 year after discharge. Sociodemographic data, biopsychosocial complexity, and presence of comorbidity were available at hospitalization (baseline) for all eligible patients. Logistic regression models were used to test a number of baseline variables as potential predictors of nonresponse to the questionnaires at each of the 2 time points. SETTING: Rehabilitation clinic. PARTICIPANTS: Patients (N=990) hospitalized for vocational rehabilitation over a period of 2 years. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURE: Nonresponse to the questionnaires was the binary dependent variable. RESULTS: Patients with high biopsychosocial complexity, foreign native language, or low educational level were less likely to respond at both time points. Younger patients were less likely to respond at 1 year. Those living in a stable partnership were less likely than singles to respond at hospitalization. Sex, psychiatric, and somatic comorbidity and alcoholism were never associated with nonresponse. CONCLUSIONS: We stress the importance of assessing biopsychosocial complexity to predict nonresponse. Furthermore, the factors we found to be predictive of nonresponse are also known to influence treatment outcome and vocational rehabilitation. Therefore, it is important to increase the response rate of the groups of concern in order to reduce selection bias in epidemiologic investigations.

Undercoverage and Nonresponse in a List-sampled Telephone Election Survey

For landline telephone surveys in particular, undercoverage has been a growing problem. However, research regarding the relative contributions of socio-demographic bias and other composition effects is scarce. We propose to address this issue by analyzing an election survey which used a sample from a register-based sampling frame containing basic socio-demographic information and to which telephone numbers were subsequently matched. With respect to socio-demographic representation of the final sample, we find that difficult to match groups are also difficult to contact, while those who cooperate tend to have different characteristics. We find bias due to undercoverage to be of greater magnitude than noncontact bias, while noncooperation falls between the two. As for substantive variables, both additional efforts to match missing telephone numbers and the construction of better weights are successful in closing the gap between survey estimates of voting behavior and true values from the election results.

Hubble parameter reconstruction from a principal component analysis: minimizing the bias

Aims. A model-independent reconstruction of the cosmic expansion rate is essential to a robust analysis of cosmological observations. Our goal is to demonstrate that current data are able to provide reasonable constraints on the behavior of the Hubble parameter with redshift, independently of any cosmological model or underlying gravity theory. Methods. Using type Ia supernova data, we show that it is possible to analytically calculate the Fisher matrix components in a Hubble parameter analysis without assumptions about the energy content of the Universe. We used a principal component analysis to reconstruct the Hubble parameter as a linear combination of the Fisher matrix eigenvectors (principal components). To suppress the bias introduced by the high redshift behavior of the components, we considered the value of the Hubble parameter at high redshift as a free parameter. We first tested our procedure using a mock sample of type Ia supernova observations, we then applied it to the real data compiled by the Sloan Digital Sky Survey (SDSS) group. Results. In the mock sample analysis, we demonstrate that it is possible to drastically suppress the bias introduced by the high redshift behavior of the principal components. Applying our procedure to the real data, we show that it allows us to determine the behavior of the Hubble parameter with reasonable uncertainty, without introducing any ad-hoc parameterizations. Beyond that, our reconstruction agrees with completely independent measurements of the Hubble parameter obtained from red-envelope galaxies.

Experimental studies of di-jet survival and surface emission bias in Au plus Au collisions via angular correlations with respect to back-to-back leading hadrons

We report first results from an analysis based on a new multi-hadron correlation technique, exploring jet-medium interactions and di-jet surface emission bias at the BNL Relativistic Heavy Ion Collider (RHIC). Pairs of back-to-back high-transverse-momentum hadrons are used for triggers to study associated hadron distributions. In contrast with two-and three-particle correlations with a single trigger with similar kinematic selections, the associated hadron distribution of both trigger sides reveals no modification in either relative pseudorapidity Delta eta or relative azimuthal angle Delta phi from d + Au to central Au + Au collisions. We determine associated hadron yields and spectra as well as production rates for such correlated back-to-back triggers to gain additional insights on medium properties.

Low-bias negative differential resistance in graphene nanoribbon superlattices

We theoretically investigate negative differential resistance (NDR) for ballistic transport in semiconducting armchair graphene nanoribbon (aGNR) superlattices (5 to 20 barriers) at low bias voltages V(SD) < 500 mV. We combine the graphene Dirac Hamiltonian with the Landauer-Buttiker formalism to calculate the current I(SD) through the system. We find three distinct transport regimes in which NDR occurs: (i) a ""classical"" regime for wide layers, through which the transport across band gaps is strongly suppressed, leading to alternating regions of nearly unity and zero transmission probabilities as a function of V(SD) due to crossing of band gaps from different layers; (ii) a quantum regime dominated by superlattice miniband conduction, with current suppression arising from the misalignment of miniband states with increasing V(SD); and (iii) a Wannier-Stark ladder regime with current peaks occurring at the crossings of Wannier-Stark rungs from distinct ladders. We observe NDR at voltage biases as low as 10 mV with a high current density, making the aGNR superlattices attractive for device applications.

Universal zero-bias conductance through a quantum wire side-coupled to a quantum dot

A numerical renormalization-group study of the conductance through a quantum wire containing noninteracting electrons side-coupled to a quantum dot is reported. The temperature and the dot-energy dependence of the conductance are examined in the light of a recently derived linear mapping between the temperature-dependent conductance and the universal function describing the conductance for the symmetric Anderson model of a quantum wire with an embedded quantum dot. Two conduction paths, one traversing the wire, the other a bypass through the quantum dot, are identified. A gate potential applied to the quantum wire is shown to control the current through the bypass. When the potential favors transport through the wire, the conductance in the Kondo regime rises from nearly zero at low temperatures to nearly ballistic at high temperatures. When it favors the dot, the pattern is reversed: the conductance decays from nearly ballistic to nearly zero. When comparable currents flow through the two channels, the conductance is nearly temperature independent in the Kondo regime, and Fano antiresonances in the fixed-temperature plots of the conductance as a function of the dot-energy signal interference between them. Throughout the Kondo regime and, at low temperatures, even in the mixed-valence regime, the numerical data are in excellent agreement with the universal mapping.

Universal zero-bias conductance for the single-electron transistor

The thermal dependence of the zero-bias conductance for the single electron transistor is the target of two independent renormalization-group approaches, both based on the spin-degenerate Anderson impurity model. The first approach, an analytical derivation, maps the Kondo-regime conductance onto the universal conductance function for the particle-hole symmetric model. Linear, the mapping is parametrized by the Kondo temperature and the charge in the Kondo cloud. The second approach, a numerical renormalization-group computation of the conductance as a function the temperature and applied gate voltages offers a comprehensive view of zero-bias charge transport through the device. The first approach is exact in the Kondo regime; the second, essentially exact throughout the parametric space of the model. For illustrative purposes, conductance curves resulting from the two approaches are compared.

Short Cognitive Performance Test: Diagnostic Accuracy and Education Bias in Older Brazilian Adults

The ""Short Cognitive Performance Test"" (Syndrom Kurztest, SKT) is a cognitive screening battery designed to detect memory and attention deficits. The aim of this study was to evaluate the diagnostic accuracy of the SKT as a screening tool for mild cognitive impairment (MCI) and dementia. A total of 46 patients with Alzheimer`s disease (AD), 82 with MCI, and 56 healthy controls were included in the study. Patients and controls were allocated into two groups according to educational level (< 8 years or > 8 years). ROC analyses suggested that the SKT adequately discriminates AD from non-demented subjects (MCI and controls), irrespective of the education group. The test had good sensitivity to discriminate MCI from unimpaired controls in the sub-sample of individuals with more than 8 years of schooling. Our findings suggest that the SKT is a good screening test for cognitive impairment and dementia. However, test results must be interpreted with caution when administered to less-educated individuals.