Examining non-response bias in substance use research-Are late respondents proxies for non-respondents?

BACKGROUND: Non-response is a major concern among substance use epidemiologists. When differences exist between respondents and non-respondents, survey estimates may be biased. Therefore, researchers have developed time-consuming strategies to convert non-respondents to respondents. The present study examines whether late respondents (converted former non-participants) differ from early respondents, non-consenters or silent refusers (consent givers but non-participants) in a cohort study, and whether non-response bias can be reduced by converting former non-respondents. METHODS: 6099 French- and 5720 German-speaking Swiss 20-year-old males (more than 94% of the source population) completed a short questionnaire on substance use outcomes and socio-demographics, independent of any further participation in a cohort study. Early respondents were those participating in the cohort study after standard recruitment procedures. Late respondents were non-respondents that were converted through individual encouraging telephone contact. Early respondents, non-consenters and silent refusers were compared to late respondents using logistic regressions. Relative non-response biases for early respondents only, for respondents only (early and late) and for consenters (respondents and silent refusers) were also computed. RESULTS: Late respondents showed generally higher patterns of substance use than did early respondents, but lower patterns than did non-consenters and silent refusers. Converting initial non-respondents to respondents reduced the non-response bias, which might be further reduced if silent refusers were converted to respondents. CONCLUSION: Efforts to convert refusers are effective in reducing non-response bias. However, converted late respondents cannot be seen as proxies of non-respondents, and are at best only indicative of existing response bias due to persistent non-respondents.

Effect on trend estimates of the difference between survey respondents and non-respondents: Results from 27 populations in the WHO MONIICA Project

Introduction: In the World Health Organization (WHO) MONICA (multinational MONItoring of trends and determinants in CArdiovascular disease) Project considerable effort was made to obtain basic data on non-respondents to community based surveys of cardiovascular risk factors. The first purpose of this paper is to examine differences in socio-economic and health profiles among respondents and non-respondents. The second purpose is to investigate the effect of non-response on estimates of trends. Methods:Socio-economic and health profile between respondents and non-respondents in the WHO MONICA Project final survey were compared. The potential effect of non-response on the trend estimates between the initial survey and final survey approximately ten years later was investigated using both MONICA data and hypothetical data. Results: In most of the populations, non-respondents were more likely to be single, less well educated, and had poorer lifestyles and health profiles than respondents. As an example of the consequences, temporal trends in prevalence of daily smokers are shown to be overestimated in most populations if they were based only on data from respondents. Conclusions: The socio-economic and health profiles of respondents and non-respondents differed fairly consistently across 27 populations. Hence, the estimators of population trends based on respondent data are likely to be biased. Declining response rates therefore pose a threat to the accuracy of estimates of risk factor trends in many countries.

Characteristics of non-responders to self-reported questionnaires in a large inflammatory bowel disease cohort study.

BACKGROUND: A major threat to the validity of longitudinal cohort studies is non-response to follow-up, which can lead to erroneous conclusions. The objective of this study was to evaluate the profile of non-responders to self-reported questionnaires in the Swiss inflammatory bowel disease (IBD) Cohort. METHODS: We used data from adult patients enrolled between November 2006 and June 2011. Responders versus non-responders were compared according to socio-demographic, clinical and psychosocial characteristics. Odds ratio for non-response to initial patient questionnaire (IPQ) compared to 1-year follow-up questionnaire (FPQ) were calculated. RESULTS: A total of 1943 patients received IPQ, in which 331 (17%) did not respond. Factors inversely associated with non-response to IPQ were age >50 and female gender (OR = 0.37; p < 0.001 respectively OR = 0.63; p = 0.003) among Crohn's disease (CD) patients, and disease duration >16 years (OR = 0.48; p = 0.025) among patients with ulcerative colitis (UC). FPQ was sent to 1586 patients who had completed the IPQ; 263 (17%) did not respond. Risk factors of non-response to FPQ were mild depression (OR = 2.17; p = 0.003) for CD, and mild anxiety (OR = 1.83; p = 0.024) for UC. Factors inversely associated with non-response to FPQ were: age >30 years, colonic only disease location, higher education and higher IBD-related quality of life for CD, and age >50 years or having a positive social support for UC. CONCLUSIONS: Characteristics of non-responders differed between UC and CD. The risk of non-response to repetitive solicitations (longitudinal versus transversal study) seemed to decrease with age. Assessing non-respondents' characteristics is important to document potential bias in longitudinal studies.

Women's health Australia: Recruitment for a national longitudinal cohort study

The Women's Health Australia (WHA) project is a longitudinal study of several cohorts of Australian women, which aims to examine the relationships between biological, psychological, social and lifestyle factors and women's physical health, emotional well-being, and their use of and satisfaction with health care. Using the Medicare database as a sampling frame (with oversampling of women from rural and remote areas), 106,000 women in the three age groups 18-23, 45-50 and 70-75 were sent an invitation to participate and a 24-page self-complete questionnaire. Reminder letters, a nation-wide publicity campaign, information brochures, a freecall number for inquiries, and the option of completing the questionnaire by telephone in English or in the respondent's own language, were used to encourage participation. Statutory regulations precluded telephone follow-up of non-respondents. Response rates were 41% (N = 14,792), 54% (N = 14,200) and 36% (N = 12,614) for the three age groups. Comparison with Australian census data indicated that the samples are reasonably representative of Australian women in these age groups, except fur a somewhat higher representation of women who are married or in a defacto relationship, and of women with post-school education. The most common reason for non-participation was lack of interest or time. Personal circumstances, objections to the questionnaire or specific items in it, and concerns about confidentiality were the other main reasons. Recruitment of three representative age-group cohorts of women, and the maintenance of these cohorts over a number of years, will provide a valuable opportunity to examine associations over time between aspects of women's lives and their physical and emotional health and well-being.

A bleach program for inmates in NSW: an HIV prevention strategy

Syringe cleaning guidelines for injecting drug users (IDUs) were revised in 1993. This paper examines efforts by IDUs in NSW prisons to adopt the revised guidelines in 1994. Consecutive inmates (229) nearing release were visited and asked to call a toll free number for an interview once released. Respondents (102) did not differ from non-respondents (127). Many respondents (64%) reported ever injecting and many of these reported injecting (58%), sharing (48%) and syringe cleaning (46%) when last in prison. Some (23%) respondents reported adopting the revised syringe cleaning guidelines. Tattooing (38%) was reported more often than sexual activity in prison (4%). A new methodology for prison research was found to be feasible in this study. The potential for HIV to spread in prison still poses major public health challenges.

Impact of international consensus guidelines on antiviral therapy of chronic hepatitis C patients in Switzerland.

To assess the impact of international consensus conference guidelines on the attitude of Swiss specialists when facing the decision to treat chronic hepatitis C patients. Questionnaires focusing on the personal situation and treatment decisions were mailed to 165 patients who were newly diagnosed with hepatitis C virus (HCV) infection and enrolled into the Swiss Hepatitis C Cohort Study during the years 2002-2004. Survey respondents (n = 86, 52.1%) were comparable to non-respondents with respect to severity of liver disease, history of substance abuse and psychiatric co-morbidities. Seventy percent of survey respondents reported having been offered antiviral treatment. Patients deferred from treatment had less advanced liver fibrosis, were more frequently infected with HCV genotypes 1 or 4 and presented more often with a history of depression. There were no differences regarding age, socio-economic background, alcohol abuse, intravenous drug abuse or methadone treatment when compared with patients to whom treatment was proposed. Ninety percent of eligible patients agreed to undergo treatment. Overall, 54.6% of respondents and 78.3% of those considered eligible had actually received antiviral therapy by 2007. Ninety-five percent of patients reported high satisfaction with their own hepatitis C management. Consistent with latest international consensus guidelines, patients enrolled in the Swiss Hepatitis C Cohort with a history of substance abuse were not withheld antiviral treatment. A multidisciplinary approach is warranted to provide antiviral treatment to patients suffering from depression.

Methods and representativeness of European surveys in children and adolescents: the KIDSCREEN study

Background: The objective of the present study was to compare three different sampling and questionnaire administration methods used in the international KIDSCREEN study in terms of participation, response rates, and external validity. Methods: Children and adolescents aged 8–18 years were surveyed in 13 European countries using either telephone sampling and mail administration, random sampling of school listings followed by classroom or mail administration, or multistage random sampling of communities and households with self-administration of the survey materials at home. Cooperation, completion, and response rates were compared across countries and survey methods. Data on non-respondents was collected in 8 countries. The population fraction (PF, respondents in each sex-age, or educational level category, divided by the population in the same category from Eurostat census data) and population fraction ratio (PFR, ratio of PF) and their corresponding 95% confidence intervals were used to analyze differences by country between the KIDSCREEN samples and a reference Eurostat population. Results: Response rates by country ranged from 18.9% to 91.2%. Response rates were highest in the school-based surveys (69.0%–91.2%). Sample proportions by age and gender were similar to the reference Eurostat population in most countries, although boys and adolescents were slightly underrepresented (PFR <1). Parents in lower educational categories were less likely to participate (PFR <1 in 5 countries). Parents in higher educational categories were overrepresented when the school and household sampling strategies were used (PFR = 1.78–2.97). Conclusion: School-based sampling achieved the highest overall response rates but also produced slightly more biased samples than the other methods. The results suggest that the samples were sufficiently representative to provide reference population values for the KIDSCREEN instrument.

The European Social Survey. Methodological aspects

From a scientific point of view, surveys are undoubtedly a valuable tool for the knowledge of the social and political reality. They are widely used in the social sciences research. However, the researcher's task is often disturbed by a series of deficiencies related to some technical aspects that make difficult both the inference and the comparison. The main aim of the present paper is to report and justify the European Social Survey's technical specifications addressed to avoid and/or minimize such deficiencies. The article also gives a characterization of the non-respondents in Spain obtained from the analysis of the 2002 fieldwork data file.

2006 Vineyard Survey Summary, 2006

Survey Methodology: The Iowa Department of Agriculture and Land Stewardship (IDALS) Bureau of Horticulture provided USDA National Agricultural Statistics Service (NASS) Iowa Field office with a complete list of apple and grape growers expected to be in operation. These operations were mailed a questionnaire and a telephone follow-up of non-respondents was conducted. The survey data was edited for reasonableness, and then summarized using statistical software. There were 236 operators who reported they did own, lease or operate a grape vineyard in 2006. The same operators reported 538 acres of grapes.

2006 Winery Survey Summary, 2006

Survey Purpose: The purpose of the survey was to measure the grape consumption, production, and expected needs by cultivar. Survey Methodology: The Iowa Department of Agriculture and Land Stewardship (IDALS) Bureau of Horticulture provided USDA National Agricultural Statistics Service (NASS) Iowa Field office with a complete list of wineries expected to be in operation. The wineries were mailed a questionnaire and a telephone follow-up of non-respondents was conducted. The survey had an 87 percent response rate. The survey data was edited for reasonableness, and then summarized using statistical software.

Identifying Pertinent Variables for Nonresponse Follow-Up Surveys : Lessons Learned from 4 Cases in Switzerland

All social surveys suffer from different types of errors, of which one of the most studied is non-response bias. Non-response bias is a systematic error that occurs because individuals differ in their accessibility and propensity to participate in a survey according to their own characteristics as well as those from the survey itself. The extent of the problem heavily depends on the correlation between response mechanisms and key survey variables. However, non-response bias is difficult to measure or to correct for due to the lack of relevant data about the whole target population or sample. In this paper, non-response follow-up surveys are considered as a possible source of information about non-respondents. Non-response follow-ups, however, suffer from two methodological issues: they themselves operate through a response mechanism that can cause potential non-response bias, and they pose a problem of comparability of measure, mostly because the survey design differs between main survey and non-response follow-up. In order to detect possible bias, the survey variables included in non-response surveys have to be related to the mechanism of participation, but not be sensitive to measurement effects due to the different designs. Based on accumulated experience of four similar non-response follow-ups, we studied the survey variables that fulfill these conditions. We differentiated socio-demographic variables that are measurement-invariant but have a lower correlation with non-response and variables that measure attitudes, such as trust, social participation, or integration in the public sphere, which are more sensitive to measurement effects but potentially more appropriate to account for the non-response mechanism. Our results show that education level, work status, and living alone, as well as political interest, satisfaction with democracy, and trust in institutions are pertinent variables to include in non-response follow-ups of general social surveys. - See more at: https://ojs.ub.uni-konstanz.de/srm/article/view/6138#sthash.u87EeaNG.dpuf

Suomi 2014 – kulutus ja elämäntapa: Tutkimusseloste ja aineistojen 1999–2014 vertailua

Julkaisussa tarkastellaan syksyllä 2014 kerättyä Suomi 2014 – kulutus ja elämäntapa -postikyselyaineistoa. Kyselylomake lähetettiin kaikkiaan 3000 suomenkieliselle 18–74-vuotiaalle Suomessa asuvalle. Otantamenetelmänä käytettiin yksinkertaista satun-naisotantaa. Aineistossa olevien tapausten lukumäärä on 1 354 ja aineiston lopullinen vastausprosentti 46. Aineiston keruusta ja tallennuksesta vastasi Turun yliopiston taloussosiologian oppiaine. Aineiston keruun kustannuksiin osallistuivat lisäksi Turun yliopiston ja Jyväskylän yliopiston sosiologian oppiaineet. Julkaisussa esitellään aluksi aineiston keräämisprosessi sekä arvioidaan aineiston katoa ja sen vaikutusta aineiston edustavuuteen. Sen jälkeen esitellään Suomi 2014 -kyselyssä käytettyjä uusia kysymystyyppejä. Julkaisun lopussa tarkastellaan sitä, miten suomalaisten kulutukseen ja elämäntapaan viittaavat asenteet, arvomaailma ja poliittinen suuntautuminen ovat muuttuneet vuosina 1999–2014.

Méthodes de rééchantillonnage en méthodologie d'enquête

Le sujet principal de cette thèse porte sur l'étude de l'estimation de la variance d'une statistique basée sur des données d'enquête imputées via le bootstrap (ou la méthode de Cyrano). L'application d'une méthode bootstrap conçue pour des données d'enquête complètes (en absence de non-réponse) en présence de valeurs imputées et faire comme si celles-ci étaient de vraies observations peut conduire à une sous-estimation de la variance. Dans ce contexte, Shao et Sitter (1996) ont introduit une procédure bootstrap dans laquelle la variable étudiée et l'indicateur de réponse sont rééchantillonnés ensemble et les non-répondants bootstrap sont imputés de la même manière qu'est traité l'échantillon original. L'estimation bootstrap de la variance obtenue est valide lorsque la fraction de sondage est faible. Dans le chapitre 1, nous commençons par faire une revue des méthodes bootstrap existantes pour les données d'enquête (complètes et imputées) et les présentons dans un cadre unifié pour la première fois dans la littérature. Dans le chapitre 2, nous introduisons une nouvelle procédure bootstrap pour estimer la variance sous l'approche du modèle de non-réponse lorsque le mécanisme de non-réponse uniforme est présumé. En utilisant seulement les informations sur le taux de réponse, contrairement à Shao et Sitter (1996) qui nécessite l'indicateur de réponse individuelle, l'indicateur de réponse bootstrap est généré pour chaque échantillon bootstrap menant à un estimateur bootstrap de la variance valide même pour les fractions de sondage non-négligeables. Dans le chapitre 3, nous étudions les approches bootstrap par pseudo-population et nous considérons une classe plus générale de mécanismes de non-réponse. Nous développons deux procédures bootstrap par pseudo-population pour estimer la variance d'un estimateur imputé par rapport à l'approche du modèle de non-réponse et à celle du modèle d'imputation. Ces procédures sont également valides même pour des fractions de sondage non-négligeables.

A eficácia do milnaciprano em pacientes ambulatoriais com transtorno depressivo maior não respondedores ao tratamento com ISRSs: um estudo aberto de 12 semanas

CONTEXTO: O objetivo deste estudo é avaliar a eficácia do milnaciprano em pacientes ambulatoriais com depressão maior grave que não respondem em tempo e em dosagem adequados à terapia com ISRSs. MÉTODOS: Um estudo aberto multicêntrico com a duração de 12 semanas foi elaborado para avaliar a eficácia do milnaciprano após falha em um experimento com ISRS. Remissão completa (HAMD-17 < 8) foi o desfecho principal. Os desfechos secundários foram resposta (HAM > 50%), CGI e avaliação da qualidade de vida (WHOQOL-Bref). RESULTADOS: O escore HAMD-17 médio da amostra foi de 27 (7,2). As taxas de remissão com o milnaciprano foram de 17,5%, e as de resposta, 61,3%. Na linha de base, 70,9% dos pacientes foram classificados como gravemente sintomáticos. Ao final do tratamento, 48,1% dos pacientes foram classificados como normais assintomáticos ou sintomáticos limítrofes e 20,2% eram moderadamente sintomáticos. Além disso, os quatro domínios do WHOQOL-Bref, um instrumento genérico de mensuração de qualidade de vida, apresentou diferenças clínicas e estatísticas: CONCLUSÃO: Nossos resultados sugerem que o milnaciprano é uma possível opção para pacientes que não respondem a ISRSs. Uma vez que não há evidências na literatura de um antidepressivo que seja a melhor opção quando um ISRS falha, o uso do milnaciprano deveria ser considerado em casos de pacientes com depressão severa.

Methods and representativeness of a European survey in children and adolescents: the KIDSCREEN study

BACKGROUND: The objective of the present study was to compare three different sampling and questionnaire administration methods used in the international KIDSCREEN study in terms of participation, response rates, and external validity. METHODS: Children and adolescents aged 8-18 years were surveyed in 13 European countries using either telephone sampling and mail administration, random sampling of school listings followed by classroom or mail administration, or multistage random sampling of communities and households with self-administration of the survey materials at home. Cooperation, completion, and response rates were compared across countries and survey methods. Data on non-respondents was collected in 8 countries. The population fraction (PF, respondents in each sex-age, or educational level category, divided by the population in the same category from Eurostat census data) and population fraction ratio (PFR, ratio of PF) and their corresponding 95% confidence intervals were used to analyze differences by country between the KIDSCREEN samples and a reference Eurostat population. RESULTS: Response rates by country ranged from 18.9% to 91.2%. Response rates were highest in the school-based surveys (69.0%-91.2%). Sample proportions by age and gender were similar to the reference Eurostat population in most countries, although boys and adolescents were slightly underrepresented (PFR <1). Parents in lower educational categories were less likely to participate (PFR <1 in 5 countries). Parents in higher educational categories were overrepresented when the school and household sampling strategies were used (PFR = 1.78-2.97). CONCLUSION: School-based sampling achieved the highest overall response rates but also produced slightly more biased samples than the other methods. The results suggest that the samples were sufficiently representative to provide reference population values for the KIDSCREEN instrument.