Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.

Using Factorial Surveys and Stated Choice Experiments to Investigate Discriminatory Attitudes and Preferences

Empirical research on discriminatory attitudes and behaviour grapples with the social undesirability of its object. In many studies using regular survey methods, estimates are biased, and the social context of discrimination is not taken into account. Several methods have been developed, especially to deal with the first problem. In this regard, the estimation of the ‘true value’ of discriminatory attitudes is at the centre of interest. However, methodological contributions focusing on the social context of attitude communication and discriminatory behaviour, as well as the correlation between both, are rare. We present two experimental methods which address those issues: factorial surveys and stated choice experiments. In a first study, the usefulness of factorial surveys is demonstrated with data on German anti-Semitism (N=279). We show that the rate of approval with anti-Semitic statements increases if (a) respondents are told that the majority of fellows agree with such statements, (b) the term “Jews” is replaced by the term “Israelis”, and (c) reference to the Holocaust is made. Apart from the main effects of these experimental factors, significant interaction effects regarding the political attitudes and social status of respondents are observed. In a second study, a stated choice experiment on the purchase of olive oil and tomatoes was conducted in Germany (N=440). We find that respondents prefer Italian and Dutch products (control treatment) compared to Israeli and Palestinian ones (discrimination treatments). There are no significant differences between preferences for a so called ‘Peace product’ (which is produced jointly by Israelis and Palestinians) and products from Italy as well as the Netherlands. Yet, taking discriminatory attitudes (anti-Semitic and anti-Arabic attitudes) into account, a strong correlation between those attitudes and stated behaviour (purchase of Israeli, Palestinian and jointly produced products) can be found. This adds support to the hypothesis that discriminatory attitudes hold behavioural consequences.

Does the Use of Mobile Devices (Tablets and Smartphones) Affect Stated Choice Behavior in Web Surveys? An Application to Environmental Valuation

Web surveys are becoming increasingly popular in survey research. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. To the best of our knowledge, this is the first study that tests whether the use of mobile devices affects survey characteristics and stated preferences in a web-based choice experiment. The web survey was carried out in Germany with 3,400 respondents, of which 12 per cent used a mobile device (i.e. tablet or smartphone), and comprised a stated choice experiment on externalities of renewable energy production using wind, solar and biomass. Our main finding is that survey characteristics such as interview length and acquiescence tendency are affected by the device used. In contrast to what might be expected, we find that, compared with respondents using desktop computers and laptops, mobile device users spent more time to answer the survey and are less likely to be prone to acquiescence bias. In the choice experiment, mobile device users tended to be more consistent in their stated choices, and there are differences in willingness to pay between both subsamples.

Influenza A(H1N1)pdm09 and cystic fibrosis lung disease: a systematic meta-analysis.

BACKGROUND To systematically assess the literature published on the clinical impact of Influenza A(H1N1)pdm09 on cystic fibrosis (CF) patients. METHODS An online search in PUBMED database was conducted. Original articles on CF patients with Influenza A(H1N1)pdm09 infection were included. We analyzed incidence, symptoms, clinical course and treatment. RESULTS Four surveys with a total of 202 CF patients infected by Influenza A(H1N1)pdm09 were included. The meta-analysis showed that hospitalisation rates were higher in CF patients compared to the general population. While general disease symptoms were comparable, the clinical course was more severe and case fatality rate (CFR) was higher in CF patients compared to asthmatics and the general population. CONCLUSIONS Evidence so far suggests that CF patients infected with Influenza A(H1N1)pdm09 show increased morbidity and a higher CFR compared to patients with other chronic respiratory diseases and healthy controls. Particularly, CF patients with advanced stage disease seem to be more susceptible to severe lung disease. Accordingly, early antiviral and antibiotic treatment strategies are essential in CF patients. Preventive measures, including vaccination as well as hygiene measures during the influenza season, should be reinforced and improved in CF patients.

Status and Future of Mountain Research: Results of two Surveys by the Research Initative of the Mountain Partnership

This report contains the results of two e-surveys conducted in 2005 and 2006 on the status and future of mountain research, as it presents itself within the Mt. Partnership. The surveys are the main outcome of a meeting of the leading members of the Mountain Partnership’s Research Initiative in 2004.

Erosive tooth wear and wedge-shaped defects in 1996 and 2006: cross- sectional surveys of Swiss army recruits.

The purpose of this study was to determine the prevalence and possible etiological factors of erosive tooth wear and wedge-shaped defects in Swiss Army recruits and compare the findings with those of an analogous study conducted in 1996. In 2006, 621 recruits between 18 and 25 years of age (1996: 417 recruits; ages 19 to 25) were examined for erosive tooth wear and wedge-shaped defects. Additional data was acquired using a questionnaire about personal details, education, dentitions subjective condition, oral hygiene, eating and drinking habits, medications used, and general medical problems. In 2006, 60.1% of those examined exhibited occlusal erosive tooth wear not involving the dentin (1996: 82.0%) and 23.0% involving the dentin (1996: 30.7%). Vestibular erosive tooth wear without dentin involvement was seen in 7.7% in 2006 vs. 14.4% in 1996. Vestibular erosive tooth wear with dentin involvement was rare in both years (0.5%). Oral erosive tooth wear lacking exposed dentin was also rare in those years, although more teeth were affected in 2006 (2.1%) than in 1996 (0.7%). The examinations in 2006 found one or more initial wedge-shaped lesions in 8.5% of the recruits, while 20.4% of the study participants exhibited such in 1996. In 1996, 53% consumed acidic foods and beverages more than 5 times/day; in 2006, 83.9% did so. In neither study did multivariate regression analyses show any significant correlations between occurrence and location of erosive tooth wear and wedge-shaped defects and various other parameters, e.g., eating and hygiene habits, or dentin hyper-sensitivity. Despite a significant increase in consumption of acidic products between 1996 and 2006, the latter study found both fewer erosive tooth wear and fewer wedge-shaped defects (i.e., fewer non-carious lesions.).

The cystatin C/creatinine ratio, a marker of glomerular filtration quality: associated factors, reference intervals, and prediction of morbidity and mortality in healthy seniors.

The ratio of cystatin C (cysC) to creatinine (crea) is regarded as a marker of glomerular filtration quality associated with cardiovascular morbidities. We sought to determine reference intervals for serum cysC-crea ratio in seniors. Furthermore, we sought to determine whether other low-molecular weight molecules exhibit a similar behavior in individuals with altered glomerular filtration quality. Finally, we investigated associations with adverse outcomes. A total of 1382 subjectively healthy Swiss volunteers aged 60 years or older were enrolled in the study. Reference intervals were calculated according to Clinical & Laboratory Standards Institute (CLSI) guideline EP28-A3c. After a baseline exam, a 4-year follow-up survey recorded information about overall morbidity and mortality. The cysC-crea ratio (mean 0.0124 ± 0.0026 mg/μmol) was significantly higher in women and increased progressively with age. Other associated factors were hemoglobin A1c, mean arterial pressure, and C-reactive protein (P < 0.05 for all). Participants exhibiting shrunken pore syndrome had significantly higher ratios of 3.5-66.5 kDa molecules (brain natriuretic peptide, parathyroid hormone, β2-microglobulin, cystatin C, retinol-binding protein, thyroid-stimulating hormone, α1-acid glycoprotein, lipase, amylase, prealbumin, and albumin) and creatinine. There was no such difference in the ratios of very low-molecular weight molecules (urea, uric acid) to creatinine or in the ratios of molecules larger than 66.5 kDa (transferrin, haptoglobin) to creatinine. The cysC-crea ratio was significantly predictive of mortality and subjective overall morbidity at follow-up in logistic regression models adjusting for several factors. The cysC-crea ratio exhibits age- and sex-specific reference intervals in seniors. In conclusion, the cysC-crea ratio may indicate the relative retention of biologically active low-molecular weight compounds and can independently predict the risk for overall mortality and morbidity in the elderly.

Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?

Web surveys are becoming increasingly popular in survey research including stated preference surveys. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. This is the first study that tests whether the use of mobile devices, tablets or smartphones, affects survey characteristics and stated preferences in a web-based choice experiment. The web survey on expanding renewable energy production in Germany was carried out with 3182 respondents, of which 12% used a mobile device. Propensity score matching is used to account for selection bias in the use of mobile devices for survey completion. We find that mobile device users spent more time than desktop/laptop users to answer the survey. Yet, desktop/laptop users and mobile device users do not differ in acquiescence tendency as an indicator of extreme response patterns. For mobile device users only, we find a negative correlation between screen size and interview length and a positive correlation between screen size and acquiescence tendency. In the choice experiment data, we do not find significant differences in the tendency to choose the status quo option and scale between both subsamples. However, some of the estimates of implicit prices differ, albeit not in a unidirectional fashion. Model results for mobile device users indicate a U-shaped relationship between error variance and screen size. Together, the results suggest that using mobile devices is not detrimental to survey quality.

Training primary care physicians to offer their patients faecal occult blood testing and colonoscopy for colorectal cancer screening on an equal basis: a pilot intervention with before-after and parallel group surveys.

OBJECTIVES Primary care physicians (PCPs) should prescribe faecal immunochemical testing (FIT) or colonoscopy for colorectal cancer screening based on their patient's values and preferences. However, there are wide variations between PCPs in the screening method prescribed. The objective was to assess the impact of an educational intervention on PCPs' intent to offer FIT or colonoscopy on an equal basis. DESIGN Survey before and after training seminars, with a parallel comparison through a mailed survey to PCPs not attending the training seminars. SETTING All PCPs in the canton of Vaud, Switzerland. PARTICIPANTS Of 592 eligible PCPs, 133 (22%) attended a seminar and 106 (80%) filled both surveys. 109 (24%) PCPs who did not attend the seminars returned the mailed survey. INTERVENTION A 2 h-long interactive seminar targeting PCP knowledge, skills and attitudes regarding offering a choice of colorectal cancer (CRC) screening options. OUTCOME MEASURES The primary outcome was PCP intention of having their patients screened with FIT and colonoscopy in equal proportions (between 40% and 60% each). Secondary outcomes were the perceived role of PCPs in screening decisions (from paternalistic to informed decision-making) and correct answer to a clinical vignette. RESULTS Before the seminars, 8% of PCPs reported that they had equal proportions of their patients screened for CRC by FIT and colonoscopy; after the seminar, 33% foresaw having their patients screened in equal proportions (p<0.001). Among those not attending, there was no change (13% vs 14%, p=0.8). Of those attending, there was no change in their perceived role in screening decisions, while the proportion responding correctly to a clinical vignette increased (88-99%, p<0.001). CONCLUSIONS An interactive training seminar increased the proportion of physicians with the intention to prescribe FIT and colonoscopy in equal proportions.

Rhinovirus Infections and Associated Respiratory Morbidity in Infants: A Prospective Cohort Study.

BACKGROUND Risk factors promoting rhinovirus (RV) infections are inadequately described in healthy populations, especially infants. OBJECTIVES To determine the frequency of symptomatic and asymptomatic RV infections and identify possible risk factors from host and environment among otherwise healthy infants. METHODS In a prospective birth cohort, respiratory health was assessed in 41 term-born infants by weekly telephone interviews during the first year of life, and weekly nasal swabs were collected to determine RV prevalence. In a multilevel logistic regression model, associations between prevalence and respiratory symptoms during RV infections and host/environmental factors were determined. RESULTS 27% of nasal swabs in 41 infants tested positive for RVs. Risk factors for RV prevalence were autumn months (OR=1.71, p=0.01, 95% CI 1.13-2.61), outdoor temperatures between 5-10 °C (OR=2.33, p=0.001, 95% CI 1.41-3.86), older siblings (OR=2.60, p=0.001, 95% CI 1.50-4.51) and childcare attendance (OR=1.53, p=0.07, 95% CI 0.96-2.44). 51% of RV-positive samples were asymptomatic. Respiratory symptoms during RV infections were less likely during the first three months of life (OR=0.34, p=0.003, 95% CI 0.17-0.69) and in infants with atopic mothers (OR=0.44, p=0.008, 95% CI 0.24-0.80). Increased tidal volume (OR=1.67, p=0.03, 95% CI 1.04-2.68) and outdoor temperatures between 2-5 °C (OR=2.79, p=0.02, 95% CI 1.17-6.61) were associated with more symptoms. CONCLUSIONS RVs are highly prevalent during the first year of life, and most infections are asymptomatic. Frequency of RV infections is associated with environmental factors, while respiratory symptoms during RV infections are linked to host determinants like infant age, maternal atopy, or premorbid lung function.

Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT)

Gaining valid answers to so-called sensitive questions is an age-old problem in survey research. Various techniques have been developed to guarantee anonymity and minimize the respondent's feelings of jeopardy. Two such techniques are the randomized response technique (RRT) and the unmatched count technique (UCT). In this study we evaluate the effectiveness of different implementations of the RRT (using a forced-response design) in a computer-assisted setting and also compare the use of the RRT to that of the UCT. The techniques are evaluated according to various quality criteria, such as the prevalence estimates they provide, the ease of their use, and respondent trust in the techniques. Our results indicate that the RRTs are problematic with respect to several domains, such as the limited trust they inspire and non-response, and that the RRT estimates are unreliable due to a strong false "no" bias, especially for the more sensitive questions. The UCT, however, performed well compared to the RRTs on all the evaluated measures. The UCT estimates also had more face validity than the RRT estimates. We conclude that the UCT is a promising alternative to RRT in self-administered surveys and that future research should be directed towards evaluating and improving the technique.