Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.

Using Factorial Surveys and Stated Choice Experiments to Investigate Discriminatory Attitudes and Preferences

Empirical research on discriminatory attitudes and behaviour grapples with the social undesirability of its object. In many studies using regular survey methods, estimates are biased, and the social context of discrimination is not taken into account. Several methods have been developed, especially to deal with the first problem. In this regard, the estimation of the ‘true value’ of discriminatory attitudes is at the centre of interest. However, methodological contributions focusing on the social context of attitude communication and discriminatory behaviour, as well as the correlation between both, are rare. We present two experimental methods which address those issues: factorial surveys and stated choice experiments. In a first study, the usefulness of factorial surveys is demonstrated with data on German anti-Semitism (N=279). We show that the rate of approval with anti-Semitic statements increases if (a) respondents are told that the majority of fellows agree with such statements, (b) the term “Jews” is replaced by the term “Israelis”, and (c) reference to the Holocaust is made. Apart from the main effects of these experimental factors, significant interaction effects regarding the political attitudes and social status of respondents are observed. In a second study, a stated choice experiment on the purchase of olive oil and tomatoes was conducted in Germany (N=440). We find that respondents prefer Italian and Dutch products (control treatment) compared to Israeli and Palestinian ones (discrimination treatments). There are no significant differences between preferences for a so called ‘Peace product’ (which is produced jointly by Israelis and Palestinians) and products from Italy as well as the Netherlands. Yet, taking discriminatory attitudes (anti-Semitic and anti-Arabic attitudes) into account, a strong correlation between those attitudes and stated behaviour (purchase of Israeli, Palestinian and jointly produced products) can be found. This adds support to the hypothesis that discriminatory attitudes hold behavioural consequences.

Does the Use of Mobile Devices (Tablets and Smartphones) Affect Stated Choice Behavior in Web Surveys? An Application to Environmental Valuation

Web surveys are becoming increasingly popular in survey research. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. To the best of our knowledge, this is the first study that tests whether the use of mobile devices affects survey characteristics and stated preferences in a web-based choice experiment. The web survey was carried out in Germany with 3,400 respondents, of which 12 per cent used a mobile device (i.e. tablet or smartphone), and comprised a stated choice experiment on externalities of renewable energy production using wind, solar and biomass. Our main finding is that survey characteristics such as interview length and acquiescence tendency are affected by the device used. In contrast to what might be expected, we find that, compared with respondents using desktop computers and laptops, mobile device users spent more time to answer the survey and are less likely to be prone to acquiescence bias. In the choice experiment, mobile device users tended to be more consistent in their stated choices, and there are differences in willingness to pay between both subsamples.

Status and Future of Mountain Research: Results of two Surveys by the Research Initative of the Mountain Partnership

This report contains the results of two e-surveys conducted in 2005 and 2006 on the status and future of mountain research, as it presents itself within the Mt. Partnership. The surveys are the main outcome of a meeting of the leading members of the Mountain Partnership’s Research Initiative in 2004.

Erosive tooth wear and wedge-shaped defects in 1996 and 2006: cross- sectional surveys of Swiss army recruits.

The purpose of this study was to determine the prevalence and possible etiological factors of erosive tooth wear and wedge-shaped defects in Swiss Army recruits and compare the findings with those of an analogous study conducted in 1996. In 2006, 621 recruits between 18 and 25 years of age (1996: 417 recruits; ages 19 to 25) were examined for erosive tooth wear and wedge-shaped defects. Additional data was acquired using a questionnaire about personal details, education, dentitions subjective condition, oral hygiene, eating and drinking habits, medications used, and general medical problems. In 2006, 60.1% of those examined exhibited occlusal erosive tooth wear not involving the dentin (1996: 82.0%) and 23.0% involving the dentin (1996: 30.7%). Vestibular erosive tooth wear without dentin involvement was seen in 7.7% in 2006 vs. 14.4% in 1996. Vestibular erosive tooth wear with dentin involvement was rare in both years (0.5%). Oral erosive tooth wear lacking exposed dentin was also rare in those years, although more teeth were affected in 2006 (2.1%) than in 1996 (0.7%). The examinations in 2006 found one or more initial wedge-shaped lesions in 8.5% of the recruits, while 20.4% of the study participants exhibited such in 1996. In 1996, 53% consumed acidic foods and beverages more than 5 times/day; in 2006, 83.9% did so. In neither study did multivariate regression analyses show any significant correlations between occurrence and location of erosive tooth wear and wedge-shaped defects and various other parameters, e.g., eating and hygiene habits, or dentin hyper-sensitivity. Despite a significant increase in consumption of acidic products between 1996 and 2006, the latter study found both fewer erosive tooth wear and fewer wedge-shaped defects (i.e., fewer non-carious lesions.).

Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?

Web surveys are becoming increasingly popular in survey research including stated preference surveys. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. This is the first study that tests whether the use of mobile devices, tablets or smartphones, affects survey characteristics and stated preferences in a web-based choice experiment. The web survey on expanding renewable energy production in Germany was carried out with 3182 respondents, of which 12% used a mobile device. Propensity score matching is used to account for selection bias in the use of mobile devices for survey completion. We find that mobile device users spent more time than desktop/laptop users to answer the survey. Yet, desktop/laptop users and mobile device users do not differ in acquiescence tendency as an indicator of extreme response patterns. For mobile device users only, we find a negative correlation between screen size and interview length and a positive correlation between screen size and acquiescence tendency. In the choice experiment data, we do not find significant differences in the tendency to choose the status quo option and scale between both subsamples. However, some of the estimates of implicit prices differ, albeit not in a unidirectional fashion. Model results for mobile device users indicate a U-shaped relationship between error variance and screen size. Together, the results suggest that using mobile devices is not detrimental to survey quality.

Training primary care physicians to offer their patients faecal occult blood testing and colonoscopy for colorectal cancer screening on an equal basis: a pilot intervention with before-after and parallel group surveys.

OBJECTIVES Primary care physicians (PCPs) should prescribe faecal immunochemical testing (FIT) or colonoscopy for colorectal cancer screening based on their patient's values and preferences. However, there are wide variations between PCPs in the screening method prescribed. The objective was to assess the impact of an educational intervention on PCPs' intent to offer FIT or colonoscopy on an equal basis. DESIGN Survey before and after training seminars, with a parallel comparison through a mailed survey to PCPs not attending the training seminars. SETTING All PCPs in the canton of Vaud, Switzerland. PARTICIPANTS Of 592 eligible PCPs, 133 (22%) attended a seminar and 106 (80%) filled both surveys. 109 (24%) PCPs who did not attend the seminars returned the mailed survey. INTERVENTION A 2 h-long interactive seminar targeting PCP knowledge, skills and attitudes regarding offering a choice of colorectal cancer (CRC) screening options. OUTCOME MEASURES The primary outcome was PCP intention of having their patients screened with FIT and colonoscopy in equal proportions (between 40% and 60% each). Secondary outcomes were the perceived role of PCPs in screening decisions (from paternalistic to informed decision-making) and correct answer to a clinical vignette. RESULTS Before the seminars, 8% of PCPs reported that they had equal proportions of their patients screened for CRC by FIT and colonoscopy; after the seminar, 33% foresaw having their patients screened in equal proportions (p<0.001). Among those not attending, there was no change (13% vs 14%, p=0.8). Of those attending, there was no change in their perceived role in screening decisions, while the proportion responding correctly to a clinical vignette increased (88-99%, p<0.001). CONCLUSIONS An interactive training seminar increased the proportion of physicians with the intention to prescribe FIT and colonoscopy in equal proportions.

Tobacco use and related psychosocial risk factors among youth in urban India: Assessment of Project MYTRI follow-up surveys

Project MYTRI (Mobilizing Youth for Tobacco-Related Initiatives in India) was a large 2-year randomized school-based trial with a goal to reduce and prevent tobacco use among students in 6th and 8th grades in Delhi and Chennai in India (n=32 schools). Baseline analyses in 2004 showed that 6th grade students reported more tobacco use than 8 th grade students, opposite of what is typically observed in developed countries like the US. The present study aims to study differences in tobacco use and psychosocial risk factors between the 6th grade cohort and 8th grade cohort, in a compliant sub-sample of control students that were present at all 3 surveys from 2004-06. Both in 2004 and 2005, 6th grade cohort reported significantly greater prevalence of ever use of all tobacco products (cigarettes, bidis, chewing tobacco, any tobacco). These significant differences in ever use of any tobacco between cohorts were maintained by gender, city and socioeconomic status. The 6th grade cohort also reported significantly greater prevalence of current use of tobacco products (cigarettes, chewing tobacco, any tobacco) in 2004. Similar findings were observed for psychosocial risk factors for tobacco use, where the 6th grade cohort scored higher risk than 8th grade cohort on scales for intentions to smoke or chew tobacco and susceptibility to smoke or chew tobacco in 2004 and 2005, and for knowledge of health effects of tobacco in all three years.^ The evidence of early initiation of tobacco use in our 6th grade cohort in India indicates the need to target prevention programs and other tobacco control measures from a younger age in this setting. With increasing proportions of total deaths and lost DALYs in India being attributable to chronic diseases, addressing tobacco use among younger cohorts is even more critical. Increase in tobacco use among youth is a cause for concern with respect to future burden of chronic disease and tobacco-related mortality in many developing countries. Similarly, epidemiological studies that aim to predict future death and disease burden due to tobacco should address the early age at initiation and increasing prevalence rates among younger populations. ^

Spatially explicit estimates of length and biomass of Micromesistius poutassou (Blue Whiting) and Clupea harengus (Norwegian spring spawning herring) from acoustic and trawl surveys in the North-East Atlantic (2004-2012)

Acoustic estimates of herring and blue whiting abundance were obtained during the surveys using the Simrad ER60 scientific echosounder. The allocation of NASC-values to herring, blue whiting and other acoustic targets were based on the composition of the trawl catches and the appearance of echo recordings. To estimate the abundance, the allocated NASC -values were averaged for ICES-squares (0.5° latitude by 1° longitude). For each statistical square, the unit area density of fish (rA) in number per square nautical mile (N*nm-2) was calculated using standard equations (Foote et al., 1987; Toresen et al., 1998). To estimate the total abundance of fish, the unit area abundance for each statistical square was multiplied by the number of square nautical miles in each statistical square and then summed for all the statistical squares within defined subareas and over the total area. Biomass estimation was calculated by multiplying abundance in numbers by the average weight of the fish in each statistical square then summing all squares within defined subareas and over the total area. The Norwegian BEAM soft-ware (Totland and Godø 2001) was used to make estimates of total biomass.

Spatially explicit estimates of length and biomass of Micromesistius poutassou (Blue Whiting) from acoustic and trawl surveys in the North-East Atlantic in May 2007

Acoustic estimates of herring and blue whiting abundance were obtained during the surveys using the Simrad ER60 scientific echosounder. The allocation of NASC-values to herring, blue whiting and other acoustic targets were based on the composition of the trawl catches and the appearance of echo recordings. To estimate the abundance, the allocated NASC -values were averaged for ICES-squares (0.5° latitude by 1° longitude). For each statistical square, the unit area density of fish (rA) in number per square nautical mile (N*nm-2) was calculated using standard equations (Foote et al., 1987; Toresen et al., 1998). To estimate the total abundance of fish, the unit area abundance for each statistical square was multiplied by the number of square nautical miles in each statistical square and then summed for all the statistical squares within defined subareas and over the total area. Biomass estimation was calculated by multiplying abundance in numbers by the average weight of the fish in each statistical square then summing all squares within defined subareas and over the total area. The Norwegian BEAM soft-ware (Totland and Godø 2001) was used to make estimates of total biomass.