Testing for Measurement Equivalence in Surveys: Dimensions of Social Trust across Cultural Contexts

Our study evaluates the dimensionality and equivalence of social trust across cultural contexts, using new data from Switzerland and the World Values Survey 2005–2008. Whereas some scholars assert that trust should be regarded as a coherent concept, others claim that trust is better conceived of as a multidimensional concept. In contrast to the conventional dichotomy of the forms of social trust, we identify three distinct forms of trust, namely, particularized, generalized, and identity-based trust. Moreover, we dispute the view that respondents understand the wording of survey questions regarding social trust differently between different cultural contexts, which would imply that comparative research on trust is a pointless endeavor. Applying multiple-group confirmatory factor analysis to the various constructs of social trust, we conclude that one may study relationships among the three forms of trust and other theoretical constructs as well as compare latent means across cultural contexts. Our analyses therefore provide an optimistic outlook for future comparative analyses that investigate forms of social trust across cultural contexts.

Antisemitismus heute. Zur Messung aktueller Erscheinungsformen von Judenfeindlichkeit mithilfe des faktoriellen Surveys

In der empirischen Antisemitismusforschung ist die standardisierte Befragung die populärste Methode der Datenerhebung. Ihre Verwendung kann jedoch weder die von Befragten wahrgenommene Normativität des Themas noch die situative Kontextabhängigkeit antisemitischer Kommunikation angemessen berücksichtigen. Die Methode des faktoriellen Surveys (auch „Vignettenexperiment“) bietet die Möglichkeit, solche situativen Merkmale systematisch zu variieren und so ihren Einfluss zu ermitteln. Damit wird eine bessere Operationalisierung von Kommunikationslatenz möglich, einem einflussreichen Konzept in der Antisemitismusforschung, dessen empirische Plausibilität unsere Studie zeigt. Sowohl Konsensgruppen- als auch Umwegkommunikation sind in der vorliegenden Stichprobe von Bedeutung: Stimmt die Mehrheit der Anwesenden antisemitischen Vorurteilen zu, steigt der Grad der Zustimmung zu antisemitischen Aussagen ebenso, wie wenn bei einer antisemitischen Aussage der Begriff „Juden“ durch den Begriff „Israelis“ ersetzt wird. Wird auf die deutsche Vergangenheit Bezug genommen, steigt die Zustimmung zu antisemitischen Aussagen ebenfalls (sekundärer Antisemitismus). Konsensgruppenkommunikation ist besonders bei eher links eingestellten Befragten, Umwegkommunikation besonders bei Personen mit niedrigem sozialen Status zu beobachten.

Sensitive Questions in Online Surveys: An Experimental Comparison of the RRT and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies show that asking sensitive questions is problematic also in self-administered mode. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors gained via online surveys can be challenged. A wellknown method to combat these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online mode is still lacking. Moreover, an alternative approach called the Crosswise Model (CM) has recently been suggested to overcome some of the deficiencies of the RRT. We therefore conducted an experimental study in which different implementations of the RRT and the CM have been tested and compared to direct questioning. Our study is a large-scale online survey on sensitive behaviors by students such as cheating in exams and paper plagiarism. The results of the study reveal poor per-formance of the RRT, while the CM yielded significantly higher estimates of sensitive behaviors than direct questioning. We conclude that the CM is a promising approach for asking sensitive questions in self-administered surveys.

Asking Sensitive Questions in Online Surveys: An Experimental Comparison of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies show that asking sensitive questions is problematic also in self-administered mode. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors gained via online surveys can be challenged. A well-known method to combat these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online mode is still lacking. Moreover, an alternative approach called the Crosswise Model (CM) has recently been suggested to overcome some of the deficiencies of the RRT. In the context of an online survey on plagiarism and cheating on exams among students of two Swiss universities (N = 6,494), we tested different implementations of the RRT and the CM and compared them to direct questioning using a randomized experimental design. Results reveal a poor performance of the RRT, which failed to elicit higher prevalence estimates than direct questioning. Using the CM however, significantly higher prevalence estimates were obtained making it a promising new alternative to the conventional RRT.

Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.

Using Factorial Surveys and Stated Choice Experiments to Investigate Discriminatory Attitudes and Preferences

Empirical research on discriminatory attitudes and behaviour grapples with the social undesirability of its object. In many studies using regular survey methods, estimates are biased, and the social context of discrimination is not taken into account. Several methods have been developed, especially to deal with the first problem. In this regard, the estimation of the ‘true value’ of discriminatory attitudes is at the centre of interest. However, methodological contributions focusing on the social context of attitude communication and discriminatory behaviour, as well as the correlation between both, are rare. We present two experimental methods which address those issues: factorial surveys and stated choice experiments. In a first study, the usefulness of factorial surveys is demonstrated with data on German anti-Semitism (N=279). We show that the rate of approval with anti-Semitic statements increases if (a) respondents are told that the majority of fellows agree with such statements, (b) the term “Jews” is replaced by the term “Israelis”, and (c) reference to the Holocaust is made. Apart from the main effects of these experimental factors, significant interaction effects regarding the political attitudes and social status of respondents are observed. In a second study, a stated choice experiment on the purchase of olive oil and tomatoes was conducted in Germany (N=440). We find that respondents prefer Italian and Dutch products (control treatment) compared to Israeli and Palestinian ones (discrimination treatments). There are no significant differences between preferences for a so called ‘Peace product’ (which is produced jointly by Israelis and Palestinians) and products from Italy as well as the Netherlands. Yet, taking discriminatory attitudes (anti-Semitic and anti-Arabic attitudes) into account, a strong correlation between those attitudes and stated behaviour (purchase of Israeli, Palestinian and jointly produced products) can be found. This adds support to the hypothesis that discriminatory attitudes hold behavioural consequences.

Does the Use of Mobile Devices (Tablets and Smartphones) Affect Stated Choice Behavior in Web Surveys? An Application to Environmental Valuation

Web surveys are becoming increasingly popular in survey research. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. To the best of our knowledge, this is the first study that tests whether the use of mobile devices affects survey characteristics and stated preferences in a web-based choice experiment. The web survey was carried out in Germany with 3,400 respondents, of which 12 per cent used a mobile device (i.e. tablet or smartphone), and comprised a stated choice experiment on externalities of renewable energy production using wind, solar and biomass. Our main finding is that survey characteristics such as interview length and acquiescence tendency are affected by the device used. In contrast to what might be expected, we find that, compared with respondents using desktop computers and laptops, mobile device users spent more time to answer the survey and are less likely to be prone to acquiescence bias. In the choice experiment, mobile device users tended to be more consistent in their stated choices, and there are differences in willingness to pay between both subsamples.

Status and Future of Mountain Research: Results of two Surveys by the Research Initative of the Mountain Partnership

This report contains the results of two e-surveys conducted in 2005 and 2006 on the status and future of mountain research, as it presents itself within the Mt. Partnership. The surveys are the main outcome of a meeting of the leading members of the Mountain Partnership’s Research Initiative in 2004.