Design effect and interviewer effects: Evidence from the Spanish ESS3-2006 Data

In 2007 the first Quality Enhancement Meeting on sampling in the European SocialSurvey (ESS) took place. The discussion focused on design effects and inteviewereffects in face-to-face interviews. Following the recomendations of this meeting theSpanish ESS team studied the impact of interviewers as a new element in the designeffect in the response s variance using the information of the correspondent SampleDesign Data Files. Hierarchical multilevel and cross-classified multilevel analysis areconducted in order to estimate the amount of responses variation due to PSU and tointerviewers for different questions in the survey. Factor such as the age of theinterviewer, gender, workload, training and experience and respondent characteristicssuch as age, gender, renuance to participate and their possible interactions are alsoincluded in the analysis of some specific questions like trust in politicians and trustin legal system . Some recomendations related to future sampling designs and thecontents of the briefing sessions are derived from this initial research.

Effects of Interviewer Experience on Components of Nonresponse in the European Social Survey

We analyze interviewer related nonresponse differences in face-to-face surveys distinguishing three types of interviewers: those who have previous experience with the same high standard cross-sectional survey ("experienced"), those who were chosen by the survey agency to complete refusal conversions ("seniors"), and usual interviewers. The nonresponse components are obtaining household contact, target person contact, and target person cooperation. In addition we examine if interviewer homogeneity with respect to these components is different across the three interviewer groups. Data come from the European Social Survey (ESS) contact forms from four countries which participated during the three rounds 2002/04/06 and used the same survey agency that in turn used to some extent the same interviewers. To analyze interviewer effects, we use discrete two-level models. We find some evidence of better performance by both senior and experienced interviewers and indications of greater homogeneity for nonresponse components, especially for those that contain room for improvement. Surprisingly, the senior interviewers do not outperform those experienced. We conclude that survey agencies should make more efforts to decrease the comparatively high interviewer turnover.

How Answers on Political Attitudes are Shaped by Interviewers: Evidence from a Panel Survey

We analyze whether the interviewers' political opinions have an influence on those of the respondents. The research uses data from a panel survey in which interviewers are randomly assigned to respondents. The results show that the respondents express significantly similar opinions to those of the interviewers in all questions considered. Multilevel models show that more educated respondents are affected to a slightly higher extent and that the interviewer's experience is also a factor. There is no difference between different respondent subgroups or when both interviewers and respondents share the same socio-demographic characteristics. While there is no evidence for respondents wanting to please the interviewers, the hypothesis of socially desirable behavior can indeed be confirmed.

Cross National Contact Strategies

Using paradata gathered from the 11-nation Survey of Health, Ageing and Retirement in Europe (SHARE), this paper examines the impact of the first contact attempt and the first contact properties, respectively, on contact and response efficiency using logistic multilevel models. We find that despite the different sample frames and interviewer compensation structure between countries, there are no considerable country effects with respect to making contact, once interviewer effects are controlled. Moreover, results point to an increased efficiency associated with evenings especially on Sundays, at least on the very first contact attempt. For attempts that result in initial contact, Saturday afternoons are most likely to eventually lead to completed interviews, followed by initial contact on weekdays during the daytime. We hypothesize that this may be due to the SHARE sample being composed of people aged 50 and over.

Online interviewing in psychology: reflections on the process

The internet is used across a range of disciplines to conduct qualitative research and qualitative psychologists are increasingly turning to the internet as a medium for conducting interviews. In this article we explore the first author’s experience of conducting synchronous online interviews using instant messaging or ‘chat’ software. We highlight the costs and benefits of conducting online interviews and reflect on the development of a rapport with participants within this medium. In particular, we consider how researchers can attempt to make online interviewing less abrupt and more conversational, how researchers can demonstrate ‘listening’ and how insider/outsider status of the interviewer effects interaction within online interviews.

The Politics of Gender Socialization

This manuscript is comprised of three papers that examine the far-reaching and often invisible political outcomes of gender role socialization in the United States. These papers focus primarily on two areas: political confidence amongst girls and women, and the effects of gender on survey measurement and data quality.

Chapter one focuses on political confidence, and the likelihood that women will run for political office. Women continue to be underrepresented at all levels of political leadership, and their lack of political ambition, relative to men, has been identified as a primary cause. In this paper, I explore the relationship between an individual's masculinity and femininity and her development of political ambition. Using original survey data from the 2012 Cooperative Congressional Election Study (CCES), I first empirically demonstrate that gender (masculinity/femininity) and sex (male/female) are unique elements of identity and, moreover, are both independently related to political ambition. I then explore the relevance of gender for the study of candidate emergence, testing whether and how masculinity and femininity might be related to political ambition are supported empirically. While the results suggest that masculinity is positively associated with the development of political ambition, the relationship between femininity and candidate emergence seems to be more complicated and not what prevailing stereotypes might lead us to expect. Moreover, while the relationship between masculinity and political ambition is the same for men and women, the relationship between femininity and political ambition is very different for women than it is for men. This study suggests that gender role socialization is highly related with both men's and women's desire to seek positions of political leadership.

Chapter two continues this exploration of gendered differences in the development of political ambition, this time exploring how social attractiveness and gendered perceptions of political leadership impact the desire to hold political office.Women are persistently underrepresented as candidates for public office and remain underrepresented at all levels of government in the United States. Previous literature suggests that the gendered ambition gap, gender socialization, insufficient recruitment, media scrutiny, family responsibilities, modern campaign strategies, and political opportunity structures all contribute to the gender imbalance in pools of officeholders and candidates. To explain women's reticence to run, scholars have offered explanations addressing structural, institutional, and individual-level factors that deter women from becoming candidates, especially for high positions in the U.S. government. This paper examines a previously unexplored factor: how dating and socialized norms of sexual attraction affect political ambition. This study investigates whether young, single, and heterosexual women's desire for male attention and fear of being perceived as unattractive or "too ambitious" present obstacles to running for office. The results of these experiments suggest that social expectations about gender, attraction and sexuality, and political office-holding may contribute to women's reticence to pursue political leadership. Chapter two is a co-authored work and represents the joint efforts of Laura Lazarus Frankel, Shauna Shames, and Nadia Farjood.

Chapter 3 bridges survey methodology and gender socialization, focusing on how interviewer sex affects survey measurement and data quality. Specifically, this paper examines whether and how matching interviewer and respondent sex affects panel attrition--respondents dropping out of the study after participating in the first wave. While the majority of research on interviewer effects suggests that matching interviewer and respondent characteristics (homophily) yields higher quality data, little work has examined whether this pattern holds true in the area of panel attrition. Using paradata from the General Social Survey (GSS), I explore this question. My analysis reveals that, despite its broader positive effects on data quality, matching interviewer and respondent sex increases likelihood to attrit. Interestingly, this phenomenon only emerges amongst male respondents. However, while assigning female interviewers to male respondents decreases their propensity to attrit, it also increases the likelihood of biased responses on gender related items. These conflicting outcomes represent a tradeoff for scholars and survey researchers, requiring careful consideration of mode, content, and study goals when designing surveys and/or analyzing survey data. The implications of these patterns and areas for further research are discussed.

Together, these papers illustrate two ways that gender norms are related to political outcomes: they contribute to patterns of candidate emergence and affect the measurement of political attitudes and behaviors.

Cooperation in centralised CATI Household Panel Surveys : A Contact-based Multilevel Analysis to Examine Interviewer, Respondent, and Fieldwork Process Effects

In this research, we analyse the contact-specific mean of the final cooperation probability, distinguishing on the one hand between contacts with household reference persons and with other eligible household members, and on the other hand between first and later contacts. Data comes from two Swiss Household Panel surveys. The interviewer-specific variance is higher for first contacts, especially in the case of the reference person. For later contacts with the reference person, the contact-specific variance dominates. This means that interaction effects and situational factors are decisive. The contact number has negative effects on the performance of contacts with the reference person, positive in the case of other persons. Also time elapsed since the previous contact has negative effects in the case of reference persons. The result of the previous contact has strong effects, especially in the case of the reference person. These findings call for a quick completion of the household grid questionnaire, assigning the best interviewers to conducting the first contact. While obtaining refusals has negative effects, obtaining other contact results has only weak effects on the interviewer's subsequent contact outcome. Using the same interviewer for contacts has no positive effects.

Interviewer and Respondent Survey Quality Effects in a CATI Panel

Especially in panel surveys, respondent attrition, respondent learning, and interviewer experience effects play a crucial role with respect to data quality. We examine three interview survey quality indicators in the same survey in a cross sectional as well as in a longitudinal way. In the cross sectional analysis we compare data quality in the mature original sample with that in a refreshment sample, surveyed in the same wave. Because in the same wave an interviewer survey was conducted, collecting attitudes on their socio demography, survey attitudes and burden measures, we are able to consider interviewer fixed effects as well. The longitudinal analysis gives more insight in the respondent learning effects with respect to the quality indicators considered by considering the very same respondents across waves. The Swiss Household Panel, a CATI survey representative of the Swiss residential population, forms an ideal modelling database: the interviewer - respondent assignment is random, both within and across waves. This design avoids possible confusion with other effects stemming from a non-random assignment of interviewers, e.g. area effects or effects from assigning the best interviewers to the hard cases. In order to separate interviewer, respondent and wave effects, we build cross-classified multilevel models.

A Note on Interviewer Performance Measures in centralised CATI Surveys

Interviewer performance with respect to convincing sample members to participate in surveys is an important dimension of survey quality. However, unlike in CAPI surveys where each sample case 'belongs' to one interviewer, there are hardly any good measures of interview performance for centralised CATI surveys, where even single contacts are assigned to interviewers at random. If more than one interviewer works one sample case, it is not clear how to attribute success or failure to the interviewers involved. In this article, we propose two correlated methods to measure interviewer contact performance in centralised CATI surveys. Their modelling must take complex multilevel clustering effects, which need not be hierarchical, into account. Results are consistent with findings from CAPI data modelling, and we find that when comparing effects with a direct ('naive') measure of interviewer contact results, interviewer random effects are largely underestimated using the naive measure.

Personal uses and perceived social and economic effects of advertising in Bulgaria and Romania

Purpose - The objective of this paper is to uncover the underlying dimensions of, and examine the similarities and differences in, personal uses of advertising, perceived socio-economic effects of advertising, and consumer beliefs and attitudes toward advertising in Bulgaria and Romania. Moreover, it aims to identify the relative importance of the predictors of attitudes toward advertising in the two countries. Design/methodology/approach - The paper draws upon findings of previous research and theoretical developments by Bauer and Greyser, Sandage and Leckenby, and Pollay and Mittal. The study uses a stratified random sample of 947 face-to-face interviews with adult respondents from major urban areas in Bulgaria (507) and Romania (440). Variables are measured on multi-item scales as a typical application of the reflective indicator model. Findings - Results show that there are significant differences between Romanian and Bulgarian respondents in terms of their attitudes toward advertising. Romanians are more positive about advertising as an institution than the instruments of advertising. Romanians seem to accept the role of advertising in a free market economy, but have less confidence in advertising claims and techniques. Bulgarian respondents seem more sceptical toward advertising in general and are less enthusiastic about embracing the role of advertising as an institution. Moreover, Bulgarians are highly negative towards the instruments advertising uses to convey its messages to consumers. Research limitations/implications - The research findings reflect the views of urban dwellers and may not be generalisable to the wider population of the two countries. Interviewer bias was reduced by eliminating verbal or non-verbal cues to the respondents, and by the use of stratified random sampling. Practical implications - The paper suggests that the regulatory role of codes of advertising practice and industry regulating bodies should be enhanced, and their ability to protect consumers enforced. Marketing campaigns should be more inclusive to involve diverse social groups and reflect generally-accepted social norms. Originality/value - This study reveals that, while general attitudes toward advertising may be similar, attitudes toward the institution and instruments of advertising may differ even in countries with geographic proximity and low cultural distance. © Emerald Group Publishing Limited.

One Step Forward: Contrasting The Effects Of Toe Clipping And Pit Tagging On Frog Survival And Recapture Probability.

Amphibians have been declining worldwide and the comprehension of the threats that they face could be improved by using mark-recapture models to estimate vital rates of natural populations. Recently, the consequences of marking amphibians have been under discussion and the effects of toe clipping on survival are debatable, although it is still the most common technique for individually identifying amphibians. The passive integrated transponder (PIT tag) is an alternative technique, but comparisons among marking techniques in free-ranging populations are still lacking. We compared these two marking techniques using mark-recapture models to estimate apparent survival and recapture probability of a neotropical population of the blacksmith tree frog, Hypsiboas faber. We tested the effects of marking technique and number of toe pads removed while controlling for sex. Survival was similar among groups, although slightly decreased from individuals with one toe pad removed, to individuals with two and three toe pads removed, and finally to PIT-tagged individuals. No sex differences were detected. Recapture probability slightly increased with the number of toe pads removed and was the lowest for PIT-tagged individuals. Sex was an important predictor for recapture probability, with males being nearly five times more likely to be recaptured. Potential negative effects of both techniques may include reduced locomotion and high stress levels. We recommend the use of covariates in models to better understand the effects of marking techniques on frogs. Accounting for the effect of the technique on the results should be considered, because most techniques may reduce survival. Based on our results, but also on logistical and cost issues associated with PIT tagging, we suggest the use of toe clipping with anurans like the blacksmith tree frog.

Impact Of Benign Prostatic Hyperplasia Pharmacological Treatment On Transrectal Prostate Biopsy Adverse Effects.

Background. Benign prostatic hyperplasia (BPH) pharmacological treatment may promote a decrease in prostate vascularization and bladder neck relaxation with theoretical improvement in prostate biopsy morbidity, though never explored in the literature. Methods. Among 242 consecutive unselected patients who underwent prostate biopsy, after excluding those with history of prostate biopsy/surgery or using medications not for BPH, we studied 190 patients. On the 15th day after procedure patients were questioned about symptoms lasting over a week and classified according to pharmacological BPH treatment. Results. Thirty-three patients (17%) were using alpha-blocker exclusively, five (3%) 5-alpha-reductase inhibitor exclusively, twelve (6%) patients used both medications, and 140 (74%) patients used none. There was no difference in regard to age among groups (P = 0.5). Postbiopsy adverse effects occurred as follows: hematuria 96 (50%), hematospermia 53 (28%), hematochezia 22 (12%), urethrorrhagia 19 (10%), fever 5 (3%), and pain 20 (10%). There was a significant negative correlation between postbiopsy hematuria and BPH pharmacological treatment with stronger correlation for combined use of 5-alpha-reductase inhibitor and alpha-blocker over 6 months (P = 0.0027). Conclusion. BPH pharmacological treatment, mainly combined for at least 6 months seems to protect against prostate biopsy adverse effects. Future studies are necessary to confirm our novel results.

Inhibitory Effects Of A Cured Antibacterial Bonding System On Viability And Metabolic Activity Of Oral Bacteria.

To evaluate the antimicrobial efficacy of Clearfil SE Protect (CP) and Clearfil SE Bond (CB) after curing and rinsed against five individual oral microorganisms as well as a mixture of bacterial culture prepared from the selected test organisms. Bacterial suspensions were prepared from single species of Streptococcus mutans, Streptococcus sobrinus, Streptococcus gordonii, Actinomyces viscosus and Lactobacillus lactis, as well as mixed bacterial suspensions from these organisms. Dentin bonding system discs (6 mm×2 mm) were prepared, cured, washed and placed on the bacterial suspension of single species or multispecies bacteria for 15, 30 and 60 min. MTT, Live/Dead bacterial viability (antibacterial effect), and XTT (metabolic activity) assays were used to test the two dentin system's antibacterial effect. All assays were done in triplicates and each experiment repeated at least three times. Data were submitted to ANOVA and Scheffe's f-test (5%). Greater than 40% bacteria killing was seen within 15 min, and the killing progressed with increasing time of incubation with CP discs. However, a longer (60 min) period of incubation was required by CP to achieve similar antimicrobial effect against mixed bacterial suspension. CB had no significant effect on the viability or metabolic activity of the test microorganisms when compared to the control bacterial culture. CP was significantly effective in reducing the viability and metabolic activity of the test organisms. The results demonstrated the antimicrobial efficacy of CP both on single and multispecies bacterial culture. CP may be beneficial in reducing bacterial infections in cavity preparations in clinical dentistry.