Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.

Increasing the career choice readiness of young adolescents: an evaluation study

A career workshop that applies models of the Cognitive Information Processing Approach (Sampson, Reardon, Peterson, & Lenz, 2004) and incorporates critical ingredients (Brown and Ryan Krane, 2000) to promote the career choice readiness of young adolescents was developed and evaluated with 334 Swiss students in seventh grade applying a Solomon four group design with a three-month follow-up. Participants significantly increased their performance in terms of career decidedness, career planning, career exploration, and vocational identity. Implications for evaluation research and counselling practice are presented.

More volunteers in football clubs. An evaluation of a method to increase the number of volunteers

An increasing number of clubs experience difficulties in recruiting and retaining sufficient numbers of volunteers to manage and staff their clubs (Lamprecht, Fischer, & Stamm, 2012). In order to facilitate volunteer recruitment, sport clubs need a specific strategy to recruit and retain volunteers for both formal positions and ad hoc tasks. Therefore, the intervention “More Volunteers in Football Clubs” was designed and its impact was evaluated in detail. The question this evaluation research wants to address is: Can football clubs recruit and retain volunteers successfully by implementing the intervention “More Volunteers in Football Clubs”? The designed intervention is based on the different expectations and needs of volunteers, as well as non-profit human resource management and organisational development management, with a strong emphasis on club-specific counseling and support. Task forces of the twelve participating football clubs attended four workshops in which they received tailor made counseling to reach the desired number of volunteers. The intervention has been implemented and its effectiveness tested in cooperation with the Swiss Football Federation with twelve Swiss football clubs following a pretest, intervention, posttest design Data have been gathered and analysed using a combination of qualitative and quantitative methods. Outcome measurements are: volunteer rate, number of recruited volunteers, number of filled volunteer positions and volunteer satisfaction. Four months after the intervention all clubs that completed the proposed intervention were successful in recruiting the desired number of volunteers. Further, all participating clubs found the intervention helpful and would recommend other clubs to participate as well. With the development of this practical intervention a solution for football clubs is provided to overcome the difficulties in recruiting and retaining sufficient numbers of volunteers. Lamprecht, M., Fischer, A., & Stamm, H.-P. (2012). Sportvereine in der Schweiz. Strukturen, Leistungen, Herausforderungen. Zürich, Switzerland: Seismo.

A novel multidimensional geriatric screening tool in the ED: evaluation of feasibility and clinical relevance

PURPOSES Geriatric problems frequently go undetected in older patients in emergency departments (EDs), thus increasing their risk of adverse outcomes. We evaluated a novel emergency geriatric screening (EGS) tool designed to detect geriatric problems. BASIC PROCEDURES The EGS tool consisted of short validated instruments used to screen 4 domains (cognition, falls, mobility, and activities of daily living). Emergency geriatric screening was introduced for ED patients 75 years or older throughout a 4-month period. We analyzed the prevalence of abnormal EGS and whether EGS increased the number of EGS-related diagnoses in the ED during the screening, as compared with a preceding control period. MAIN FINDINGS Emergency geriatric screening was performed on 338 (42.5%) of 795 patients presenting during screening. Emergency geriatric screening was unfeasible in 175 patients (22.0%) because of life-threatening conditions and was not performed in 282 (35.5%) for logistical reasons. Emergency geriatric screening took less than 5 minutes to perform in most (85.8%) cases. Among screened patients, 285 (84.3%) had at least 1 abnormal EGS finding. In 270 of these patients, at least 1 abnormal EGS finding did not result in a diagnosis in the ED and was reported for further workup to subsequent care. During screening, 142 patients (42.0%) had at least 1 diagnosis listed within the 4 EGS domains, significantly more than the 29.3% in the control period (odds ratio 1.75; 95% confidence interval, 1.34-2.29; P<.001). Emergency geriatric screening predicted nursing home admission after the in-hospital stay (odds ratio for ≥3 vs <3 abnormal domains 12.13; 95% confidence interval, 2.79-52.72; P=.001). PRINCIPAL CONCLUSIONS The novel EGS is feasible, identifies previously undetected geriatric problems, and predicts determinants of subsequent care.

Report of a European Society of Cardiology-European Association of Percutaneous Cardiovascular Interventions task force on the evaluation of coronary stents in Europe: executive summary.

The evaluation for European Union market approval of coronary stents falls under the Medical Device Directive that was adopted in 1993. Specific requirements for the assessment of coronary stents are laid out in supplementary advisory documents. In response to a call by the European Commission to make recommendations for a revision of the advisory document on the evaluation of coronary stents (Appendix 1 of MEDDEV 2.7.1), the European Society of Cardiology (ESC) and the European Association of Percutaneous Cardiovascular Interventions (EAPCI) established a Task Force to develop an expert advisory report. As basis for its report, the ESC-EAPCI Task Force reviewed existing processes, established a comprehensive list of all coronary drug-eluting stents that have received a CE mark to date, and undertook a systematic review of the literature of all published randomized clinical trials evaluating clinical and angiographic outcomes of coronary artery stents between 2002 and 2013. Based on these data, the TF provided recommendations to inform a new regulatory process for coronary stents. The main recommendations of the task force include implementation of a standardized non-clinical assessment of stents and a novel clinical evaluation pathway for market approval. The two-stage clinical evaluation plan includes recommendation for an initial pre-market trial with objective performance criteria (OPC) benchmarking using invasive imaging follow-up leading to conditional CE-mark approval and a subsequent mandatory, large-scale randomized trial with clinical endpoint evaluation leading to unconditional CE-mark. The data analysis from the systematic review of the Task Force may provide a basis for determination of OPC for use in future studies. This paper represents an executive summary of the Task Force's report.

Capturing socially motivated linguistic change. How the use of gender-fair language afffects support for social initiatives in Austria and Poland.

Gender-fair language consists of the symmetric linguistic treatment of women and men instead of using masculine forms as generics. In this study, we examine how the use of gender-fair language affects readers' support for social initiatives in Poland and Austria. While gender-fair language is relatively novel in Poland, it is well established in Austria. This difference may lead to different perceptions of gender-fair usage in these speech communities. Two studies conducted in Poland investigate whether the evaluation of social initiatives (Study 1: quotas for women on election lists; Study 2: support for women students or students from countries troubled by war) is affected by how female proponents (lawyers, psychologists, sociologists, and academics) are referred to, with masculine forms (traditional) or with feminine forms (modern, gender-fair). Study 3 replicates Study 2 in Austria. Our results indicate that in Poland, gender-fair language has negative connotations and therefore, detrimental effects particularly when used in gender-related contexts. Conversely, in Austria, where gender-fair language has been implemented and used for some time, there are no such negative effects. This pattern of results may inform the discussion about formal policies regulating the use of gender-fair language.

European university-based study programmes in evaluation: characteristics and future challenges

This chapter examines the state of evaluation training programs at European universities in 2012. It summarises the results of a survey that was conducted among representatives of 15 programs located in Belgium, Denmark, Greece, Italy, France, The Netherlands, Romania, Spain, Sweden and Switzerland. Some basic information about the programs are reported (e.g. organising body, degree offered, admission requirements, duration in months, price), as well as the programs’ core subjects and learning outcomes. The chapter discusses the challenges for university-based study programmes that arise from the current situation of the evaluation profession, and concludes with some thoughts on education and training as requirements for professionalisation in evaluation

Evaluation of leaders – does gender still matter?

Purpose: Leadership positions are still stereotyped as male, especially in male-dominated fields such as STEM. Therefore, women in such positions run the risk of being evaluated less favorably than men. Our study investigates how female and male leaders in existing teams (engineering project) are evaluated, and how these evaluations change over time. Design/Methodology: Participants worked in 45 teams to develop specific engineering projects. Evaluations of 45 leaders (33% women) by 258 team members (39% women) were analyzed, that is, leaders’ self-evaluation and their evaluation by team members. Results: Although female and male leaders did not differ in their self-evaluations at the beginning of the project, female leaders evaluated themselves better within time. However, team members evaluated female leaders better than male leaders at the beginning of the project. These gender differences disappeared over the time. Limitations: It should be replicated in a non-student sample. Implications: The results show that female leaders entering a male-dominated field (engineering) are evaluated better by team members than male leaders at the beginning of the team work, in line with the ‘shifting standard model’ (Biernat & Fuegen, 2001). While the initial impression formation of female and male leaders is influenced by category membership, its impact decreases over time as a consequence of individualization (Fiske & Neuberg, 1990); this results in similar evaluations over time. Originality: To our knowledge this is the first study to systematically test perceptions of change in the evaluation over time of female and male leaders in natural setting.

Restoring balance within cognitive unit or deservingness evaluation? The role of attitudes and deservingness in shaping emotional reactions to others’ outcomes

Based on Heider’s theory I persumed that personal attitudes are stronger predictors of emotional responses to others’ outcomes than deservingness evaluation. I manipulated outcome, attitude and deservingness experimentally, and measured specific emotions. It appeared deservingness to play a secondary role in eliciting joy and sorrow when interpersonal attitudes were involved.

Nonverbal synchrony in social interactions of patients with schizophrenia indicates socio-communicative deficits

Background Disordered interpersonal communication can be a serious problem in schizophrenia. Recent advances in computer-based measures allow reliable and objective quantification of nonverbal behavior. Research using these novel measures has shown that objective amounts of body and head movement in patients with schizophrenia during social interactions are closely related to the symptom profiles of these patients. In addition to and above mere amounts of movement, the degree of synchrony, or imitation, between patients and normal interactants may be indicative of core deficits underlying various problems in domains related to interpersonal communication, such as symptoms, social competence, and social functioning. Methods Nonverbal synchrony was assessed objectively using Motion Energy Analysis (MEA) in 378 brief, videotaped role-play scenes involving 27 stabilized outpatients diagnosed with paranoid-type schizophrenia. Results Low nonverbal synchrony was indicative of symptoms, low social competence, impaired social functioning, and low self-evaluation of competence. These relationships remained largely significant when correcting for the amounts of patients‘ movement. When patients showed reduced imitation of their interactants’ movements, negative symptoms were likely to be prominent. Conversely, positive symptoms were more prominent in patients when their interaction partners’ imitation of their movements was reduced. Conclusions Nonverbal synchrony can be an objective and sensitive indicator of the severity of patients’ problems. Furthermore, quantitative analysis of nonverbal synchrony may provide novel insights into specific relationships between symptoms, cognition, and core communicative problems in schizophrenia.

Evaluation of Leaders – Does Gender Really Matter?

We examined the leaders’ self-evaluation and their evaluation by subordinates. We found that, over time, female leaders evaluated themselves better than male leaders and that subordinates evaluated female leaders better than male leaders at the beginning of the project. The latter gender differences disappeared over the course of the project.