The direct-democratic challenge to evidence-based policy making: Questioning the governmental PISA narrative in Swiss school policy

The democratic deficit of evidence-based policymaking and the little attention the approach pays to values and norms have repeatedly been criticized. This article argues that direct-democratic campaigns may provide an arena for citizens and stakeholders to debate the belief systems inherent to evidence. The study is based on a narrative analysis of Program for International Student Assessment (PISA) reports, as well as of newspaper coverage and governmental information referring to PISA in Swiss direct-democratic campaigns on a variety of school policy issues. The findings show that PISA reports are discursive instruments rather than ‘objective evidence’. The reports promote a narrative of economic progress through educational evidence that is adopted without scrutiny by governmental coalitions in direct-democratic campaigns to justify school policy reforms. Yet, the dominant PISA narrative is contested in two counter-narratives, one endorsed by numerous citizens, the other by a group of experts. These counter-narratives question how PISA is used by an ‘expertocracy’ to prescribe reforms, as well as the performance ideology inherent to. Overall, these findings suggest that direct-democratic campaigns may make more transparent how evidence is produced and used according to existing belief systems. Evidence, on the other hand, may be a stimulus for democratic discourse by feeding the debate with potential policy problems and solution. Thus, direct-democratic debates may reconcile normative positions of citizens with the desire to base decisions on empirical evidence.

Does a reference to evaluations contribute to discourse quality? The case of Swiss direct-democratic campaigns on school policy: a conceptual framework

This article examines how references to evaluations in school policy debates contribute to discourse quality. The article consists of two parts: First, it presents a descriptive overview of the references to evidence in direct-democratic campaigns. These results are based on a quantitative content analysis of the newspaper coverage and governmental information documents of 103 direct-democratic Swiss school policy votes. In a second step, it discusses these findings in view of the question of whether the incorporation of evaluation results in policy debates contributes to discourse quality. It presents a conceptual framework, including hypotheses and a research design to answer this question.