Global evidence in local debates: the Programme for International Student Assessment (PISA) in Swiss direct-democratic debates on school policy

This article analyses the use of the Programme for International Student Assessment (PISA) and other evidence in educational policy discourse in the context of direct-democratic votes in Switzerland. The results of a quantitative content analysis show that PISA is used by all actors to support a wide range of policy measures and ideological positions. Other evidence, however, is only used to support single specific policy positions. These findings demonstrate the ubiquity of PISA. The article discusses these results in view of the question of whether the incorporation of evidence into policy debates contributes to informed discourse.

PISA und die Möglichkeiten der Analyse von Kontexteffekten

Im Beitrag werden – mit Schwerpunkt für Deutschland und die Analyse von Kontexteffekten – die international vergleichende Schulleistungsstudie PISA (Programme for International Student Assessment) vorgestellt. Im Fokus stehen hierbei neben der Zielsetzung von PISA und der theoretischen Grundlage der Studie zum einen die methodische Basis der Daten und zum anderen empirische Beispiele für die Analyse von Bildungskontexten, die für den Erwerb von Kompetenzen und Bildungserfolgen als relevant angesehen werden. Schließlich werden auch Grenzen der PISA-Daten aufgezeigt, wenn es um die Effekte von sozialen Kontexten auf die Entwicklung von Wissen, Fertigkeiten und Fähigkeiten und anderen Bildungsprozessen geht.

The direct-democratic challenge to evidence-based policy making: Questioning the governmental PISA narrative in Swiss school policy

The democratic deficit of evidence-based policymaking and the little attention the approach pays to values and norms have repeatedly been criticized. This article argues that direct-democratic campaigns may provide an arena for citizens and stakeholders to debate the belief systems inherent to evidence. The study is based on a narrative analysis of Program for International Student Assessment (PISA) reports, as well as of newspaper coverage and governmental information referring to PISA in Swiss direct-democratic campaigns on a variety of school policy issues. The findings show that PISA reports are discursive instruments rather than ‘objective evidence’. The reports promote a narrative of economic progress through educational evidence that is adopted without scrutiny by governmental coalitions in direct-democratic campaigns to justify school policy reforms. Yet, the dominant PISA narrative is contested in two counter-narratives, one endorsed by numerous citizens, the other by a group of experts. These counter-narratives question how PISA is used by an ‘expertocracy’ to prescribe reforms, as well as the performance ideology inherent to. Overall, these findings suggest that direct-democratic campaigns may make more transparent how evidence is produced and used according to existing belief systems. Evidence, on the other hand, may be a stimulus for democratic discourse by feeding the debate with potential policy problems and solution. Thus, direct-democratic debates may reconcile normative positions of citizens with the desire to base decisions on empirical evidence.

Quantitative and qualitative research approaches to assess student well-being

Although there is dissimiliarity in theoretical research approaches to subjective well-being and to assessments of well-being, there is agreement regarding the value of well-being, especially among student populations. In the highly structured, achievement-oriented, non-optimal context of a classroom, individual well-being is a necessary pre-condition for learning. Among student populations well-being should not be construed as an achievement enhancer; but, rather, recognized and measured as an educational value of its own. However, it is necessary for the positive bias towards learning at least in highly structured, achievement-orientated, non-optional learning contexts like school [cf. Hascher, T. (2004). Wohlbefinden in der Schule. Münster: Waxmann]. How can it be measured? Since different research approaches lead to a variety of instruments, the following paper will focus on two ways of assessing well-being in school: a questionnaire on student well-being (N = 2014) 1 and a semi-structured daily diary about relevant emotional situations in school (N = 58, period 3 × 2 weeks). Both methods are introduced and their methodological quality is discussed in terms of reliability, validity and in terms of their usefulness for improving school practice. Furthermore, the research potential of combining quantitative and qualitative data on students’ well-being is addressed.

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique.

INTRODUCTION the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. METHODS a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. RESULTS the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. DISCUSSION a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe.

Improving the Assessment of Communication Skills at the Swiss Federal Licensing Exam: Results of a Student's Needs Assessment

Introduction With a three year project the assessment of communication skills within the Swiss Federal Licensing Examinations (FLE) shall be improved. As a first step a needs assessment among communication experts and medical students of the Swiss Medical Faculties will be performed. In this presentation the results of the students’ needs assessment will be presented. Methods A bilingual student’s online questionnaire will be developed by an expert panel taking relevant literature, the Swiss Catalogue of Learning Objectives and other consensus statements for communication (e.g., the European and Basler consensus statements) into account. With a think aloud study response process validity evidence will be sought. The questionnaire will focus on the following topics related to communication skills: (1) What has been taught?, (2) What has been assessed in the faculty exams?, (3) What has been assessed in the FLE?, (4) What should have been assessed in the FLE and how should the assessment be improved? Results Results of the students’ needs assessment will be available by the end of 2015 and be presented. Conclusions/ Take-home message We hope for valuable input for improving the assessment of communications skills within the FLE also from the students’ side. Results of the needs assessment from the students and experts will be combined and taken as input for an international expert symposium on how to improve the communication skills assessment within the FLE.