Global evidence in local debates: the Programme for International Student Assessment (PISA) in Swiss direct-democratic debates on school policy

This article analyses the use of the Programme for International Student Assessment (PISA) and other evidence in educational policy discourse in the context of direct-democratic votes in Switzerland. The results of a quantitative content analysis show that PISA is used by all actors to support a wide range of policy measures and ideological positions. Other evidence, however, is only used to support single specific policy positions. These findings demonstrate the ubiquity of PISA. The article discusses these results in view of the question of whether the incorporation of evidence into policy debates contributes to informed discourse.

PISA und die Möglichkeiten der Analyse von Kontexteffekten

Im Beitrag werden – mit Schwerpunkt für Deutschland und die Analyse von Kontexteffekten – die international vergleichende Schulleistungsstudie PISA (Programme for International Student Assessment) vorgestellt. Im Fokus stehen hierbei neben der Zielsetzung von PISA und der theoretischen Grundlage der Studie zum einen die methodische Basis der Daten und zum anderen empirische Beispiele für die Analyse von Bildungskontexten, die für den Erwerb von Kompetenzen und Bildungserfolgen als relevant angesehen werden. Schließlich werden auch Grenzen der PISA-Daten aufgezeigt, wenn es um die Effekte von sozialen Kontexten auf die Entwicklung von Wissen, Fertigkeiten und Fähigkeiten und anderen Bildungsprozessen geht.

The direct-democratic challenge to evidence-based policy making: Questioning the governmental PISA narrative in Swiss school policy

The democratic deficit of evidence-based policymaking and the little attention the approach pays to values and norms have repeatedly been criticized. This article argues that direct-democratic campaigns may provide an arena for citizens and stakeholders to debate the belief systems inherent to evidence. The study is based on a narrative analysis of Program for International Student Assessment (PISA) reports, as well as of newspaper coverage and governmental information referring to PISA in Swiss direct-democratic campaigns on a variety of school policy issues. The findings show that PISA reports are discursive instruments rather than ‘objective evidence’. The reports promote a narrative of economic progress through educational evidence that is adopted without scrutiny by governmental coalitions in direct-democratic campaigns to justify school policy reforms. Yet, the dominant PISA narrative is contested in two counter-narratives, one endorsed by numerous citizens, the other by a group of experts. These counter-narratives question how PISA is used by an ‘expertocracy’ to prescribe reforms, as well as the performance ideology inherent to. Overall, these findings suggest that direct-democratic campaigns may make more transparent how evidence is produced and used according to existing belief systems. Evidence, on the other hand, may be a stimulus for democratic discourse by feeding the debate with potential policy problems and solution. Thus, direct-democratic debates may reconcile normative positions of citizens with the desire to base decisions on empirical evidence.

Improving the Assessment of Communication Skills at the Swiss Federal Licensing Exam: Results of a Student's Needs Assessment

Introduction With a three year project the assessment of communication skills within the Swiss Federal Licensing Examinations (FLE) shall be improved. As a first step a needs assessment among communication experts and medical students of the Swiss Medical Faculties will be performed. In this presentation the results of the students’ needs assessment will be presented. Methods A bilingual student’s online questionnaire will be developed by an expert panel taking relevant literature, the Swiss Catalogue of Learning Objectives and other consensus statements for communication (e.g., the European and Basler consensus statements) into account. With a think aloud study response process validity evidence will be sought. The questionnaire will focus on the following topics related to communication skills: (1) What has been taught?, (2) What has been assessed in the faculty exams?, (3) What has been assessed in the FLE?, (4) What should have been assessed in the FLE and how should the assessment be improved? Results Results of the students’ needs assessment will be available by the end of 2015 and be presented. Conclusions/ Take-home message We hope for valuable input for improving the assessment of communications skills within the FLE also from the students’ side. Results of the needs assessment from the students and experts will be combined and taken as input for an international expert symposium on how to improve the communication skills assessment within the FLE.

Reproducibility of dGEMRIC in assessment of hip joint cartilage: a prospective study

PURPOSE: To investigate the reproducibility of dGEMRIC in the assessment of cartilage health of the adult asymptomatic hip joint. MATERIALS AND METHODS: Fifteen asymptomatic volunteers (mean age, 26.3 years +/- 3.0) were preliminarily studied. Any volunteer that was incidentally diagnosed with damaged cartilage on MRI (n = 5) was excluded. Ten patients that had no evidence of prior cartilage damage (mean age, 26.2 years +/- 3.4) were evaluated further in this study. The reproducibility of dGEMRIC was assessed with two T1(Gd) exams performed 4 weeks apart in these volunteers. The protocol involved an initial standard MRI to confirm healthy cartilage, which was then followed by dGEMRIC. The second scan included only the repeat dGEMRIC. Region of interest (ROI) analyses for T1(Gd)-measurement was performed in seven radial reformats. Statistical analysis included the student's t-test and intra-class correlation (ICC) measurement to assess reproducibility. RESULTS: Overall 70 ROIs were studied. Mean cartilage T1(Gd) values at various loci ranged from 560.9 ms to 684.4 ms at the first set of readings and 551.5 ms to 662.2 ms in the second one. The mean difference per region of interest between the two T1(Gd)-measurements ranged from 21.4 ms (3.7%) to 45.0 ms (6.8%), which was not found to be statistically significant (P = 0.153). There was a high reproducibility detected (ICC range, 0.667-0.915). Intra- and Inter-observer analyses proved a high agreement for T1(Gd) assessment (0.973 and 0.932). CONCLUSION: We found dGEMRIC to be a reliable tool in the assessment of cartilage health status in adult hip joints.

Teaching and assessment of implant dentistry in undergraduate and postgraduate education: a European consensus

This paper constitutes a summary of the consensus documents agreed at the First European Workshop on Implant Dentistry University Education held in Prague on 19-22 June 2008. Implant dentistry is becoming increasingly important treatment alternative for the restoration of missing teeth, as patients expectations and demands increase. Furthermore, implant related complications such as peri-implantitis are presenting more frequently in the dental surgery. This consensus paper recommends that implant dentistry should be an integral part of the undergraduate curriculum. Whilst few schools will achieve student competence in the surgical placement of implants this should not preclude the inclusion of the fundamental principles of implant dentistry in the undergraduate curriculum such as the evidence base for their use, indications and contraindications and treatment of the complications that may arise. The consensus paper sets out the rationale for the introduction of implant dentistry in the dental curriculum and the knowledge base for an undergraduate programme in the subject. It lists the competencies that might be sought without expectations of surgical placement of implants at this stage and the assessment methods that might be employed. The paper also addresses the competencies and educational pathways for postgraduate education in implant dentistry.