The Impact of Multimedia Education on Uptake of Comprehensive Eye Examinations in Rural China: A Randomized, Controlled Trial

PURPOSE: To study the effect of multimedia education on acceptance of comprehensive eye examinations (CEEs), critical for detecting glaucoma and diabetic eye disease, among rural Chinese patients using a randomized, controlled design.
METHODS: Patients aged ≥40 years were recruited from 52 routine clinic sessions (26 intervention, 26 control) conducted at seven rural hospitals in Guangdong, China. Subjects answered demographic questionnaires, were tested on knowledge about CEEs and chronic eye disease, and were told the cost of examination (range US$0-8). At intervention sessions, subjects were cluster-randomized to view a 10-minute video on the value of CEEs and retested. Control subjects were not retested. Trial outcomes were acceptance of CEEs (primary outcome) and final knowledge scores (secondary outcome).
RESULTS: At baseline, >70% (p = 0.70) of both intervention (n = 241, 61.2 ± 12.3 years) and control (n = 218, 58.4 ± 11.7 years) subjects answered no knowledge questions correctly, but mean scores on the test (maximum 5 points) increased by 1.39 (standard deviation 0.12) points (p < 0.001) after viewing the video. Intervention (73.0%) and control (72.9%) subjects did not differ in acceptance of CEEs (p > 0.50). In mixed-effect logistic regression models, acceptance of CEEs was associated with availability of free CEEs (odds ratio 18.3, 95% confidence interval 1.32-253.0), but not group assignment or knowledge score. Acceptance was 97.5% (79/81) when free exams were offered.
CONCLUSIONS: Education increased knowledge about but not acceptance of CEEs, which was generally high. Making CEEs free could further increase acceptance.

Wishful Thinking: Lessons from the internal and external evaluations of an innovatory education project in Northern Ireland

From March 1999 to August 2000, the authors were involved in simultaneous internal and external evaluations of the social civic and political education (SCaPE) project in Northern Ireland. This project was a major initiative established by the Citizenship Foundation, the Northern Ireland Council for the Curriculum, Examination and Assessment (CCEA), and the School of Education at the University of Ulster at Coleraine. It was a 2-year project in 25 secondary schools established to design, develop, pilot and evaluate a new programme of social, civic and political education for Northern Ireland. It also aimed to serve as a model for future Citizenship curriculum developments throughout Northern Ireland and elsewhere. This paper describes the background to the project, the design and conduct of the two evaluations, and the links between them. It outlines the main conclusions of each evaluation and describes the way SCaPE has since evolved into a mainstream curriculum development project. The final part of the paper analyses the key opportunities, tensions and challenges involved in running such evaluations at a critical time in the history of Northern Ireland – a time when innovation is both necessary and controversial. It argues that, especially in such circumstances, evaluation cannot be conducted from a neutral, objective standpoint, and that it is incumbent on evaluators to recognise the emotional, personal and political commitment they make to the projects in which they are engaged.