High-stakes testing and Educational Governance – insights and innovations in European school systems. Special Issue Editorial

International research with regard to the intended as well as to the unintended outcomes and effects of high-stakes testing shows that the impact of high-stakes tests has important consequences for the participants involved in the respective educational systems. The purpose of this special issue is to examine the implementation of high-stakes testing in different national school systems and to refer to the effects in view of the concept of Educational Governance. (DIPF/Orig.)

Does gender make a difference? Gender-related fairness of high-stakes testing in A-level examinations in English as foreign language in the German state of North Rhine-Westphalia in the context of Educational Governance

The shift from decentralized to centralized A-level examinations (Abitur) was implemented in the German school system as a measure of Educational Governance in the last decade. This reform was mainly introduced with the intention of providing higher comparability of school examinations and student achievement as well as increasing fairness in school examinations. It is not known yet if these ambitious aims and functions of the new centralized examination format have been achieved and if fairer assessment can be guaranteed in terms of providing all students with the same opportunities to pass the examinations by allocating fair tests to different student subpopulations e.g., students of different background or gender. The research presented in this article deals with these questions and focuses on gender differences. It investigates gender-specific fairness of the test items in centralized Abitur examinations as high school exit examinations in Germany. The data are drawn from Abitur examinations in English (as a foreign language). Differential item functioning (DIF) analysis reveals that at least some parts of the examinations indicate gender inequality. (DIPF/Orig.)

Governing the transition to higher levels of education and differences between achievement and school grades by gender

The author will explore the performance of boys and girls in external examinations in Slovenia at the beginning of upper secondary and tertiary education. These are critical points in students’ educational career at which he/she has to choose a school/university. Since both transitions are managed centrally by appropriate authorities, this is also a question of Educational Governance. Transitions between levels of education should, above all, assure fairness in selection procedures. At the point of transition to upper secondary schools we will explore differences between students’ achievements in various school subjects tested at the national assessment of knowledge (NA), and their school grades by gender. Since only school grades are used as admission criteria to upper secondary schools, this comparison of school grades with external and more objective measure of students’ achievement will show possible bias. In Slovenia admission to tertiary education usually consists of (externally assessed) Matura results and school grades in the last two years of upper secondary school. The author will compare the effects of both most commonly used measures of academic achievement on admission in view of gender differences. Study courses where selection procedure was actually applied will be of specific interest since they can show signs of (un)fairness. Results show signs of bias and build case for better Educational Governance. (DIPF/Orig.)

A reappraisal of blood clotting response tests for anticoagulant resistance and a proposal for a standardised BCR test methodology

Blood clotting response (BCR) resistance tests are available for a number of anticoagulant rodenticides. However, during the development of these tests many of the test parameters have been changed, making meaningful comparisons between results difficult. It was recognised that a standard methodology was urgently required for future BCR resistance tests and, accordingly, this document presents a reappraisal of published tests, and proposes a standard protocol for future use (see Appendix). The protocol can be used to provide information on the incidence and degree of resistance in a particular rodent population; to provide a simple comparison of resistance factors between active ingredients, thus giving clear information about cross-resistance for any given strain; and to provide comparisons of susceptibility or resistance between different populations. The methodology has a sound statistical basis in being based on the ED50 response, and requires many fewer animals than the resistance tests in current use. Most importantly, tests can be used to give a clear indication of the likely practical impact of the resistance on field efficacy. The present study was commissioned and funded by the Rodenticide Resistance Action Committee (RRAC) of CropLife International.

National numeracy tests : a graphic tells a thousand words

Mandatory numeracy tests have become commonplace in many countries, heralding a new era in school assessment. New forms of accountability and an increased emphasis on national and international standards (and benchmarks) have the potential to reshape mathematics curricula. It is noteworthy that the mathematics items used in these tests are rich in graphics. Many of the items, for example, require students to have an understanding of information graphics (e.g., maps, charts and graphs) in order to solve the tasks. This investigation classifies mathematics items in Australia’s inaugural national numeracy tests and considers the effect such standardised testing will have on practice. It is argued that the design of mathematics items are more likely to be a reliable indication of student performance if graphical, linguistic and contextual components are considered both in isolation and in integrated ways as essential elements of task design.

Who pays for standardised testing? A cost-benefit study of mandated testing in three Queensland secondary schools

This paper reports on an Australian study that explored the costs and benefits of the National Assessment Programme, Literacy and Numeracy (NAPLAN) testing, both tangible and intangible, of Year 9 students in three Queensland schools. The study commenced with a review of pertinent studies and other related material about standardised testing in Australia, the USA and UK. Information about NAPLAN testing and reporting, and the pedagogical impacts of standardised testing were identified, however little about administrative costs to schools was found. A social constructivist perspective and a multiple case study approach were used to explore the actions of school managers and teachers in three Brisbane secondary schools. The study found that the costs of NAPLAN testing to schools fell into two categories: preparation of students for the testing; and administration of the tests. Whilst many of the costs could not be quantified, they were substantial and varied according to the education sector in which the school operated. The benefits to schools of NAPLAN testing were found to be limited. The findings have implications for governments, curriculum authorities and schools, leading to the conclusion that, from a school perspective, the benefits of NAPLAN testing do not justify the costs.

A standardised BCR resistance test for all anticoagulant rodenticides

This paper presents a reappraisal of the blood clotting response (BCR) tests for anticoagulant rodenticides, and proposes a standardised methodology for identifying and quantifying physiological resistance in populations of rodent species. The standardisation is based on the International Normalised Ratio, which is standardised against a WHO international reference preparation of thromboplastin, and allows comparison of data obtained using different thromboplastin reagents. ne methodology is statistically sound, being based on the 50% response, and has been validated against the Norway rat (Rattus norvegicus) and the house mouse (Mus domesticus). Susceptibility baseline data are presented for warfarin, diphacinone, chlorophacinone and coumatetralyl against the Norway rat, and for bromadiolone, difenacoum, difethialone, flocoumafen and brodifacoum against the Norway rat and the house mouse. A 'test dose' of twice the ED50 can be used for initial identification of resistance, and will provide a similar level of information to previously published methods. Higher multiples of the ED50 can be used to assess the resistance factor, and to predict the likely impact on field control.

Neospora caninum IgG avidity tests: an interlaboratory comparison

Avidity tests can be used to discriminate between cattle that are acutely and chronically infected with the intracellular parasite Neospora caninum. The aim of this study was to compare the IgG avidity ELISA tests being used in four European laboratories. A coded panel of 200 bovine sera from well documented naturally and experimentally N. caninum infected animals were analysed at the participating laboratories by their respective assay systems and laboratory protocols. Comparing the numeric test results, the concordance correlation coefficients were between 0.479 and 0.776. The laboratories categorize the avidity results into the classes "low" and "high" which are considered indicative of recent and chronic infection, respectively. Three laboratories also use an "intermediate" class. When the categorized data were analysed by Kappa statistics there was moderate to substantial agreements between the laboratories. There was an overall better agreement for dichotomized results than when an intermediate class was also used. Taken together, this first ring test for N. caninum IgG avidity assays showed a moderate agreement between the assays used by the different laboratories to estimate the IgG avidity. Our experience suggests that avidity tests are sometimes less robust than conventional ELISAs. Therefore, it is essential that they are carefully standardised and their performance continuously evaluated.

Generation of a recombinant Gag virus-like-particle panel for the evaluation of p24 antigen detection by diagnostic HIV tests.

BACKGROUND Detection of HIV-1 p24 antigen permits early identification of primary HIV infection and timely intervention to limit further spread of the infection. Principally, HIV screening should equally detect all viral variants, but reagents for a standardised test evaluation are limited. Therefore, we aimed to create an inexhaustible panel of diverse HIV-1 p24 antigens. METHODS We generated a panel of 43 recombinantly expressed virus-like particles (VLPs), containing the structural Gag proteins of HIV-1 subtypes A-H and circulating recombinant forms (CRF) CRF01_AE, CRF02_AG, CRF12_BF, CRF20_BG and group O. Eleven 4th generation antigen/antibody tests and five antigen-only tests were evaluated for their ability to detect VLPs diluted in human plasma to p24 concentrations equivalent to 50, 10 and 2 IU/ml of the WHO p24 standard. Three tests were also evaluated for their ability to detect p24 after heat-denaturation for immune-complex disruption, a pre-requisite for ultrasensitive p24 detection. RESULTS Our VLP panel exhibited an average intra-clade p24 diversity of 6.7%. Among the 4th generation tests, the Abbott Architect and Siemens Enzygnost Integral 4 had the highest sensitivity of 97.7% and 93%, respectively. Alere Determine Combo and BioRad Access were least sensitive with 10.1% and 40.3%, respectively. Antigen-only tests were slightly more sensitive than combination tests. Almost all tests detected the WHO HIV-1 p24 standard at a concentration of 2 IU/ml, but their ability to detect this input for different subtypes varied greatly. Heat-treatment lowered overall detectability of HIV-1 p24 in two of the three tests, but only few VLPs had a more than 3-fold loss in p24 detection. CONCLUSIONS The HIV-1 Gag subtype panel has a broad diversity and proved useful for a standardised evaluation of the detection limit and breadth of subtype detection of p24 antigen-detecting tests. Several tests exhibited problems, particularly with non-B subtypes.

Prevalence of the use of cancer related self-tests by members of the public:A community survey

Background: Self-tests are those where an individual can obtain a result without recourse to a health professional, by getting a result immediately or by sending a sample to a laboratory that returns the result directly. Self-tests can be diagnostic, for disease monitoring, or both. There are currently tests for more than 20 different conditions available to the UK public, and self-testing is marketed as a way of alerting people to serious health problems so they can seek medical help. Almost nothing is known about the extent to which people self-test for cancer or why they do this. Self-tests for cancer could alter perceptions of risk and health behaviour, cause psychological morbidity and have a significant impact on the demand for healthcare. This study aims to gain an understanding of the frequency of self-testing for cancer and characteristics of users. Methods: Cross-sectional survey. Adults registered in participating general practices in the West Midlands Region, will be asked to complete a questionnaire that will collect socio-demographic information and basic data regarding previous and potential future use of self-test kits. The only exclusions will be people who the GP feels it would be inappropriate to send a questionnaire, for example because they are unable to give informed consent. Freepost envelopes will be included and non-responders will receive one reminder. Standardised prevalence rates will be estimated. Discussion: Cancer related self-tests, currently available from pharmacies or over the Internet, include faecal occult blood tests (related to bowel cancer), prostate specific antigen tests (related to prostate cancer), breast cancer kits (self examination guide) and haematuria tests (related to urinary tract cancers). The effect of an increase in self-testing for cancer is unknown but may be considerable: it may affect the delivery of population based screening programmes; empower patients or cause unnecessary anxiety; reduce costs on existing healthcare services or increase demand to investigate patients with positive test results. It is important that more is known about the characteristics of those who are using self-tests if we are to determine the potential impact on health services and the public. © 2006 Wilson et al; licensee BioMed Central Ltd.