Educational assessment policy and practice - a matter of ethics

Long-standing concerns within the field of educational assessment consider the impact of assessment policy and practice as matters of equity, inequality and social justice.Yet educational assessment policy and practice continues to have powerful social consequences for key users such as children and young people.This paper re-positions these consequences as a matter of ethics.It uses the work of Messick to frame how ethical matters extend beyond test instruments into the realm of uses and impact. A case study of the 11+ school transfer system in Northern Ireland is presented to illustrate ethical dilemmas emerging as a consequence of actions and decisions of using assessment systems for particular purposes.In looking forward to how we might attend to ethical matters in assessment policy and practice, a consideration of a children’s rights approach is outlined that may provide a moral and legal framework for action.

A quantum measurement paradigm for educational predicates: Implications for validity in educational measurement

The outcomes of educational assessments undoubtedly have real implications for students, teachers, schools and education in the widest sense. Assessment results are, for example, used to award qualifications that determine future educational or vocational pathways of students. The results obtained by students in assessments are also used to gauge individual teacher quality, to hold schools to account for the standards achieved by their students, and to compare international education systems. Given the current high-stakes nature of educational assessment, it is imperative that the measurement practices involved have stable philosophical foundations. However, this paper casts doubt on the theoretical underpinnings of contemporary educational measurement models. Aspects of Wittgenstein’s later philosophy and Bohr’s philosophy of quantum theory are used to argue that a quantum theoretical rather than a Newtonian model is appropriate for educational measurement, and the associated implications for the concept of validity are elucidated. Whilst it is acknowledged that the transition to a quantum theoretical framework would not lead to the demise of educational assessment, it is argued that, where practical, current high-stakes assessments should be reformed to become as ‘low-stakes’ as possible. The paper also undermines some of the pro high-stakes testing rhetoric that has a tendency to afflict education.

Predictability in high-stakes examinations: students' perspectives on a perennial assessment dilemma

Key debates within educational assessment continuously encourage us to reflect on the design, delivery and implementation of examination systems as well as their relevance to students. In more recent times, such reflections have also required a rethinking of who is authoritative about assessment issues and whose views we seek in order to better understand these perennial assessment dilemmas. This paper considers one such dilemma, predictability in high-stakes assessment, and presents students’ perspectives on this issue. The context is the Irish Leaving Certificate (LC) taken by upper secondary students (aged between 16 and 18) in order (mainly) to enter tertiary-level education. The data come from 13 group interviews with 81 students across a range of schools in Ireland. Listening to students about complex, high-stakes examining problems has a limited history within the educational assessment literature. The findings from the study address this shortcoming and depict how students’ insightful reflections can improve our understanding of these dilemmas. Further, students are more than able to reflect on their own situations with regard to high stakes examining contexts and have important contributions to make to our fuller understanding of those elements that will promote high quality and fair assessment.

Creating an Inclusive Society… How Close are We in Relation to Autism Spectrum Disorder? A General Population Survey

BackgroundChildren with autism spectrum disorder are increasingly educated in mainstream classrooms in the United Kingdom (Wilkinson & Twist, Autism and Educational Assessment: UK Policy and Practice. NFER, Slough, 2010), and some employers are now specifically seeking out staff on the autism spectrum. Does that mean that we are living in an inclusive society' [United Nations Department of Economic and Social Affairs (UNDESA), Creating an Inclusive Society: Practical Strategies to Promote Social Integration 2008], in the sense that inequalities are reduced and full economic, social and cultural participation is advanced for individuals with autism?

MethodsA general population survey was conducted to assess how close we, as a society, are to an inclusive society for individuals with autism in Northern Ireland. Public attitudes were examined to (i) visibility and social interaction, (ii) aetiology, needs and interventions, and (iii) rights and resources.

ResultsA stratified, representative sample of 1204 adults took part in the survey; of these, 989 were aware of autism and their attitudes and behavioural projections reflected a mix of acceptance and denunciation. The level of confusion with regard to interventions reflected the general uncertainty within UK policy regarding meeting the needs of individuals on the autism spectrum (International Journal of Disability, Development and Education 61, 134, 2014a).

ConclusionTherefore, it seems that inclusion is working to an extent, but more clarity is needed with regard to adequate education, intervention and support for individuals with autism.

Evaluation of an Older Persons’ Assessment Educational Workbook with second year nursing students in the UK.

Background: As a first step to successfully meet the complex health and social needs of older people, patient assessment has become a central feature of government policy and practice in order to ensure that care planning is person-centred. A core component of nurse education is clinical practice in order to support the development of clinical skills and competence; therefore it is important to help students and their practice-based mentors to develop and apply older person assessment skills. Therefore, an educational workbook was developed to help 2nd year nursing students to learn a structured, systematic and individualised older person assessment process with the support of their mentor.

Aim: A pilot study to evaluate the impact of an Older Persons’ Assessment Educational Workbook and explore second year nursing students’ competence and their opinions and use of an older person’s assessment skills workbook.

Research Methodology: A pre-experimental design (pre and post-test with no comparison group) was undertaken with n=6 2nd year students in 2014. The outcome measure was the Nursing Competence Questionnaire and results were analysed using the Wilcoxin Signed Rank Test in SPSS version 21. Content analysis of completed workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Key Findings- No pre-post-test difference was found in the Nursing Competence Questionnaire with p=0.058 for the total scale. However, as this was a pilot, the study was under-powered and all students’ scores improved. Content analysis of the workbook found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (Std dev 281.8). Through the survey students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The workbook showed potential as an intervention to help support development of nursing students’ assessment skills in practice.

Consulting pupils in Assessment for Learning classrooms: the twists and turns of working with students as co-researchers

This is an invited paper to a special issue on pupil voice focusing on methodological issues arising from the ESRC/TLRP project on consulting pupils about assessment practices in their classrooms. The issue of consulting pupils about assessment has rarely been researched before but what this article illustrates are some of the difficulties, tensions and positive outcomes of engaging with students as researchers within a nationally funded (and therefore externally driven), university-based project. This study adds considerably to the body of knowledge in this area by engaging students in the process as researchers in different capacities within the project. Issues discussed include the use of student advisory groups, ethical negotiation, students undertaking videotaped classroom observations and their subsequent role in co-interpreting video excerpts and visual images. The paper has attracted considerable interest already through the ESRC pupil seminar series forum and also from a prior paper presentation to the European Educational Research Association in September 2006 in Switzerland to the Childrens' Rights SIG becasue of researchers' current interests in embedding democratic principles and practices within research with children and young people.

Revisioning assessment through a children’s rights approach: implications for policy, process and practice

The linkage between the impact of assessment and compliance with children’s rights is a connection, which although seemingly obvious, is nonetheless rarely made, particularly by governments, which, as signatories to the relevant human rights treaties, have the primary responsibility for ensuring that educational practice is compatible with international children’s rights standards. While some jurisdictions are explicit about an adherence to children’s rights frameworks in general policy documentation, such a commitment rarely features when the focus is on assessment and testing. Thus, in spite of significant public and academic attention given to the consequences of assessment for children and governments committed to working within children’s rights standards, the two are rarely considered together. This paper examines the implications for the policy, process and practice of assessment in light of international human rights standards. Three key children’s rights principles and standards are used as a critical lens to examine assessment policy and practice: (1) best interests; (2) non-discrimination; and (3) participation. The paper seeks new insights into the complexities of assessment practice from the critical perspective of children’s rights and argues that such standards not only provide a convenient benchmark for developing, implementing and evaluating assessment practices, but also acknowledge the significance of assessment in the delivery of children’s rights to, in and through education more generally.