Assessment for Education : Standards, Judgement and Moderation

Do you need a practical guide to assessment, curriculum and policy? Are you also looking for a book that is firmly grounded in the theory of this subject? Assessment for Education combines both theory and practice, making it the perfect guide for students, researchers, academics and teachers. This book makes assessment processes transparent for practitioners, and shows how assessment should relate to education. It looks at evidence-informed decision-making and the interrelationships between standards, judgment and moderation practice for improved assessment, teacher quality, schools and systems. The book will provide you with: ' Knowledge about quality assessment and judgement practice ' Understanding of relationships across curriculum, assessment, teaching and learning ' Knowledge of the concept of front-ending assessment based on the learner's needs ' An analysis of practitioner judgement approaches ' Understanding of the conditions under which teacher assessment can be valid ' Principles derived from research of social moderation practices Whether you are studying and researching assessment or working in curriculum and assessment policy, this book will show you how practitioner use of achievement standards can improve learning, equity, social justice and accountability.

ATAR scores only part of the picture for teaching

A common debate has resurfaced over teacher quality and the quality of teacher education in Australia. This time it was started by a leaked draft report into teacher education from the Australian Institute of Teaching and School Leadership (AITSL) which the public can’t expect to see for at least another month. Media reports have all focused on one aspect of the wide-ranging report: teaching students' ATARs.

Education policy-making and time

This paper examines the global policy convergence toward high-stakes testing in schools and the use of test results to ‘steer at a distance’, particularly as it applies to policy-makers’ promise to improve teacher quality. Using Deleuze’s three syntheses of time in the context of the Australian policy blueprint Quality Education, this paper argues that using test scores to discipline teaching repeats the past habit of policy-making as continuing the problem of the unaccountable teacher. This results in local policy-making enfolding test scores in a pure past where the teacher-as-problem is resolved through the use of data from testing to deliver accountability and transparency. This use of the database returns a digitised form of inspection that is a repetition of the habit of teacher-as-problem. While dystopian possibilities are available through the database, in what Deleuze refers to as a control society, for us the challenge is to consider policy-making as a step into an unknown future, to engage with producing policy that is not grounded on the unconscious interiority of solving the teacher problem, but of imagining new ways of conceiving the relationship between policy-making and teaching.

Catholic teachers’ postgraduate qualifications and students’ end of schooling outcomes: A large scale Queensland based comparative study

A key feature of the current era of Australian schooling is the dominance of publically available student, school and teacher performance data. Our paper examines the intersection of data on teachers’ postgraduate qualifications and students’ end of schooling outcomes in 26 Catholic Systemic Secondary Schools and 18 Catholic Independent Secondary Schools throughout the State of Queensland. We introduce and justify taking up a new socially-just measurement model of students’ end of schooling outcomes, called the ‘Tracking and Academic Management Index’, otherwise known as ‘TAMI’. Additional analysis is focused on the outcomes of top-end students vis-à-vis all students who are encouraged to remain in institutionalised education of one form or another for the two final years of senior secondary schooling. These findings of the correlations between Catholic teachers’ postgraduate qualifications and students’ end of schooling outcomes are also compared with teachers’ postgraduate qualifications and students’ end of schooling outcomes across 174 Queensland Government Secondary Schools and 58 Queensland Independent Secondary Schools from the same data collection period. The findings raise important questions about the transference of teachers’ postgraduate qualifications for progressing students’ end of schooling outcomes as well as the performance of Queensland Catholic Systemic Secondary Schools and Queensland Catholic Independent Secondary Schools during a particular era of education.

An online community designed to support future makers in educational reform

Australian education is undergoing national reform at many levels. The school sector, where preservice teachers will be employed, are adjusting to the demands of the National Curriculum and improving teacher quality through the National Professional Standards for Teachers. In addition, the university sector, where pre-service teachers are prepared, is undergoing its own education reform through the introduction of a demand-driven system and ensuring quality for tertiary education interns through the Higher Education Standards Framework. In moving to prepare preservice teachers for the school system; universities are grappling with the double-barreled approach to teacher quality; quality within the university course and quality within the student teachers being prepared. Through a collaborative partnership including university lecturers, Department of Education central administration staff, school principals, school coordinators, practicum supervisors, mentor teachers and pre-service teachers; the stakeholders have formed an online community of learners engaging in reflective practice who are committed to improving teacher quality. This online community not only links the key stakeholders within the project, it facilitates the nexus between theory and practice often missing in our pre-service teacher placements. This paper reports preliminary data about an initiative to ensure final year pre-service teachers are aspiring to meet the graduate professional standards through the use of an innovative online community.

A quantum measurement paradigm for educational predicates: Implications for validity in educational measurement

The outcomes of educational assessments undoubtedly have real implications for students, teachers, schools and education in the widest sense. Assessment results are, for example, used to award qualifications that determine future educational or vocational pathways of students. The results obtained by students in assessments are also used to gauge individual teacher quality, to hold schools to account for the standards achieved by their students, and to compare international education systems. Given the current high-stakes nature of educational assessment, it is imperative that the measurement practices involved have stable philosophical foundations. However, this paper casts doubt on the theoretical underpinnings of contemporary educational measurement models. Aspects of Wittgenstein’s later philosophy and Bohr’s philosophy of quantum theory are used to argue that a quantum theoretical rather than a Newtonian model is appropriate for educational measurement, and the associated implications for the concept of validity are elucidated. Whilst it is acknowledged that the transition to a quantum theoretical framework would not lead to the demise of educational assessment, it is argued that, where practical, current high-stakes assessments should be reformed to become as ‘low-stakes’ as possible. The paper also undermines some of the pro high-stakes testing rhetoric that has a tendency to afflict education.

Evaluation of Multidisciplinary Delivery of Surgical Anatomy Teaching

Title Evaluation of Multidisciplinary Delivery of Surgical Anatomy Teaching

Authors Walsh I.K., Taylor S.J., Dorman A, Boohan M.

Objectives To evaluate the efficacy of newly introduced multidisciplinary methods to deliver Surgical Anatomy teaching to undergraduate medical students.

Design and Setting Qualitative and quantitative study using questionnaires and focus groups, employing students of the perioperative and emergency medicine (POEM) module of the phase 4 undergraduate medical curriculum at Queen’s University Belfast.

Outcome Measures To determine:
(1) if multidisciplinary teaching is effective in delivering surgical anatomy teaching,
(2) student’s learning preferences regarding this teaching method.
Results The questionnaire response rate was 89% (216 of 244 students; female: male ratio 1.25) and 42 students participated in 6 focus groups. Mean questionnaire responses indicated a favourable opinion on quality assurance items and multidisciplinary teaching. 81% of students agreed that multidisciplinary teaching enhanced learning and 86% felt that this did not adversely affect interaction. A positive contribution towards POEM learning was reported for Radiology (95% of students), Anatomy (93%) and Surgery (78%). The benefits of multidisciplinary teaching were congruent for Anatomy, Radiology and Surgery with 78% of students indicating a perceived favourable association with learning. Multidisciplinary teaching was not associated with diluted interaction, with 62% of students describing interaction as sufficient. 88% of students positively ranked tutor characteristics of enthusiasm and encouragement as being strongly associated with teacher quality. Positive perception of overall quality was strongly associated with learning preferences as well as more generic quality assurance issues (80% students; alpha coefficient 0.83).
The results were supported by triangulation of the above quantitative data with qualitative data generated by the focus groups. Whilst students frequently misunderstood the meaning of “multidisciplinary teaching”, there was an appreciation of the method’s worth; students recognised and valued the relevance of Anatomy, Radiology and Surgery teaching to POEM learning. The importance of vertically integrating Anatomy into all stages of the undergraduate curriculum was especially recognised.

Reference Aarnio M, Nieminen J, Pyorala E, Lindbolm-Ylanne S. Motivating medical students to learn. 2010 Med Teach;32(4):199-204.

Conceptualising a voluntary certification system for highly accomplished teachers

In this paper I argue that a voluntary certification system for highly accomplished teachers must be part of a coherent system of professional accountability which is developed, implemented and managed by the profession. This would be a system that engages professional judgement of evidence provided by teachers in relation to their professional knowledge and practice, and professional standards for teaching would provide the organising framework for that judgment. It would be a system incorporating and aligning all forms of professional licensure, including entry into the profession and subsequent professional milestones. It would be a system that all partners in the profession across Australia—employers, professional associations, and registration authorities—endorse, participate in and align with.

The profession can take the lead in developing and implementing such a coherent and coordinated national approach by carefully developing a system to recognise and reward highly accomplished teaching. Such a system should aim to recognise and build teacher quality by defining what it is highly accomplished teachers know and are able to do. Moreover, such a system must fi nd ways of making teaching public and acknowledging teaching as intellectual work which involves professional judgment that draws on a recognised professional knowledge base and contextualised knowledge about students and their learning.

The paper is presented in two main sections. First, a proposed conceptual framework for the professional recognition and certification of highly accomplished teachers is outlined. Then, the argument for this proposed conceptual framework is presented drawing on learnings from relevant research and professional activity in both Australia and the USA.

Student attitudes and aspirations towards science

Research on student attitudes and aspirations towards science has been an increasing focus of concern in the past decade. Much of this is driven by a growing concern about students’ lack of interest in the further study of science in advanced societies. Because attitude to science is a multifaceted construct, the chapter first reviews research into attitudes in order to develop principles for its meaningful measurement. We then explore the main features of student responses to science and examine the common assertion that there is a negative downward trend as many have suggested. Recent research clearly shows a negative correlation between a country’s developmental index and student attitudes to science. The effects of gender, teacher quality and pre-adolescent experience on student attitudes and aspirations towards science are examined in some detail, as well as a number of other factors in attempting to understand the complex pathways and choices that students make throughout their schooling about the study of STEM subjects. The construct of identity is used to make sense of the variety of attitudes and aspirations of students towards science, with particular emphasis on gender and youth in post-industrial societies. Finally, the role of enrichment experiences in science is examined, as a real and potential influence on student engagement with science.

Teach for Australia (TFA) : can it overcome educational disadvantage?

This paper considers an alternative teacher certification pathway known as Teach for Australia (TFA) that is currently operating in the Australian state of Victoria. A discursive approach informed by critical theory is used in the paper to critically examine the specific case of TFA as an alternative teacher certification pathway charged with improving student learning outcomes and reducing educational disadvantage. The problematization of educational programmes such as TFA, including specific terms and statements found in TFA documentation, features prominently in the paper alongside the political and economic policy context of public education. The argument and central contention of the paper is that TFA will not overcome educational disadvantage; nor will it over time improve student learning outcomes.

Building an effective school-university partnership : a cluster approach

Deakin University has introduced a new Master of Teaching course incorporating a new form school-university partnership that we refer to as the ‘cluster approach’. In addition to responding to recent state and National reports on teacher education (e.g. House of Representatives Standing Committee on Education and Vocational Training, 2007; Kruger et al., 2009; Parliament of Victoria Education and Training Committee, 2005), this cluster approach aims to respond directly to recommendations from the Australian Teaching and Learning Council funded project into practicum partnerships (Ure, 2009), and focuses specifically on one of the reform agendas of the National Partnership Agreement on Improving Teacher Quality, that of ‘improving the quality and consistency of teacher training in partnership with universities’ (see http://smarterschools.gov.au/nationalpartnerships/Pages/ImprovingTeacherQuality.aspx)
Learning to teach is a continuum whereby teachers create new understandings and build professional knowledge and practice in collaboration with colleagues during their pre-service teacher education and then during their careers as teachers (Fieman-Nemser 2001). Learning to teach is not a sole learning activity; rather teachers learn in communities and in collaboration with colleagues. Moreover, teachers are always balancing ‘being the teacher’ while at the same time ‘becoming a teacher’ (e.g. Britzman, 2003). Thus, they balance the notion of ‘doing teaching’ while at the same time ‘learning teaching’, and this is nowhere more evident than during the professional experience component of teacher education. This cluster approach is based on these premises.
The work of Le Cornu (2004), Le Cornu and Ewing (2008) and Little (2001) also informed aspects of the approach, which is predicated on ‘reciprocal relationships’ amongst pre-service teachers, and between pre-service teachers and experienced teachers both in schools and in universities. It frames teachers as cultural producers of knowledge, pre-service teachers as new resources bringing different ideas and practices into schools and schools as knowledge building communities (Little 2001, Nias 1998, Retallick et al 1999, Veugelers & O’Hair 2005).

International ‘benchmarking’ studies and the identification of ‘education best practice’: a focus on classroom teachers and their practices

 Abstract:The disproportionate focus on classroom teachers and their instruction—teacher effectiveness—in order to confront and address under-achievement and disadvantage appears as a contemporary education policy theme in Australia. Phrases such as ‘high performing schooling systems’, ‘the best teachers’, ‘high performing countries’, ‘quality teaching’, ‘under-performing schools’, ‘the right change’, ‘operationally feasible’, ‘targeting of reforms’, ‘degrees of under-performance’, ‘educational drivers’, ‘teacher quality and improved teaching’ and ‘external standards and governance’ are constantly mentioned and given continual attention and prominence by policy-makers. The paper questions and critiques a policy-making direction that uses teacher effectiveness research to force and steer reform in education. The distinctive and narrow concern with teacher effectiveness works to the specific exclusion of breadth and scope concerning debate about broader education related issues and questions, for example, matters of student achievement, exclusion and disadvantage. This article uses a qualitative research approach informed by critical theory to examine three influential private sector reports on education and schooling: The McKinsey Report ( 2007 )—How the world’s best-performing school systems come out on top, The Nous Group ( 2011 )—Schooling Challenges and Opportunities and The Grattan Institute ( 2012 )—Catching up: Learning from the best school systems in East Asia. The article subjects the reports to close critical scrutiny and examination and finds that classroom teachers are positioned so that their specific and explicit instruction becomes the differentiating ‘variable’ in matters of student achievement and success.

Higher salaries, more teaching, better performance? The effects of the introduction of the minimum salary for teachers in Brazil

De acordo com a literatura empírica, há fortes evidências de que, após o controle de características socioeconômicas dos alunos, a qualidade dos professores é o fator mais importante para explicar o desempenho do aluno em testes padronizados. No entanto, não há consenso sobre como sistemas públicos de ensino podem melhorar a qualidade dos professores. Será que o pagamento de salários mais elevados a professores da rede pública impactam a qualidade dos professores nas escolas públicas? O Governo Federal brasileiro introduziu, em 2009, piso salarial nacional para os professores de escolas públicas, provocando um perceptível aumento exógeno dos salários dos professores municipais. O principal objetivo desta tese é avaliar os impactos de curto prazo da elevação linear e incondicional do salário do professor na qualidade da educação. Devido à ausência de dados secundários sobre o valor do salário-base de professores entre 2008 e 2013, tivemos que realizar um levantamento com as Secretarias Municipais de Educação para reunir informação sobre a estrutura da carreira docente e sobre os salários-bases nesse período. Com base em nossa pesquisa de campo, o primeiro capítulo investiga a conformidade dos sistemas municipais de ensino ao piso salarial nacional para professores de redes públicas. Encontramos que fatores não observáveis/observados são determinantes para explicar a variabilidade salarial verificada entre os municípios e o cumprimento da lei, o que embasa nossa estratégia de identificação com base em métodos de diferença em diferenças, combinados com pareamento com base em escore de propensão. O segundo capítulo centra-se na estimativa do impacto da elevação dos salários dos professores sobre a proficiência dos alunos de 5º ano do ensino fundamental municipal. De acordo com estes resultados, o aumento salarial incondicional não gerou uma expansão da proficiência escolar dos alunos, pelo menos no curto prazo. Embora não tenham sido detectados impactos na aprendizagem dos alunos, alguns mecanismos de transmissão do aumento salarial para melhores resultados educacionais podem já ter sido ativados. Assim, o principal objetivo do terceiro capítulo é avaliar o impacto dos aumentos de salário sobre a qualidade dos professores atuais e dos potenciais futuros professores. Avaliamos o impacto de aumentos de salário sobre o desempenho dos professores no ENADE, uma proxy de sua qualidade, e sobre a atratividade dos cursos de ensino superior associados à carreira docente. Essa atratividade é medida por meio da qualidade dos que entram nos respectivos cursos superiores, de acordo com seu desempenho no Enem. Neste último capítulo, aplicamos modelo de Tripla-Diferenças visando controlar dois tipos de potenciais fatores de confusão: (i) mudanças no desempenho dos professores (potenciais futuros professores) entre grupos de municípios, que foram submetidos ao tratamento e os que não foram tratados, que nada têm a ver com a política; e (ii) as alterações no desempenho de todos os professores (alunos) que vivem no município em que houve a elevação salarial devido à introdução da lei. As estimativas obtidas indicam que a elevação salarial gerou efeitos leves sobre a qualidade dos professores e sobre a atratividade dos cursos relacionados à carreira docente.

Einstellung von Lehrkräften zum Qualitätsmanagement an Schulen und deren Prädiktoren : eine empirische Untersuchung an berufsbildenden Schulen in Rheinland-Pfalz

Diese Studie untersucht die Einstellung von Lehrkräften zum Qualitätsmanagement an berufsbildenden Schulen sowie Prädiktoren dieser Einstellung. Bei der Einstellung zum Qualitätsmanagement finden sich eine kleine Gruppe von Lehrkräften mit sehr positiver Einstel-lung und eine etwas größere Gruppe von Lehrkräften mit sehr negativer Einstellung. Der größte Teil der Lehrkräfte zeigt eine indifferente Einstellung; der Mittelwert und der Median liegen knapp im positiven Bereich. Als größter Einfluss nehmender Faktor kann die Reform-bereitschaft der Lehrer identifiziert werden. Starke Effekte zeigen sich auch für den Informationsstand der Lehrkräfte zum Qualitätsmanagement, das Selbstverständnis der Lehrkraft (paidotrop/logotrop), das empfundene Führungshandeln der Schulleitung sowie die empfundene Autonomie der Lehrkraft.

Examining the impact of pre-k and kindergarten classroom alignment on school readiness outcomes

This study explored children’s experiences of instructional alignment from prekindergarten to kindergarten and analyzed the impact of those alignment experiences on children’s school readiness outcomes. The study answered the following overarching research question: Does the alignment of children’s learning experiences between prekindergarten and kindergarten impact school readiness outcomes? Three sub-questions drove the research design: (1) How do children’s prekindergarten and kindergarten learning experiences align; (2) To what extent does the alignment of early learning experiences predict children’s school readiness outcomes; and (3) Does the quality of prekindergarten classroom teacher interactions moderate the impact of any PK-K alignment effects? Using cluster analysis and hierarchical linear modeling (HLM) to analyze data from over 1,300 children in the 2009 Head Start Family and Child Experiences Survey (FACES), the study found that children have distinct and definable experiences of PK-K alignment. Results also indicated a disparity in children’s PK-K alignment experiences, with Hispanic/Latino children more likely to attend Head Start programs with poor systems transition practices followed by kindergartens with poor classroom structures. The study found that growth in the use of instructional activity centers from prekindergarten to kindergarten is predictive of better literacy and math outcomes. Findings further suggested that boys, minority students, and children from lower income households are predicted to score lower than girls, white classmates, and higher-income peers across school readiness measures. Findings support the need for equitable transition and alignment practices for children from all racial and ethnic groups. They also argue for an increase in child-directed activity centers in kindergarten. With one exception, the current findings did not support the hypothesis that prekindergarten teacher quality is a moderator of alignment effects on children’s school readiness outcomes. The study presents suggestions for further research.