Faculty Instructional Quality Assessment Practices Incorporating Teaching Portfolios and Peer Review with Student Course Evaluations

Program directors and department chairs require different means of assessing faculty quality due to the unreliability of student course evaluation data. This report outlines alternative strategies for review committees to assess faculty instructional quality. This report also details incorporation of annual performance reviews for tenure-track faculty into tenure decisions.

Concepções e práticas de avaliação de professores de ciências físico-químicas do ensino básico

Este estudo teve como objetivo caracterizar as concepções e práticas de avaliação de professores portugueses de Ciências Físico-Químicas do ensino básico e conhecer como estes integram a avaliação nas suas aulas no contexto de uma reorganização curricular. Realizaram-se três estudos de caso, em que participaram professores com menos de três anos de serviço. A recolha de dados consistiu na observação naturalista de aulas, entrevistas semiestruturadas e documentos fornecidos pelos participantes. Os resultados evidenciam duas concepções de avaliação das aprendizagens: avaliação da aprendizagem e avaliação para a aprendizagem. Um dos participantes evidencia uma concepção de avaliação da aprendizagem, valorizando uma avaliação de natureza sumativa. Os professores com uma concepção sobre avaliação para a aprendizagem promovem uma avaliação orientada para a melhoria das aprendizagens, valorizando o carácter formativo da avaliação. Relativamente às práticas avaliativas dos três participantes, verificou-se que os critérios de avaliação não são explicitados aos alunos, o feedback é pouco frequente e os alunos têm um papel reduzido no processo de avaliação. Todos os professores demonstram dificuldades na avaliação das competências atitudinais e processuais, sendo que, apenas um dos participantes elabora registos de observação para avaliar estas competências. Os testes constituem o principal instrumento de avaliação nas aulas dos professores participantes neste estudo, o que é coerente com uma concepção de ensino e aprendizagem ainda, marcadamente tradicional.

Concepções e práticas de avaliação de professores de ciências físico-químicas do ensino básico

Este estudo teve como objetivo caracterizar as concepções e práticas de avaliação de professores portugueses de Ciências Físico-Químicas do ensino básico e conhecer como estes integram a avaliação nas suas aulas no contexto de uma reorganização curricular. Realizaram-se três estudos de caso, em que participaram professores com menos de três anos de serviço. A recolha de dados consistiu na observação naturalista de aulas, entrevistas semiestruturadas e documentos fornecidos pelos participantes. Os resultados evidenciam duas concepções de avaliação das aprendizagens: avaliação da aprendizagem e avaliação para a aprendizagem. Um dos participantes evidencia uma concepção de avaliação da aprendizagem, valorizando uma avaliação de natureza sumativa. Os professores com uma concepção sobre avaliação para a aprendizagem promovem uma avaliação orientada para a melhoria das aprendizagens, valorizando o carácter formativo da avaliação. Relativamente às práticas avaliativas dos três participantes, verificou-se que os critérios de avaliação não são explicitados aos alunos, o feedback é pouco frequente e os alunos têm um papel reduzido no processo de avaliação. Todos os professores demonstram dificuldades na avaliação das competências atitudinais e processuais, sendo que, apenas um dos participantes elabora registos de observação para avaliar estas competências. Os testes constituem o principal instrumento de avaliação nas aulas dos professores participantes neste estudo, o que é coerente com uma concepção de ensino e aprendizagem ainda, marcadamente tradicional.

A study of the TAGS, an enduring teaching tool: teachers’ perspectives on the Teacher Assessment of Grammatical Structures teaching practices and application

This paper is studied look at the Teacher’s Assessment of Grammatical Structures (TAGS), Teacher Assessment of Spoken Language (TASL), and Cottage Acquisition Scales for Listening, Language and Speech (CASLLS) criterion-referenced language assessments as well as an inquiry into how teachers of the deaf use the TAGS currently as a teaching tool.

ESL teacher profiles of ICT integration in their classroom practices and assessment activities : a portrait viewed through the lens of some Quebec teachers’ social representations

Abstract : Information and communication technologies (ICTs, henceforth) have become ubiquitous in our society. The plethora of devices competing with the computer, from iPads to the Interactive whiteboard, just to name a few, has provided teachers and students alike with the ability to communicate and access information with unprecedented accessibility and speed. It is only logical that schools reflect these changes given that their purpose is to prepare students for the future. Surprisingly enough, research indicates that ICT integration into teaching activities is still marginal. Many elementary and secondary schoolteachers are not making effective use of ICTs in their teaching activities as well as in their assessment practices. The purpose of the current study is a) to describe Quebec ESL teachers’ profiles of using ICTs in their daily teaching activities; b) to describe teachers’ ICT integration and assessment practices; and c) to describe teachers’ social representations regarding the utility and relevance of ICT use in their daily teaching activities and assessment practices. In order to attain our objectives, we based our theoretical framework, principally, on the social representations (SR, henceforth) theory and we defined most related constructs which were deemed fundamental to the current thesis. We also collected data from 28 ESL elementary and secondary school teachers working in public and private sectors. The interview guide used to that end included a range of items to elicit teachers’ SR in terms of ICT daily use in teaching activities as well as in assessment practices. In addition, we carried out our data analyses from a textual statistics perspective, a particular mode of content analysis, in order to extract the indicators underlying teachers’ representations of the teachers. The findings suggest that although almost all participants use a wide range of ICT tools in their practices, ICT implementation is seemingly not exploited to its fullest potential and, correspondingly, is likely to produce limited effects on students’ learning. Moreover, none of the interviewees claim that they use ICTs in their assessment practices and they still hold to the traditional paper-based assessment (PBA, henceforth) approach of assessing students’ learning. Teachers’ common discourse reveals a gap between the positive standpoint with regards to ICT integration, on the one hand, and the actual uses of instructional technology, on the other. These results are useful for better understanding the way ESL teachers in Quebec currently view their use of ICTs, particularly for evaluation purposes. In fact, they provide a starting place for reconsidering the implementation of ICTs in elementary and secondary schools. They may also be useful to open up avenues for the development of a future research program in this regard.

The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

Teachers using annotations to engage students in assessment conversations : recontextualising knowledge

Assessment for Learning practices with students such as feedback, and self- and peer assessment are opportunities for teachers and students to develop a shared understanding of how to create quality learning performances. Quality is often represented through achievement standards. This paper explores how primary school teachers in Australia used the process of annotating work samples to develop shared understanding of achievement standards during their curriculum planning phase, and how this understanding informed their teaching so that their students also developed this understanding. Bernstein's concept of the pedagogic device is used to identify the ways teachers recontextualised their assessment knowledge into their pedagogic practices. Two researchers worked alongside seven primary school teachers in two schools over a year, gathering qualitative data through focus groups and interviews. Three general recontextualising approaches were identified in the case studies; recontextualising standards by reinterpreting the role of rubrics, recontextualising by replicating the annotation process with the students and recontextualising by reinterpreting practices with students. While each approach had strengths and limitations, all of the teachers concluded that annotating conversations in the planning phase enhanced their understanding, and informed their practices in helping students to understand expectations for quality.

Academic rigour in science assessment tasks

The critical problem of student disengagement and underachievement in the middle years of schooling (Years 4 . 9) has focussed attention on the quality of educational programs in schools, in Australia and elsewhere. The loss of enthusiasm for science in the middle years is particularly problematic given the growing demand for science professionals. Reshaping middle years programs has included an emphasis on integrating Information and Communication Technologies (ICTs) and improving assessment practices to engage students in higher cognitive processes and enhance academic rigour. Understanding the nature of academic rigour and how to embed it in students. science assessment tasks that incorporate the use of ICTs could enable teachers to optimise the quality of the learning environment. However, academic rigour is not clearly described or defined in the literature and there is little empirical evidence upon which researchers and teachers could draw to enhance understandings. This study used a collective case study design to explore teachers' understandings of academic rigour within science assessment tasks. The research design is based on a conceptual framework that is underpinned by socio-cultural theory. Three methods were used to collect data from six middle years teachers and their students. These methods were a survey, focus group discussion with teachers and a group of students and individual semi-structured interviews with teachers. Findings of the case study revealed six criteria of academic rigour, namely, higher order thinking, alignment, building on prior knowledge, scaffolding, knowledge construction and creativity. Results showed that the middle years teachers held rich understandings of academic rigour that led to effective utilisation of ICTs in science assessment tasks. Findings also indicated that teachers could further enhance their understandings of academic rigour in some aspects of each of the criteria. In particular, this study found that academic rigour could have been further optimised by: promoting more thoughtful discourse and interaction to foster higher order thinking; increasing alignment between curriculum, pedagogy, and assessment, and students. prior knowledge; placing greater emphasis on identifying, activating and building on prior knowledge; better differentiating the level of scaffolding provided and applying it more judiciously; fostering creativity throughout tasks; enhancing teachers‟ content knowledge and pedagogical content knowledge, and providing more in-depth coverage of fewer topics to support knowledge construction. Key contributions of this study are a definition and a model which clarify the nature of academic rigour.

Culture-fair assessment : challenging Indigenous students through effortful mathematics teaching

This paper reports on a mathematics education research project centred on teachers’ pedagogical practices and capacity to assess Indigenous Australian students in a culture-fair manner. The project has been funded by the Australian Research Council Linkage program and is being conducted in seven Catholic and Independent primary schools in north Queensland. Our Industry Partners are Catholic Education and the Association of Independent Schools, Queensland. The study aims to provide greater understanding about how to build more equitable assessment practices to address the issue of underperforming Aboriginal and Torres Strait Islander (ATSI) students in regional and remote Australia. The goal is to identify ways forward by attending to culture-fair assessment practice. The research is exploring the attitudes, beliefs and responses of Indigenous students to assessment in the context of mathematics learning with particular focus on teacher knowledge in these educational settings in relation to the design of assessment tasks that are authentic and engaging for these students in an accountability context. This approach highlights how teachers need to distinguish the ‘funds of knowledge’ (González, Moll, Floyd Tenery, Rivera, Rendón, Gonzales & Amanti, 2008) that Indigenous students draw on and how teachers need to be culturally responsive in their pedagogy to open up curriculum and assessment practice to allow for different ways of knowing and being

Moderation and consistency of teacher judgement : teachers’ views

Major curriculum and assessment reforms in Australia have generated research interest in issues related to standards, teacher judgement and moderation. This article is based on one related inquiry of a large-scale Australian Research Council Linkage project conducted in Queensland. This qualitative study analysed interview data to identify teachers’ views on standards and moderation as a means to achieving consistency of teacher judgement. A complementary aspect of the research involved a blind review that was conducted to determine the degree of teacher consistency without the experience of moderation. Empirical evidence was gained that most teachers, of the total interviewed, articulated a positive attitude towards the use of standards in moderation and perceived that this process produces consistency in teachers’ judgements. Context was identified as an important influential factor in teachers’ judgements and it was concluded that teachers’ assessment beliefs, attitudes and practices impact on their perceptions of the value of moderation practice and the extent to which consistency can be achieved.