Investigating Multiple-Choice Assessment: Secondary School Teachers' Perceptions and Practices

Multiple-choice assessment is used within nearly all levels of education and is often heavily relied upon within both secondary and postsecondary institutions in determining a student’s present and future success. Understanding why it is effective or ineffective, how it is developed, and when it is or is not used by teachers can further inform teachers’ assessment practices, and subsequently, improve opportunities for student success. Twenty-eight teachers from 3 secondary schools in southern Ontario were interviewed about their perceptions and use of multiple-choice assessment and participated in a single-session introductory workshop on this topic. Perceptions and practices were revealed, discussed, and challenged through the use of a qualitative research method and examined alongside existing multiple-choice research. Discussion centered upon participants’ perspectives prior to and following their participation in the workshop. Implications related to future assessment practices and research in this field of assessment were presented. Findings indicated that many teachers utilized the multiple-choice form of assessment having had very little teacher education coursework or inservice professional development in the use of this format. The findings also revealed that teachers were receptive to training in this area but simply had not been exposed to or been given the opportunity to further develop their understanding. Participants generally agreed on its strengths (e.g., objectivity) and weaknesses (e.g., development difficulty). Participants were particularly interested in the potential for this assessment format to assess different levels of cognitive difficulty (i.e., levels beyond remembering of Bloom’s revised taxonomy), in addition to its potential to perhaps provide equitable means for assessing students of varying cultures, disabilities, and academic streams.

A Teacher’s Formative Assessment Perceptions and Practices in Oral Intermediate English Courses at the Université de Montréal

Au cours des dernières années, les pratiques de l’évaluation comme aide à l’apprentissage (c’est-à-dire l’auto-évaluation, l’évaluation par les pairs, la rétroaction) dans la salle de classe ont été de plus en plus considérées comme des éléments essentiels (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). Cependant, dans le domaine de l’apprentissage d’une langue seconde la recherche sur ce sujet est plutôt limitée. En nous fondant sur les études de Colby-Kelly et Turner (2007) et de Lyster et Ranta (1997), nous avons mené une recherche exploratoire visant à combler ce besoin. L’objectif général était de comprendre comment l’évaluation formative se réalise dans deux cours d’anglais intermédiaire à l’Université de Montréal, et de comparer comment ces pratiques sont perçues et vécues par la professeure et ses étudiants. Trois questions de recherche étaient posées: 1. Quelle est la nature de l’évaluation formative dans une salle de classe d’anglais langue seconde? 2. Est-ce que les pratiques de la professeure reflètent ce qu’elle pense de l’évaluation formative? 3. Quels sont les correspondances et différences entre les croyances de la professeure et les perceptions de ses étudiants quant aux bénéfices de l’évaluation formative pour l’apprentissage de l’anglais langue seconde? La collecte de données comprend des observations en classe, des entrevues auprès de la professeure et des questionnaires pour les étudiants. Pour répondre à notre première question de recherche, nous avons analysé la rétroaction donnée par la professeure pendant une production orale réalisée par ses étudiants à partir de la typologie de feedback et de uptake de l’étude de Lyster et Ranta (1997). En ce qui a trait à la deuxième question de recherche, nous avons fait des entrevues avec la professeure en vue d’expliciter ses perceptions relativement à l’évaluation formative. À la fin du trimestre, nous avons comparé ses réponses avec sa pratique à partir des enregistrements vidéo produits en classe. Finalement, pour répondre à notre dernière question de recherche nous avons comparé les réponses données par la professeure aux entrevues avec les réponses des étudiants à un questionnaire adapté à partir de celui de Colby-Kelly et Turner. Finalement, nous présentons et discutons les résultats les plus significatifs obtenus dans cette étude qualitative Nous concluons cette thèse en proposant de avenues pour des recherches futures.

Social justice in education : how the function of selection in educational institutions predicts support for (non)egalitarian assessment practices

Educational institutions are considered a keystone for the establishment of a meritocratic society. They supposedly serve two functions: an educational function that promotes learning for all, and a selection function that sorts individuals into different programs, and ultimately social positions, based on individual merit. We study how the function of selection relates to support for assessment practices known to harm vs. benefit lower status students, through the perceived justice principles underlying these practices. We study two assessment practices: normative assessment-focused on ranking and social comparison, known to hinder the success of lower status students-and formative assessment-focused on learning and improvement, known to benefit lower status students. Normative assessment is usually perceived as relying on an equity principle, with rewards being allocated based on merit and should thus appear as positively associated with the function of selection. Formative assessment is usually perceived as relying on corrective justice that aims to ensure equality of outcomes by considering students' needs, which makes it less suitable for the function of selection. A questionnaire measuring these constructs was administered to university students. Results showed that believing that education is intended to select the best students positively predicts support for normative assessment, through increased perception of its reliance on equity, and negatively predicts support for formative assessment, through reduced perception of its ability to establish corrective justice. This study suggests that the belief in the function of selection as inherent to educational institutions can contribute to the reproduction of social inequalities by preventing change from assessment practices known to disadvantage lowerstatus student, namely normative assessment, to more favorable practices, namely formative assessment, and by promoting matching beliefs in justice principles.

Faculty Instructional Quality Assessment Practices Incorporating Teaching Portfolios and Peer Review with Student Course Evaluations

Program directors and department chairs require different means of assessing faculty quality due to the unreliability of student course evaluation data. This report outlines alternative strategies for review committees to assess faculty instructional quality. This report also details incorporation of annual performance reviews for tenure-track faculty into tenure decisions.

Concepções e práticas de avaliação de professores de ciências físico-químicas do ensino básico

Este estudo teve como objetivo caracterizar as concepções e práticas de avaliação de professores portugueses de Ciências Físico-Químicas do ensino básico e conhecer como estes integram a avaliação nas suas aulas no contexto de uma reorganização curricular. Realizaram-se três estudos de caso, em que participaram professores com menos de três anos de serviço. A recolha de dados consistiu na observação naturalista de aulas, entrevistas semiestruturadas e documentos fornecidos pelos participantes. Os resultados evidenciam duas concepções de avaliação das aprendizagens: avaliação da aprendizagem e avaliação para a aprendizagem. Um dos participantes evidencia uma concepção de avaliação da aprendizagem, valorizando uma avaliação de natureza sumativa. Os professores com uma concepção sobre avaliação para a aprendizagem promovem uma avaliação orientada para a melhoria das aprendizagens, valorizando o carácter formativo da avaliação. Relativamente às práticas avaliativas dos três participantes, verificou-se que os critérios de avaliação não são explicitados aos alunos, o feedback é pouco frequente e os alunos têm um papel reduzido no processo de avaliação. Todos os professores demonstram dificuldades na avaliação das competências atitudinais e processuais, sendo que, apenas um dos participantes elabora registos de observação para avaliar estas competências. Os testes constituem o principal instrumento de avaliação nas aulas dos professores participantes neste estudo, o que é coerente com uma concepção de ensino e aprendizagem ainda, marcadamente tradicional.

Concepções e práticas de avaliação de professores de ciências físico-químicas do ensino básico

Este estudo teve como objetivo caracterizar as concepções e práticas de avaliação de professores portugueses de Ciências Físico-Químicas do ensino básico e conhecer como estes integram a avaliação nas suas aulas no contexto de uma reorganização curricular. Realizaram-se três estudos de caso, em que participaram professores com menos de três anos de serviço. A recolha de dados consistiu na observação naturalista de aulas, entrevistas semiestruturadas e documentos fornecidos pelos participantes. Os resultados evidenciam duas concepções de avaliação das aprendizagens: avaliação da aprendizagem e avaliação para a aprendizagem. Um dos participantes evidencia uma concepção de avaliação da aprendizagem, valorizando uma avaliação de natureza sumativa. Os professores com uma concepção sobre avaliação para a aprendizagem promovem uma avaliação orientada para a melhoria das aprendizagens, valorizando o carácter formativo da avaliação. Relativamente às práticas avaliativas dos três participantes, verificou-se que os critérios de avaliação não são explicitados aos alunos, o feedback é pouco frequente e os alunos têm um papel reduzido no processo de avaliação. Todos os professores demonstram dificuldades na avaliação das competências atitudinais e processuais, sendo que, apenas um dos participantes elabora registos de observação para avaliar estas competências. Os testes constituem o principal instrumento de avaliação nas aulas dos professores participantes neste estudo, o que é coerente com uma concepção de ensino e aprendizagem ainda, marcadamente tradicional.

A study of the TAGS, an enduring teaching tool: teachers’ perspectives on the Teacher Assessment of Grammatical Structures teaching practices and application

This paper is studied look at the Teacher’s Assessment of Grammatical Structures (TAGS), Teacher Assessment of Spoken Language (TASL), and Cottage Acquisition Scales for Listening, Language and Speech (CASLLS) criterion-referenced language assessments as well as an inquiry into how teachers of the deaf use the TAGS currently as a teaching tool.

ESL teacher profiles of ICT integration in their classroom practices and assessment activities : a portrait viewed through the lens of some Quebec teachers’ social representations

Abstract : Information and communication technologies (ICTs, henceforth) have become ubiquitous in our society. The plethora of devices competing with the computer, from iPads to the Interactive whiteboard, just to name a few, has provided teachers and students alike with the ability to communicate and access information with unprecedented accessibility and speed. It is only logical that schools reflect these changes given that their purpose is to prepare students for the future. Surprisingly enough, research indicates that ICT integration into teaching activities is still marginal. Many elementary and secondary schoolteachers are not making effective use of ICTs in their teaching activities as well as in their assessment practices. The purpose of the current study is a) to describe Quebec ESL teachers’ profiles of using ICTs in their daily teaching activities; b) to describe teachers’ ICT integration and assessment practices; and c) to describe teachers’ social representations regarding the utility and relevance of ICT use in their daily teaching activities and assessment practices. In order to attain our objectives, we based our theoretical framework, principally, on the social representations (SR, henceforth) theory and we defined most related constructs which were deemed fundamental to the current thesis. We also collected data from 28 ESL elementary and secondary school teachers working in public and private sectors. The interview guide used to that end included a range of items to elicit teachers’ SR in terms of ICT daily use in teaching activities as well as in assessment practices. In addition, we carried out our data analyses from a textual statistics perspective, a particular mode of content analysis, in order to extract the indicators underlying teachers’ representations of the teachers. The findings suggest that although almost all participants use a wide range of ICT tools in their practices, ICT implementation is seemingly not exploited to its fullest potential and, correspondingly, is likely to produce limited effects on students’ learning. Moreover, none of the interviewees claim that they use ICTs in their assessment practices and they still hold to the traditional paper-based assessment (PBA, henceforth) approach of assessing students’ learning. Teachers’ common discourse reveals a gap between the positive standpoint with regards to ICT integration, on the one hand, and the actual uses of instructional technology, on the other. These results are useful for better understanding the way ESL teachers in Quebec currently view their use of ICTs, particularly for evaluation purposes. In fact, they provide a starting place for reconsidering the implementation of ICTs in elementary and secondary schools. They may also be useful to open up avenues for the development of a future research program in this regard.

Induction practices : experiences of newly qualified teachers

The thesis consists of four studies (articles I–IV) and a comprehensive summary. The aim is to deepen understanding and knowledge of newly qualified teachers’ experiences of their induction practices. The research interest thus reflects the ambition to strengthen the research-based platform for support measures. The aim can be specified in the following four sub-areas: to scrutinise NQTs’ experiences of the profession in the transition from education to work (study I), to describe and analyse NQTs’ experiences of their first encounters with school and classroom (study II), to explore NQTs’ experiences of their relationships within the school community (study III), to view NQTs’ experiences of support through peer-group mentoring as part of the wider aim of collaboration and assessment (study IV). The overall theoretical perspective constitutes teachers’ professional development. Induction forms an essential part of this continuum and can primarily be seen as a socialisation process into the profession and the social working environment of schools, as a unique phase of teachers’ development contributing to certain experiences, and as a formal programme designed to support new teachers. These lines of research are initiated in the separate studies (I–IV) and deepened in the theoretical part of the comprehensive summary. In order to appropriately understand induction as a specific practice the lines of research are in the end united and discussed with help of practice theory. More precisely the theory of practice architectures, including semantic space, physical space-time and social space, are used. The methodological approach to integrating the four studies is above all represented by abduction and meta-synthesis. Data has been collected through a questionnaire survey, with mainly open-ended questions, and altogether ten focus group meetings with newly qualified primary school teachers in 2007–2008. The teachers (n=88 in questionnaire, n=17 in focus groups), had between one and three years of teaching experience. Qualitative content analysis and narrative analysis were used when analysing the data. What is then the collected picture of induction or the first years in the profession if scrutinising the results presented in the articles? Four dimensions seem especially to permeate the studies and emerge when they are put together. The first dimension, the relational ˗ emotional, captures the social nature of induction and teacher’s work and the emotional character intimately intertwined. The second dimension, the tensional ˗ mutable, illustrates the intense pace of induction, together with the diffuse and unclear character of a teacher’s job. The third dimension, the instructive ˗ developmental, depicts induction as a unique and intensive phase of learning, maturity and professional development. Finally, the fourth dimension, the reciprocal ˗ professional, stresses the importance of reciprocity and collaboration in induction, both formally and informally. The outlined four dimensions, or integration of results, describing induction from the experiences of new teachers, constitute part of a new synthesis, induction practice. This synthesis was generated from viewing the integrated results through the theoretical lens of practice architecture and the three spaces, semantic space, physical space-time and social space. In this way, a more comprehensive, refined and partially new architecture of teachers’ induction practices are presented and discussed.

Integrating environmental education in primary school education in Tanzania : teachers’ perceptions and teaching practices

The study focuses on primary school teachers’ perceptions of environmental education, its integration into primary school education and teachers’ teaching practices in Tanzania. The thesis is based on empirical research. The theoretical underpinnings of the study are based on Palmer’s (1998) model of environmental education. According to the model, meaningful environmental education should include education about, in or through and for the environment. The study is supported by national and international literature from research done on environmental education and education for sustainable development and policy statements. The study is qualitative in nature, adopting phenomenography and phenomenology as points of departure. The empirical data was collected from four primary schools in Morogoro region in Tanzania. The study sample consisted of 31 primary school teachers. Data was collected through interviews and lesson observations. According to the results of the study, primary school teachers expressed variations in their perceptions of environmental education and education for sustainable development. Most of the teachers focused on the aspect of knowledge acquisition. According to Tanzanian education and training policy, environmental education has to be integrated into all subjects. Although there is environmental education in the primary school curriculum, it is not integrated on an equal footing in all subjects. Some subjects like science, social studies and geography have more environmental content than other subjects. Teachers claim that the approach used to integrate environmental education into the school curriculum was not favoured because many claimed that what is to be taught as environmental education in the various subjects is not shown clearly. As a result, many teachers suggested that to ensure that it is taught properly it should be included in the curriculum as an independent subject or as specific topics. The study revealed that teachers’ teaching practices in integrating environmental education varied from one subject to another. Although most of the teachers said that they used participatory methods, lesson observations showed that they limited themselves to question and answer and group discussion. However, the teachers faced a number of barriers in the teaching of environmental education, some of which include lack of teaching and learning resources, time and large class size. The role of teachers in the implementation of environmental education in developing an environmentally literate citizenry is of great significance. The responsibility of the government in developing a curriculum with clear goals and content, developing teachers’ capacity in the teaching of environmental education and provision of teaching and learning materials needs to be taken seriously by the government in educational plans and programs.