Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform

Teacher assessment literacy is a phrase that is often used but rarely defined. Yet understanding teacher assessment literacy is important in an international curriculum and assessment reform context that continues to challenge teachers’ assessment practices. In this article situated examples of classroom assessment literacies are analysed using Bernstein’s (Pedagogy, symbolic control and identity: Theory, research and critique, Taylor and Francis, London, 1996; Br J Sociol Educ 20(2):157–173, 1999) theoretical tools of vertical and horizontal discourses, classification and framing. Drawing on a sociocultural view of learning, the authors define teacher assessment literacies as dynamic social practices which are context dependent and which involve teachers in articulating and negotiating classroom and cultural knowledges with one another and with learners, in the initiation, development and practice of assessment to achieve the learning goals of students. This conceptualisation of assessment literacy aims to make explicit some underpinning theoretical constructs of assessment literacy to inform dialogue and decision making for policy and practice to benefit student learning and achievement.

Investigating Multiple-Choice Assessment: Secondary School Teachers' Perceptions and Practices

Multiple-choice assessment is used within nearly all levels of education and is often heavily relied upon within both secondary and postsecondary institutions in determining a student’s present and future success. Understanding why it is effective or ineffective, how it is developed, and when it is or is not used by teachers can further inform teachers’ assessment practices, and subsequently, improve opportunities for student success. Twenty-eight teachers from 3 secondary schools in southern Ontario were interviewed about their perceptions and use of multiple-choice assessment and participated in a single-session introductory workshop on this topic. Perceptions and practices were revealed, discussed, and challenged through the use of a qualitative research method and examined alongside existing multiple-choice research. Discussion centered upon participants’ perspectives prior to and following their participation in the workshop. Implications related to future assessment practices and research in this field of assessment were presented. Findings indicated that many teachers utilized the multiple-choice form of assessment having had very little teacher education coursework or inservice professional development in the use of this format. The findings also revealed that teachers were receptive to training in this area but simply had not been exposed to or been given the opportunity to further develop their understanding. Participants generally agreed on its strengths (e.g., objectivity) and weaknesses (e.g., development difficulty). Participants were particularly interested in the potential for this assessment format to assess different levels of cognitive difficulty (i.e., levels beyond remembering of Bloom’s revised taxonomy), in addition to its potential to perhaps provide equitable means for assessing students of varying cultures, disabilities, and academic streams.

A Teacher’s Formative Assessment Perceptions and Practices in Oral Intermediate English Courses at the Université de Montréal

Au cours des dernières années, les pratiques de l’évaluation comme aide à l’apprentissage (c’est-à-dire l’auto-évaluation, l’évaluation par les pairs, la rétroaction) dans la salle de classe ont été de plus en plus considérées comme des éléments essentiels (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). Cependant, dans le domaine de l’apprentissage d’une langue seconde la recherche sur ce sujet est plutôt limitée. En nous fondant sur les études de Colby-Kelly et Turner (2007) et de Lyster et Ranta (1997), nous avons mené une recherche exploratoire visant à combler ce besoin. L’objectif général était de comprendre comment l’évaluation formative se réalise dans deux cours d’anglais intermédiaire à l’Université de Montréal, et de comparer comment ces pratiques sont perçues et vécues par la professeure et ses étudiants. Trois questions de recherche étaient posées: 1. Quelle est la nature de l’évaluation formative dans une salle de classe d’anglais langue seconde? 2. Est-ce que les pratiques de la professeure reflètent ce qu’elle pense de l’évaluation formative? 3. Quels sont les correspondances et différences entre les croyances de la professeure et les perceptions de ses étudiants quant aux bénéfices de l’évaluation formative pour l’apprentissage de l’anglais langue seconde? La collecte de données comprend des observations en classe, des entrevues auprès de la professeure et des questionnaires pour les étudiants. Pour répondre à notre première question de recherche, nous avons analysé la rétroaction donnée par la professeure pendant une production orale réalisée par ses étudiants à partir de la typologie de feedback et de uptake de l’étude de Lyster et Ranta (1997). En ce qui a trait à la deuxième question de recherche, nous avons fait des entrevues avec la professeure en vue d’expliciter ses perceptions relativement à l’évaluation formative. À la fin du trimestre, nous avons comparé ses réponses avec sa pratique à partir des enregistrements vidéo produits en classe. Finalement, pour répondre à notre dernière question de recherche nous avons comparé les réponses données par la professeure aux entrevues avec les réponses des étudiants à un questionnaire adapté à partir de celui de Colby-Kelly et Turner. Finalement, nous présentons et discutons les résultats les plus significatifs obtenus dans cette étude qualitative Nous concluons cette thèse en proposant de avenues pour des recherches futures.

Changing assessment practices : the case for online moderation

Online moderation meetings have the potential to support the collaborative professional development of teachers, and the formation of a common understanding of what denotes quality in student work in a standards based assessment system. In doing so systemic calls for consistency across education systems are also being met. In this paper a case for employing online moderation meetings is developed through recourse to the demands of learning in the twenty-first century and the place of assessment within those discourses. It is argued that empirical data is needed on the efficacy of online moderation meetings to guide future practice as the use of information and communication technologies increases in education systems. Online moderation is one way of gathering teachers across vast distances to share their understandings and develop common meanings of assessment. While it is suggested that online moderation is one possible procedure to meet systemic requirements and support teachers’ professional collaboration, the implementation of such a system also introduces new challenges for schools and teachers. Meeting online to discuss professional understandings is a new way of operating for teachers and involves technology that has not yet been fully utilised within education departments. Issues such as the types of interactions that are afforded within such an environment, as well as technical operating problems that occur when using technology impact on the employment of online meetings. Online moderation meetings while potentially solving the issue of developing common understandings across an entire department also pose new issues to be resolved. There is a need for research into the efficacy of online moderation meetings so that future policy decisions may be based on sound empirical data. It is imperative that as new ways of knowing and acting are incorporated into school curriculum and pedagogy, assessment practices are also aligned. Online moderation meetings can support such practices by enabling teachers to communicate with a wider and more diverse group of teachers to establish common understandings.

An exploratory study of the current assessment practices for improving the learning of English as a foreign language (EFL) in two Vietnamese universities

This case study investigated EFL assessment practices at one public and one private university to explore the support of assessment for English language learning (ELL) within the Vietnamese sociocultural context. Findings demonstrated the potential of assessment to engage students in learning; enhance their understanding of the learning objectives; and facilitate their learning reflection. Findings also identified strong influences of contextual factors such as teachers' language assessment literacy, high-stakes testing and institutional administrative policies on the practices of assessment for ELL. This study contributes to research on Assessment for Learning and EFL education at tertiary level in Vietnam and other similar sociocultural contexts.

Physical education teacher training in fundamental movement skills makes a difference to instruction and assessment practices

The purpose of this study was to investigate instruction and assessment of fundamental movement skills (FMSs) by Physical Education (PE) teachers of Year 7 girls. Of 168 secondary school PE teachers, many had received little FMSs professional development, and although most assessed student FMSs proficiency, the quality of assessment was variable. Neither years of experience nor confidence influenced the quality of assessment tools used; however, greater FMSs training improved assessment practice regularity. Teachers more recently out of preservice were more confident in demonstrating FMSs. The results suggest that FMSs education for teachers should be a priority inclusion in both the training of preservice teachers and the ongoing professional development of in-service teachers.

Renewing assessment practices: literacy teaching and learning in digital environments

Interpretations of “literacy” and approaches to literacy pedagogy and assessment are under renewal as meaning-making and learning are increasingly situated in digitized environments. While the implications of these shifts are in part technological, they are also relational, as students are increasingly positioned as interactive with participatory roles in self-knowledge and increased responsibility for their learning. However, while shifts are occurring in understandings of literacy and approaches to literacy pedagogy, the same cannot be said for the way in which assessments of digital literacies are undertaken. There is a lack of valid, reliable, and practical assessments of new literacies to inform and help students to become better prepared for study, work, and citizenship in digital environments. This article maps five characteristics of effective formative assessment in print-based classrooms with seven affordancesin digital learning and assessment to suggest an analytical framework for examining teacher and student assessment in digital environments. Drawing on data from a research project in which a team of teachers introduced a one-to-one computing program and worked to renew their literacy assessment practices, this article discusses how each of the seven affordances are enacted in the assessment practices in a years five and six primary school classroom. The findings from this research project show that educational technologies have the potential to enable new approaches to teaching, learning, and assessment that better align with the needs of twenty-first century literacy learners. The findings alsosupport approaches to formative assessment that value print and multimodality and engage students in more flexible and differentiated ways. They can enable teachers and students to be re-positioned as designers, knowledge producers, and collaborative learners. The seven affordances provide a framework that holds rich possibilities for teacher learning and planning as prompts to support reflection on formative assessment practices, critique habitual practices, and considernew opportunities.

Orals ain't orals : how instruction and assessment practices affect delivery choices with prepared student oral presentations.

Despite an ostensibly technology-driven society, the ability to communicate orally is still seen as an essential ability for students at school and university, as it is for graduates in the workplace. The need to develop effective oral communication skills is often tied to future work-related tasks. One tangible way that educators have assessed proficiency in this area is through prepared oral presentations. While some use the terms oral communication and oral presentation interchangeably, other writers question the role more formal presentations play in the overall development of oral communication skills. Adding to the discussion, this paper is part of a larger study examining the knowledge and skills students bring into the academy from previous educational experiences. The study examines some of the teaching and assessment methods used in secondary schools to develop oral communication skills through the use of formal oral presentations. Specifically, it will look at assessment models and how these are used as a form of instruction as well as how they contribute to an accurate evaluation of student abilities. The purpose of this paper is to explore key terms and identify tensions between expectations and practice. Placing the emphasis on the ‘oral’ aspect of this form of communication this paper will particularly look at the ‘delivery’ element of the process.

Risk-assessment practices in the private rental sector : implications for low-income renters (Final Report)

This report focuses on risk-assessment practices in the private rental market, with particular consideration of their impact on low-income renters. It is based on the fieldwork undertaken in the second stage of the research process that followed completion of the Positioning Paper. The key research question this study addressed was: What are the various factors included in ‘risk-assessments’ by real estate agents in allocating ‘affordable’ tenancies? How are these risks quantified and managed? What are the key outcomes of their decision-making? The study builds on previous research demonstrating that a relatively large proportion of low-cost private rental accommodation is occupied by moderate- to high-income households (Wulff and Yates 2001; Seelig 2001; Yates et al. 2004). This is occurring in an environment where the private rental sector is now the de facto main provider of rental housing for lower-income households across Australia (Seelig et al. 2005) and where a number of factors are implicated in patterns of ‘income–rent mismatching’. These include ongoing shifts in public housing assistance; issues concerning eligibility for rent assistance; ‘supply’ factors, such as loss of low-cost rental stock through upgrading and/or transfer to owner-occupied housing; patterns of supply and demand driven largely by middle- to high-income owner-investors and renters; and patterns of housing need among low-income households for whom affordable housing is not appropriate. In formulating a way of approaching the analysis of ‘risk-assessment’ in rental housing management, this study has applied three sociological perspectives on risk: Beck’s (1992) formulation of risk society as entailing processes of ‘individualisation’; a socio-cultural perspective which emphasises the situated nature of perceptions of risk; and a perspective which has drawn attention to different modes of institutional governance of subjects, as ‘carriers of specific indicators of risk’. The private rental market was viewed as a social institution, and the research strategy was informed by ‘institutional ethnography’ as a method of enquiry. The study was based on interviews with property managers, real estate industry representatives, tenant advocates and community housing providers. The primary focus of inquiry was on ‘the moment of allocation’. Six local areas across metropolitan and regional Queensland, New South Wales, and South Australia were selected as case study localities. In terms of the main findings, it is evident that access to private rental housing is not just a matter of ‘supply and demand’. It is also about assessment of risk among applicants. Risk – perceived or actual – is thus a critical factor in deciding who gets housed, and how. Risk and its assessment matter in the context of housing provision and in the development of policy responses. The outcomes from this study also highlight a number of salient points: 1.There are two principal forms of risk associated with property management: financial risk and risk of litigation. 2. Certain tenant characteristics and/or circumstances – ability to pay and ability to care for the rented property – are the main factors focused on in assessing risk among applicants for rental housing. Signals of either ‘(in)ability to pay’ and/or ‘(in)ability to care for the property’ are almost always interpreted as markers of high levels of risk. 3. The processing of tenancy applications entails a complex and variable mix of formal and informal strategies of risk-assessment and allocation where sorting (out), ranking, discriminating and handing over characterise the process. 4. In the eyes of property managers, ‘suitable’ tenants can be conceptualised as those who are resourceful, reputable, competent, strategic and presentable. 5. Property managers clearly articulated concern about risks entailed in a number of characteristics or situations. Being on a low income was the principal and overarching factor which agents considered. Others included: - unemployment - ‘big’ families; sole parent families - domestic violence - marital breakdown - shift from home ownership to private rental - Aboriginality and specific ethnicities - physical incapacity - aspects of ‘presentation’. The financial vulnerability of applicants in these groups can be invoked, alongside expressed concerns about compromised capacities to manage income and/or ‘care for’ the property, as legitimate grounds for rejection or a lower ranking. 6. At the level of face-to-face interaction between the property manager and applicants, more intuitive assessments of risk based upon past experience or ‘gut feelings’ come into play. These judgements are interwoven with more systematic procedures of tenant selection. The findings suggest that considerable ‘risk’ is associated with low-income status, either directly or insofar as it is associated with other forms of perceived risk, and that such risks are likely to impede access to the professionally managed private rental market. Detailed analysis suggests that opportunities for access to housing by low-income householders also arise where, for example: - the ‘local experience’ of an agency and/or property manager works in favour of particular applicants - applicants can demonstrate available social support and financial guarantors - an applicant’s preference or need for longer-term rental is seen to provide a level of financial security for the landlord - applicants are prepared to agree to specific, more stringent conditions for inspection of properties and review of contracts - the particular circumstances and motivations of landlords lead them to consider a wider range of applicants - In particular circumstances, property managers are prepared to give special consideration to applicants who appear worthy, albeit ‘risky’. The strategic actions of demonstrating and documenting on the part of vulnerable (low-income) tenant applicants can improve their chances of being perceived as resourceful, capable and ‘savvy’. Such actions are significant because they help to persuade property managers not only that the applicant may have sufficient resources (personal and material) but that they accept that the onus is on themselves to show they are reputable, and that they have valued ‘competencies’ and understand ‘how the system works’. The parameters of the market do shape the processes of risk-assessment and, ultimately, the strategic relation of power between property manager and the tenant applicant. Low vacancy rates and limited supply of lower-cost rental stock, in all areas, mean that there are many more tenant applicants than available properties, creating a highly competitive environment for applicants. The fundamental problem of supply is an aspect of the market that severely limits the chances of access to appropriate and affordable housing for low-income rental housing applicants. There is recognition of the impact of this problem of supply. The study indicates three main directions for future focus in policy and program development: providing appropriate supports to tenants to access and sustain private rental housing, addressing issues of discrimination and privacy arising in the processes of selecting suitable tenants, and addressing problems of supply.

Governmentality and the reflection of legal educators : assessment practices as a case study

This paper presents a conceptual framework, informed by Foucault’s work on governmentality, which allows for new kinds of reflection on the practice of legal education. Put simply, this framework suggests that legal education can be understood as a form of government that relies on a specific rationalisation and programming of the activities of legal educators, students, and administrators, and is implemented by harnessing specific techniques and bodies of ‘know-how’. Applying this framework to assessment at three Australian law schools, this paper highlights how assessment practices are rationalised, programmed, and implemented, and points out how this government shapes students’ legal personae. In particular, this analysis focuses on the governmental effects of pedagogical discourses that are dominant within the design and scholarship of legal education. It demonstrates that the development of pedagogically-sound regimes of assessment has contributed to a reformulation of the terrain of government, by providing the conditions under which forms of legal personae may be more effectively shaped, and extending the power relations that achieve this. This analysis provides legal educators with an original way of reflecting on the power effects of teaching the law, and new opportunities for thinking about what is possible in legal education.

Error correction in second language writing : teachers’ beliefs, practices, and students’ preferences

Error correction is perhaps the most widely used method for responding to student writing. While various studies have investigated the effectiveness of providing error correction, there has been relatively little research incorporating teachers' beliefs, practices, and students' preferences in written error correction. The current study adopted features of an ethnographic research design in order to explore the beliefs and practices of ESL teachers, and investigate the preferences of L2 students regarding written error correction in the context of a language institute situated in the Brisbane metropolitan district. In this study, two ESL teachers and two groups of adult intermediate L2 students were interviewed and observed. The beliefs and practices of the teachers were elicited through interviews and classroom observations. The preferences of L2 students were elicited through focus group interviews. Responses of the participants were encoded and analysed. Results of the teacher interviews showed that teachers believe that providing written error correction has advantages and disadvantages. Teachers believe that providing written error correction helps students improve their proof-reading skills in order to revise their writing more efficiently. However, results also indicate that providing written error correction is very time consuming. Furthermore, teachers prefer to provide explicit written feedback strategies during the early stages of the language course, and move to a more implicit strategy of providing written error correction in order to facilitate language learning. On the other hand, results of the focus group interviews suggest that students regard their teachers' practice of written error correction as important in helping them locate their errors and revise their writing. However, students also feel that the process of providing written error correction is time consuming. Nevertheless, students want and expect their teachers to provide written feedback because they believe that the benefits they gain from receiving feedback on their writing outweigh the apparent disadvantages of their teachers' written error correction strategies.

Mentoring preservice teachers' reflective practices towards producing teaching outcomes

Reflective practice appears crucial for professional growth, and making connections between mentoring practices and mentees’ reflections may assist mentors to guide reflective processes. This interpretive study initially explores, through the literature (e.g., Dewey, Schön), common processes of reflective thinking and uses a mentoring feedback framework with six practices to collect and analyse video, audio and observational data around two mentor-mentee case studies. The findings showed that these mentors (experienced primary teachers) articulated expectations for teaching, modelled reflective practices to their mentees (preservice teachers), and facilitated time and opportunities for advancing teaching practices, which influenced the mentees’ reflective practices and their pedagogical development. This study showed that the mentors’ personal attributes influenced the mentoring relationship and the mentees’ abilities to critically reflect on their practices.

What factors influence nurses’ assessment practices? Development of the Barriers to Nurses’ use of Physical Assessment Scale

Aim To develop and psychometrically test the Barriers to Nurses’ use of Physical Assessment Scale. Background There is growing evidence of failure to recognise hospitalised patients at risk of clinical deterioration, in part due to inadequate physical assessment by nurses. Yet, little is known about the barriers to nurses’ use of physical assessment in the acute hospital setting and no validated scales have been published. Design Instrument development study. Method Scale development was based on a comprehensive literature review, focus groups, expert review and psychometric evaluation. The scale was administered to 434 acute care registered nurses working at a large Australian teaching hospital between June and July 2013. Psychometric analysis included factor analysis, model fit statistics and reliability testing. Results The final scale was reduced to 38 items representing seven factors, together accounting for 57.7% of the variance: (1) reliance on others and technology, (2) lack of time and interruptions, (3) ward culture, (4) lack of confidence, (5) lack of nursing role models, (6) lack of influence on patient care, and; (7) specialty area. Internal reliability ranged from .70 to .86. Conclusion Findings provide initial evidence for the validity and reliability of the Barriers to Nurses’ use of Physical Assessment Scale and point to the importance of understanding the organisational determinants of nurses’ assessment practices. The new scale has potential clinical and research applications to support nursing assessment in acute care settings.

Transforming assessment practices

This research project produced a number of resources to assist faculties in reviewing their assessment practices. These resources include an Evidence of Learning Matrix, Assessment Review Flowchart and Action Plan. In completing a review of assessment practices, this would then inform a curriculum review or retreat.

Building teachers' pedagogy practices in reasoning, to improve students' dispositions towards mathematics

Drawing on participatory action research, this study identifies the pedagogies necessary to advance reasoning, which is one of the proficiencies from the Australian Curriculum Mathematics, and explores how reasoning leads to greater productive disposition. With the current emphasis on STEM in schools, this research is timely. This thesis makes an original and substantive contribution to the understanding of why and how teachers can most effectively advance student proficiency in reasoning through targeted instructional strategies and style of instruction. The study explores the ways in which teacher practices, when focused on reasoning, enhance the disposition of students towards greater mathematical proficiency.