How do preservice teacher education students move from novice to expert assessors?

Despite the acknowledged importance of assessment in education, there has been minimal research into the preparation of preservice teachers for the important role of involving preservice teachers in marking, grading, moderating and providing feedback on student work. This article reports on a pilot project in which preservice teachers participated in an ongoing peer assessment and social moderation process in a dedicated course on assessment. The purpose of the project was to investigate specific ways in which key assessment processes can be effectively taught to preservice teachers. The research involved 96 preservice teachers who completed a Likert scale survey and free text responses to set questions. The results indicated that while preservice teachers valued the process, continual opportunities to learn the nature and purpose of essential assessment practices related to marking, grading, moderating and providing feedback are necessary to graduate competent and work-ready assessors.

Risk assessment with female sex offenders : can women meet the criteria of community protection laws?

Although females represent a small proportion of the sex offender population, they occasionally appear before the courts under the current generation of laws intended to protect the public from high-risk sex offenders. In this context, practitioners are called upon to provide assessment of the risk these women pose for sexual re-offending. The primary issues addressed in this paper are related to the validity of conducting such risk assessments and providing professional opinions as to the risk of further sexual offences that may be committed by female offenders. The approach taken is to summarize briefly the available professional literature regarding female sex offenders, and then to present the findings of the relatively few empirical studies that address sexual recidivism in females. The final section examines the positions taken in the published works of various international experts regarding risk assessment with females, followed by conclusions and recommendations in light of the standards typically prescribed by community protection laws.

Video capture : pre-service teacher reflection, assessment or both

This paper reports on a small trial with 6 pre-service teachers who videoed their own teaching practices. The pre-service teachers used the tool to reflect on practice and to enhance their own understandings of themselves as teachers. The initial footage was used to by the pre-service teachers to gauge quite specific elements of their teaching: for example, were they asking effective questions, or were they responding appropriately to questions children asked and as always, what management strategies seemed to be working? Critical feedback from other students was initially „less than critical‟, but again over time, this also appeared to sharpen as they had more opportunity to use the technology. Initial embarrassment of being on screen was replaced with a professional approach to seeing the video as a tool for providing the opportunity to systematically deconstruct practices and for providing concrete feedback for improvement. Used in conjunction with teaching preparation courses, the videoed segments of teaching practice could be used to highlight exemplars, to show what actually happens in classrooms and to explain certain practices. Cunningham and Benedetto (2002) state “Recent developments in digital video technologies permit teacher candidates to collect, review, and manipulate video to demonstrate their growth as a professional and as a reflective practitioner.” However, in the development of the trial, the issue was raised by the pre-service teachers that they would be interested in keeping the videos as evidence of their teaching competence to be used in applications for teaching positions. In the small trial, ethics permission had not been gained for that to happen, but it is certainly a valid and viable possibility for the future. Currently prospective employers have to rely on paper applications which respond to selection criteria, evidence from pre-service teachers‟ teaching rounds and the subjective impressions of an interview. If students were able to present a 5 minute segment of them teaching, it might count for much more than any other evidence. Video capture of teaching practice would provide potential employers with an indication of a pre-service teacher‟s management strategies, relationships with children and a snapshot of a pre-service teacher‟s instructional practice. The idea of video-capture as a tool for pre-service teachers to illustrate teaching capabilities will be more fully investigated in this paper.

Does calibration reduce variability in the assessment of accounting learning outcomes?

Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.

The calibration of student judgement through self-assessment: disruptive effects of assessment patterns

Can extended opportunities for self-assessment over time help students develop the capacity to make better judgements about their work? Using evidence gathered through students' voluntary self-assessment of their performance with respect to assessment tasks in two different disciplines at two Australian universities, the paper focuses on the effects of sequences of units of study and the use of different types of assessment task (written, oral, analysis, and project) in the development of student judgement. Convergence between student criteria-based gradings of their own performance in units of study and those allocated by tutors was analysed to explore the calibration of students' judgement over time. First, it seeks to replicate analyses from an earlier smaller-scale study to confirm that students' judgements can be calibrated through continuing opportunities for self-assessment and feedback. Second, it extends the analysis to coherently designed sequences of units of study and explores the effects of different types of assessment. It finds that disruptive patterns of assessment within a sequence of subjects can reduce convergence between student and tutor judgements.

An assessment of legal knowledge of preservice teachers completing accredited teacher education programs in South Florida

The purpose of the study was to assess the legal knowledge of preservice teachers completing their educational training at accredited South Florida universities. The population consisted of 372 preservice kindergarten through twelfth grade teachers completing their educational training in any area of public school education.^ The researcher selected areas of school law to assess based on nationwide studies of litigation involving teachers and school boards, the areas most pertinent to the teachers' daily activities and responsibilities. A forty-item instrument was developed and administered to preservice teachers at six South Florida public and private universities. The areas of school law surveyed were tort liability, teachers' rights as instructors and employees, and students' rights. The research questions asked if preservice teachers possess a fundamental knowledge of school law in any of the identified areas and if a significant difference of legal knowledge existed when comparing preservice teachers by university and comparing preservice elementary and preservice secondary teachers. The criteria for a fundamental knowledge of school law was established as scoring 80% or above on the total survey or any area of school law.^ Conclusions. (1) On the overall survey, the preservice teachers did not exhibit a fundamental knowledge of school law. The mean score was 64.2%, with 11.6% of the respondents scoring at or above the 80% level. (2) The preservice teachers did not possess a fundamental knowledge of school law in any of the three areas of school law, though the survey revealed a difference in the preservice teachers' knowledge in the specific areas. The scores were tort liability, 71.9%; teachers' rights, 65%; and students' rights, 52.3%. (3) A significant difference did not exist between elementary and secondary preservice teachers' knowledge of school law. (4) A significant difference did not exist among the preservice teachers' knowledge of school law when compared by university.^ The study suggested a need for increased instruction in these areas of school law to preservice teachers prior to the beginning of their teaching careers. ^

How can preservice teachers be measured against advocated professional teaching standards?

Australia has had many inquiries into teaching and teacher education over the last decade. Standards for teaching have been produced by national education systems with many state systems following suit. The Queensland College of Teachers (QCT) advocates ten professional teaching standards for teachers and preservice teachers. How can preservice teachers be measured against advocated professional standards? This study investigated 106 second-year preservice teachers’ perceptions of their development against the QCT standards. A pretest-posttest survey instrument was developed based on the QCT standards and administered to these preservice teachers before and after their science education coursework. Percentages, ANOVAs and t-tests were generated to analyse the results. Findings indicated that 22 of the 24 paired pretest-posttest items were highly significant (p<.001). Percentage increases ranged from as low as 27% in the pretest to as high as 97% in the posttest, yet, there were two items with lower significance (i.e., working in professional science education teams and supporting students’ participation in society). Understanding preservice teachers’ perceptions of their abilities to implement these standards may be a step towards the process of determining the achievement of teaching standards; however, more rigorous measurements will need to be developed for both teachers and preservice teachers. University coursework and related assessments can provide an indication of achieving these standards, especially authentic assessment of preservice teachers’ practices.

Levelling expectations across different years in an undergraduate degree to support work-related learning : evidence for a multi-pronged approach.

One of the ways in which university departments and faculties can enhance the quality of learning and assessment is to develop a ‘well thought out criterion‐referenced assessment system’ (Biggs, 2003, p. 271). In designing undergraduate degrees (courses) this entails making decisions about the levelling of expectations across different years through devising objectives and their corresponding criteria and standards: a process of alignment analogous to what happens in unit (subject) design. These decisions about levelling have important repercussions in terms of supporting students’ work‐related learning, especially in relation to their ability to cope with the increasing cognitive and skill demands made on them as they progress through their studies. They also affect the accountability of teacher judgments of students’ responses to assessment tasks, achievement of unit objectives and, ultimately, whether students are awarded their degrees and are sufficiently prepared for the world of work. Research reveals that this decision‐making process is rarely underpinned by an explicit educational rationale (Morgan et al, 2002). The decision to implement criterion referenced assessment in an undergraduate microbiology degree was the impetus for developing such a rationale because of the implications for alignment, and therefore ‘levelling’ of expectations across different years of the degree. This paper provides supporting evidence for a multi‐pronged approach to levelling, through backward mapping of two revised units (foundation and exit year). This approach adheres to the principles of alignment while combining a work‐related approach (via industry input) with the blended disciplinary and learner‐centred approaches proposed by Morgan et al. (2002). It is suggested that this multi‐pronged approach has the potential for making expectations, especially work‐related ones across different year levels of degrees, more explicit to students and future employers.

Redefining the student-teacher relationship through online sharing activities

The student-teacher relationship should be a critical factor for successful teaching and learning in design education. In tradition, the relationship is defined as a master-apprentice, so design teachers’ visual assessment capability and technical standards significantly affect students’ quality of learning and achievements. However, there are some negative aspects of the master-apprentice relationship in design education that it may restrict student experiences to cultural diversity and interdisciplinary learning through various interactions with other students. A visual design subject was designed to adapt a new learning method that is to share students’ work and assessment through an asynchronous communication tool. This method was expected to reduce the negative aspects of the master-apprentice relationship and enhance peer-to-peer interactions and individualistic collaboration. A survey with two types of student groups in terms of their levels of participation was conducted to evaluate student experiences to this method. The outcomes implicate that online peer assessment is helpful to reduce the negative aspects of master-apprentice relation and can be useful for achieving the ultimate purpose of design education.

The impact of outcomes-driven curriculum reform on teacher perspectives of professional practice

This thesis is the result of an investigation of a Queensland example of curriculum reform based on outcomes, a type of reform common to many parts of the world during the last decade. The purpose of the investigation was to determine the impact of outcomes on teacher perspectives of professional practice. The focus was chosen to permit investigation not only of changes in behaviour resulting from the reform but also of teachers' attitudes and beliefs developed during implementation. The study is based on qualitative methodology, chosen because of its suitability for the investigation of attitudes and perspectives. The study exploits the researcher's opportunities for prolonged, direct contact with groups of teachers through the selection of an over-arching ethnography approach, an approach designed to capture the holistic nature of the reform and to contextualise the data within a broad perspective. The selection of grounded theory as a basis for data analysis reflects the open nature of this inquiry and demonstrates the study's constructivist assumptions about the production of knowledge. The study also constitutes a multi-site case study by virtue of the choice of three individual school sites as objects to be studied and to form the basis of the report. Three primary school sites administered by Brisbane Catholic Education were chosen as the focus of data collection. Data were collected from three school sites as teachers engaged in the first year of implementation of Student Performance Standards, the Queensland version of English outcomes based on the current English syllabus. Teachers' experience of outcomes-driven curriculum reform was studied by means of group interviews conducted at individual school sites over a period of fourteen months, researcher observations and the collection of artefacts such as report cards. Analysis of data followed grounded theory guidelines based on a system of coding. Though classification systems were not generated prior to data analysis, the labelling of categories called on standard, non-idiosyncratic terminology and analytic frames and concepts from existing literature wherever practicable in order to permit possible comparisons with other related research. Data from school sites were examined individually and then combined to determine teacher understandings of the reform, changes that have been made to practice and teacher responses to these changes in terms of their perspectives of professionalism. Teachers in the study understood the reform as primarily an accountability mechanism. Though teachers demonstrated some acceptance of the intentions of the reform, their responses to its conceptualisation, supporting documentation and implications for changing work practices were generally characterised by reduced confidence, anger and frustration. Though the impact of outcomes-based curriculum reform must be interpreted through the inter-relationships of a broad range of elements which comprise teachers' work and their attitudes towards their work, it is proposed that the substantive findings of the study can be understood in terms of four broad themes. First, when the conceptual design of outcomes did not serve teachers' accountability requirements and outcomes were perceived to be expressed in unfamiliar technical language, most teachers in the study lost faith in the value of the reform and lost confidence in their own abilities to understand or implement it. Second, this reduction of confidence was intensified when the scope of outcomes was outside the scope of the teachers' existing curriculum and assessment planning and teachers were confronted with the necessity to include aspects of syllabuses or school programs which they had previously omitted because of a lack of understanding or appreciation. The corollary was that outcomes promoted greater syllabus fidelity when frameworks were closely aligned. Third, other benefits the teachers associated with outcomes included the development of whole school curriculum resources and greater opportunity for teacher collaboration, particularly among schools. The teachers, however, considered a wide range of factors when determining the overall impact of the reform, and perceived a number of them in terms of the costs of implementation. These included the emergence of ethical dilemmas concerning relationships with students, colleagues and parents, reduced individual autonomy, particularly with regard to the selection of valued curriculum content and intensification of workload with the capacity to erode the relationships with students which teachers strongly associated with the rewards of their profession. Finally, in banding together at the school level to resist aspects of implementation, some teachers showed growing awareness of a collective authority capable of being exercised in response to top-down reform. These findings imply that Student Performance Standards require review and, additional implementation resourcing to support teachers through times of reduced confidence in their own abilities. Outcomes prove an effective means of high-fidelity syllabus implementation, and, provided they are expressed in an accessible way and aligned with syllabus frameworks and terminology, should be considered for inclusion in future syllabuses across a range of learning areas. The study also identifies a range of unintended consequences of outcomes-based curriculum and acknowledges the complexity of relationships among all the aspects of teachers' work. It also notes that the impact of reform on teacher perspectives of professional practice may alter teacher-teacher and school-system relationships in ways that have the potential to influence the effectiveness of future curriculum reform.

Role and purpose of standards in the context of national curriculum and assessment reform for accountability, improvement and equity in student learning

In this article our starting point is the current context of national curriculum change and intense speculation about the assessment, standards and reporting. It is written against a background of accountability measures and improvement imperatives, and focuses attention on standards as offering representations of quality. We understand standards to be constructs that aim to achieve public credibility and utility. Further, they can be examined for the purposes they seek to serve and also their expected functions. Fitness for purpose is therefore a useful notion in considering the nature of standards. Our interest in the discussion is the ‘fit’ between how standards are formulated and how they are used in practice, by whom and for what purposes. A related interest is in the matter of how standards can be harnessed to realise improvement.