Course/instructor evaluation : perspectives of part-time graduate students

This study explored 6 part-time graduate students' perspectives on course/instructor evaluation. The purpose was to explore whether a link exists between the evaluation for course and instructors as contained in the Faculty of Education courselinstructor evaluation form and the needs of part-time students enrolled in that program. The literature review provided contextual information concerning the 3 main subject areas based upon which the research questions were designed: learner needs in the context of part-time graduate students, courselinstructor eval~ation, and the potential lack of congruency between the 2. Using a semistructured interview process, participants identified criteria important or relevant to the evaluation process and incongruent with the course/instructor evaluation form. A qualitative research methodology using a grounded theory approach contributed to the theory on the nature of course evaluation instruments in a graduate program and addressed the notion of where power was situated within the evaluation process. Findings suggested that the concepts of relevance and the instructor's role that participants identified as important in their graduate learning experience were congruent with what they considered important components of the course/instructor evaluation form. Participants noted a lack of congruency between their expectations of a quality graduate learning experience and the format, content, intent, and timing of the evaluation process. The study confirmed that students did want a voice in the evaluation of their learning experience at both the course and program levels.

The student bullying of teachers in Irish second level schools: exploring the influence of historical low state intervention in education on the development of contemporary policy responses in Ireland

The student bullying of teachers (SBT) is a distinct and complex form of bullying with a multiplicity of diverse, changeable and intersecting causes which is experienced by and affects teachers in a variety of ways. SBT is both a national and an international phenomenon which is under-recognised in academic, societal and political spheres, resulting in limited conceptual understanding and awareness of the issue. This study explores teachers’ experiences of SBT behaviours in Irish second level schools as well as teachers’ perceptions regarding training, policies and supports in Ireland to address the issue. Specifically, the study seeks to explore the influence of historical low State intervention in education on contemporary policies and supports to deal with SBT in Ireland. A mixed methods approach involving a survey of 531 second level school teachers and 17 semi-structured interviews with teachers, Year Heads and representatives from teacher trade unions and school management bodies was employed to collect and analyse data. Findings indicate that SBT behaviours are prevalent in many forms in Irish second level schools. The hidden nature of the phenomenon has simultaneously contributed to and is reinforced by limited understanding of the issue as well as teachers’ reluctance to disclose their experiences. Findings reveal that teachers perceive the contemporary policies, training and support structures in Ireland to be inadequate in equipping them to effectively deal with SBT. State intervention in addressing SBT behaviours to date, has been limited, therefore many teachers are forced to respond to the issue based on their own initiatives and assumptions rather than from an informed critically reflective approach, supported by national guidelines and sufficient State investment. This has resulted in a piecemeal, un-coordinated and ad-hoc approach to SBT in Irish schools both in terms of teachers’ management of SBT behaviours and with respect to the supports extended to staff. The potential negative consequences of SBT behaviours on teachers’ wellbeing and professional performance and thus, on the education system itself, underlines the need for a strategic, evidence-based, resourced and integrated approach which includes, as a pivotal component, consultation with teachers, whose contribution to the process is crucial.

An impact evaluation of the Ontario ban on smoking in schools and on school property : does the ban on smoking influence high school students' intentions to smoke cigarettes?

The Ontario Tobacco Control Act of 1994 imposed a total ban on smoking in schools, and on school property for every school in the province. The imposition of this policy created problems for school administrators. For instance, students who were smoking on walkways and properties adjacent to school boundaries, clashed with neighbouring property owners who were angry about the resulting damage and disruption. The enforcement of this policy consumes valuable resources at each school; therefore, knowledge about the impact of the policy is important. If effective, this policy has the potential to improve the health of students over their lifetime, by preventing or delaying smoking behaviour. Alternatively, an ineffective policy will continue to create administrative problems for the school and serve no legitimate purpose. Therefore, knowledge about the impact of the smoking ban policy on students' smoking intentions assists policy makers and school administrators in their understanding of the policy's impact within the schools. This research provided an impact evaluation of the ban on smoking in schools and on school property in Ontario. A total of 2069 students, from five high schools, in the Niagara Region, provided complete responses to a survey, designed to test whether smoking intentions were affected by the imposition of the policy. The study used Ajzen's theory of planned behaviour (Ajzen, 1991), specifically, the perceived behavioural control measure, to gain some understanding of students' perceptions of control over smoking imposed by the ban. The findings indicate the policy has the potential to influence students' overall smoking intentions. The ban on smoking policy was found to be a significant predictor of the smoking intentions of high school students. As well, attitude, social norms, and perceptions of control were significant predictors of smoking intentions. Exploratory findings also indicated differences between the control beliefs of students from different high schools, indicating potential differences in the enforcement of the smoking ban between schools. The findings also support the utility of the theory of planned behaviour as a methodology for evaluating the influence of punitive policies. This research study should be continued by utilizing the full theory of planned behaviour, including two phases of data collection and the measurement of actual smoking behaviour.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Integration of medical images to the teaching of systematic pathology : an evaluation of relevance

A sound knowledge of pathological disease processes is required for professional practice within health professions. The project described in this paper reviewed the resources currently available for the delivery of systematic pathology tutorials. Additional complementary resources were developed and the inclusion of these additional learning resources in practical tutorial sessions was evaluated for their impact on student learning. Student evaluation of the learning resources was undertaken across one semester with two different cohorts of health profession students using questionnaires and focus group discussion. Both cohorts reported an enhancement to their understanding of pathological disease processes through the use of the additional resources. Results indicate student perception of the value of the resources correlates with staff perception and is independent of prior experiences.

What Matters? : the full-time graduate students' perceptions of teacher effectiveness

The purpose of this qualitative study was to explore the full-time graduate students' perceptions of teacher effectiveness at the graduate school level, to identify how graduate students perceive effective and ineffective teachers, and specifically to discover the main dimensions of teacher effectiveness that graduate students perceive as most significant. This topic was investigated because, although the teacher has been deemed as a crucial component in the teaching process, there is no common agreement on the definition and measure of teacher effectiveness. Graduate students' perceptions of teacher effectiveness have not been given much attention. The research design was based on a ground theory approach. It utilized qualitative data through interviews, field notes, andjournals. The findings ofthis study revealed that teacher effectiveness is markedly influential to graduate students. There is no universally consented definition or measure of teacher effectiveness due to the multidimensionality of teaching and learning. Nevertheless, several major dimensions ofteacher effectiveness were discovered and highlighted in this study. Such dimensions include good command of subject matter, presentation skills, challenging and motivating students, rapport with students, learning environment, course demands, as well as assessment and feedback. It was hoped that the study would move towards developing a theory that contributes to the knowledge base of graduate students' perceptions of teacher effectiveness. It was anticipated that the results would provide first-hand information for the instructor to improve teaching; for the administrator to promote the effective educational experiences and student achievements. It was intended that the findings would lay a theoretical and empirical groundwork for future research.

La evaluación de la competencia curricular en el contexto de la orientación educativa = Evaluation of assessment criteria in the context of educational guidance : how teachers assess and evaluate their student' s performance.

Resumen basado en el del autor

Skill development and social inclusion via peer assisted learning in first-year higher education : an evaluation of student experiences across two law units

Because professions seek graduates who can 'collaborate, share skills and knowledge, and communicate' (Kruck and Reif, 2001, p 37), it is important that university graduates are not equipped solely with the content knowledge of their discipline, but also with prospective employment skills. Furthermore, when students 'interact more in positive ways with their teachers and peers, they gain more in terms of essential skills and competencies, such as critical thinking, problem~solving [and] effective communication' (NSSE, 2000, p 2)./n this way, peer assisted fellowing has the potential to enhance students' professional development, and provide the social inclusion and engagement necessary for effective learning. This session describes two peer assisted learning models embedded within first year QUT Faculty of Law units. Through a partnership between teaching staff, student mentors and mentees, the models aim to facilitate student socialisation whilst supplementing understanding of substantive law with the development of academic and work·related skills. Mentor and mentee perceptions, and program implications, are considered.

Systematic evaluation of GoSoapBox in tertiary education : a student response system for improving learning experiences and outcomes

There is currently a wide range of research into the recent introduction of student response systems in higher education and tertiary settings (Banks 2006; Kay and Le Sange, 2009; Beatty and Gerace 2009; Lantz 2010; Sprague and Dahl 2009). However, most of this pedagogical literature has generated ‘how to’ approaches regarding the use of ‘clickers’, keypads, and similar response technologies. There are currently no systematic reviews on the effectiveness of ‘GoSoapBox’ – a more recent, and increasingly popular student response system – for its capacity to enhance critical thinking, and achieve sustained learning outcomes. With rapid developments in teaching and learning technologies across all undergraduate disciplines, there is a need to obtain comprehensive, evidence-based advice on these types of technologies, their uses, and overall efficacy. This paper addresses this current gap in knowledge. Our teaching team, in an undergraduate Sociology and Public Health unit at the Queensland University of Technology (QUT), introduced GoSoapBox as a mechanism for discussing controversial topics, such as sexuality, gender, economics, religion, and politics during lectures, and to take opinion polls on social and cultural issues affecting human health. We also used this new teaching technology to allow students to interact with each other during class – both on both social and academic topics – and to generate discussions and debates during lectures. The paper reports on a data-driven study into how this interactive online tool worked to improve engagement and the quality of academic work produced by students. This paper will firstly, cover the recent literature reviewing student response systems in tertiary settings. Secondly, it will outline the theoretical framework used to generate this pedagogical research. In keeping with the social and collaborative features of Web 2.0 technologies, Bandura’s Social Learning Theory (SLT) will be applied here to investigate the effectiveness of GoSoapBox as an online tool for improving learning experiences and the quality of academic output by students. Bandura has emphasised the Internet as a tool for ‘self-controlled learning’ (Bandura 2001), as it provides the education sector with an opportunity to reconceptualise the relationship between learning and thinking (Glassman & Kang 2011). Thirdly, we describe the methods used to implement the use of GoSoapBox in our lectures and tutorials, and which aspects of the technology we drew on for learning purposes, as well as the methods for obtaining feedback from the students about the effectiveness or otherwise of this tool. Fourthly, we report cover findings from an examination of all student/staff activity on GoSoapBox as well as reports from students about the benefits and limitations of it as a learning aid. We then display a theoretical model that is produced via an iterative analytical process between SLT and our data analysis for use by academics and teachers across the undergraduate curriculum. The model has implications for all teachers considering the use of student response systems to improve the learning experiences of their students. Finally, we consider some of the negative aspects of GoSoapBox as a learning aid.

Studies of human relations in the teaching-learning process. v. final report: Evaluation of laboratory human relations training for classroom teachers,

"The research reported ... was performed pursuant to Contract no. 8143 with the cooperative research Branch, United States Office of Education, Department of Health, Education, and Welfare."

Evaluation of the year 1 literacy and numeracy checkpoints assessments trial - 2010

The draft Year 1 Literacy and Numeracy Checkpoints Assessments were in open and supported trial during Semester 2, 2010. The purpose of these trials was to evaluate the Year 1 Literacy and Numeracy Checkpoints Assessments (hereafter the Year 1 Checkpoints) that were designed in 2009 as a way to incorporate the use of the Year 1 Literacy and Numeracy Indicators as formative assessment in Year 1 in Queensland Schools. In these trials there were no mandated reporting requirements. The processes of assessment were related to future teaching decisions. As such the trials were trials of materials and the processes of using those materials to assess students, plan and teach in year 1 classrooms. In their current form the Year 1 Checkpoints provide assessment resources for teachers to use in February, June and October. They aim to support teachers in monitoring children's progress and making judgments about their achievement of the targeted P‐3 Literacy and Numeracy Indicators by the end of Year 1 (Queensland Studies Authority, 2010 p. 1). The Year 1 Checkpoints include support materials for teachers and administrators, an introductory statement on assessment, work samples, and a Data Analysis Assessment Record (DAAR) to record student performance. The Supported Trial participants were also supported with face‐to‐face and on‐line training sessions, involvement in a moderation process after the October Assessments, opportunities to participate in discussion forums as well as additional readings and materials. The assessment resources aim to use effective early years assessment practices in that the evidence is gathered from hands‐on teaching and learning experiences, rather than more formal assessment methods. They are based in a model of assessment for learning, and aim to support teachers in the “on‐going process of determining future learning directions” (Queensland Studies Authority, 2010 p. 1) for all students. Their aim is to focus teachers on interpreting and analysing evidence to make informed judgments about the achievement of all students, as a way to support subsequent planning for learning and teaching. The Evaluation of the Year 1 Literacy and Numeracy Checkpoints Assessments Supported Trial (hereafter the Evaluation) aimed to gather information about the appropriateness, effectiveness and utility of the Year 1 Checkpoints Assessments from early years’ teachers and leaders in up to one hundred Education Queensland schools who had volunteered to be part of the Supported Trial. These sample schools represent schools across a variety of Education Queensland regions and include schools with:  - A high Indigenous student population; - Urban, rural and remote school locations; - Single and multi‐age early phase classes; - A high proportion of students from low SES backgrounds. The purpose of the Evaluation was to: Evaluate the materials and report on the views of school‐based staff involved in the trial on the process, materials, and assessment practices utilised. The Evaluation has reviewed the materials, and used surveys, interviews, and observations of processes and procedures to collect relevant data to help present an informed opinion on the Year 1 Checkpoints as assessment for the early years of schooling. Student work samples and teacher planning and assessment documents were also collected. The evaluation has not evaluated the Year 1 Checkpoints in any other capacity than as a resource for Year 1 teachers and relevant support staff.

A formative evaluation of the Stronger Smarter Learning Communities Project. 2011 report.

This report is a formative evaluation of the operations of the DEEWR funded Stronger Smarter Learning Community (SSLC) project from September 2009 to July 2011. It is undertaken by an independent team of researchers from Queensland University of Technology, the University of Newcastle and Harvard University. It reports on findings from: documentary analysis; qualitative case studies of SSLC Hub schools; descriptive, multivariate and multilevel analysis of survey data from school leaders and teachers from SSLC Hub and Affiliate schools and from a control group of non-SSLC schools; and multilevel analysis of school-level data on SSLC Hubs, Affiliates and ACARA like-schools. Key findings from this work are that: • SSLC school leaders and teachers are reporting progress in changing school ethos around issues of: recognition of Indigenous identity, Indigenous leadership, innovative approaches to staffing and school models, Indigenous community engagement and high expectations leadership; • Many Stronger Smarter messages are reportedly having better uptake in schools with high percentages of Indigenous students; • There are no major or consistent patterns of differences between SSLC and non-SSLC schools in teacher and school leader self-reports of curriculum and pedagogy practices; and • There is no evidence to date that SSLC Hubs and Affiliates have increased attendance or increased achievement gains compared to ACARA like-schools. Twenty-one months is relatively early in this school reform project. Hence the major focus of subsequent reports will be on the documentation of comparative longitudinal gains in achievement tests and improved attendance. The 2011 and 2012 research also will model the relationships between change in school ethos/climate, changed Indigenous community relations, improved curriculum/pedagogy, and gains in Indigenous student achievement, attendance and outcomes. The key challenge for SSLC and the Stronger Smarter approach will be whether it can systematically generate change and reform in curriculum and pedagogy practices that can be empirically linked to improved student outcomes.