Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

From rhetoric to practice : issues in teaching and learning touch keyboarding

Touch keyboarding as a vocational skill is disappearing at a time when students and educators across alleducational sectors are expected to use a computer keyboard on a regular basis. there is documentation surrounding the embedding of Information and Communication Technology (ICT) within the curricula and yet within the National Training Packages touch keyboarding, previously considered a core component, is now an elective in the Business Services framework. This situation is an odds with current practice overseas where touch keyboarding is a component of primary and secondary curricula. From Rhetoric to Practice explores the current issues and practice in teaching and learning touch keyboarding in primary, secondary and tertiary institutions. Through structured interview participants detailed current practice of teachers and their students. Further, tertiary students participated in a training program aimed at achquiring touch keyboarding as a skill to enhance their studies. The researcher's background experience of fifteen years teaching touch keyboarding and computer literacty to adults and 30 years in Business Services trade provides a strong basis for this project. The teaching experience is enhanced by industry experience in administration, course coordination in technical, community and tertiary institutions and a strong commitment to the efficient usage of a computer by all. The findings of this project identified coursework expectations requiring all students from kindergarten to tertiary to use a computer keyboard on a weekly basis and that neither teaching nor learning tough keyboarding appears in the primary, secondary and tertiary curricula in New South Wales. Further, teachers recognised tough keyboarding as the prefered style over 'hunt and peck' keyboarding while acknowledging the teaching and learning difficulties of time constraints, the need for qualified touch keyboarding teachers and issues arising when retraining students from existing poor habits. In conclusion, this project recommends that computer keyboarding be defined as a writing tool for education, vocation and life, with early instruction set in primary schooling area and embedding touch keyboarding with the secondary, technical and tertiary areas and finally to draw the attention of educational authorities to the Duty Of Care aspects associated with computer keyboarding in the classroom.

Connecting Indigenous stories with geology : inquiry-based learning in a middle years classroom

One way to integrate indigenous perspectives in junior science is through links between indigenous stories of the local area and science concepts. Using local indigenous stories about landforms, a teacher of year 8 students designed a unit on geology that catered for the diverse student population in his class. This paper reports on the inquiry-based approach structured around the requirements of the Australian Curriculum highlighting the learning and engagement of students during the unit.

The trials and tribulations of a BYOD science classroom

The increase in the availability and use of portable mobile devices has had a number of impacts on society. In particular, this impact has been seen within Higher Education Institutions where staff and students are using these devices for both simple and complex tasks. Within undergraduate teacher education courses there is an expectation that students will be fully prepared for teaching their respective areas of expertise as well as having the ability to use ICT, and in particular portable mobile devices, to support teaching and learning. This paper reports on a small case study into the use of portable mobile devices in a science unit, where the students (N=16) bring their own devices into the classroom and use them in lectures, tutorials and workshops. The study highlights the changing nature of classroom practice within the university setting and the challenges faced by teaching staff and students when using these devices.

Intercultural competence in engineering education : who are we teaching?

BACKGROUND There is little doubt that our engineering graduates’ ability to identify cultural differences and their potential to impact on engineering projects, and to work effectively with these differences is of key importance in the modern engineering practice. Within engineering degree programs themselves there is also a significant need to recognise the impact of changing student and staff profiles on what happens in the classroom. The research described in this paper forms part of a larger project exploring issues of intercultural competence in engineering. PURPOSE This paper presents an observational and survey study of undergraduate and postgraduate engineering students from four institutions working in groups on tasks with a purely technical focus, or with a cultural and humanitarian element. The study sought to explore how students rate their own intercultural competence and team process and whether any differences exist depending on the nature of the task they are working on. We also investigated whether any differences were evident between groups of first year, second year and postgraduate students. DESIGN/METHOD The study used the miniCQS instrument (Ang & Van Dyne, 2008) and a Bales Interaction Process Analysis based scale (Bales, 1950; Carney, 1976) to collect students self ratings of group process, task management, and cultural experience and behaviour. The Bales IPA was also used for coding video observations of students working in groups. Survey data were used to form descriptive variables to compare outcomes across the different tasks and contexts. Observations analysed in Nvivo were used to provide commentary and additional detail on the quantitative data. RESULTS The results of the survey indicated consistent mean scores on each survey item for each group of students, despite vastly different tasks, student backgrounds and educational contexts. Some small, statistically significant mean differences existed, offering some basic insights into how task and student group composition could affect self ratings. Overall though, the results suggest minimal shift in how students view group function and their intercultural experience, irrespective of differing educational experience. CONCLUSIONS The survey results, contrasted with group observations, indicate that either students are not translating their experience (in the group tasks) into critical self assessment of their cultural competence and teamwork, or that they become more critical of team performance and cultural competence as their competence in these areas grows, so their ratings remain consistent. Both outcomes indicate that students need more intensive guidance to build their critical self and peer assessment skills in these areas irrespective of their year level of study.

Teacher aides and their pedagogical contributions in the underachieving Indigenous mathematics classroom

This study examines the pedagogical contributions made by teacher aides in underperforming Indigenous mathematics secondary classrooms. Three teaching teams, each consisting of a teacher and their teacher aide, responded to semi-structured interviews. Their mathematics classrooms were observed for details of pedagogical contributions to the mathematics lessons. It was found that the pedagogical contributions of the teacher aides varied from co-teaching contributions, to the provision of menial support and behaviour management. The techniques used by the teacher aides to provide student feedback, to support behaviour management and to undertake questioning vary greatly, and this variance is also evident in the classroom atmosphere. Teacher aides are providing pedagogical contributions, and are engaged in instructional interactions, and are in a sense “teaching”.

Curriculum, assessment teaching and learning for all

This chapter explores how the culture of classrooms and schools can acknowledge diversity and meet all learning needs. Classroom and school culture can and should enhance the belonging and learning of all students. Understanding of learning, curriculum, pedagogy and assessment influences the ways teachers consider their expectations of student achievement and participation in school. We revisit the theory of social constructionism to emphasise the development of shared and valued curriculum, which meets all learner needs. Decisions about what to teach, how to teach and assess, and what supports student needs are important considerations discussed in this chapter. Key messages drawn from the Australian and New Zealand curriculum reinforce the need to ensure education responds to the diversity of students in classrooms. A range of models of pedagogy that have influenced education in Australia and New Zealand are presented, with a particular focus on meeting the needs of students who have disabilities. In addition, the issues related to student and teacher identity, the importance of respectful partnerships that acknowledge family knowledge, and respectful collaboration are discussed. Belonging to a community of learners is made possible through teachers forming authentic relationships with students and their families. In turn, these relationships support teachers to understand how the students in their classrooms learn, and to know their students’ strengths and interests.

Solo life to Second Life : the design of physical and virtual learning spaces inspired by the drama classroom

This paper explores the design of virtual and physical learning spaces developed for students of drama and theatre studies. What can we learn from the traditional drama workshop that will inform the design of drama and theatre spaces created in technology-mediated learning environments? The authors examine four examples of spaces created for online, distance and on-campus students and discuss the relationship between the choice of technology, the learning and teaching methods, and the outcomes for student engagement. Combining insights from two previous action research projects, the discussion focuses on the physical space used for contemporary drama workshops, supplemented by Web 2.0 technologies; a modular online theatre studies course; the blogging space of students creating a group devised play; and the open and immersive world of Second Life, where students explore 3D simulations of historical theatre sites. The authors argue that the drama workshop can be used as inspiration for the design of successful online classrooms. This is achieved by focusing on students’ contributions to the learning as individuals and group members, the aesthetics and mise-en-scene of the learning space, and the role of mobile and networked technologies. Students in this environment increase their capacity to become co-creators of knowledge and to achieve creative outcomes. The drama workshop space in its physical and virtual forms is seen as a model for classrooms in other disciplines, where dynamic, creative and collaborative spaces are required.

Recipe for success : cooking up a storm in the technology classroom

Ingredients: - 1 cup Vision - 100ml ‘Real World’ Application - 100ml Unit Structure/Organisation - 100ml Student-centric Approach [optional: Add Social Media/Popular Culture for extra goodness] - Large Dollop of Passion + Enthusiasm - Sprinkle of Approachability Mix all ingredients well. Cover and leave to rise in a Lecture Theatre for 1.5 hours. Cook in a Classroom for 1.5 hours. Garnish with a dash of Humour before serving. Serves 170 Students

Embedding information and communication technologies in the early childhood classroom

New technologies and the pace of change in modern society mean changes for classroom teaching and learning. Information and communication technologies (ICTs) feature in everyday life and provide ample opportunities for enhancing classroom programs. This article outlines how ICTs complement curriculum implementation in one year two classroom. It suggests practical strategies demonstrating how teachers can make ICTs work for them and progressively teach children how to make ICTs work for them.

Learning and teaching reflection : developing capacities for lifelong learning

Reflection is an essential part of being an effective learner and working as a productive teacher. It enables the learner or teacher to deliberate about the factors that lead to successful learning and teaching for them and/or their students, in a particular place and for a specific purpose, so they can make reasoned and effective choices. This chapter introduces important frameworks that cover a century of thinking around reflection in education, and illustrates how preservice teachers can use these ideas across three phases. First, becoming a reflective learner as a university student to enhance learning and assessment outcomes; second, becoming a reflective teacher to improve classroom teaching and learning outcomes; and third, developing the reflective capacities of primary students so they can enhance their skills for lifelong learning.

Relationship between emotional climate and the fluency of classroom interactions

This study examined emotional climate in relation to the teaching and learning of grade 7 science. A multi-method and multi-theoretic approach used sociocultural frameworks as a foundation for interpretive research, conversation analysis, prosody analysis, and studies of nonverbal conduct. Emotional climate varied continuously throughout a lesson. Dialogues occurred and afforded learning when interactions between the teacher and students were fluent and included humour and collective effervescence. Emotional climate was negatively valenced when the teacher and/or students endeavoured to establish and maintain power by restricting others’ participation to spectator roles. The teacher’s endeavours to maintain and establish control over students were potentially detrimental to teaching and learning, teachers and learners. This type of teaching gradually evolved into a form we referred to as cranky teaching, whereby the teacher and her students showed signs of frustration and the enacted teaching and learning roles lacked fluency. The methods we pioneered in the present study might be helpful for other teachers who wish to participate in research on their classes to ascertain what works and should be strengthened, and identify practices and rituals that are deleterious and in need of change.

Teaching and learning family and consumer sciences through K-W-L charts

While much of the control and many of the activities found in today’s classrooms have been placed in the hands of the learners and learning has become inquiry-based, there remains a need for teachers to use teaching tools that would facilitate this student-centered teaching process. This article identifies the K-W-L Chart as one such tool and follows a case study of four Kuwaiti ‘Family and Consumer Sciences’ teaching / learning events to evaluate their ability to enhance the learning outcomes of eight students. The research was designed from a qualitative, multi-tiered design approach and was assessed through a constant comparative method of data analysis of interview responses, classroom observations and worksheet-assessments. The results showed that the use of K-W-L Charts influenced the teachers and learners toward a more inquiry-based approach and facilitated a more student-centered and collaborative learning environment, raising the level of interest and the amount of personal input given by the students.

Embedding graphic organisers in the teaching and learning of family and consumer sciences (home economics) in Kuwait

Educational reforms currently being enacted in Kuwaiti Family and Consumer Sciences (FCS) in response to contemporary demands for increased student-centred teaching and learning are challenging for FCS teachers due to their limited experience with student-centred learning tools such as Graphic Organisers (GOs). To adopt these reforms, Kuwaiti teachers require a better understanding of and competency in promoting cognitive learning processes that will maximise student-centred learning approaches. This study followed the experiences of four Grade 6 FCS Kuwaiti teachers as they undertook a Professional Development (PD) program specifically designed to advance their understanding of the use of GOs and then as they implemented what they had learned in their Grade 6 FCS classroom. The PD program developed for this study was informed by Nasseh.s competency PD model as well as Piaget and Ausubel.s cognitive theories. This model enabled an assessment and evaluation of the development of the teachers. competencies as an outcome of the PD program in terms of the adoption of GOs, in particular, and their capacity to use GOs to engage students in personalised, in-depth, learning through critical thinking and understanding. The research revealed that the PD program was influential in reforming the teachers. learning, understanding of and competency in, cognitive and visual theories of learning, so that they facilitated student-centred teaching and learning processes that enabled students to adopt and adapt GOs in constructivist learning. The implementation of five GOs - Flow Chart, Concept Maps, K-W-L Chart, Fishbone Diagram and Venn Diagram - as learning tools in classrooms was investigated to find if changes in pedagogical approach for supporting conceptual learning through cognitive information processing would reduce the cognitive work load of students and produce better learning approaches. The study as evidenced by the participant teachers. responses and classroom observations, showed a marked increase in student interest, participation, critical thought, problem solving skills, as a result of using GOs, compared to using traditional teaching and learning methods. A theoretical model was developed from the study based on the premise that teachers. knowledge of the subject, pedagogy and student learning precede the implementation of student-centred learning reform, that it plays an important role in the implementation of student-centred learning and that it brings about a change in teaching practice. The model affirmed that observed change in teaching-practice included aspects of teachers. beliefs, as well as confidence and effect on workplace and on student learning, including engagement, understanding, critical thinking and problem solving. The model assumed that change in teaching practice is inseparable from teachers. lifelong PD needs related to knowledge, understanding, skills and competency. These findings produced a set of preliminary guidelines for establishing student-centred constructivist strategies in Kuwaiti education while retaining Kuwait.s cultural uniqueness.

Assessment as a Generative Dance : Connecting Teaching, Learning and Curriculum

This chapter focuses on learning and assessment as social and cultural practices situated within national and international policy contexts of educational change. Classroom assessment was researched using a conceptualization of knowing in action, or the ‘generative dance’. Fine-grained analyses of interactivity between students, and between teacher and student/s, and their patterns of participation in assessment and learning were conducted. The findings offer original insights into how learners draw on explicit and tacit forms of knowing in order to successfully participate in learning. Assessment is re-imagined as a dynamic space in which teachers learn about their students as they learn with their students, and where all students can be empowered to find success.