Teaching Teachers for the Future (TTF) Project TPACK Survey : summary of the key findings

This paper presents a summary of the key findings of the TTF TPACK Survey developed and administered for the Teaching the Teachers for the Future (TTF) Project implemented in 2011. The TTF Project, funded by an Australian Government ICT Innovation Fund grant, involved all 39 Australian Higher Education Institutions which provide initial teacher education. TTF data collections were undertaken at the end of Semester 1 (T1) and at the end of Semester 2 (T2) in 2011. A total of 12881 participants completed the first survey (T1) and 5809 participants completed the second survey (T2). Groups of like-named items from the T1 survey were subject to a battery of complementary data analysis techniques. The psychometric properties of the four scales: Confidence - teacher items; Usefulness - teacher items; Confidence - student items; Usefulness- student items, were confirmed both at T1 and T2. Among the key findings summarised, at the national level, the scale: Confidence to use ICT as a teacher showed measurable growth across the whole scale from T1 to T2, and the scale: Confidence to facilitate student use of ICT also showed measurable growth across the whole scale from T1 to T2. Additional key TTF TPACK Survey findings are summarised.

How can preservice teachers be measured against advocated professional teaching standards?

Australia has had many inquiries into teaching and teacher education over the last decade. Standards for teaching have been produced by national education systems with many state systems following suit. The Queensland College of Teachers (QCT) advocates ten professional teaching standards for teachers and preservice teachers. How can preservice teachers be measured against advocated professional standards? This study investigated 106 second-year preservice teachers’ perceptions of their development against the QCT standards. A pretest-posttest survey instrument was developed based on the QCT standards and administered to these preservice teachers before and after their science education coursework. Percentages, ANOVAs and t-tests were generated to analyse the results. Findings indicated that 22 of the 24 paired pretest-posttest items were highly significant (p<.001). Percentage increases ranged from as low as 27% in the pretest to as high as 97% in the posttest, yet, there were two items with lower significance (i.e., working in professional science education teams and supporting students’ participation in society). Understanding preservice teachers’ perceptions of their abilities to implement these standards may be a step towards the process of determining the achievement of teaching standards; however, more rigorous measurements will need to be developed for both teachers and preservice teachers. University coursework and related assessments can provide an indication of achieving these standards, especially authentic assessment of preservice teachers’ practices.

Teachers reporting suspected child sexual abuse : results of a three-state study

Over 3000 cases of child sexual abuse are identified every year in Australia, but the real incidence is higher still. As a strategy to identify child sexual abuse, Australian States and Territories have enacted legislation requiring members of selected professions, including teachers, to report suspected cases. In addition, policy-based reporting obligations have been developed by professions, including the teaching profession. These legislative and industry-based developments have occurred in a context of growing awareness of the incidence and consequences of child sexual abuse. Teachers have frequent contact and close relationships with children, and possess expertise in monitoring changes in children’s behaviour. Accordingly, teachers are seen as being well-placed to detect and report suspected child sexual abuse. To date, however, there has been little empirical research into the operation of these reporting duties. The extent of teachers’ awareness of their duties to report child sexual abuse is unknown. Further, there is little evidence about teachers’ past reporting practice. Teachers’ duties to report sexual abuse, especially those in legislation, differ between States, and it is not known whether or how these differences affect reporting practice. This article presents results from the first large-scale Australian survey of teachers in three States with different reporting laws: New South Wales, Queensland, and Western Australia. The results indicate levels of teacher knowledge of reporting duties, reveal evidence about past reporting practice, and provide insights into anticipated future reporting practice and legal compliance. The findings have implications for reform of legislation and policy, training of teachers about the reporting of child sexual abuse, and enhancement of child protection.

Two Thai teachers' perceptions of cooperative learning

Over the past decade, the need for educational reform in Thailand has become increasingly apparent. The strong tradition of teacher-directed instruction has been the major teaching and learning style in Thai education. Recent policy changes have focused on expanding education opportunities, the implementation of compulsory education and also on more student-centered pedagogies (Carter, 2006). A suggested way of bringing about the changes necessary to improve the standard of education in primary schools and retention rates is to incorporate cooperative learning into Thai primary school classrooms. The action research in this study proceeded in four stages. There were pre-implementation interviews of teachers, teacher preparation, implementation of program, and post-implementation evaluation. This study focused on the two Thai teachers' perceptions about the benefits of cooperative learning and the roles of the teachers in cooperative learning classroom. The study found that the two teachers had constructed different levels of perceptions about the benefits of cooperative learning and the roles of the teacher. These findings indicated that Thai teachers who are relatively inexperienced, lacking in confidence and with little or no experience with group work strategies such as peer tutoring need alternative, less intense professional development programs conducted over a period of a semester than the professional development program implemented in this study. In addition to being conducted over a longer period of time, the findings also indicate that alternative teacher professional programs need to provide additional workshops to improve their understanding of cooperative learning and the teachers' roles.

Is the world their oyster? The global imagination of pre-service teachers

This paper reports on a qualitative interview study with eleven pre-service primary teachers in Queensland about their career plans exploring whether and how a global imagination motivates this next generation of teachers. The study is framed within sociological theory of globalisation, with regard to the growing possibilities for international mobility for work purposes, and the new life circumstances which make this imaginable. Teaching as a profession has changed and teachers are no longer as entangled with specific systems or geographical locations anymore. International recruitment campaigns are shown to pursue these pre-service teachers during their university preparation. The analysis of the interview data reveals the kind of impact these possibilities make on how pre-service teachers imagine their career, and what other considerations enhance or limit their global imagination. The findings are used to reflect on the highly localised governance of pre-service teacher preparation and the limited state-bound imaginaries to which these pre-service teachers are unnecessarily confined in their preparation.

A life jacket with holes- : a case study of 'temporary engagement' : a strategy used by Education Queensland to employ beginning secondary teachers

This research investigated the impact of Education Queensland's employment policy and practices for beginning secondary teachers appointed on temporary engagement. The context was the public secondary school sector within the state of Queensland, Australia. The study was set within a context of the changing nature of work from full-time permanent employment towards casual, fixed-term contracts, temporary and part-time employment, a trend reflected in the employment patterns for teachers within Australia. Two broad categories of literature relating to the research problem of this thesis were reviewed, namely the beginning teacher and permanency or tenure. The focus in the research literature on beginning teachers was the professional experiences of teachers within the classroom and school. There was a paucity of research that considered the working and industrial conditions of temporary employment for beginning teachers or the personal and professional implications of this form of employment. The review of the context and literature was conceptualised as a Beginning Temporary Teacher Theoretical Framework which served to inform the study. Using a qualitative case study methodology, the research techniques employed for the thesis were semi-structured interview and document analysis. A simultaneously conducted research project in which the researcher participated entitled 'Winning the Lottery? Beginning Teachers on Temporary Engagement' foregrounded this thesis in terms of refining the research question, contributing to the literature and in the selection of the participants. For this case study the perspectives of four distinct yet inter-related categories of professionals were sought. These included four beginning secondary teachers, three school administrators, a Senior Personnel Officer with Education Queensland, and a representative from the Queensland Teachers' Union. The research findings indicated that none of the beginning teachers or other professionals viewed starting a career in teaching on temporary engagement as the ideal. The negative features identified were the differential treatment received and the high level of uncertainty associated with temporary employment. Differential treatment tended to indicate 'less' entitlements, in terms of access to induction and professional development, recreational and sick leave, acceptance by and expectations of other colleagues, and avenues of redress in grievance cases. Moreover, interviews indicated a high level of uncertainty in terms of starting within the teaching profession, commencing at a new school, and a regular income. In addition, frequent changes in schools and/or cohorts of students exacerbated levels of uncertainty. The beginning teachers reported significantly decreased motivation, self-esteem and sense of belonging, and increased stress levels. There was an even more marked negative impact on those beginning teachers who had experienced a higher number of temporary engagements and schools in their first year of teaching. Conversely, strong staff support and a reasonable length of time in the one school improved the quality of the beginning teachers' experiences. The overall impact of being on temporary engagement resulted in delayed permanent position appointments, decreased commitment to particular schools and to Education Queensland as the employing authority, and for two of the beginning teachers, it produced a desire to seek alternative employment. The implementation of Education Queensland's policies relating to working conditions and entitlements for these temporary beginning teachers at the school level was revealed to be less than satisfactory. There was a tendency towards 'just-in- time' management of the beginning teacher on temporary engagement. The beginning teachers received 'less-than-messages' about access to and use of departmental documentation, support through induction and professional development, and their transition from temporary to permanent employment. To ensure a more systematic, supportive and inclusive process for managing the temporary beginning teacher, a conceptual framework entitled 'Continuums of Tension' was developed. The four continuums included permanent employment - temporary employment; system perspective - individual perspective; teaching as a profession - teaching as a job; and the permanent beginning teacher - university graduate. The general principles of the human resource policies of Education Queensland were based on a commitment to permanent employment, a system's perspective, viewing teaching as a profession and a homogeneous group of permanent beginning teachers. Contrasting with this, the beginning teacher on temporary engagement tended to operate from the position of temporary employment and a perspective that was individually based. Their priorities therefore included the 'occupational' aspects of being a temporary teacher striving to become permanent. Thus there existed a tension or contradiction between the general principles of human resource policies within Education Queensland and the employment experiences of beginning teachers on temporary engagement. The study proposed three actions for resolution to address the aforementioned tensions. The actions included: (a) the effective provision and targeted communication of information; (b) support, induction and professional development; and (c) a coordinated approach between Education Queensland, Queensland Teachers' Union, the Universities and the beginning teacher. These actions are fm1her refined to include: (a) an induction kit to suppm1 the individual through the pre-employment to permanent employee phases, (b) an extrapolation of the roles and responsibilities of Education Queensland personnel charged with supporting the beginning temporary teacher, and (c) a series of recommendations to effect a coordinated approach amongst the key stakeholders. The theoretical and conceptual frameworks have provided a means of addressing the identified needs of the beginning teacher on temporary engagement. As such, this study has contributed to the research literature on teacher employment and professionalism and aims to provide a beginning temporary teacher with managed professional and occupational support.

Art in early childhood : the discourse of 'proper' teaching

This thesis is a problematisation of the teaching of art to young children. To problematise a domain of social endeavour, is, in Michel Foucault's terms, to ask how we come to believe that "something ... can and must be thought" (Foucault, 1985:7). The aim is to document what counts (i.e., what is sayable, thinkable, feelable) as proper art teaching in Queensland at this point ofhistorical time. In this sense, the thesis is a departure from more recognisable research on 'more effective' teaching, including critical studies of art teaching and early childhood teaching. It treats 'good teaching' as an effect of moral training made possible through disciplinary discourses organised around certain epistemic rules at a particular place and time. There are four key tasks accomplished within the thesis. The first is to describe an event which is not easily resolved by means of orthodox theories or explanations, either liberal-humanist or critical ones. The second is to indicate how poststructuralist understandings of the self and social practice enable fresh engagements with uneasy pedagogical moments. What follows this discussion is the documentation of an empirical investigation that was made into texts generated by early childhood teachers, artists and parents about what constitutes 'good practice' in art teaching. Twenty-two participants produced text to tell and re-tell the meaning of 'proper' art education, from different subject positions. Rather than attempting to capture 'typical' representations of art education in the early years, a pool of 'exemplary' teachers, artists and parents were chosen, using "purposeful sampling", and from this pool, three videos were filmed and later discussed by the audience of participants. The fourth aspect of the thesis involves developing a means of analysing these texts in such a way as to allow a 're-description' of the field of art teaching by attempting to foreground the epistemic rules through which such teacher-generated texts come to count as true ie, as propriety in art pedagogy. This analysis drew on Donna Haraway's (1995) understanding of 'ironic' categorisation to hold the tensions within the propositions inside the categories of analysis rather than setting these up as discursive oppositions. The analysis is therefore ironic in the sense that Richard Rorty (1989) understands the term to apply to social scientific research. Three 'ironic' categories were argued to inform the discursive construction of 'proper' art teaching. It is argued that a teacher should (a) Teach without teaching; (b) Manufacture the natural; and (c) Train for creativity. These ironic categories work to undo modernist assumptions about theory/practice gaps and finding a 'balance' between oppositional binary terms. They were produced through a discourse theoretical reading of the texts generated by the participants in the study, texts that these same individuals use as a means of discipline and self-training as they work to teach properly. In arguing the usefulness of such approaches to empirical data analysis, the thesis challenges early childhood research in arts education, in relation to its capacity to deal with ambiguity and to acknowledge contradiction in the work of teachers and in their explanations for what they do. It works as a challenge at a range of levels - at the level of theorising, of method and of analysis. In opening up thinking about normalised categories, and questioning traditional Western philosophy and the grand narratives of early childhood art pedagogy, it makes a space for re-thinking art pedagogy as "a game oftruth and error" (Foucault, 1985). In doing so, it opens up a space for thinking how art education might be otherwise.

Embracing diversity : empowering preservice teachers for teaching gifted and talented students

This study investigated preservice teachers’ perceptions for teaching and sustaining gifted and talented students while developing, modifying and implementing activities to cater for the diverse learner. Participants were surveyed at the end of a gifted and talented education program on their perceptions to differentiate the curriculum for meeting the needs of the student (n=22). SPSS data analysis with the five-part Likert scale indicated these preservice teachers agreed or strongly agreed they had developed skills in curriculum planning (91%) with well-designed activities (96%), and lesson preparation skills (96%). They also claimed they were enthusiastic for teaching (91%) and understanding of school practices and policies (96%). However, 46% agreed they had knowledge of syllabus documents with 50% claiming an ability to provide written feedback on student’s learning. Furthermore, nearly two-thirds suggested they had educational language from the syllabus and effective student management strategies. Preservice teachers require more direction on how to cater for diversity and begin creating sustainable societies by building knowledge from direct GAT experiences. Designing diagnostic surveys associated with university coursework can be used to determine further development for specific preservice teacher development in GAT education. Preservice teachers need to create opportunities for students to realise their potential by involving cognitive challenges through a differentiated curriculum. Differentiation requires modification of four primary areas of curriculum development (Maker, 1975) content (what we teach), process (how we teach), product (what we expect the students to do or show) and learning environment (where we teach/our class culture). Ashman and Elkins (2009) and Glasson (2008) emphasise the need for preservice teachers, teachers and other professionals to be able to identify what gifted and talented (GAT) students know and how they learn in relation to effective teaching. Glasson (2008) recommends that educators keep up to date with practices in pedagogy, support, monitoring and profiling of GAT students to create an environment conducive to achieving. Oral feedback is one method to communicate to learners about their progress but has advantages and disadvantages for some students. Oral feedback provides immediate information to the student on progress and performance (Ashman & Elkins, 2009). However, preservice teachers must have clear understandings of key concepts to assist the GAT student. Implementing teaching strategies to engage innovate and extend students is valuable to the preservice teacher in focusing on GAT student learning in the classroom (Killen, 2007). Practical teaching strategies (Harris & Hemming, 2008; Tomlinson et al., 1994) facilitate diverse ways for assisting GAT students to achieve learning outcomes. Such strategies include activities to enhance creativity, co-operative learning and problem-solving activities (Chessman, 2005; NSW Department of Education and Training, 2004; Taylor & Milton, 2006) for GAT students to develop a sense of identity, belonging and self esteem towards becoming an autonomous learner. Preservice teachers need to understand that GAT students learn in a different way and therefore should be assessed differently. Assessment can be through diverse options to demonstrate the student’s competence, demonstrate their understanding of the material in a way that highlights their natural abilities (Glasson, 2008; Mack, 2008). Preservice teachers often are unprepared to assess students understanding but this may be overcome with teacher education training promoting effective communication and collaboration in the classroom, including the provision of a variety of assessment strategies to improve teaching and learning (Callahan et al., 2003; Tomlinson et al., 1994). It is also critical that preservice teachers have enthusiasm for teaching to demonstrate inclusion, involvement and the excitement to communicate to GAT students in the learning process (Baum, 2002). Evaluating and reflecting on teaching practices must be part of a preservice teacher’s repertoire for GAT education. Evaluating teaching practices can assist to further enhance student learning (Mayer, 2008). Evaluation gauges the success or otherwise of specific activities and teaching in general (Mayer, 2008), and ensures that preservice teachers and teachers are well prepared and maintain their commitment to their students and the community. Long and Harris (1999) advocate that reflective practices assist teachers in creating improvements in educational practices. Reflective practices help preservice teachers and teachers to improve their ability to pursue improved learning outcomes and professional growth (Long & Harris, 1999). Context This study is set at a small regional campus of a large university in Queensland. As a way to address departmental policies and the need to prepare preservice teachers for engaging a diverse range of learners (see Queensland College of Teachers, Professional Standards for Teachers, 2006), preservice teachers at this campus completed four elective units within their Bachelor of Education (primary) degree. The electives include: 1. Middle years students and schools 2. Teaching strategies for engaging learners 3. Teaching students with learning difficulties, and 4. Middle-years curriculum, pedagogy and assessment. In the university-based component of this unit, preservice teachers engaged in learning about middle years students and schools, and gained knowledge of government policies pertaining to GAT students. Further explored within in this unit was the importance of: collaboration between teachers, parents/carers and school personnel in supporting middle years GAT students; incorporating challenging learning experiences that promoted higher order thinking and problem solving skills; real world learning experiences for students and; the alignment and design of curriculum, pedagogy and assessment that is relevant to the students development, interests and needs. The participants were third-year Bachelor of Education (primary) preservice teachers who were completing an elective unit as part of the middle years of schooling learning with a focus on GAT students. They were assigned one student from a local school. In the six subsequent ninety minute weekly lessons, the preservice teachers were responsible for designing learning activities that would engage and extend the GAT students. Furthermore, preservice teachers made decisions about suitable pedagogical approaches and designed the assessment task to align with the curriculum and the developmental needs of their middle years GAT student. This research aims to describe preservice teachers’ perceptions of their education for teaching gifted and talented students.

High-challenge teaching for senior English as an Additional Language (EAL) learners in times of change

This paper will present a brief overview of the recent shifts within English and EAL/D (English as an additional language/dialect) curriculum documents and their focus on critical literacy, using the Queensland context as a case in point. The English syllabus landscape in Queensland has continued to morph in recent years. From 2002 to 2009, teachers of senior English and English as an Additional Language (EAL/D) have witnessed no less than four separate syllabus documents that impact on their daily work. The Australian Curriculum, when finally implemented, will also require teachers to navigate and grapple with its particular obligations and affordances. The combined effect of the shifts and tensions between recent policy documents has led to confusion about exactly how to cater for EAL/D learners in mainstream English. We discuss the possible effects of this on teachers as the agents of policy implementation and argue that in spite of such contradictions, EAL/D teachers can productively use syllabus frameworks to craft pedagogy to cater for their EAL/D learners’ language and literacy needs. Following this, we present aspects of the teaching practice of four teachers of senior EAL/D, who provide intellectually-engaging, critical literacy pedagogy that takes into account the language proficiency level of their learners, within the required curriculum. Such practice provides teachers with valuable pedagogic possibilities to meet EAL/D learners’ needs within continually varying policy terrain.

TAFE-horticulture teachers’ conceptions of curriculum changes in Queensland, 1990-2003

The period from 1990-2003 was one of unprecedented curriculum change in the Queensland TAFE sector in general and Horticulture in particular. While curriculum theory had been clear for many years that teachers should be involved deeply in the curriculum process, data collected at the end of that period reveals that TAFE Horticulture teachers felt excluded and manipulated by the curriculum developers. With the benefit of distance, this thesis examines TAFE teachers’ conceptions of curriculum change in Horticulture and considers whether events since then have justified their reservations. The research paradigm of this study was informed by the qualitative research orientation of phenomenography based on extended interviews. The study revealed that teachers held eight qualitatively different conceptions of curriculum development. Some viewed the changes as representing a reduction in the quality of education, some as a retreat from education and training while others saw it as a reduction in the quality of teaching delivery. There were teachers who saw it as a way of saving money and others as causing instability and uncertainty, as exploitation of staff and a cause of extra (often unnecessary) work. Most saw the changes as imposed from above with the changes experienced as destructive to staff morale. Despite the generally negative conceptions of curriculum change, the study confirms the importance of teachers being regarded as central in the curriculum change process.

Perspectives of teaching in Papua New Guinea : a case study of elementary teacher trainers and their mentors

Global and national agenda for quality education led to reform in Papua New Guinea (PNG) based on the provision of quality basic education. “Education for All” (EFA) is a worldwide emphasis on the review and restructure of existing curriculum and teacher training programs to provide quality education and quality life. The provision of quality education is seen as an investment in developing countries including PNG. Quality education is facilitated through structural and curriculum reform, and teacher education programs. One such influence on quality education in teacher education relates to perspectives of teaching. Existing research shows teachers’ beliefs and perceptions of teaching influence their practice (Kember & Kwan, 2000; Prosser & Trigwell, 2004). However, there is no research focusing on perspectives of teaching for elementary education in PNG. This single exploratory case study (Yin, 2009) investigated the perspectives of teaching of eighteen elementary teacher trainers and their five mentors in the context of an Australian university Bachelor of Early Childhood (in teacher education) degree programme. The study drew on an interpretivist paradigm to analyse journals, semi-structured interviews and course planning documents using a thematic approach to data analysis (Braun & Clark, 2006). The findings revealed that participants held perspectives of teaching related to teaching children and teaching adults. The perspective of teaching children described by the trainers and mentors was learning-centred (the focus is on what the teacher does); while the perspective of teaching adults was both learning-centred and learner-centred (the focus is on what the learner does). The learning-centred perspective is at odds with the learner-centred perspective espoused in the PNG reform. The perspectives of teaching adults reflected a culturally nuanced view; providing insights about how teaching and learning are understood in different sociocultural contexts. Based on these findings, the study proposes a perspective of teaching for elementary education in PNG known as culturally connected teaching. This perspective enables the co-existence of both the learning-centred and learner-centred perspectives of teaching in the PNG cultural context. This perspective has implications for teacher training and the communities involved in elementary education.

Middle school social sciences : exploring teachers’ conceptions of essential knowledge

This study examines teachers’ conceptions of essential knowledge in the humanities and social sciences, commonly referred to as "social education", in the middle years of schooling. Social education has long been a highly contested area of the curriculum in Australia. In Queensland, social education comprises the integrated learning area of Studies of Society and Environment (SOSE). However, the new Australian Curriculum marks a return to discipline-based study of history and geography. This phenomenographic study addresses a perceived lack of understanding in the current research literature in Australia of the nature of middle school teachers’ professional knowledge for teaching the social sciences. Teachers are conceptualised in this study as curriculum makers in the classroom and, as such, their conceptions of essential knowledge are significant. Shulman’s (1986, 1987) theory of teachers’ knowledge forms the theoretical foundation of the study, which is contextualised in Federal and State education policies and the literature on the middle phase of schooling. Transcripts of interviews conducted with a group of thirty-one Queensland middle school teachers of SOSE were subjected to phenomenographic analysis, revealing seven qualitatively different categories of description. Essential aspects of knowledge for social education emerging from the study were: (1) discipline-based knowledge; (2) curriculum knowledge; (3) knowledge derived from teaching experience; (4) knowledge of middle years learners; (5) knowledge of integration; (6) knowledge of current affairs; and (7) knowledge invested in teacher identity. The three dimensions of variation that linked and differentiated the categories were: (1) content; (2) inquiry learning; and (3) teacher autonomy. These findings are presented as an outcome space where the categories are grouped as knowledge of the learning area, knowledge of contexts and knowledge of self as teacher. The results of the study suggest that social education teachers’ identity and knowledge of self are critical aspects of their knowledge as curriculum makers. The results illustrate that the professional and personal domains intersect, extending Shulman’s (1986, 1987) original theorisation of teachers’ knowledge into the personal arena. Further, middle years teachers’ conceptions of essential knowledge reveal a practice-based theorisation of knowledge for social education that fits the goals of middle schooling. The research concludes that attention to teacher identity in teacher education and in-service professional development has considerable potential to grow teachers’ knowledge in the social sciences and enhance their capacity for school-based curriculum leadership.

Tell me what you see : Pre-service teachers' recognition of exemplary digital pedagogy

How do you identify "good" teaching practice in the complexity of a real classroom? How do you know that beginning teachers can recognise effective digital pedagogy when they see it? How can teacher educators see through their students’ eyes? The study in this paper has arisen from our interest in what pre-service teachers “see” when observing effective classroom practice and how this might reveal their own technological, pedagogical and content knowledge. We asked 104 pre-service teachers from Early Years, Primary and Secondary cohorts to watch and comment upon selected exemplary videos of teachers using ICT (information and communication technologies) in Science. The pre-service teachers recorded their observations using a simple PMI (plus, minus, interesting) matrix which were then coded using the SOLO Taxonomy to look for evidence of their familiarity with and judgements of digital pedagogies. From this, we determined that the majority of preservice teachers we surveyed were using a descriptive rather than a reflective strategy, that is, not extending beyond what was demonstrated in the teaching exemplar or differentiating between action and purpose. We also determined that this method warrants wider trialling as a means of evaluating students’ understandings of the complexity of the digital classroom.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.