Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Reflection in Integrated Problem Based Learning : 20 years of continuing application to the teaching of architecture

In 1984 the School of Architecture and Built Environment within the University of Newcastle, Australia introduced an integrated program based on real design projects and using Integrated Problem Based Learning (IPBL) as the teaching method. Since 1984 there have been multiple changes arising from the expectations of the architectural fraternity, enrolling students, lecturers, available facilities, accreditation authorities and many others. These challenges have been successfully accommodated whilst maintaining the original purposes and principles of IPBL. The Architecture program has a combined two-degree structure consisting of a first degree, Bachelor of Science (Architecture), followed by a second degree, Bachelor of Architecture. The program is designed to simulate the problem-solving situations that face a working architect in every day practice. This paper will present the degree structure where each student is enrolled in a single course per semester incorporating design integration and study areas in design studies, professional studies, historical studies, technical studies, environmental studies and communication skills. Each year the design problems increase in complexity and duration set around an annual theme. With 20 years of successful delivery of any program there are highlights and challenges along the way and this paper will discuss some of the successes and barriers experienced within the School of Architecture and Built Environment in delivering IPBL. In addition, the reflective process investigates the currency of IPBL as an appropriate vehicle for delivering the curriculum in 2004 and any additional administrative or staff considerations required to enhance the continuing application of IPBL.

From rhetoric to practice : issues in teaching and learning touch keyboarding

Touch keyboarding as a vocational skill is disappearing at a time when students and educators across alleducational sectors are expected to use a computer keyboard on a regular basis. there is documentation surrounding the embedding of Information and Communication Technology (ICT) within the curricula and yet within the National Training Packages touch keyboarding, previously considered a core component, is now an elective in the Business Services framework. This situation is an odds with current practice overseas where touch keyboarding is a component of primary and secondary curricula. From Rhetoric to Practice explores the current issues and practice in teaching and learning touch keyboarding in primary, secondary and tertiary institutions. Through structured interview participants detailed current practice of teachers and their students. Further, tertiary students participated in a training program aimed at achquiring touch keyboarding as a skill to enhance their studies. The researcher's background experience of fifteen years teaching touch keyboarding and computer literacty to adults and 30 years in Business Services trade provides a strong basis for this project. The teaching experience is enhanced by industry experience in administration, course coordination in technical, community and tertiary institutions and a strong commitment to the efficient usage of a computer by all. The findings of this project identified coursework expectations requiring all students from kindergarten to tertiary to use a computer keyboard on a weekly basis and that neither teaching nor learning tough keyboarding appears in the primary, secondary and tertiary curricula in New South Wales. Further, teachers recognised tough keyboarding as the prefered style over 'hunt and peck' keyboarding while acknowledging the teaching and learning difficulties of time constraints, the need for qualified touch keyboarding teachers and issues arising when retraining students from existing poor habits. In conclusion, this project recommends that computer keyboarding be defined as a writing tool for education, vocation and life, with early instruction set in primary schooling area and embedding touch keyboarding with the secondary, technical and tertiary areas and finally to draw the attention of educational authorities to the Duty Of Care aspects associated with computer keyboarding in the classroom.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Coming to belong : a narrative analysis of international students’ experiences in an Australian university

This thesis reports on an interview study with 17 international students about their experiences of coming to belong in an Australian university. All used English as an additional language (EAL). The students’ narratives of ‘coming to belong’ are conceptualised through the theory of Bourdieu, in particular the concepts of field, capital, habitus and legitimation; and the methodological premises of critical realism’s layered ontology. The literature review argues that access to and accrual of a range of capital is critical to successful adaptation to a new educational system. This, and processes of legitimation by others in the fields, affects the senses of belonging for students of various linguistic backgrounds, of different countries of origin, studying from primary to higher education in diverse parts of the world. Data were collected by semi-structured interviews and email dialogues at three points during the students’ first year of study in Australia. The analysis shows how the students’ empirical experiences were ordered in terms of narrative structure—orientation, complication, evaluation, resolution and coda—and highlight the emotions generated by the sequence of events. The findings show that EAL international students sought new field positions through legitimation in multiple senses across (sub-)fields. They also show that academic, social and linguistic legitimacy granted by others produced a spectrum of belonging: in the centre, at the margin, and/or to meaningful intercultural encounters. This study makes a contribution to the growing literature around the experience of international students in higher education, and to empirical literature using Bourdieu to understand educational relations.

A qualitative investigation into the different health experiences of people living with type II diabetes, in the rural environments

Study Rationale The objective of the study was to explore if and how rural culture influences type II diabetes management and to better understand the social processes that rural people construct in coping with diabetes and its complications. In particular, the study aimed to analyse the interface and interactions between rural people with type II diabetes and the Australian health care system. Theoretical framework and methods The research applied constructivist grounded theory methods within an interpretive interactionist framework. Data from 39 semi-structured interviews with rural and urban people with type II diabetes plus a mix of rural health care providers were analysed to develop a theoretical understanding of the social processes that define diabetes management in that context. Results The analysis suggests that although type II diabetes imposes limitations that require adjustment and adaptation these processes are actively negotiated by rural people within the environmental context to fit the salient social understandings of autonomy and self-reliance. Thus people normalised self-reliant diabetes management behaviours because this was congruent with the rural culture. Factors that informed the actions of normalisation were the relationships between participants and health care professions, support and access to individual resources. Conclusions The findings point to ways in which rural self-reliance is conceived as the primary strategy of diabetic management. People face the paradox of engaging with a health care system that at the same time maximises individual responsibility for health and minimises the social support by which individuals manage the condition. The emphasis on self-reliance gives some legitimacy to a lack of prevention and chronic care services. Success of diabetic management behaviours is contingent on relative resources. Where there is good primary care there develop a number of downstream effects including a sense of empowerment to manage difficult rural environmental circumstances. This has particular bearing on health outcomes for people with fewer resources.

Factors affecting the motivation of TEFL academics in higher education in China

This study investigates the motivation of English language lecturers in a Chinese university. Recent studies have shown that low morale and job dissatisfaction are significant problems identified in lecturers who teach English in universities in China. Given the importance of teaching English as a second language in China, this problem has potentially significant ramifications for the nation’s future. Low staff morale is likely to be associated with less effective teaching and poor student learning outcomes. Although the problem is acknowledged, there has been limited research to understand the underlying contributing factors. To address this, a sequential explanatory mixed methods approach was adopted and implemented in two phases at a large regional university in Northern China. The participants in the main study were 100 lecturers from two colleges at this university. All of the lecturers were responsible for teaching English as a foreign language (TEFL); 50 were teaching English majors and 50 were teaching university students whose majors were not English. The research was informed by a synthesis of self determination theory and theories of organisational culture. The study found: 1) in contrast to previously reported studies, lecturers in this institution were in general autonomously motivated in teaching. 2) However, their level of motivation was influenced by their personal experiences and varied sense of competence, relatedness and autonomy. 3) In particular, personal experiences and contextual factors such as the influence of Chinese culture, societal context, and organisational climate were significant in regulating lecturers’ motivation to teach. The findings are significant for leaders in higher education who need to implement policies that foster effective work environments. The study has also provided insights into the capacity of self determination theory to explain motivation in a Chinese culture.

The experiences of novices in an enhanced graduated driver licensing program in Queensland, Australia

- Young novice drivers - The Queensland graduated driver licensing (GDL) context - Pre-July 2007 (‘Original-GDL’) - Post-July 2007 (‘Enhanced-GDL’) - Experiences of Learners in Queensland’s enhanced-GDL program - Pre-/post-July 2007 comparison - Post-July 2007 only - Implications - Strengths and limitations

I just want to design a sexy flying car! Teaching design-led innovation to designers

Many international management programs have capitalised on the value design can have upon potential business solutions and strategies (Martin, 2009 & Brown, 2008) as well as many international design programs introducing designers to business theory and curriculum (Manzini & Rizzo, 2011). This paper presents the findings from structured interviews with undergraduate design students and design industry professionals. Current literature surrounding design led innovation and the role designers’ play within it is also discussed and the challenges facing designers in this emerging design era are presented. The findings from this study indicate that most designers enter an undergraduate program not wanting to become the business leaders of tomorrow. Instead, they enter in the hope they can humbly help people and to make a difference in the world. There are contentions with this perspective, felt by industry, academia and students around why designers need to be taught business theory content. This paper provides the first step to overcoming this challenge by providing insight into the attitudes, perceptions and challenges designers are facing with this new design era.

Using the index for inclusion to develop inclusive school communities

This chapter provides an overview of how school communities can work together in processes or review and development to strive towards a more inclusive approach to education. The writers of this chapter have been using a resource called the Index for Inclusion (Booth & Ainscow, 2005, 2011) for a number of years in Australia and in a pilot trail in New Zealand to support education staff in processes of review, with the aim to increase the participation and learning of all students. The resource supports the development of collaborative community processes and defines inclusion as ‘putting values into action’ (Booth & Ainscow, 2011, p.18). The process of review and development for more inclusive and socially just schools supports the development of a school culture, policy and practice where people are valued and treated with respect for their varied knowledge and experiences. In our experience, this resource has been useful to challenge our thinking about education in school communities and in region/districts about inclusive school development. We suggest the Index framework is broad enough to be used in a range of settings and countries. The resource is also useful for pre-service and in-service teacher development to provoke reflection and discussion about inclusion. This chapter provides an overview of the dimensions and framework that inform the Index of Inclusion. We discuss how the Index can be used in school contexts and draw on our own experience to give real examples of how teachers, paraprofessionals, students, principals and parents have experienced the Index when used in their local school communities in Australia and New Zealand. The chapter concludes with some points for discussion to challenge the status quo in schools and to inspire teachers to work towards a more socially just society through making changes at a school level.

Pedagogy and paradox : teaching interpretation in a religious community

A qualitative, discourse analytic study of literate practices in a small religious community in a northern Australian city. The chapter documents how this community constructs religious reading and writing, affiliated ideologies and theologies, and how readers/hearers/learners are positions vis a vis the authority of sacred text.

Australian literature : culture, identity and English teaching

The development of the Australian Curriculum has reignited a debate about the role of Australian literature in the contexts of curricula and classrooms. A review of the mechanisms for promoting Australian literature including literary prizes, databases, surveys and texts included for study in senior English classrooms in New South Wales and Victoria provides a background for considering the purpose of Australian texts and the role of literature teachers in shaping students’ engagement with literature.

Identities and transformational experiences for quantitative problem solving : gender comparisons of first-year university science students

Women are underrepresented in science, technology, engineering and mathematics (STEM) areas in university settings; however this may be the result of attitude rather than aptitude. There is widespread agreement that quantitative problem-solving is essential for graduate competence and preparedness in science and other STEM subjects. The research question addresses the identities and transformative experiences (experiential, perception, & motivation) of both male and female university science students in quantitative problem solving. This study used surveys to investigate first-year university students’ (231 females and 198 males) perceptions of their quantitative problem solving. Stata (statistical analysis package version 11) analysed gender differences in quantitative problem solving using descriptive and inferential statistics. Males perceived themselves with a higher mathematics identity than females. Results showed that there was statistical significance (p<0.05) between the genders on 21 of the 30 survey items associated with transformative experiences. Males appeared to have a willingness to be involved in quantitative problem solving outside their science coursework requirements. Positive attitudes towards STEM-type subjects may need to be nurtured in females before arriving in the university setting (e.g., high school or earlier). Females also need equitable STEM education opportunities such as conversations or activities outside school with family and friends to develop more positive attitudes in these fields.

Preservice teachers’ observations of their mentors’ teaching strategies for differentiated learning

Tensions exist between teacher-centred and learner-centred approaches with constructivism as being favoured for learning in the 21st Century. There is little evidence of teaching strategies being used in the field for differentiating student learning. In addition, preservice teachers need to learn about teaching strategies for which observations of their mentor teachers can provide practical applications. This study explores 16 preservice teachers’ observations of their mentors’ teaching strategies over a four-week professional experience. They provided a minimum of five written observations during this period. Findings indicated that these preservice teachers observed their mentors’ practices and recorded four key teaching strategies used to differentiate learning, namely: (1) designating facilitators for students’ learning, including teacher, peers, parents, and support staff such as teachers aides, (2) managing student groups, (3) contexts for learning, and (4) using a range of teaching aids (visual, auditory, games) and resources. Preservice teachers’ observations of their mentor teachers indicated that they can commence at early stages for identifying teaching strategies and how they work for differentiating student learning.