Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Reflection in Integrated Problem Based Learning : 20 years of continuing application to the teaching of architecture

In 1984 the School of Architecture and Built Environment within the University of Newcastle, Australia introduced an integrated program based on real design projects and using Integrated Problem Based Learning (IPBL) as the teaching method. Since 1984 there have been multiple changes arising from the expectations of the architectural fraternity, enrolling students, lecturers, available facilities, accreditation authorities and many others. These challenges have been successfully accommodated whilst maintaining the original purposes and principles of IPBL. The Architecture program has a combined two-degree structure consisting of a first degree, Bachelor of Science (Architecture), followed by a second degree, Bachelor of Architecture. The program is designed to simulate the problem-solving situations that face a working architect in every day practice. This paper will present the degree structure where each student is enrolled in a single course per semester incorporating design integration and study areas in design studies, professional studies, historical studies, technical studies, environmental studies and communication skills. Each year the design problems increase in complexity and duration set around an annual theme. With 20 years of successful delivery of any program there are highlights and challenges along the way and this paper will discuss some of the successes and barriers experienced within the School of Architecture and Built Environment in delivering IPBL. In addition, the reflective process investigates the currency of IPBL as an appropriate vehicle for delivering the curriculum in 2004 and any additional administrative or staff considerations required to enhance the continuing application of IPBL.

From rhetoric to practice : issues in teaching and learning touch keyboarding

Touch keyboarding as a vocational skill is disappearing at a time when students and educators across alleducational sectors are expected to use a computer keyboard on a regular basis. there is documentation surrounding the embedding of Information and Communication Technology (ICT) within the curricula and yet within the National Training Packages touch keyboarding, previously considered a core component, is now an elective in the Business Services framework. This situation is an odds with current practice overseas where touch keyboarding is a component of primary and secondary curricula. From Rhetoric to Practice explores the current issues and practice in teaching and learning touch keyboarding in primary, secondary and tertiary institutions. Through structured interview participants detailed current practice of teachers and their students. Further, tertiary students participated in a training program aimed at achquiring touch keyboarding as a skill to enhance their studies. The researcher's background experience of fifteen years teaching touch keyboarding and computer literacty to adults and 30 years in Business Services trade provides a strong basis for this project. The teaching experience is enhanced by industry experience in administration, course coordination in technical, community and tertiary institutions and a strong commitment to the efficient usage of a computer by all. The findings of this project identified coursework expectations requiring all students from kindergarten to tertiary to use a computer keyboard on a weekly basis and that neither teaching nor learning tough keyboarding appears in the primary, secondary and tertiary curricula in New South Wales. Further, teachers recognised tough keyboarding as the prefered style over 'hunt and peck' keyboarding while acknowledging the teaching and learning difficulties of time constraints, the need for qualified touch keyboarding teachers and issues arising when retraining students from existing poor habits. In conclusion, this project recommends that computer keyboarding be defined as a writing tool for education, vocation and life, with early instruction set in primary schooling area and embedding touch keyboarding with the secondary, technical and tertiary areas and finally to draw the attention of educational authorities to the Duty Of Care aspects associated with computer keyboarding in the classroom.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

I just want to design a sexy flying car! Teaching design-led innovation to designers

Many international management programs have capitalised on the value design can have upon potential business solutions and strategies (Martin, 2009 & Brown, 2008) as well as many international design programs introducing designers to business theory and curriculum (Manzini & Rizzo, 2011). This paper presents the findings from structured interviews with undergraduate design students and design industry professionals. Current literature surrounding design led innovation and the role designers’ play within it is also discussed and the challenges facing designers in this emerging design era are presented. The findings from this study indicate that most designers enter an undergraduate program not wanting to become the business leaders of tomorrow. Instead, they enter in the hope they can humbly help people and to make a difference in the world. There are contentions with this perspective, felt by industry, academia and students around why designers need to be taught business theory content. This paper provides the first step to overcoming this challenge by providing insight into the attitudes, perceptions and challenges designers are facing with this new design era.

Pedagogy and paradox : teaching interpretation in a religious community

A qualitative, discourse analytic study of literate practices in a small religious community in a northern Australian city. The chapter documents how this community constructs religious reading and writing, affiliated ideologies and theologies, and how readers/hearers/learners are positions vis a vis the authority of sacred text.

Australian literature : culture, identity and English teaching

The development of the Australian Curriculum has reignited a debate about the role of Australian literature in the contexts of curricula and classrooms. A review of the mechanisms for promoting Australian literature including literary prizes, databases, surveys and texts included for study in senior English classrooms in New South Wales and Victoria provides a background for considering the purpose of Australian texts and the role of literature teachers in shaping students’ engagement with literature.

Preservice teachers’ observations of their mentors’ teaching strategies for differentiated learning

Tensions exist between teacher-centred and learner-centred approaches with constructivism as being favoured for learning in the 21st Century. There is little evidence of teaching strategies being used in the field for differentiating student learning. In addition, preservice teachers need to learn about teaching strategies for which observations of their mentor teachers can provide practical applications. This study explores 16 preservice teachers’ observations of their mentors’ teaching strategies over a four-week professional experience. They provided a minimum of five written observations during this period. Findings indicated that these preservice teachers observed their mentors’ practices and recorded four key teaching strategies used to differentiate learning, namely: (1) designating facilitators for students’ learning, including teacher, peers, parents, and support staff such as teachers aides, (2) managing student groups, (3) contexts for learning, and (4) using a range of teaching aids (visual, auditory, games) and resources. Preservice teachers’ observations of their mentor teachers indicated that they can commence at early stages for identifying teaching strategies and how they work for differentiating student learning.

"Are there any right or wrong answers in teaching philosophy": ethics, epistemology, and philosophy in the classroom

This article assesses undergraduate teaching students’ assertion that there are no right and wrong answers in teaching philosophy. When asked questions about their experiences of philosophy in the classroom for primary children, their unanimous declaration that teaching philosophy has ‘no right and wrong answers’ is critically examined across the three sub-disciplinary areas to which they were generally referring, namely, pedagogy, ethics, and epistemology. From a pedagogical point of view, it is argued that some teaching approaches may indeed be more effective than others, and some pupils’ opinions less defensible, but pedagogically, in terms of managing the power relations in the classroom, it is counter-productive to continually insist on notions of truth and falsity at every point. From an ethical point of view, it is contended that anti-realist approaches to meta-ethics may represent a viable intellectual position, but from the point of view of normative ethics, notions of right and wrong still retain significant currency. From an epistemological point of view, it is argued using Karl Poppers’ work that while it may be difficult to determine what constitutes a right answer, determining a wrong one is far more straightforward. In conclusion, it is clear that prospective teachers engaging in philosophy in the classroom, and also future teachers in general, require a far more nuanced philosophical understanding of the notions of right and wrong and truth and falsity. In view of this situation, it we wish to promote the effective teaching of philosophical thinking to children, or produce educators who can understand the conceptual limits of the claims they make and their very real and often serious practical and social consequences, it is recommended that philosophy be reinstated to a fundamental, foundational place within the pre-service teaching curriculum.

Development and testing of an iPad application for teaching self-management to heart failure patients. (Nursing/Allied Health Professional Investigator Award)- Abstract

Purpose: Heart failure (HF) is the leading cause of hospitalization and significant burden to the health care system in Australia. To reduce hospitalizations, multidisciplinary approaches and enhance self-management programs have been strongly advocated for HF patients globally. HF patients who can effectively manage their symptoms and adhere to complex medicine regimes will experience fewer hospitalizations. Research indicates that information technologies (IT) have a significant role in providing support to promote patients' self-management skills. The iPad utilizes user-friendly interfaces and to date an application for HF patient education has not been developed. This project aimed to develop the HF iPad teaching application in the way that would be engaging, interactive and simple to follow and usable for patients' carers and health care workers within both the hospital and community setting. Methods: The design for the development and evaluation of the application consisted of two action research cycles. Each cycle included 3 phases of testing and feedback from three groups comprising IT team, HF experts and patients. All patient education materials of the application were derived from national and international evidence based practice guidelines and patient self-care recommendations. Results: The iPad application has animated anatomy and physiology that simply and clearly teaches the concepts of the normal heart and the heart in failure. Patient Avatars throughout the application can be changed to reflect the sex and culture of the patient. There is voice-over presenting a script developed by the heart failure expert panel. Additional engagement processes included points of interaction throughout the application with touch screen responses and the ability of the patient to enter their weight and this data is secured and transferred to the clinic nurse and/or research data set. The application has been used independently, for instance, at home or using headphones in a clinic waiting room or most commonly to aid a nurse-led HF consultation. Conclusion: This project utilized iPad as an educational tool to standardize HF education from nurses who are not always heart failure specialists. Furthermore, study is currently ongoing to evaluate of the effectiveness of this tool on patient outcomes and to develop several specifically designed cultural adaptations [Hispanic (USA), Aboriginal (Australia), and Maori (New Zealand)].

Enhancing opportunities to feed forward ; developing problem solving skills using web based scenarios

Universities often struggle to satisfy students’ need for feedback. This is an area where student satisfaction with courses of study can be low. Yet it is clear that one of the properties of good teaching is giving the highest quality feedback on student work. The term ‘feedback’ though is most commonly associated with summative assessment given by a teacher after work is completed. The student can often be a passive participant in the process. This paper looks at the implementation of a web based interactive scenario completed by students prior to summative assessment. It requires students to participate actively to develop and improve their legal problem solving skills. Traditional delivery of legal education focuses on print and an instructor who conveys the meaning of the written word to students. Today, mixed modes of teaching are often preferred and they can provide enhanced opportunities for feeding forward with greater emphasis on what students do. Web based activities allow for flexible delivery; they are accessible off campus, at a time that suits the student and may be completed by students at their own pace. This paper reports on an online interactive activity which provides valuable formative feedback necessary to allow for successful completion of a final problem solving assignment. It focuses on how the online activity feeds forward and contributes to the development of legal problem solving skills. Introduction to Law is a unit designed and introduced for completion by undergraduate students from faculties other than law but is focused most particularly on students enrolled in the Bachelor of Entertainment Industries degree, a joint initiative of the faculties of Creative Industries, Business and Law at the Queensland University of Technology in Australia. The final (and major) assessment for the unit is an assignment requiring students to explain the legal consequences of particular scenarios. A number of cost effective web based interactive scenarios have been developed to support the unit’s classroom activities. The tool commences with instruction on problem solving method. Students then view the stimulus which is a narrative produced in the form of a music video clip. A series of questions are posed which guide students through the process and they can compare their responses with sample answers provided. The activity clarifies the problem solving method and expectations for the summative assessment and allows students to practise the skill. The paper reports on the approach to teaching and learning taken in the unit including the design process and implementation of the activity. It includes an evaluation of the activity with respect to its effectiveness as a tool to feed forward and reflects on the implications for the teaching of law in higher education.

First year industrial design studio-based teaching pedagogies and students’ engagement

Student engagement tends to be viewed as a reflection of learning processes, and in the context of first year university studies, it is a crucial means of an educational process that establishes the foundations for successful later year studies (Krausse and Coates, 2008). In the context of first year design studio teaching in higher education, fostering students’ positive engagement poses challenges to design educators as current trends set these design studios to be large size classes that makes difficult to manage and follow up students’ individual learning experiences. At QUT’s first year industrial design studio classes we engage in a variety of teaching pedagogies from which we identify two of them as instrumental vehicles to foster positive student engagement. Concept bombs and the field trip experience provide such platform as shown in student responses through a learning experience survey.