Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Reflection in Integrated Problem Based Learning : 20 years of continuing application to the teaching of architecture

In 1984 the School of Architecture and Built Environment within the University of Newcastle, Australia introduced an integrated program based on real design projects and using Integrated Problem Based Learning (IPBL) as the teaching method. Since 1984 there have been multiple changes arising from the expectations of the architectural fraternity, enrolling students, lecturers, available facilities, accreditation authorities and many others. These challenges have been successfully accommodated whilst maintaining the original purposes and principles of IPBL. The Architecture program has a combined two-degree structure consisting of a first degree, Bachelor of Science (Architecture), followed by a second degree, Bachelor of Architecture. The program is designed to simulate the problem-solving situations that face a working architect in every day practice. This paper will present the degree structure where each student is enrolled in a single course per semester incorporating design integration and study areas in design studies, professional studies, historical studies, technical studies, environmental studies and communication skills. Each year the design problems increase in complexity and duration set around an annual theme. With 20 years of successful delivery of any program there are highlights and challenges along the way and this paper will discuss some of the successes and barriers experienced within the School of Architecture and Built Environment in delivering IPBL. In addition, the reflective process investigates the currency of IPBL as an appropriate vehicle for delivering the curriculum in 2004 and any additional administrative or staff considerations required to enhance the continuing application of IPBL.

From rhetoric to practice : issues in teaching and learning touch keyboarding

Touch keyboarding as a vocational skill is disappearing at a time when students and educators across alleducational sectors are expected to use a computer keyboard on a regular basis. there is documentation surrounding the embedding of Information and Communication Technology (ICT) within the curricula and yet within the National Training Packages touch keyboarding, previously considered a core component, is now an elective in the Business Services framework. This situation is an odds with current practice overseas where touch keyboarding is a component of primary and secondary curricula. From Rhetoric to Practice explores the current issues and practice in teaching and learning touch keyboarding in primary, secondary and tertiary institutions. Through structured interview participants detailed current practice of teachers and their students. Further, tertiary students participated in a training program aimed at achquiring touch keyboarding as a skill to enhance their studies. The researcher's background experience of fifteen years teaching touch keyboarding and computer literacty to adults and 30 years in Business Services trade provides a strong basis for this project. The teaching experience is enhanced by industry experience in administration, course coordination in technical, community and tertiary institutions and a strong commitment to the efficient usage of a computer by all. The findings of this project identified coursework expectations requiring all students from kindergarten to tertiary to use a computer keyboard on a weekly basis and that neither teaching nor learning tough keyboarding appears in the primary, secondary and tertiary curricula in New South Wales. Further, teachers recognised tough keyboarding as the prefered style over 'hunt and peck' keyboarding while acknowledging the teaching and learning difficulties of time constraints, the need for qualified touch keyboarding teachers and issues arising when retraining students from existing poor habits. In conclusion, this project recommends that computer keyboarding be defined as a writing tool for education, vocation and life, with early instruction set in primary schooling area and embedding touch keyboarding with the secondary, technical and tertiary areas and finally to draw the attention of educational authorities to the Duty Of Care aspects associated with computer keyboarding in the classroom.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Exploiting SNOMED CT concepts and relationships for clinical information retrieval : Australian e-Health Research Centre and Queensland University of Technology at the TREC 2012 Medical Track

The Australian e-Health Research Centre and Queensland University of Technology recently participated in the TREC 2012 Medical Records Track. This paper reports on our methods, results and experience using an approach that exploits the concept and inter-concept relationships defined in the SNOMED CT medical ontology. Our concept-based approach is intended to overcome specific challenges in searching medical records, namely vocabulary mismatch and granularity mismatch. Queries and documents are transformed from their term-based originals into medical concepts as defined by the SNOMED CT ontology, this is done to tackle vocabulary mismatch. In addition, we make use of the SNOMED CT parent-child `is-a' relationships between concepts to weight documents that contained concept subsumed by the query concepts; this is done to tackle the problem of granularity mismatch. Finally, we experiment with other SNOMED CT relationships besides the is-a relationship to weight concepts related to query concepts. Results show our concept-based approach performed significantly above the median in all four performance metrics. Further improvements are achieved by the incorporation of weighting subsumed concepts, overall leading to improvement above the median of 28% infAP, 10% infNDCG, 12% R-prec and 7% Prec@10. The incorporation of other relations besides is-a demonstrated mixed results, more research is required to determined which SNOMED CT relationships are best employed when weighting related concepts.

I just want to design a sexy flying car! Teaching design-led innovation to designers

Many international management programs have capitalised on the value design can have upon potential business solutions and strategies (Martin, 2009 & Brown, 2008) as well as many international design programs introducing designers to business theory and curriculum (Manzini & Rizzo, 2011). This paper presents the findings from structured interviews with undergraduate design students and design industry professionals. Current literature surrounding design led innovation and the role designers’ play within it is also discussed and the challenges facing designers in this emerging design era are presented. The findings from this study indicate that most designers enter an undergraduate program not wanting to become the business leaders of tomorrow. Instead, they enter in the hope they can humbly help people and to make a difference in the world. There are contentions with this perspective, felt by industry, academia and students around why designers need to be taught business theory content. This paper provides the first step to overcoming this challenge by providing insight into the attitudes, perceptions and challenges designers are facing with this new design era.

Pedagogy and paradox : teaching interpretation in a religious community

A qualitative, discourse analytic study of literate practices in a small religious community in a northern Australian city. The chapter documents how this community constructs religious reading and writing, affiliated ideologies and theologies, and how readers/hearers/learners are positions vis a vis the authority of sacred text.

Australian literature : culture, identity and English teaching

The development of the Australian Curriculum has reignited a debate about the role of Australian literature in the contexts of curricula and classrooms. A review of the mechanisms for promoting Australian literature including literary prizes, databases, surveys and texts included for study in senior English classrooms in New South Wales and Victoria provides a background for considering the purpose of Australian texts and the role of literature teachers in shaping students’ engagement with literature.

Preservice teachers’ observations of their mentors’ teaching strategies for differentiated learning

Tensions exist between teacher-centred and learner-centred approaches with constructivism as being favoured for learning in the 21st Century. There is little evidence of teaching strategies being used in the field for differentiating student learning. In addition, preservice teachers need to learn about teaching strategies for which observations of their mentor teachers can provide practical applications. This study explores 16 preservice teachers’ observations of their mentors’ teaching strategies over a four-week professional experience. They provided a minimum of five written observations during this period. Findings indicated that these preservice teachers observed their mentors’ practices and recorded four key teaching strategies used to differentiate learning, namely: (1) designating facilitators for students’ learning, including teacher, peers, parents, and support staff such as teachers aides, (2) managing student groups, (3) contexts for learning, and (4) using a range of teaching aids (visual, auditory, games) and resources. Preservice teachers’ observations of their mentor teachers indicated that they can commence at early stages for identifying teaching strategies and how they work for differentiating student learning.

Negotiating : experiences of community nurses when contracting with clients

A community nurse is required to have excellent interpersonal, teaching, collaborative and clinical skills in order to develop effective individualised client care contracts. Using a descriptive qualitative design data was collected from two focus groups of fourteen community nurses to explore the issues surrounding negotiating and contracting client care contracts from the perspective of community nurses. Thematic analysis revealed three themes: ‘assessment of needs’, ‘education towards enablement’, and ‘negotiation’. ‘Assessment of needs’ identified that community nurses assess both the client’s requirements for health care as well as the ability of the nurse to provide that care. ‘Education towards enablement’ described that education of the client is a common strategy used by community nurses to establish realistic goals of health care as part of developing an ongoing care plan. The final theme, ‘negotiation’, involved an informed agreement between the client and the community nurse which forms the origin of the care contract that will direct the partnership between the client and the nurse. Of importance for community nurses is that development of successful person-centred care contracts requires skillful negotiation of care that strikes the balance between the needs of the client and the ability of the nurse to meet those needs.

What information-related activities do people with ESKD use?

Background Information practice is an emerging area of research that seeks to reveal how people learn to connect with the complex multimodal information landscapes that informs their ability to make decisions. Previous research has identified that people with end stage kidney disease (ESKD) tend to adopt a ‘received’ or ‘engaged’ view of information but little is known about the activities of information practice. Objectives This research project sought to identify the: i) information-related activities; and ii) how information is used. Methods Using a constructivist qualitative methodology, ten people with ESKD living in a large metropolitan city were purposively selected and interviewed. Data was subject to thematic analysis by researchers from nursing and information science. Saturation of themes was achieved. Results Participants were between 38 and 72 years, had been receiving kidney replacement therapy from 2 weeks to 31 years. Eight participants reported having access to the internet but none participated in chat rooms. The activities were conceptualized into themes as listening, seeking, searching, sharing and observing. These activities enabled people to create, reflect on and evaluate the information needed to inform their decision-making Conclusion/Application to Clinical Practice The information practice research approach will enable a better understanding of the underlying relationship between information, knowledge and experience to be better understood. For renal nurses who are involved in patient education being able to recognise the way people use information will assist in individualizing educational sessions and tailoring teaching strategies to make it more meaningful.

Productivity and time use during occupational therapy and nutrition/dietetics clinical education : a cohort study

Background: Currently in the Australian higher education sector higher productivity from allied health clinical education placements are a contested issue. This paper will report results of a study that investigated output changes associated with occupational therapy and nutrition/dietetics clinical education placements in Queensland, Australia. Supervisors’ and students’ time use during placements and how this changes for supervisors compared to when students are not present in the workplace is also presented. Methodology/Principal Findings: A cohort design was used with students from four Queensland universities, and their supervisors employed by Queensland Health. There was an increasing trend in the number of occasions of service delivered when the students were present, and a statistically significant increase in the daily mean length of occasions of service delivered during the placement compared to pre-placement levels. For project-based placements that were not directly involved in patient care, supervisors’ project activity time decreased during placements, with students undertaking considerably more time in project activities. Conclusions/Significance: A novel method for estimating productivity and time use changes during clinical education programs for allied health disciplines has been applied. During clinical education placements there was a net increase in outputs, suggesting supervisors engage in longer consultations with patients for the purpose of training students, while maintaining patient numbers. Other activities are reduced. This paper is the first time these data have been shown and form a good basis for future assessments of the economic impact of student placements for allied health disciplines.