Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Pedagogy and paradox : teaching interpretation in a religious community

A qualitative, discourse analytic study of literate practices in a small religious community in a northern Australian city. The chapter documents how this community constructs religious reading and writing, affiliated ideologies and theologies, and how readers/hearers/learners are positions vis a vis the authority of sacred text.

Shut up and write! Some surprising uses of cafes and crowds in doctoral writing

This chapter discusses a ‘writing movement’, which is currently occurring in various parts of Australia through the support of social media. A concept emerging from the café scene in San Francisco, ‘Shut Up and Write!’ is a meetup group that brings writers together at a specific time and place to write side by side, thus making writing practice, social. This concept has been applied to the academic environment and our case-study explores the positive outcomes in two locations: RMIT University and Queensland University of Technology. This informal learning practice can be implemented to assist research students in developing academic skills.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

The legacy of Ian Hunter's work on literature education and the history of reading practices : some preliminary remarks

Ian Hunter's early work on the history of literature education and the emergence of English as school subject issued a bold challenge to traditional accounts that have in the main focused on English either as knowledge of a particular field or as ideology. The alternative proposal put forward by Hunter and supported by detailed historical analysis is that English exists as a series of historically contingent techniques and practices for shaping the self-managing capacities of children. The challenge for the field is to advance this historical work and to examine possible implications for English teaching.

The first year experience of social work students : developing a “sense of fit” and engagement with the profession : a practice report

Engagement is believed to be critical to a successful first year experience. This paper examines a range of strategies introduced into a first year Social Work and Human Services unit at Queensland University of Technology. The focus of these strategies was to enhance student engagement through building connections with peers, lecturers and the Social Work and Human Services professions. It is argued in this paper that students are more likely to continue with their studies if they are supported in building an emerging identity as both a university student and as a Social Work or Human Services practitioner. A range of strategies was introduced, including restructuring the unit to include an early intensive teaching block; inviting current practitioners to speak with students about the realities of practice; and embedding an academic skills component into the unit. Feedback from students highlighted the success of these strategies in developing their academic skills, building connections and embedding a sense of fit with the profession.

Embedding graphic organisers in the teaching and learning of family and consumer sciences (home economics) in Kuwait

Educational reforms currently being enacted in Kuwaiti Family and Consumer Sciences (FCS) in response to contemporary demands for increased student-centred teaching and learning are challenging for FCS teachers due to their limited experience with student-centred learning tools such as Graphic Organisers (GOs). To adopt these reforms, Kuwaiti teachers require a better understanding of and competency in promoting cognitive learning processes that will maximise student-centred learning approaches. This study followed the experiences of four Grade 6 FCS Kuwaiti teachers as they undertook a Professional Development (PD) program specifically designed to advance their understanding of the use of GOs and then as they implemented what they had learned in their Grade 6 FCS classroom. The PD program developed for this study was informed by Nasseh.s competency PD model as well as Piaget and Ausubel.s cognitive theories. This model enabled an assessment and evaluation of the development of the teachers. competencies as an outcome of the PD program in terms of the adoption of GOs, in particular, and their capacity to use GOs to engage students in personalised, in-depth, learning through critical thinking and understanding. The research revealed that the PD program was influential in reforming the teachers. learning, understanding of and competency in, cognitive and visual theories of learning, so that they facilitated student-centred teaching and learning processes that enabled students to adopt and adapt GOs in constructivist learning. The implementation of five GOs - Flow Chart, Concept Maps, K-W-L Chart, Fishbone Diagram and Venn Diagram - as learning tools in classrooms was investigated to find if changes in pedagogical approach for supporting conceptual learning through cognitive information processing would reduce the cognitive work load of students and produce better learning approaches. The study as evidenced by the participant teachers. responses and classroom observations, showed a marked increase in student interest, participation, critical thought, problem solving skills, as a result of using GOs, compared to using traditional teaching and learning methods. A theoretical model was developed from the study based on the premise that teachers. knowledge of the subject, pedagogy and student learning precede the implementation of student-centred learning reform, that it plays an important role in the implementation of student-centred learning and that it brings about a change in teaching practice. The model affirmed that observed change in teaching-practice included aspects of teachers. beliefs, as well as confidence and effect on workplace and on student learning, including engagement, understanding, critical thinking and problem solving. The model assumed that change in teaching practice is inseparable from teachers. lifelong PD needs related to knowledge, understanding, skills and competency. These findings produced a set of preliminary guidelines for establishing student-centred constructivist strategies in Kuwaiti education while retaining Kuwait.s cultural uniqueness.

The practice of adaptation : turning fact and fiction into theatre

Adaptation of novels and other source texts into theatre has proven to be a recurring and popular form of writing through the ages. This study argues that as the theoretical discourse has moved on from outmoded notions of fidelity to original sources, the practice of adaptation is a method of re-invigorating theatre forms and inventing new ones. This practice-led research employed a tripartite methodology comprised of the writing of two play adaptations, participation by the author/researcher in their productions, and exegetical components focused on the development and deployment of analytical tools. These tools were derived from theoretical literature and a creative practice based on acquired professional artistry "learnt by doing" over a longstanding professional career as actor, director and writer. A suite of analytical tools was developed through the three phases of the first project, the adaptation of Nick Earls’ novel Perfect Skin. The tools draw on Cardwell’s "comparative analysis", which encompasses close consideration of generic context, authorial context and medium-specific context; and on Stam’s "mechanics of narrative": order, duration, frequency, the narrator and point of view. A third analytical lens was developed from an awareness of the significance of the commissioning brief and ethical considerations and obligations to the source text and its author and audience. The tripartite methodology provided an adaptation template that was applied to the writing and production of the second play Red Cap, which used factual and anecdotal sources. The second play’s exegesis (Chapter 10) analyses the effectiveness of the suite of analytical tools and the reception of the production in order to conclude the study with a workable model for use in the practice of adapting existing texts, both factual and fictional, for the theatre.

Nursing practice environment, quality of care and morale of hospital nurses in Japan

The purpose of this study was to describe Japanese hospital nurses’ perceptions of the nursing practice environment and examine its association with nurse-reported ability to provide quality nursing care, quality of patient care and ward morale. A cross-sectional survey design was used including 223 nurses working in 12 acute inpatient wards in a large Japanese teaching hospital. Nurses rated their work environment favorably overall using the Japanese version of the Practice Environment Scale of the Nursing Work Index. Subscale scores indicated high perceptions of physician relations and quality of nursing management, but lower scores for staffing and resources. Ward nurse managers generally rated the practice environment more positively than staff nurses except for staffing and resources. Regression analyses found the practice environment was a significant predictor of quality of patient care and ward morale, whereas perceived ability to provide quality nursing care was most strongly associated with years of clinical experience. These findings support interventions to improve the nursing practice environment, particularly staffing and resource adequacy, to enhance quality of care and ward morale in Japan.

Re-reading the reading lesson : episodes in the history of reading pedagogy

Reading pedagogy is constantly an object of discussion and debate in contemporary policy and practice but is rarely a matter for historical inquiry. This paper reports from a recent study of the history of reading pedagogy in Australia and beyond. It focuses on a recurring figure in the historical record—the ‘reading lesson’. Presented as a distinctive trope, the reading lesson is traced in its regularity in and through the discourse of reading pedagogy, starting in 1930s Australia and moving back into 19th-century Europe, and with specific reference to the UK and the USA. Teaching reading is expressly identified as a moral project—something that, it can be argued, clearly continues into the present.

Competition Hertz : the culture and practice of car audio competitions

The present paper explores extreme car audio systems and the culture and practices that surround car audio competitions. I begin by examining whether, and how, car audio can be thought of as a 'music scene' and in what ways the culture and practice of car audio may fit within post-subcultural discourses. Following this, I offer a description of car audio competitions, revealing some of the practices that define this aspect of car audio scenes. In particular, I concentrate on sound pressure level (SPL) competitions and some of the interesting aspects of the SPL scene. Finally, I briefly examine how the powerful effects (and affects) of bass frequencies are an important part of the attraction of loud car audio systems and how car audio systems contribute to the territorializing of urban spaces.

Entrepreneurship education in non-business schools : best practice for Australian contexts of knowledge and innovation communities (Final Report)

In the current era of global economic instability, business and industry have already identified a widening gap between graduate skills and employability. An important element of this is the lack of entrepreneurial skills in graduates. This Teaching Fellowship investigated two sides of a story about entrepreneurial skills and their teaching. Senior players in the innovation commercialisation industry, a high profile entrepreneurial sector, were surveyed to gauge their needs and experiences of graduates they employ. International contexts of entrepreneurship education were investigated to explore how their teaching programs impart the skills of entrepreneurship. Such knowledge is an essential for the design of education programs that can deliver the entrepreneurial skills deemed important by industry for future sustainability. Two programs of entrepreneurship education are being implemented at QUT that draw on the best practice exemplars investigated during this Fellowship. The QUT Innovation Space (QIS) focuses on capturing the innovation and creativity of students, staff and others. The QIS is a physical and virtual meeting and networking space; a connected community enhancing the engagement of participants. The Q_Hatchery is still embryonic; but it is intended to be an innovation community that brings together nascent entrepreneurial businesses to collaborate, train and support each other. There is a niche between concept product and business incubator where an experiential learning environment for otherwise isolated ‘garage-at-home’ businesses could improve success rates. The QIS and the Q_Hatchery serve as living research laboratories to trial the concepts emerging from the skills survey. The survey of skills requirements of the innovation commercialisation industry has produced a large and high quality data set still being explored. Work experience as an employability factor has already emerged as an industry requirement that provides employee maturity. Exploratory factor analysis of the skills topics surveyed has led to a process-based conceptual model for teaching and learning higher-order entrepreneurial skills. Two foundational skills domains (Knowledge, Awareness) are proposed as prerequisites which allow individuals with a suite of early stage entrepreneurial and behavioural skills (Pre-leadership) to further leverage their careers into a leadership role in industry with development of skills around higher order elements of entrepreneurship, management in new business ventures and progressing winning technologies to market. The next stage of the analysis is to test the proposed model through structured equation modelling. Another factor that emerged quickly from the survey analysis broadens the generic concept of team skills currently voiced in Australian policy documents discussing the employability agenda. While there was recognition of the role of sharing, creating and using knowledge in a team-based interdisciplinary context, the adoption and adaptation of behaviours and attitudes of other team members of different disciplinary backgrounds (interprofessionalism) featured as an issue. Most undergraduates are taught and undertake teamwork in silos and, thus, seldom experience a true real-world interdisciplinary environment. Enhancing the entrepreneurial capacity of Australian industry is essential for the economic health of the country and can only be achieved by addressing the lack of entrepreneurial skills in graduates from the higher education system. This Fellowship has attempted to address this deficiency by identifying the skills requirements and providing frameworks for their teaching.

Analysing children’s persuasive texts : the use of hedging and intensification

Research Quality This is a dialogue between two Australian literacy scholars about two persuasive writing techniques that posed difficulty for the students in our research. This dialogue flows from the analysis of Year 6 writing samples from an ARC Linkage Project, URLearning (2009-2013) - the focus of the symposium. We use vivid examples of writing from students’ handwritten persuasive texts on topics that were chosen by teachers. The persuasive structure in the texts followed the Toulmin (2003) model: a thesis statement, three arguments with evidence, and a conclusion. The findings show that to realise the effective power of rhetorical persuasion, students need an expanded lexicon that does not rely on intensifiers, and which employs a greater range of advanced hedging techniques to use to their advantage. National & International Importance The study is potentially of national and international relevance, given that argumentation or persuasion is a key life skill in many professional, personal, and discourses. It is also a requirement in the International English Language Testing Systems (IELTS) tests, which are a critical gateway for tertiary studies in many English-speaking countries (Coffin, 2004). Timeliness The research is timely given the Australian Curriculum English, in which persuasive texts figure prominently from Preparatory to Year 10 (ACARA, 2014). The recommendations are also timely in the context of educational policies in other parts of the world. For example, in the United States, the Common Core Standards: English Language Arts, mandates the teaching of persuasive texts (Council of Chief State School Officers & National Governors Association, 2013) Implications for practice/policy The findings of the study have specific practical implications for teachers, who can address the persuasive writing techniques of hedging and intensification with which children need targeted support and explicit instruction. The presentation is positioned at the nexus of teacher practice to better address the national priorities of the Australian Curriculum: English (ACARA, 2014), while having implications for applied linguistics research by identifying common problems in students' persuasive writing.

Negotiating indeterminacy in studio teaching: Using the zones of material and immaterial play to shape pedagogies and practices in art

The processes of studio-based teaching in visual art are often still tied to traditional models of discrete disciplines and largely immersed in skill-based learning. These approaches to training artists are also tied to an individual model of art practice that is clearly defined by the boundaries of those disciplines. This paper will explain how the open studio program at QUT can be broadly understood as an action research model of learning that ‘plays’ with the post-medium, post-studio genealogies and zones of contemporary art. This emphasises developing conceptual, contextual and formal skills as essential for engaging with and practicing in the often-indeterminate spatio-temporal sites of studio teaching. It will explore how this approach looks to Sutton-Smith’s observations on the role of play and Vygotsky’s zone of proximal development in early childhood learning as a way to develop strategies for promoting creative learning environments that are collaborative and self sustainable. Social, cultural, political and philosophical dialogues are examined as they relate to art practice with the aim of forming the shared interests, aims, and ambitions of graduating students into self initiated collectives or ARIs.