Kaleidoscope : Reframing learning and teaching evaluation through a shared stakeholder lens

Sector wide interest in Reframe: QUT’s Evaluation Framework continues with a number of institutions requesting finer details as QUT embeds the new approach to evaluation across the university in 2013. This interest, both nationally and internationally has warranted QUT’s collegial response to draw upon its experiences from developing Reframe into distilling and offering Kaleidoscope back to the sector. The word Reframe is a relevant reference for QUT’s specific re-evaluation, reframing and adoption of a new approach to evaluation; whereas Kaleidoscope reflects the unique lens through which any other institution will need to view their own cultural specificity and local context through an extensive user-led stakeholder engagement approach when introducing new approaches to learning and teaching evaluation. Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sector. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own evaluation projects and maximise impact. Kaleidoscope offers an institutional case study of widespread organisational change underpinned by Reframe’s (i) evidence-based methodology; (ii) research including published environmental scan, literature review (Alderman, et al., 2012), development of a conceptual model (Alderman, et al., in press 2013), project management principles (Alderman & Melanie, 2012) and national conference peer reviews; and (iii) year-long strategic project with national outreach to collaboratively engage the development of a draft set of National Guidelines. Kaleidoscope’s aims are to inform Higher Education evaluation policy development through national stakeholder engagement, the finalisation of proposed National Guidelines. In correlation with the conference paper, the authors will present a Draft Guidelines and Framework ready for external peer review by evaluation practitioners from the Higher Education sector, as part of Kaleidoscope’s dissemination strategy (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and ongoing discussions (Shapiro, et al., 1983; Jacobs, 2000). The initial National Guidelines will be distilled from the Reframe: QUT’s Evaluation Framework’s Policy, Protocols, and incorporated Business Rules. It is intended that the outcomes of Kaleidoscope are owned by and reflect sectoral engagement, including iterative evaluation through multiple avenues of dissemination and collaboration including the Higher Education sector. The dissemination strategy with the inclusion of Illuminative Evaluation methodology provides an inclusive opportunity for other institutions and stakeholders across the Higher Education sector to give voice through the information-gathering component of evaluating the draft Guidelines, providing a comprehensive understanding of the complex realities experienced across the Higher Education sector, and thereby ‘illuminating’ both the shared and unique lenses and contexts. This process will enable any final guidelines developed to have broader applicability, greater acceptance, enhanced sustainability and additional relevance benefiting the Higher Education sector, and the adoption and adaption by any single institution for their local contexts.

Kaleidoscope : illuminating learning and teaching evaluation for a shared stakeholder lens

Within the Australian higher education sector, institutions are required to evaluate teaching, units and courses to assure the quality of the student learning experience, however with hardly any regulatory parameters guiding institutions, and with disparate practices, there are few opportunities to benchmakr across institutions or the sector. QUT has received interest and requests from national and international universities on accessing Reframe: QUT's Evaluation Framework.

A snapshot of 40 years in early childhood education and care through oral histories

The year 2012 marked 40 years since the introduction of the Child Care Act 1972 and the federal government introduced financial support for the provision of child care services in Australia. Significant changes have occurred in social, political and theoretical contexts of early childhood education and care (ECEC) during this time. Bringing these to life, this paper investigates archival data of key changes in ECEC in association with oral histories of staff, parents and children associated with The Gowrie Qld during the years 1972‒2012. With narrative analysis considered alongside historical information, two dominant issues emerge as integral to ECEC in the past, now and the future. These are: 1) what constitutes effective teaching and learning in the educational program and 2) professional expectations in ECEC. Building an historical picture, this paper provides for critical reflection on the past to inform current and future practices.

Distance education and the application of academagogy : a case study

The education sector has dramatically changed in the past half decade. In a time of globalisation of education and tightening budgets, various paradigm shifts and challenges have rapidly changed learning and teaching. These include: meeting student expectation for more engaging, more interactive learning experiences, the increased focus to deliver content online, and the complexities of fast-changing technologies. Rising to these challenges and responding to them is a complex and multi-faceted task. This paper discusses educational theories and issues and explores current educational practices in the context of teaching undergraduate students via distance education in the university context. A case study applies a framework drawn from engineering education using the learner-centric concept of academagogy. Results showed that academagogy actively empowers students to build effective learning, and engages facilitators in meaningful teaching and delivery methods.

Research and/or learning and teaching : a study of Australian professors' priorities, beliefs and behaviours

This paper presents findings from an empirical study of key aspects of the teaching and research priorities, beliefs and behaviours of 72 professorial and associate professorial academics in Science, Information Technology and Engineering across four faculties in three Australian universities. The academics ranked 16 research activities and 16 matched learning and teaching (L&T) activities from three perspectives: job satisfaction, role model behaviour and perceptions of professional importance. The findings were unequivocally in favour of research in all three areas and remarkably consistent across the universities. The only L&T activity that was ranked consistently well was 'improving student satisfaction ratings for teaching', an area in which academics are increasingly held accountable. Respondents also indicated that their seniors encourage research efforts more than L&T efforts. Recommendations include that higher education rewards for quality L&T are maintained or improved and that recognition of L&T research domains is further strengthened.

Mandate for remote sensing education and the remote sensing core curriculum

Consensus was developed by the remote sensing community during the 1980s and early 1990s regarding the need for an organized approach to teaching remote sensing fundamentals for collegiate institutions. Growth of the remote sensing industry might be seriously hampered without concerted efforts to bolster the capacity to teach state-of-the-practice remote sensing theory and practice to the next generation of professionals. A concerted effort of educators, researchers, government, and industry began in 1992 to meet these demands leading to the creation of the Remote Sensing Core Curriculum. The RSCC is currently sustained by cooperative efforts of the ASPRS, ICRSE, NASA, NCGIA, and others in the remote sensing community. Growth of the RSCC into the K-12 community resulted from its Internet teaching foundation that enables comprehensive and response reference links to the whole of the education community.

Successful outcomes in vocational education and training courses and mathematics: how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate Vocational Education and Training (VET) and teaching, Indigenous learners’ needs, employer culture and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty - nine teachers/trainers/teacher aides and two hundred and thirty - one students consented to participate in the project. Nine VET courses offered in schools and Technical and Further Education Institutes (TAFE) were nominated to be the focus on the study. This paper focuses on student questionnaire responses and interview responses from teachers/trainers one high school principal and five students as a result of these processes, the findings indicated that VET course teachers work hard to adopt contextualising strategies to their teaching; however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned by trainers and teachers. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

Personal Epistemologies and Teaching

Over the last three decades, a growing body of research related to epistemic beliefs has been identified as a crucial for understanding teaching and learning (Yadav, Herron, & Samarapungavan, 2011). In particular, research related to beliefs about teaching, learning and knowledge has been considered important for understanding why teachers engage in certain approaches to pedagogy, curriculum and assessment in classrooms (Stromlo & Bråten, 2011). The beliefs held by teachers about knowledge and knowing, otherwise known as personal epistemology (Hofer, 2010), have been shown to influence other knowledge and beliefs (Schommer-Aikens, 2004). Five and Buehl (2012) indicated that because an individual’s understanding of reality is always seen through the lens of existing beliefs, the role of beliefs as a filter is particularly relevant in the context of teacher education. That is, if beliefs influence how individuals interpret new information and experiences, preservice and practicing teachers’ beliefs shape what and how they learn about teaching.” (p. 470-480). It is likely that such beliefs have an important relationship with teacher knowledge and practices...

Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

The WIL (Work Integrated Learning) Report : A national scoping study [Australian Learning and Teaching Council (ALTC) Final report]

This report provides an account of the first large-scale scoping study of work integrated learning (WIL) in contemporary Australian higher education. The explicit aim of the project was to identify issues and map a broad and growing picture of WIL across Australia and to identify ways of improving the student learning experience in relation to WIL. The project was undertaken in response to high levels of interest in WIL, which is seen by universities both as a valid pedagogy and as a means to respond to demands by employers for work-ready graduates, and demands by students for employable knowledge and skills. Over a period of eight months of rapid data collection, 35 universities and almost 600 participants contributed to the project. Participants consistently reported the positive benefits of WIL and provided evidence of commitment and innovative practice in relation to enhancing student learning experiences. Participants provided evidence of strong partnerships between stakeholders and highlighted the importance of these relationships in facilitating effective learning outcomes for students. They also identified a range of issues and challenges that face the sector in growing WIL opportunities; these issues and challenges will shape the quality of WIL experiences. While the majority of comments focused on issues involved in ensuring quality placements, it was recognised that placements are just one way to ensure the integration of work with learning. Also, the WIL experience is highly contextualised and impacted by the expectations of students, employers, the professions, the university and government policy.

Feeling the pressure: Early childhood educators’ reported views about learning and teaching phonics in Australian prior-to-school settings

Early childhood educators’ beliefs about literacy teaching can impact on the types of phonics experiences educators provide for children in prior-to-school settings. The Australian Early Years Learning Framework supports a play-based, intentional approach to teaching phonics, however little is known about what Australian early childhood educators believe is important in teaching phonics in the prior-to-school years. Using a qualitative content analysis, this research study investigates 115 early childhood educators’ views about how phonics should be taught and the use of commercially produced phonics programs (e.g. Jolly Phonics and Letterland) in prior-to-school settings. This study further investigates educators’ perceived pressures to include structured phonics lessons, as a way of addressing parental notions of ‘school readiness’. The results of this study indicate conflicting views were held about how phonics should be taught. Some educators also experienced external pressures to engage in literacy practices that may be in opposition with their own beliefs about how literacy is learnt. This study provides insights into the pedagogical practices early childhood educators believe are appropriate when teaching phonics. The educational implications are discussed.

Medical education and law: Withholding/withdrawing treatment from adults without capacity

BACKGROUND Law is increasingly involved in clinical practice, particularly at the end of life, but undergraduate and postgraduate education in this area remains unsystematic. We hypothesised that attitudes to and knowledge of the law governing withholding/withdrawing treatment from adults without capacity (the WWLST law) would vary and demonstrate deficiencies among medical specialists. AIMS We investigated perspectives, knowledge and training of medical specialists in the three largest (populations and medical workforces) Australian states, concerning the WWLST law. METHODS Following expert legal review, specialist focus groups, pre-testing and piloting in each state, seven specialties involved with end-of-life care were surveyed, with a variety of statistical analyses applied to the responses. RESULTS Respondents supported the need to know and follow the law. There were mixed views about its helpfulness in medical decision-making. Over half the respondents conceded poor knowledge of the law; this was mirrored by critical gaps in knowledge that varied by specialty. There were relatively low but increasing rates of education from the undergraduate to continuing professional development (CPD) stages. Mean knowledge score did not vary significantly according to undergraduate or immediate postgraduate training, but CPD training, particularly if recent, resulted in greater knowledge. Case-based workshops were the preferred CPD instruction method. CONCLUSIONS Teaching of current and evolving law should be strengthened across all stages of medical education. This should improve understanding of the role of law, ameliorate ambivalence towards the law, and contribute to more informed deliberation about end-of-life issues with patients and families.

Education and the relation to the outside: A little real reality

One of the aims of Deleuze. Guattari. Schizoanalysis. Education. is to focus on the radical reconfiguration that education is undergoing, impacting educator, administrator, institution and ‘sector’ alike. More to the point, it is the responses to that process of reconfiguration - this newly emerging assemblage - that are a key focal point in this issue. Essential to these responses, we propose, is Deleuze and Guattari’s method of schizonalysis, which offers a way to not only understand the rules of this new game, but also, hopefully, some escape from the promise of a brave new world of continuous education and motivation. A brave new world of digitised courses, impersonal and corporate expertise, updatable performance metrics, Massive Open Online Courses (MOOCs), learning analytics, transformative teaching and learning, online high-stakes testing in the name of transforming and augmenting human capital overlays the corporeal practices of institutional surveillance, examination and categorical sorting. A brave new world, importantly, where people’s continuous education is instituted less, or not simply, through disciplinary practices, and increasingly through a constant and continuous sampling and profiling of not simply performance but their activity, measured against the profiled activity of a ‘like’ age group, person, or an institution. This continuous education, including the sampling that accompanies it, we are all informed through various information and marketing campaigns, is in our best interest. An interest that is driven and governed by an ever-increasing corporatisation and monetisation of ‘the knowledge sector’, as well as an interest that is sustained through an ever-increasing, as well as continuous, debt.