Kaleidoscope : Reframing learning and teaching evaluation through a shared stakeholder lens

Sector wide interest in Reframe: QUT’s Evaluation Framework continues with a number of institutions requesting finer details as QUT embeds the new approach to evaluation across the university in 2013. This interest, both nationally and internationally has warranted QUT’s collegial response to draw upon its experiences from developing Reframe into distilling and offering Kaleidoscope back to the sector. The word Reframe is a relevant reference for QUT’s specific re-evaluation, reframing and adoption of a new approach to evaluation; whereas Kaleidoscope reflects the unique lens through which any other institution will need to view their own cultural specificity and local context through an extensive user-led stakeholder engagement approach when introducing new approaches to learning and teaching evaluation. Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sector. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own evaluation projects and maximise impact. Kaleidoscope offers an institutional case study of widespread organisational change underpinned by Reframe’s (i) evidence-based methodology; (ii) research including published environmental scan, literature review (Alderman, et al., 2012), development of a conceptual model (Alderman, et al., in press 2013), project management principles (Alderman & Melanie, 2012) and national conference peer reviews; and (iii) year-long strategic project with national outreach to collaboratively engage the development of a draft set of National Guidelines. Kaleidoscope’s aims are to inform Higher Education evaluation policy development through national stakeholder engagement, the finalisation of proposed National Guidelines. In correlation with the conference paper, the authors will present a Draft Guidelines and Framework ready for external peer review by evaluation practitioners from the Higher Education sector, as part of Kaleidoscope’s dissemination strategy (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and ongoing discussions (Shapiro, et al., 1983; Jacobs, 2000). The initial National Guidelines will be distilled from the Reframe: QUT’s Evaluation Framework’s Policy, Protocols, and incorporated Business Rules. It is intended that the outcomes of Kaleidoscope are owned by and reflect sectoral engagement, including iterative evaluation through multiple avenues of dissemination and collaboration including the Higher Education sector. The dissemination strategy with the inclusion of Illuminative Evaluation methodology provides an inclusive opportunity for other institutions and stakeholders across the Higher Education sector to give voice through the information-gathering component of evaluating the draft Guidelines, providing a comprehensive understanding of the complex realities experienced across the Higher Education sector, and thereby ‘illuminating’ both the shared and unique lenses and contexts. This process will enable any final guidelines developed to have broader applicability, greater acceptance, enhanced sustainability and additional relevance benefiting the Higher Education sector, and the adoption and adaption by any single institution for their local contexts.

Kaleidoscope : shaping a better future through a stakeholder approach to widespread organisational change

The main focus of ‘Kaleidoscope: Reframing evaluation through a stakeholder approach to sustainable, cultural change in Higher Education’ is to develop a set of principles to guide user-led engagement in widespread organisational change and maximise its impact. The word kaleidoscope represents the unique lens through which each institution will need to view their cultural specificity and local context through an extensive process of collaboration and engagement, followed by communication and dissemination. Kaleidoscope has particular relevance when new approaches to learning and teaching evaluation are introduced by tertiary institutions. Building on the Reframe Project, which involved three years of user-led consultation and was designed to meet stakeholders’ needs, QUT successfully introduced a new evaluation framework in 2013 across the university. Reframe was evidence based, involved scholarly reflection and was founded on a strong theoretical framework. The evolution of the evaluation framework included analysis of scholarly literature and environmental scans across the higher education sector (Alderman, et al., 2012), researched development of conceptual theory (Alderman, et al., in press 2013), incorporated the stakeholder voice and framed within project management principles (Alderman & Melanie, 2012). Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sectors. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own projects and maximise the impact. In correlation with a our conference paper, this round table presents the Draft Guidelines and Framework ready for external peer review by evaluation practitioners, as part of Kaleidoscope’s dissemination (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and linked round table discussions (Shapiro, et al., 1983; Jacobs, 2000).

Kaleidoscope : illuminating learning and teaching evaluation for a shared stakeholder lens

Within the Australian higher education sector, institutions are required to evaluate teaching, units and courses to assure the quality of the student learning experience, however with hardly any regulatory parameters guiding institutions, and with disparate practices, there are few opportunities to benchmakr across institutions or the sector. QUT has received interest and requests from national and international universities on accessing Reframe: QUT's Evaluation Framework.

Exploring the experiences of embedding Indigenous knowledge and perspectives on teaching practicum through interpretive phenomenology

In this paper, we discuss interpretive/hermeneutic phenomenology as a theoretical approach to explore the experiences of three stakeholder groups in embedding Indigenous knowledge and perspectives on teaching practicum, a project sponsored by ALTC. We begin by asking the phenomenological question ‘what is your experience of practice teaching?’ An open, explorative, phenomenological framework seeks the meanings of experiences, not truths, from the participants’ words themselves. Interpretive phenomenology is particularly suitable to explore educational experiences (Grumet, 1992; M. van Manen, 1990), as it provides rich ground for listening to the stakeholders’ lived experience and documenting it for interpretation. In an interpretive process, perspectives on lifeworlds, worldview and lenses get highlighted (Cunningham & Stanley, 2003). We establish how through various project stages, interpretive phenomenology gets to the essence of practice teaching experience creating a pedagogical ‘understanding’ of the essential nature of shared experience as lived by the participants (M van Manen, 2002). Thereby, it foregrounds voices of agency, dissent, acceptance and resistance. We consider how our research study focuses on the pedagogic voice of Indigenous pre-service teachers and the recognition of complex pedagogic fields in Indigenous education. We explain how this study seeks insights into their evaluation of pedagogic relations with two other education stakeholders – their practicum supervising teachers at schools and university staff involved practicum experience. As such, our study aims to support and develop long term, future-oriented opportunities for Indigenous pre-service teachers to embed Indigenous knowledge in the curricula. We conclude with some projections into the discourse on how Indigenous knowledge (IK) and perspectives might be diversely exemplified in pre-service teachers’ professional works (particularly E-portfolios). We speculate how this change could in turn maximise opportunities for Indigenous pre-service teachers, their supervising teachers and university staff to demonstrate leadership in their field through the creation of future tangible products such as units of work, resources, assessment and reflection tools. The processes contextualising the cultural interface of competing knowledge systems (Nakata, 2007) provide important analytical tools for understanding issues affecting student-teacher-mentor relationships occurring on practicum.

The emergence of giving circles and their relationships with nonprofit organisations : a case study

This thesis explores the relationships that exist between a giving circle and the nonprofit organisations it supports. The case study focusses on a formal giving circle operating in Austin, Texas, United States and includes embedded case studies of nonprofit organisations that had received funding from the giving circle. Findings provide insights to nonprofit experiences with the giving circle phenomenon stimulating further conversation for fundraising practitioners in how they engage with not only giving circles but donors who may wish to be engaged at a different level, compared to the more traditional means adopted by nonprofit organisations.

Responses, relationships and responsibility : examining influences on organisational assets during crisis

This thesis explains how an organisation's relationships with its key stakeholders influence the public's view of its responsibility for a crisis event and how this subsequently influences the protective and reparative powers of its crisis response on its reputation and legitimacy. From the results, a continuum of the influencing effect of relationship history was developed which demonstrates the positive and negative frames through which stakeholders view an organisation in crisis and its response. Organisational age and the evaluative character of its relationships with key stakeholders were considered in the experimental design as descriptors of an organisation's relationship history. The findings provide guidance to crisis managers on effective crisis response selection.

Pleasures, perversities, and partnerships : the historical emergence of LGBT-police relationships

Relationships between LGBT people and police have been turbulent for some time now, and have been variously characterized as supportive (McGhee, 2004) and antagonistic (Radford, Betts, & Ostermeyer, 2006). These relationships were, and continue to be, influenced by a range of political, legal, cultural, and social factors. This chapter will examine historical and social science accounts of LGBT-police histories to chart the historical peaks and troughs in these relationships. The discussion demonstrates how, in Western contexts, we oscillate between historical moments of police criminalizing homosexual perversity and contemporary landscapes of partnership between police and LGBT people. However, the chapter challenges the notion that it is possible to trace this as a lineal progression from a painful past to a more productive present. Rather, it focuses on specific moments, marked by pain or pleasure or both, and how these moments emerge and re-emerge in ways that shaped LGBT-police landscapes in potted, uneven ways. The chapter concludes noting how, although certain ideas and police practices may shift towards more progressive notions of partnership policing, we cannot just take away the history that emerged out of mistrust and pain.

Nucleotide sequences of an Australian and a Canadian isolate of potato leafroll luteovirus and their relationships with two European isolates

The genomes of an Australian and a Canadian isolate of potato leafroll virus have been cloned and sequenced. The sequences of both isolates are similar (about 93%), but the Canadian isolate (PLRV-C) is more closely related (about 98% identity) to a Scottish (PLRV-S) and a Dutch isolate (PLRV-N) than to the Australian isolate (PLRV-A). The 5'-terminal 18 nucleotide residues of PLRV-C, PLRV-A, PLRV-N and beet western yellows virus have 17 residues in common. In contrast, PLRV-S shows no obvious similarity in this region. PLRV-A and PLRV-C genomic sequences have localized regions of marked diversity, in particular a 600 nucleotide residue sequence in the polymerase gene. These data provide a world-wide perspective on the molecular biology of PLRV strains and their comparison with other luteoviruses and related RNA plant viruses suggests that there are two major subgroups in the plant luteoviruses.

Strategies and solutions for housing sustainability : building information files and performance certificates

The overall aim of this research project was to provide a broader range of value propositions (beyond upfront traditional construction costs) that could transform both the demand side and supply side of the housing industry. The project involved gathering information about how building information is created, used and communicated and classifying building information, leading to the formation of an Information Flow Chart and Stakeholder Relationship Map. These were then tested via broad housing industry focus groups and surveys. The project revealed four key relationships that appear to operate in isolation to the whole housing sector and may have significant impact on the sustainability outcomes and life cycle costs of dwellings over their life cycle. It also found that although a lot of information about individual dwellings does already exist, this information is not coordinated or inventoried in any systematic manner and that national building information files of building passports would present value to a wide range of stakeholders.

Investigating relationships between relationship quality, customer loyalty and cooperation : an empirical study of convenience stores' franchise chain systems

Franchising has become a way to minimise the risks of small business management. There has been little research into the factors that promote franchise relationship success. This study attempts to empirically examine the important elements (relationship quality, customer loyalty and cooperation), which might promote a successful long-term franchising relationship between franchisors and franchisees within the context of convenience stores in Taiwan. A model of these relationships was developed and tested. A total of 500 surveys were mailed to a random sample of convenience stores’ franchisee owners among the four main franchisors in Taiwan. The results show that relationship quality positively influences the cooperation between franchisors and franchisees and is positively correlated with franchisee loyalty. Additionally, the cooperative behaviour between franchisees and franchisors is significantly associated with franchisees’ loyalty.

Mathematical relationships for metal build-up on urban road surfaces based on traffic and land use characteristics

The study investigated the influence of traffic and land use parameters on metal build-up on urban road surfaces. Mathematical relationships were developed to predict metals originating from fuel combustion and vehicle wear. The analysis undertaken found that nickel and chromium originate from exhaust emissions, lead, copper and zinc from vehicle wear, cadmium from both exhaust and wear and manganese from geogenic sources. Land use does not demonstrate a clear pattern in relation to the metal build-up process, though its inherent characteristics such as traffic activities exert influence. The equation derived for fuel related metal load has high cross-validated coefficient of determination (Q2) and low Standard Error of Cross-Validation (SECV) values indicates that the model is reliable, while the equation derived for wear-related metal load has low Q2 and high SECV values suggesting its use only in preliminary investigations. Relative Prediction Error values for both equations are considered to be well within the error limits for a complex system such as an urban road surface. These equations will be beneficial for developing reliable stormwater treatment strategies in urban areas which specifically focus on mitigation of metal pollution.

Gender differences in Australian students' relationships with school science

This paper explores issues of gender in Year 10 Australian students‘ experiences of science at school, their self-reported ability in science and their perceptions of science as a subject choice for senior secondary school. A sample of 3759 Year 10 students from across Australia responded to Likert-style questions related to these issues, with findings showing gender differences in perceptions of science, self-rated ability, and reasons for choosing not to study further science. Moreover, interesting contrasts were revealed in patterns of difference of self-rated ability for boys and girls across single-sex and co-educational schools.

Working together-apart : exploring the relationships between formal and informal care networks for people dying at home

Introduction Informal caring networks contribute significantly to end-of-life (EOL) care in the community. However, to ensure that these networks are sustainable, and unpaid carers are not exploited, primary carers need permission and practical assistance to gather networks together and negotiate the help they need. Our aim in this study was to develop an understanding of how formal and informal carers work together when care is being provided in a dying person's home. We were particularly interested in formal providers’ perceptions and knowledge of informal networks of care and in identifying barriers to the networks working together. Methods Qualitative methods, informed by an interpretive approach, were used. In February-July 2012, 10 focus groups were conducted in urban, regional, and rural Australia comprising 88 participants. Findings Our findings show that formal providers are aware, and supportive, of the vital role informal networks play in the care of the dying at home. A number of barriers to formal and informal networks working together more effectively were identified. In particular, we found that the Australian policy of health-promoting palliative is not substantially translating to practice. Conclusion Combinations of formal and informal caring networks are essential to support people and their primary carers. Formal service providers do little to establish, support, or maintain the informal networks although there is much goodwill and scope for them to do so. Further re-orientation towards a health-promoting palliative care and community capacity building approach is suggested.

The impact of funding deadlines on personal workloads, stress and family relationships : a qualitative study of Australian researchers

Objective To examine the impact of applying for funding on personal workloads, stress and family relationships. Design Qualitative study of researchers preparing grant proposals. Setting Web-based survey on applying for the annual National Health and Medical Research Council (NHMRC) Project Grant scheme. Participants Australian researchers (n=215). Results Almost all agreed that preparing their proposals always took top priority over other work (97%) and personal (87%) commitments. Almost all researchers agreed that they became stressed by the workload (93%) and restricted their holidays during the grant writing season (88%). Most researchers agreed that they submitted proposals because chance is involved in being successful (75%), due to performance requirements at their institution (60%) and pressure from their colleagues to submit proposals (53%). Almost all researchers supported changes to the current processes to submit proposals (95%) and peer review (90%). Most researchers (59%) provided extensive comments on the impact of writing proposals on their work life and home life. Six major work life themes were: (1) top priority; (2) career development; (3) stress at work; (4) benefits at work; (5) time spent at work and (6) pressure from colleagues. Six major home life themes were: (1) restricting family holidays; (2) time spent on work at home; (3) impact on children; (4) stress at home; (5) impact on family and friends and (6) impact on partner. Additional impacts on the mental health and well-being of researchers were identified. Conclusions The process of preparing grant proposals for a single annual deadline is stressful, time consuming and conflicts with family responsibilities. The timing of the funding cycle could be shifted to minimise applicant burden, give Australian researchers more time to work on actual research and to be with their families.

Primary schools and the delivery of relationships and sexuality education : the experience of Queensland teachers

Primary school provides an appropriate opportunity for children to commence comprehensive relationships and sexuality education (RSE), yet many primary school teachers avoid teaching this subject area. In the absence of teacher confidence and competence, schools have often relied on health promotion professionals, external agencies and/or one-off issue related presentations rather than cohesive, systematic and meaningful health education. This study examines the implementation of a ten-lesson pilot RSE unit of work and accompanying assessment task in two primary schools in South-East Queensland, Australia. Drawing predominantly from qualitative data, this research explores the experiences of primary school teachers as they engage with RSE curriculum resources and content delivery. The results show that the provision of a high quality RSE curriculum resource grounded in contemporary educational principles and practices enables teachers to feel more confident to deliver RSE and minimises potential barriers such as parental objections and fear of mishandling sensitive content.