Exploring the Possibilities and Methodological Challenges of Evaluation Practice : A Democratic Question

In our exploration of the methodological possibilities and challenges of evaluation practice that foregrounds a democratic approach, we argue that having sensitivity to participants’ different positions, ideological perspectives, and values, and an understanding of the existing power relationships are paramount for the evaluators if the evaluation is to achieve its goals. This chapter draws on our experiences as evaluators in Australia, where school leaders and teachers are currently experiencing significant curriculum and assessment changes, and now work in a context of heightened accountability. Our evaluation practices with schools are used to illustrate how democratic practices can be incorporated into evaluation in ways that provide opportunities and support for school self-evaluation. It is paramount to recognise that evaluation is a political and ideological practice, and therefore is not a neutral process. Our argument is that it remains the responsibility of evaluators to design spaces that build sustainable relationships with participants and the targets of the programmes being evaluated; ensure that dialogue and deliberation are valued between all stakeholders; represent a range of interests; and give a service back to the evaluated communities by offering understandings and promoting reflective practice and informed decision-making throughout programme implementation.

Work integrated learning: Exposure to professional practice : expectations and challenges

Prior to graduation engineering students are expected to provide evidence of relevant experience in the workplace. This experience is expected to provide opportunities for exposure to the profession and to help students develop confidence, skills and capabilities as emerging professionals. This investigation considers the expectations and challenges in implementing WIL programs in different contexts. While this will inform the next iteration of engineering course development at QUT the issues and interventions described provide useful insights into options available and engineering curriculum design more broadly. This comparative analysis across three phases highlights expectations and challenges including stakeholder responsibilities, expectations, and assessment. The study draws on the findings of a 2005 investigation into the purpose and provision of WIL and findings of a 2012 Faculty review of the current WIL model. The enhancement of WIL through a series of developmental phases highlights strengths and weaknesses of various models. It is anticipated that this investigation will inform course development decisions on a whole-of-course approach to WIL that improves student engagement and learning experience. The importance of WIL is not disputed. However with industry expectations, increasing student numbers and cohort diversity the ways in which students and industry currently engage in WIL are not sustainable and more creative, flexible and engaging approaches are needed.

Risky Business : managing creative practice postgraduates

In Australia, as elsewhere, universities are being encouraged to grow their postgraduate research candidature base while at the same time there is increasing pressure on resources with which to manage the burgeoning groups. In this environment HDR supervision strategies are seen as increasingly important as research managers seek the best possible ‘fit’ for an applicant: the candidate who will provide a sound return on investment and demonstrate endurance in the pursuit of a timely completion.

The Effective and The Evocative : A Spectrum of Creative Practice Research

In the expanding literature on creative practice research, art and design are often described as a unified field. They are bracketed together (art-and-design), referred to as interchangeable terms (art/design), and nested together, as if the practices of one domain encompass the other. However it is possible to establish substantial differences in research approaches. In this chapter we argue that core distinctions arise out of the goals of the research, intentions invested in the resulting “artefacts” (creative works, products, events), and the knowledge claims made for the research outcomes. Moreover, these fundamental differences give rise to a number of contingent attributes of the research such as the forming contexts, methodological approaches, and ways of evidencing and reporting new knowledge. We do not strictly ascribe these differences to disciplinary contexts. Rather, we use the terms effective practice research and evocative practice research to describe the spirit of the two distinctive research paradigms we identify. In short, effective practice research (often pursued in design fields) seeks a solution (or resolution) to a problem identified with a particular community, and it produces an artefact that addresses this problem by effecting change (making a situation, product or process more efficient or effective in some way). On the other hand, evocative practice research (often pursued by creative arts fields) is driven by individual pre-occupations, cultural concerns or human experience more broadly. It produces artefacts that evoke affect and resonance, and are poetically irreducible in meaning. We cite recent examples of creative research projects that illustrate the distinctions we identify. We then go on to describe projects that integrate these modes of research. In this way, we map out a creative research spectrum, with distinct poles as well as multiple hybrid possibilities. The hybrid projects we reference are not presented as evidence an undifferentiated field. Instead, we argue that they integrate research modes in deliberate, purposeful and distinctive ways: employing effective practice research methods in the production of evocative artefacts or harnessing evocative (as well as effective) research paradigms to effect change.

Building distributed leadership for effective supervision of creative practice higher research degrees : final report 2014

Building distributed leadership for effective supervision of creative practice higher research degrees is an Office for Learning and Teaching (OLT) funded project, conducted in partnership between Queensland University of Technology, The University of Melbourne, Auckland University of Technology, University of New South Wales and University of Western Sydney. The project was initiated to develop a cooperative approach to establishing an understanding of the contextual frameworks of the emergent field of creative practice higher degrees by research (HDRs); capturing early insights of administrators and supervisors; gathering exemplars of good practices; and establishing an in-common understanding of effective approaches to supervision. To this end, the project has produced: • A literature review, to provide a research foundation for creative practice higher research degree supervision (Chapter 3). • A contextual review of disciplinary frameworks for HDR programs, produced through surveys of postgraduate research administrators (Section 4.1), and an analysis of institutional materials and academic development programs for supervisors (Section 4.2). • A National Symposium, Effective Supervision of Creative Arts Research Degrees (ESCARD), at QUT in Brisbane in February 2013, with 62 delegates from 20 Australasian Universities, at which project findings were disseminated, and delegates presented case studies and position papers, and participated in discussions on key issues for supervisors (Appendix 1). • Resources, including a booklet for supervisors: 12 Principles for the Effective Supervision of Creative Practice Higher Research Degrees, which encapsulates attitudes, insights and good practices of experienced and new supervisors. It was produced through a content analysis of interviews with twenty-five supervisors in creative disciplines (visual and performing arts, music, new media, creative writing and design) (Printed booklet, PDF, Appendix 3). • A project website to disseminate project outcomes , which holds project findings, relevant references, and a repository of case studies and position papers by supervisors and program administrators. • A call for papers for a special issue ‘Supervising Practice: Perspectives on the Supervision of Creative Practice Research Higher Degrees’ of ACCESS Journal: Critical Perspectives on Communication, Cultural & Policy Studies (ERA ranked A quality) in 2014 (Appendix 2). • A community of supervisory practice initiated through project partnerships, a national symposium where supervisors from across Australasia met in dialogue for the first time, resource sharing, and joint publishing opportunities. • A set of recommendations for supervision capacity building and academic development, produced through the triangulation of literature and contextual reviews, analysis of institutional frameworks, interviews with supervisors and national dialogues. It is anticipated that the project’s outcomes will support experienced and new supervisors in this emergent field, and so benefit HDR students, and will enable creative disciplines to build supervision capacity, and so to accommodate growth in postgraduate enrolments. Funded as a pilot project, the project set out to establish a robust research base to provide a foundation for future work involving sharing good practices, resource building, and designing effective approaches to academic development for supervisors. Recommendations that were produced out of this project include the need to extend beyond generic, formal training for supervisors to academic development that harnesses and extends distributed leadership; focuses on local, disciplinary contexts; has a strong emphasis on case studies; provides diverse resources; and facilitates dialogue between supervisors. Recommendations also include developing frameworks for mentoring new supervisors and building a national network to facilitate cross-institutional discourse, disseminate good practices, and share insights into the management of risk factors, ethical issues, and preparing candidates for examination. As a pilot investigation, the outcomes of this project lay the ground for this future work.

Providing 'best practice' placements begins with mentoring skills : overview of the Program of Experience in the Palliative Approach (PEPA) quality improvement initiatives for mentors

Objectives PEPA is funded by the Department of Health and Ageing and aims to further improve the skill and confidence of the generalist workforce to work with people with palliative care needs. Recent quality improvement initiatives to promote transfer of learning into practice include appointment of a clinical educator, implementation of an online module for mentors and delivery of a mentoring workshop (collaborating with NSAP and PCC4U). This paper presents an overview of outcomes from these quality improvement initiatives. Methods PEPA host sites are selected based on their specialist palliative care level. Host site managers are surveyed six-monthly and participants are surveyed pre and three months post-placement to collect open and fixed response data on their experience of the program. Participants in the mentoring workshop (n=39) were asked to respond to a survey regarding the workshop outcomes. Results The percentage of placement participants who strongly agreed they ‘have the ability to implement the interventions required for people who have a life-limiting illness’ increased from 35% in 2011 (n=34) to 51% in 2012 (n=91) post-placement. Responses from mentor workshop participants indicated that 76% of respondents (n=25) agreed that they were able to identify principles for mentoring in the context of palliative care. In 2012, 61% of host site managers (n=54) strongly agreed that PEPA supports clinician working with people with a life-limiting illness. Conclusion Strategies to build the capabilities of palliative care professionals to mentor and support the learning experience of PEPA participants are critical to ongoing improvements of the program.

Experience of being an advanced practice nurse within Australian acute care settings : a systematic review of qualitative evidence

Background Nationally and internationally, advanced practice nurses are working under various titles and in different contexts to address gaps within healthcare systems. Analysis of advanced practice roles in different countries has been undertaken, but due to variations in cultural, geographical and professional factors, it is difficult and perhaps ineffectual to compare roles between countries. Contextual factors may also affect the actual experience of being an advanced practice nurse. A systematic review was therefore undertaken of qualitative evidence on the experience of being an advanced practice nurse in Australia, to provide deeper understanding of the role in the defined context. Methods The review followed the method for qualitative synthesis as per the Joanna Briggs Institute. An extensive search was undertaken of databases and online resources to find published and unpublished studies. Papers from 1990 to October 2011 which met specified inclusion criteria were appraised using the Joanna Briggs Institute Qualitative Assessment and Review Instrument. Results Three published studies and one unpublished dissertation were included in the review. From these studies, 216 findings were extracted and these were formed into 18 categories. Six meta-syntheses grouped under the headings of expert knowledge, confidence, education, relationships, negative experiences and patient-centred experience were created. Organisational factors impact greatly on the experience, professionally and personally. Conclusions Heterogeneity of role titles makes synthesis a difficult process, but contextualising the population provides a pragmatic approach to informing the status of the advanced practice nurse discourse. The review identifies positive and negative experiences of being an advanced practice nurse in Australian acute care settings with overlapping and intertwining findings that reinforce the complexity of the role.

12 principles for the effective supervision of creative practice higher research degrees, dispatches from the field

In late 2012 and early 2013 we interviewed 25 experienced and early career supervisors of creative practice higher research degrees. This journey spanned five universities and a broad range of disciplines including visual art, music, performing art, new media, creative writing, fashion, graphic design, interaction design and interior design. Some of the supervisors we interviewed were amongst the first to complete and supervise practice-led and practice-based PhDs; some have advocated for and defined this emergent field; and some belong to the next generation of supervisors who have confidently embarked on this exciting and challenging path. Their reflections have brought to light many insights gained over the past decade. Here we have drawn together common themes into a collection of principles and best practice examples. We present them as advice rather than rules, as one thing that the supervisors were unanimous about is the need to avoid proscriptive models and frameworks, and to foster creativity and innovation in what is still an emergent field of postgraduate supervision. It is with thanks to all of the supervisors who contributed to these conversations, and their generosity in sharing their practices, that we present their advice, exemplars and case studies.

Implementing open licensing in government open data initiatives : a review of Australian government practice

As support grows for greater access to information and data held by governments, so does awareness of the need for appropriate policy, technical and legal frameworks to achieve the desired economic and societal outcomes. Since the late 2000s numerous international organizations, inter-governmental bodies and governments have issued open government data policies, which set out key principles underpinning access to, and the release and reuse of data. These policies reiterate the value of government data and establish the default position that it should be openly accessible to the public under transparent and non-discriminatory conditions, which are conducive to innovative reuse of the data. A key principle stated in open government data policies is that legal rights in government information must be exercised in a manner that is consistent with and supports the open accessibility and reusability of the data. In particular, where government information and data is protected by copyright, access should be provided under licensing terms which clearly permit its reuse and dissemination. This principle has been further developed in the policies issued by Australian Governments into a specific requirement that Government agencies are to apply the Creative Commons Attribution licence (CC BY) as the default licensing position when releasing government information and data. A wide-ranging survey of the practices of Australian Government agencies in managing their information and data, commissioned by the Office of the Australian Information Commissioner in 2012, provides valuable insights into progress towards the achievement of open government policy objectives and the adoption of open licensing practices. The survey results indicate that Australian Government agencies are embracing open access and a proactive disclosure culture and that open licensing under Creative Commons licences is increasingly prevalent. However, the finding that ‘[t]he default position of open access licensing is not clearly or robustly stated, nor properly reflected in the practice of Government agencies’ points to the need to further develop the policy framework and the principles governing information access and reuse, and to provide practical guidance tools on open licensing if the broadest range of government information and data is to be made available for innovative reuse.

‘Crack in the pavement’ : pedagogy as political and moral practice for educating culturally competent professionals

This paper explores the reception of Indigenous perspectives and knowledges in university curricula and educators’ social responsibility to demonstrate cultural competency through their teaching and learning practices. Drawing on tenets of critical race theory, Indigenous standpoint theory and critical pedagogies, this paper argues that the existence of Indigenous knowledges in Australian university curricula and pedagogy demands personal and political activism (Dei, 2008) as it requires educators to critique both personal and discipline-based knowledge systems. The paper interrogates the experiences of non-Indigenous educators involved in this contested epistemological space (Nakata, 2002), and concludes by arguing for a political and ethical commitment by educators towards embedding Indigenous knowledges towards educating culturally competent professionals.

What is the evidence to guide best practice for the management of older people with cognitive impairment presenting to emergency departments? A systematic review

The aim of this study was to conduct a systematic literature review of research-based studies to identify practices designed to meet the specific care needs of older cognitively impaired patients in emergency departments (ED). A systematic literature review of studies was completed using PRIMSA methodology. The search criteria included articles from both emergency and acute care settings. A total of 944 articles were screened, and a total of 43 articles were identified as eligible. The review found a number of intervention studies to improve quality of care for older persons with cognitive impairment carried out or commenced in emergency settings, including interventions to improve cognitive impairment recognition (n = 9) and clinical approaches to reduce falls (n = 1) and both delirium incidence and prevalence (n = 2). Relevant studies carried out in acute care settings regarding cognitive impairment recognition (n = 4) and primary and secondary prevention of delirium (n = 18) and intervention studies that reduced the prescription of deliriogenic drugs (n = 1), reduced behavioral symptoms and discomfort (n = 7), and improved nutritional intake (n = 1) in hospitalized older persons with dementia were also identified. There is limited research available that reports interventions that improve the quality of care of older ED patients with cognitive impairment. Although this review found evidence obtained from the acute care setting, additional research is needed to identify whether these interventions are beneficial in fast-paced emergency settings.

But what makes it doctoral? Taking on the traditionalists : interdisciplinary, practice-led doctoral research in the creative industries - a case study in academic politics, research, rigour and relevance

This paper examines a Doctoral journey of interdisciplinary exploration, explication, examination...and exasperation. In choosing to pursue a practice-led doctorate I had determined from the outset that ‘writing 100,000 words that only two people ever read’, was not something which interested me. Hence, the oft-asked question of ‘what kind of doctorate’ I was engaged in, consistently elicited the response, “a useful one”. In order to satisfy my own imperatives of authenticity and usefulness, my doctoral research had to clearly demonstrate relevance to; productively inform; engage with; and add value to: wider professional field(s) of practice; students in the university courses I teach; and the broader community - not just the academic community. Consequently, over the course of my research, the question, ‘But what makes it Doctoral?’ consistently resounded and resonated. Answering that question, to satisfy not only the traditionalists asking it but, perhaps surprisingly, some academic innovators - and more particularly, myself as researcher - revealed academic/political inconsistencies and issues which challenged both the fundamental assumptions and actuality of practice-led research. This paper examines some of those inconsistencies, issues and challenges and provides at least one possible answer to the question: ‘But what makes it Doctoral?’

Dietetic practice by Australian and Canadian dietitians with people with Parkinson's disease

Although Parkinson’s disease (PD) is a complex disease for which appropriate nutrition management is important, limited evidence is currently available to support dietetic practice. Existing PD-specific guidelines do not span all phases of the Nutrition Care Process (NCP). This study aimed to document PD-specific nutrition management practice by Australian and Canadian dietitians. DAA members and PEN subscribers were invited to participate in an online survey (late 2011). Eighty-four dietitians responded (79.8% Australian). The majority (70.2%) worked in the clinical setting. Existing non-PD guidelines were used by 52.4% while 53.6% relied on self-initiated literature reviews. Weight loss/malnutrition, protein intake, dysphagia and constipation were common issues in all NCP phases. Respondents also requested more information/evidence for these topics. Malnutrition screening (82.1%) and assessment (85.7%) were routinely performed. One-third did not receive referrals for weight loss for overweight/obesity. Protein intake meeting gender/age recommendations (69.0%), and high energy/high protein diets to manage malnutrition (82.1%) were most commonly used. Constipation management was through high fibre diets (86.9%). Recommendations for spacing of meals and PD medications varied with 34.5% not making recommendations. Nutritional diagnosis (70.2%) and stage of disease (61.9%) guided monitoring frequency. Common outcome measures included appropriate weight change (97.6%) and regular bowel movements (88.1%). With limited PD-specific guidance, dietitians applied best available evidence for other groups with similar issues. Dietitians requested evidence-based guidelines specifically for the nutritional management of PD. Guideline development should focus on those areas reported as commonly encountered. This process can identify the gaps in evidence to guide future research.

CPD : Using evidence based clinical practice guidelines in the management of anaemia in patients with chronic renal failure

Anaemia is a chronic problem in patients with renal insufficiency, especially chronic renal failure (CRF). In patients with CRF, anaemia is primarily due to a deficiency in erythropoietin (EPO), a glycoprotein growth factor that stimulates RBC production. The long-term effects and burden of anaemia for patients with CRF can be physical, emotional and financial. With efficient, systematic management of anaemia, clinicians have the potential to realise not only better clinical outcomes for CRF patients but also significant cost savings for them and the health system. During the last decade, significant advances have been made in clinicians’ understanding of how best to manage anaemia in this vulnerable population. One of the most important efforts to improve clinical practice has been the development of best practice guidelines.

Orchids, intersex and the auto/biographical project

Auto/biographical documentaries ask audiences to take a ‘leap of faith’, not being able to offer any real ‘proof’ of the people and events they claim to document, other than that of the film-maker’s saying this is what happened. With only memory and history seen through the distorting lens of time, ‘the authenticity of experience functions as a receding horizon of truth in which memory and testimony are articulated as modes of salvage’. Orchids: My Intersex Adventure follows a salvaging of the film-maker’s life events and experiences, being born with an intersex condition, and, via the filming and editing process, revolving around the core question: who am I? From this transformative creative documentary practice evolves a new way of embodying experience and ‘seeing’, playfully dubbed here as the ‘intersex gaze’.