New evaluation methodologies for public art programs in cultural instiutions

I put my abstract in for this conference back in March, based on some evaluation work I had been doing in 2010 with my colleague Professor Greg Hearn for the 3C Regional Writing NeoGreography Project. I had been swapping notes with a colleague from the Smithsonian’s Centre for Folklife and Cultural Heritage about their evaluation work, and stuck inside during the rains of January, I decided to apply for a Qld Smithsonian fellowship based on the quandary of evaluation-particular in public histories (oral histories) and digital storytelling. In July I was awarded the fellowship, so I have tweaked my presentation to talk about what we hope to do with this collaboration, to propel the importance placed on evaluation in public arts programs in Qld and beyond.

Getting stuck in together : improving work integrated learning from an Australian institution and faculty perspective

According to a recent report Australian higher education is not in crisis. However, we could be doing it better. The report Mapping Australian Higher Education (Norton, 2012) highlights comparative weaknesses such as levels f student engagement; interactions between students and academic staff; and academic staff preferences for research over teaching. The report points out that despite these concerns most graduates continue to get good, well-paid jobs, student satisfaction is improving, and levels of public confidence in Australian higher education are high. It also stresses that ‘the promise of higher education is that it provides adaptable cognitive skills, not that it always provides the job specific skills graduates will need in their future employment’ (Norton, 2012, p.58). This is worth keeping in mind as we contribute to the significant growth in curriculum initiatives aimed at preparing graduates for the world of work. Work Integrated Learning (WIL) is not a new concept but there is increased pressure on higher education globally to address graduate employability skills. The sector is under pressure in an increasingly competitive environment to demonstrate the relevance of courses, accountability and effective use of public funds (Peach & Gamble, 2011). In the Australian context this also means responding to the skills shortage in areas such as engineering, health, construction and business (DEEWR, 2010). This paper provides a brief overview of collaborative efforts over several years to improve the activity of WIL at the Queensland University of Technology (QUT). These efforts have resulted in changes to curriculum, pedagogy, systems and processes, and the initiation of local, regional, national, and international networks. The willingness of students, staff, and industry partners to ‘get stuck in’ and try new approaches in these different contexts can be understood as a form of boundary spanning. That is, the development of the capability to mediate between different forms of expertise and the demands of different contexts in order to nurture student learning and improve the outcomes of higher education through WIL (Peach, Cates, Ilg, Jones, Lechleiter, 2011).

Developing a framework for planning healthy communities : the Logan Beaudesert health decision support system

In the last few decades, the focus on building healthy communities has grown significantly (Ashton, 2009). There is growing evidence that new approaches to planning are required to address the challenges faced by contemporary communities. These approaches need to be based on timely access to local information and collaborative planning processes (Murray, 2006; Scotch & Parmanto, 2006; Ashton, 2009; Kazda et al., 2009). However, there is little research to inform the methods that can support this type of responsive, local, collaborative and consultative health planning (Northridge et al., 2003). Some research justifies the use of decision support systems (DSS) as a tool to support planning for healthy communities. DSS have been found to increase collaboration between stakeholders and communities, improve the accuracy and quality of the decision-making process, and improve the availability of data and information for health decision-makers (Nobre et al., 1997; Cromley & McLafferty, 2002; Waring et al., 2005). Geographic information systems (GIS) have been suggested as an innovative method by which to implement DSS because they promote new ways of thinking about evidence and facilitate a broader understanding of communities. Furthermore, literature has indicated that online environments can have a positive impact on decision-making by enabling access to information by a broader audience (Kingston et al., 2001). However, only limited research has examined the implementation and impact of online DSS in the health planning field. Previous studies have emphasised the lack of effective information management systems and an absence of frameworks to guide the way in which information is used to promote informed decisions in health planning. It has become imperative to develop innovative approaches, frameworks and methods to support health planning. Thus, to address these identified gaps in the knowledge, this study aims to develop a conceptual planning framework for creating healthy communities and examine the impact of DSS in the Logan Beaudesert area. Specifically, the study aims to identify the key elements and domains of information that are needed to develop healthy communities, to develop a conceptual planning framework for creating healthy communities, to collaboratively develop and implement an online GIS-based Health DSS (i.e., HDSS), and to examine the impact of the HDSS on local decision-making processes. The study is based on a real-world case study of a community-based initiative that was established to improve public health outcomes and promote new ways of addressing chronic disease. The study involved the development of an online GIS-based health decision support system (HDSS), which was applied in the Logan Beaudesert region of Queensland, Australia. A planning framework was developed to account for the way in which information could be organised to contribute to a healthy community. The decision support system was developed within a unique settings-based initiative Logan Beaudesert Health Coalition (LBHC) designed to plan and improve the health capacity of Logan Beaudesert area in Queensland, Australia. This setting provided a suitable platform to apply a participatory research design to the development and implementation of the HDSS. Therefore, the HDSS was a pilot study examined the impact of this collaborative process, and the subsequent implementation of the HDSS on the way decision-making was perceived across the LBHC. As for the method, based on a systematic literature review, a comprehensive planning framework for creating healthy communities has been developed. This was followed by using a mixed method design, data were collected through both qualitative and quantitative methods. Specifically, data were collected by adopting a participatory action research (PAR) approach (i.e., PAR intervention) that informed the development and conceptualisation of the HDSS. A pre- and post-design was then used to determine the impact of the HDSS on decision-making. The findings of this study revealed a meaningful framework for organising information to guide planning for healthy communities. This conceptual framework provided a comprehensive system within which to organise existing data. The PAR process was useful in engaging stakeholders and decision-making in the development and implementation of the online GIS-based DSS. Through three PAR cycles, this study resulted in heightened awareness of online GIS-based DSS and openness to its implementation. It resulted in the development of a tailored system (i.e., HDSS) that addressed the local information and planning needs of the LBHC. In addition, the implementation of the DSS resulted in improved decision- making and greater satisfaction with decisions within the LBHC. For example, the study illustrated the culture in which decisions were made before and after the PAR intervention and what improvements have been observed after the application of the HDSS. In general, the findings indicated that decision-making processes are not merely informed (consequent of using the HDSS tool), but they also enhance the overall sense of ‗collaboration‘ in the health planning practice. For example, it was found that PAR intervention had a positive impact on the way decisions were made. The study revealed important features of the HDSS development and implementation process that will contribute to future research. Thus, the overall findings suggest that the HDSS is an effective tool, which would play an important role in the future for significantly improving the health planning practice.

Evaluation of an Augmented Reality Collaborative Process Modelling System

Identifying, modelling and documenting business processes usually requires the collaboration of many stakeholders that may be spread across companies in inter-organizational business settings. While there are many process modelling tools available, the support they provide for remote collaboration is still limited. This paper investigates the application of virtual environment and augmented reality technologies to remote business process modelling, with an aim to assisting common collaboration tasks by providing an increased sense of immersion in a shared workspace. We report on the evaluation of a prototype system with five key informants. The results indicate that this approach to business process modelling is suited to remote collaborative task settings, and stakeholders may indeed benefit from using augmented reality interfaces.

Leveraging innovation for sustainable construction, proceedings of the CIB Task Group 58: Clients and Construction Innovation Workshop

This publication consists of a volume of papers presented at the workshop of the CIB Task Group 58: Clients and Construction Innovation, held on May 18- 19, 2009 at the University of Alberta in Edmonton, Canada. The workshop theme, “Leveraging Innovation for Sustainable Construction”, reflects a growing concern among clients for perspectives, approaches, and tools that will secure the practice of construction economically, socially, and environmentally. This collection encompasses some of the most incisive assessments of the challenges facing the construction industry today from a range of researchers and industry practitioners who are leading the way for tomorrow’s innovations. It provides a useful documentation of the ongoing conversation regarding innovation and sustainability issues and a foundation of knowledge for future research and development. The papers contained in this volume explore the workshop’s overarching theme of how to leverage innovation to increase the sustainability of the construction process and product. Participants sought to generate discussion on the topics of innovation and sustainability within the construction field, to share international examples of innovation from the research community and from industry, and to establish a point of reference for ongoing enquiry. In particular, our contributors have noted the value of learning through practice in order to orient research based on real-world industry experience. Chapters two and three present complementary models of sustainable research programs through the three parts collaboration of government, industry, and academia. Chapters four and five explore new tools and forms of technological innovation as they are deployed to improve construction project management and set the direction for advances in research. Chapters six, seven, and eight closely study practical examples of innovation in large-scale construction projects, showing with concrete results the impact of applying creative methods and best practices to the field. Innovation and sustainability in construction are truly global efforts; these papers illustrate how we can draw on international examples and cooperative organizations to address these important issues for long-term benefit of the industry.

Dietetic confidence working with clients with depression/anxiety is associated with client-focused practice and advocacy skills

Confidence in a professional role is a key element in the successful transition to competent practice. New graduate dietitians report that whilst they are confident about their general dietetic ability, they are not as confident when working with clients experiencing depression or anxiety. This study aimed to develop and validate a scale which measured confidence about working with clients with depression/anxiety. The 21-item Dietetic Collaborative Practice Scale was developed using research about dietetic practice in mental health (Dowding et al., 2011), coping self-efficacy literature (Chesney et al., 2006) and collaboration with industry experts. A convenience sample of 189 Australian dietitians completed the questionnaire. Exploratory factor analysis suggests that dietetic confidence is best represented by a two-dimensional solution consisting of (a) Client-focused practice (CFP, 50.8% variance); and (b) Advocacy for self and client care (ASC, 9.7% variance). The alpha coefficient of both dimensions (CFP α=.95, ASC α=.84) demonstrates the internal consistency of components. Combined, these two components account for 60.5% of variance. The scale components were not related to years of practice or working with mental health clients but were significantly related to overall dietetic confidence (ODC). Correlation coefficients between ODC and CFP were .501 (p<.01), ODC and ASC were correlated at .465 (p<.01) and CFP and number of years as a dietitian were weakly correlated at 0.24 (p<.05). Results have implications for dietetic training and professional development. Client focus and advocacy for self and client appear to be important factors in overall confidence as a dietitian.

Digital Storytelling within a Service-Learning Partnership: Technology as Product and Process for University Students and Culturally and Linguistically Diverse High School Youth

This chapter describes a university/high school partnership focused on digital storytelling. It also explains the multi-stage process used to establish this successful partnership and project. The authors discuss the central role that technology played in developing this university/high school partnership, a collaboration that extended the impact of a digital storytelling project to reach high school students, university students, educators, high school administrators, and the local community. Valuing a reflective process that can lead to the creation of a powerful final product, the authors describe the impact of digital storytelling on multiple stakeholders, including the 13 university students and 33 culturally and linguistically diverse high school youth who participated during the fall of 2009. In addition, the chapter includes reflections from university and high school student participants expressed during focus groups conducted throughout the project. While most participants had a positive experience with the project, complications with the technology component often caused frustrations and additional challenges. Goals for sharing this project are to critically evaluate digital storytelling, describe lessons learned, and recommend good practices for others working within a similar context or with parallel goals.

Two decades of exceptional achievements : does the evidence support nurses to favour Cochrane systematic reviews over other systematic reviews?

Systematic reviews (SRs) are increasingly recognised as the standard approach in summarising health research and influence clinical nursing practice and health care decisions (Coster and Norman, 2009, Grimshaw and Russell, 1993 and Griffiths and Norman, 2005). High quality SRs should have a clearly stated set of objectives with pre-defined eligibility criteria for studies; an explicit reproducible methodology; a systematic search that attempts to identify all studies that would meet the eligibility criteria; an assessment of the validity of the findings of the included studies; the assessment of risk of bias; and a systematic presentation and synthesis of the characteristics of findings of the included study (Higgins and Green, 2011). Although SRs are highly regarded and are expected to be rigorous, just as other research, their quality may vary (Choi et al., 2001 and Hoving et al., 2001)...

Community wide interventions for increasing physical activity

Not having enough physical activity leads to poorer health. Regular physical activity can reduce the risk of chronic disease and improve one's health and well being. The lack of physical activity is a common and growing health problem. To address this, 25 studies have used improvement activities directed at communities using more than one approach in a single program. When we looked at the available research, we observed that there was a lack of good studies which could show whether this approach was or wasn't beneficial. For example, some research studies claimed that community wide programs improved physical activities and other studies did not. It was not possible to determine what might work. Future research is needed with improved designs, measures of outcomes and larger samples of participants.

An action research approach for the professional development of Vietnamese nurse educators

Nurse education in Viet Nam is undergoing substantial reform. In order to facilitate the change, in 2007 the Viet Nam Nurses Association formed a collaborative partnership with the School of Nursing and Midwifery at an Australia university. This collaboration gave rise to the Viet Nam Nursing Capacity Building Project under the leadership of Professor Genevieve Gray, funded by the Atlantic Philanthropies. The new four year competency based nursing curriculum frame is expected to be implemented in September 2011 following approval by the Viet Nam Ministry of Education. The focus of this paper is the Teaching Fellowships Program, an initiative of the Viet Nam Nursing Capacity Building Project, developed to help meet the challenges associated with leading and dealing with the curriculum change. The paper explores the development of the program and justifies an action research approach, illuminates key issues, and briefly refers to changes to the next fellowship program.

Meaningful musical engagement : the potential impact of generative music systems on learning experiences

In order to create music, the student must establish a relationship with the musical materials. In this thesis, I examine the capacity of a generative music system called jam2jam to offer individuals a virtual musical play-space to explore. I outline the development of an iteration of software development named jam2jam blue and the evolution of a games-like user interface in the research design that jointly revealed the nature of this musical exploration. The findings suggest that the jam2jam blue interface provided an expressive gestural instrument to jam and experience musicmaking. By using the computer as an instrument, participants in this study were given access to meaningful musical experiences in both solo and ensemble situations and the researcher is allowed a view of their development of a relationship with the musical materials from the perspective of the individual participants. Through an iterative software development methodology, pedagogy and experience design were created simultaneously. The research reveals the potential for the jam2jam software to be used as a reflective tool for feedback and assessment purposes. The power of access to ensemble music making is realised though the participants’ virtual experiences which are brought into their physical space by sharing their experience with others. It is suggested that this interaction creates an environment conducive to self-initiated learning in which music is the language of interaction. The research concludes that the development of a relationship between the explorer and the musical materials is subject to the collaborative nature of the interaction through which the music is experienced.

The implementation of sustainable housing through mutual benefits to key stakeholders

Among the Australian general public, there are increasing concerns about environmental issues. Accordingly, sustainability in the housing industry is also becoming a priority on the development agenda. However, putting the principles of ecological sustainability into practice within social and economic development requires intensive involvement of major stakeholders such as governments, developers, builders, consumers and a range of other professionals. Establishing a sustainable value entails asymmetric life-cycle returns, making it important for major stakeholders to appreciate the benefits of this new agenda not only for the individual businesses but also for other supply chain partners. This context warrants the study to promote collective benefits for key stakeholders by establishing a mutual-benefit framework for sustainable housing implementation. A research was carried out in the hope to establish a mutual-benefit framework by investigating challenges of achieving benefits (CABs) from sustainable housing development in a multi-stakeholder context. In the research work reported in this article, a comparative questionnaire study was first conducted among seven stakeholder groups in the Australian housing industry, to examine the importance and inter-relationships of CABs. In-depth interviews then furthered the survey findings with a focus on stakeholder diversity. The synthesized findings of the survey and interview study lead to the identification of 12 critical mutual-benefit factors and their mutual influence. Based on such a platform, a systematic framework is developed with the aid of Interpretive Structural Modelling (ISM), to identify the patterns of stakeholder benefit materialisation, suggest the priority of critical factors and provide related stakeholder-specific action guide for sustainable housing implementation.

Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.