Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

When non-significance may be significant : lessons learned from a study of the development, implementation and evaluation of a fleet risk assessment tool

This paper reports on the development and implementation of a self-report risk assessment tool that was developed in an attempt to increase the efficacy of crash prediction within Australian fleet settings. This study forms a part of a broader program of research into work related road safety and identification of driving risk. The first phase of the study involved a series of focus groups being conducted with 217 professional drivers which revealed that the following factors were proposed to influence driving performance: Fatigue, Knowledge of risk, Mood, Impatience and frustration, Speed limits, Experience, Other road users, Passengers, Health, and Culture. The second phase of the study involved piloting the newly developed 38 item Driving Risk Assessment Scale - Work Version (DRAS-WV) with 546 professional drivers. Factor analytic techniques identified a 9 factor solution that was comprised of speeding, aggression, time pressure, distraction, casualness, awareness, maintenance, fatigue and minor damage. Speeding and aggressive driving manoeuvres were identified to be the most frequent aberrant driving behaviours engaged in by the sample. However, a series of logistic regression analyses undertaken to determine the DRAS-WV scale’s ability to predict self-reported crashes revealed limited predictive efficacy e.g., 10% of crashes. This paper outlines proposed reasons for this limited predictive ability of the DRAS-WV as well as provides suggestions regarding the future of research that aims to develop methods to identify “at risk” drivers.

How to work the crowd : a snapshot of barriers and motivations to crowdfunding

Introduction This study is a snapshot of Australian donor motivations and donor barriers to crowdfunding, and provides some indicative recommendations on ways the uptake of crowdfunding in the creative industries might increase. It is based upon a literature review and semi-structured interviews with 17 stakeholders who have used crowdfunding in Australia, including: creative producers seeking funds; financial crowdfunding donors; Artsupport Australia mentors of artists who are using crowdfunding; and crowdfunding site stakeholders. About the report Artsupport Australia commissioned the Queensland University of Technology Creative Industries team to produce a report on trends related to crowdfunding, particularly identifying barriers and motivations that might be associated with it. Artsupport Australia suggested a list of interview candidates, based on those individuals’ knowledge or experience with crowdfunding, to provide a better understanding of perceptions of this emerging practice, and to inform discussions on whether it is a useful revenue generating mechanism for the cultural sector.

An interview with Jacques Rancière : on medium-specificity and discipline crossovers in modern art

Jacques Rancière's work on aesthetics has received a great deal of attention in recent years. Given his work has enormous range – covering art and literature, political theory, historiography, pedagogy and worker's history – Andrew McNamara and Toni Ross (UNSW) explore his wider critical ambitions in this interview, while showing how it leads to alternative insights into aesthetics. Rancière sets aside the core suppositions linking the medium to aesthetic judgment, which has informed many definitions of modernism. Rancière is emphatic in freeing aesthetic judgment from issues of medium-specificity. He argues that the idea of autonomy associated with medium-specificity – or 'truth to the medium' – was 'a very late one' in modernism, and that post-medium trends were already evident in early modernism. While not stressing a simple continuity between early modernism and contemporary art, Ranciere nonetheless emphasizes the on-going ethical and political ramifications of maintaining an a-disciplinary stance.

Akin Collection : curation of a collaboration between Indigenous artists and fashion designers to create a retail-ready luxury fashion label

The Akin collection is the outcome of a project to lead, guide and curate a luxury, retail-ready fashion collection from a collaboration between five emerging fashion designers and five established Indigenous artists. Research background There is a history of Indigenous artists in Australia being treated unethically; by misappropriation and misrepresentation of their work, inequity of payment for their creativity and little acknowledgement of their cultural contribution to collaborative fashion product sold globally. This has created an atmosphere of bad press for fashion, as well as a fear for emerging designers to include/collaborate with Indigenous artists for textile prints. This fear has been so intense that many emerging Australian designers are now seeking collaboration with other countries’ Indigenous communities, thus missing out on a rich cultural and diverse aesthetic that could brand a truly unique Australian label in the international marketplace. The fashion brands that have collaborated with Indigenous Australian artists have traditionally been a ONE designer label incorporating Indigenous prints, for collections that have little acknowledgement of the artist’s contribution and strong branding for the label and/or fashion designer. This collection seeks to create an equitable and profitable fashion collection under one brand where all artists and designers receive equal payment, equal promotion/credibility, as well as equal royalties for any garments ordered by retailers. Research question Is it possible to curate an ethical, luxury, retail-ready, international fashion brand with a collaboration of five (5) emerging designers and five (5) Indigenous artists? Research contribution In the fashion industry, existing collaborations for Australian Indigenous artists have been with ONE fashion designer or one existing fashion label. This is the first fashion collection created under one brand name with equal credibility and profits for both artists and designers. The process involved presenting workshops ranging from understanding the logistics and timing of the fashion supply chain, costing of garments, the process of ‘ranging’ fashion product for a collection and creating repeat prints from a specific artwork, ready for digital printing. A workshop was also facilitated so both designer and artist could work together to create (and co-own) unique t shirt prints. Lawyers were consulted and ethical contracts were drawn up to cover all participants in this innovative collaboration. While the collaboration of artist and designer was important, the collection required curation of all elements so that the final collection came together as a professional and cohesive, quality, retail- ready product. This could only be created by experienced practitioners. Research significance The Akin Collection is the first Australian fashion brand to be created as a collaboration between five equally recognised Indigenous artists and five emerging fashion designers. It has familiarized the Indigenous artists to the logistics and culture of the fashion industry and the emerging fashion designers have been familiarized to the logistics and culture of how to collaborate with the unique Indigenous artwork that exists in Australia. After only three months, this culminated in a fashion parade showcasing the Akin collection to over 400 members of the public, government, media and retail. Feedback has been strong from the media and the industry, and a lookbook and photoshoot has been organised to promote and sell the collection both nationally and internationally. These concepts plus the curation outlined, has created a successful, luxury, quality collection ready for the international runways. This project has devised an ethical template for other Indigenous artists and emerging designers to create fashion collections that offer a unique aesthetic that could position and brand Australian fashion in the international marketplace. Key Words Indigenous artists, emerging fashion designers, Australian fashion design, ethical fashion, luxury Australian brand

Cross-cultural language learning and web design complexity

Accepting the fact that culture and language are interrelated in second language learning (SLL), the web sites should be designed to integrate with the cultural aspects. Yet many SLL web sites fail to integrate with the cultural aspects and/or focus on language acquisition only. This study identified three issues: (1) anthropologists’ cultural models mostly adopted in cross-cultural web user interface have been superficially used; (2) web designers deal with culture as a fixed one which needs to be modeled into interface design elements, so (3) there is a need for a communication framework between educators and design practitioners, which can be utilized in web design processes. This paper discusses what anthropology can contribute to language learning, mediated through web design processes and suggests a cultural user experience framework for web-based SLL by presenting an exemplary matrix. To evaluate the effectiveness of the framework, the key stakeholders (learners, teachers, and designers) participated in a case scenario-based evaluation. The result shows a high possibility that the framework can enhance the effective communication and collaboration for the cultural integration.

Between formal and informal : the shakeout in China’s online video industry

While a rich body of literature in television and film studies and media policy studies has tended to focus on the media activities in the formal sector, we know much less about informal media activities, its influence on state policies, as well as the dynamics between the formal and the informal sectors. This article examines these issues with reference to a particularly revealing period following a large-scale government crackdown on peer-to-peer video sharing sites in China in 2008. By analyzing the aim and consequences of the state action, I point to the counter-productive effect in terms of cultural loss and the resurgence of offline piracy; and show the positive impact on forcing the informal into the formal sector, and pressuring the formal to innovate. Meanwhile, an increasing rapprochement between professional and user-created content leads to a new relationship between formal and informal sectors. This case demonstrates the importance of considering the dynamics between the two sectors. It also offers compelling evidence of the role of the informal sector in engendering state action, which in turn impacted on the co-evolution of the formal and the informal sectors.

Development and testing of an iPad application for teaching self-management to heart failure patients. (Nursing/Allied Health Professional Investigator Award)- Abstract

Purpose: Heart failure (HF) is the leading cause of hospitalization and significant burden to the health care system in Australia. To reduce hospitalizations, multidisciplinary approaches and enhance self-management programs have been strongly advocated for HF patients globally. HF patients who can effectively manage their symptoms and adhere to complex medicine regimes will experience fewer hospitalizations. Research indicates that information technologies (IT) have a significant role in providing support to promote patients' self-management skills. The iPad utilizes user-friendly interfaces and to date an application for HF patient education has not been developed. This project aimed to develop the HF iPad teaching application in the way that would be engaging, interactive and simple to follow and usable for patients' carers and health care workers within both the hospital and community setting. Methods: The design for the development and evaluation of the application consisted of two action research cycles. Each cycle included 3 phases of testing and feedback from three groups comprising IT team, HF experts and patients. All patient education materials of the application were derived from national and international evidence based practice guidelines and patient self-care recommendations. Results: The iPad application has animated anatomy and physiology that simply and clearly teaches the concepts of the normal heart and the heart in failure. Patient Avatars throughout the application can be changed to reflect the sex and culture of the patient. There is voice-over presenting a script developed by the heart failure expert panel. Additional engagement processes included points of interaction throughout the application with touch screen responses and the ability of the patient to enter their weight and this data is secured and transferred to the clinic nurse and/or research data set. The application has been used independently, for instance, at home or using headphones in a clinic waiting room or most commonly to aid a nurse-led HF consultation. Conclusion: This project utilized iPad as an educational tool to standardize HF education from nurses who are not always heart failure specialists. Furthermore, study is currently ongoing to evaluate of the effectiveness of this tool on patient outcomes and to develop several specifically designed cultural adaptations [Hispanic (USA), Aboriginal (Australia), and Maori (New Zealand)].

Motivations and barriers to crowdfunding

This modest study is a snapshot of Australian donor motivations and donor barriers to crowdfunding, and provides some tentative recommendations to Artsupport Australia on ways crowdfunding uptake in Australia might increase. Limited qualitative data was gathered from 17 participants who have used crowdfunding in Australia such as: creative producers seeking funds; financial crowdfunding donors; Artsupport Australia mentors of artists who are using crowdfunding; and crowdfunding site stakeholders. These recommendations contribute ideas for development and implementation that align with the Australia Council for the Arts priorities, particularly to ‘build programs that support artists through all stages of their careers and to increase support for the arts from the business and general community through cultural philanthropy’ (Artsupport Australia website).

Examination of distracted driving and yellow light running : analysis of simulator data

Driving on an approach to a signalized intersection while distracted is particularly dangerous, as potential vehicular conflicts and resulting angle collisions tend to be severe. Given the prevalence and importance of this particular scenario, the decisions and actions of distracted drivers during the onset of yellow lights are the focus of this study. Driving simulator data were obtained from a sample of 58 drivers under baseline and handheld mobile phone conditions at the University of Iowa - National Advanced Driving Simulator. Explanatory variables included age, gender, cell phone use, distance to stop-line, and speed. Although there is extensive research on drivers’ responses to yellow traffic signals, the examination has been conducted from a traditional regression-based approach, which does not necessary provide the underlying relations and patterns among the sampled data. In this paper, we exploit the benefits of both classical statistical inference and data mining techniques to identify the a priori relationships among main effects, non-linearities, and interaction effects. Results suggest that novice (16-17 years) and young drivers’ (18-25 years) have heightened yellow light running risk while distracted by a cell phone conversation. Driver experience captured by age has a multiplicative effect with distraction, making the combined effect of being inexperienced and distracted particularly risky. Overall, distracted drivers across most tested groups tend to reduce the propensity of yellow light running as the distance to stop line increases, exhibiting risk compensation on a critical driving situation.

Tech-Savvy Youth and Participatory Research in “iScapes”

This chapter provides a theoretically and empirically grounded discussion of participatory research methodologies with respect to investigating the dynamic and evolving phenomenon of young people constructing identities and social relations in “iScapes”. We coin the term iScapes to refer to the online/offline interconnectedness of spaces in the fabric of everyday life. Specifically, we offer a critical analysis of the participatory research methods we used in our own research project to understand the ways in which high school students use new media and information communication technologies (ICTs) to construct identities, form social relations, and engage in creative practices as part of their everyday lives. The chapter concludes with reflexive deliberations on our approach to participatory research that may benefit other researchers who share a similar interest in youth and new media.

Confucius institutes and the rise of china

Abstract: Since 2004 China has set up over 700 Confucius Institutes and Confucius Classrooms around the world to promote its language and culture and thereby to shape its image. Despite this impressive number Confucius Institutes are surprisingly understudied, especially in terms of their actual structure, operation mode and activities. This paper uses German Confucius Institutes as a case study to bridge this gap. It first discusses the concepts of public and cultural diplomacy and culture institutes as a conceptual tool to analyze Confucius Institutes. It then turns to the case study to provide empirical data to better understand this instrument of China’s image shaping efforts. It argues that Confucius Institutes are connected to the rise of China and a unique member of the family of national culture institutes.

New graduate occupational therapists feelings of preparedness for practice in Australia and Aotearoa/New Zealand

Aim The development of competent future allied health professionals through academic programmes, professional support and practical education is continually evolving. The aim of this study was to explore the feelings of newly graduated occupational therapists in Australia and Aotearoa/New Zealand regarding their education and work preparedness. Methods Newly graduated occupational therapists from Australia (n = 178) and Aotearoa/New Zealand (n = 53) who had completed their occupational therapy studies in 2007 were recruited. Participants completed an online survey which explored their preparedness for work; based on professional competencies. Results Most newly graduated occupational therapists felt somewhat prepared for practice. However, only 17.1% of Australian new graduates, and even fewer (8.5%) of Aotearoa/New Zealand new graduates felt very well prepared. Participants felt more prepared for the competencies required for ‘managing inwards’ (including interpersonal skills) and less prepared for those required for ‘managing outwards’ (including evidence-based practice). Conclusions This study provides the first international comparison into the feelings of competence and preparedness for practice of new graduates of occupational therapy from Australia and Aotearoa/New Zealand. Given the importance of competencies, such as evidence-based practice to the progress of the profession, there is a need to further explore methods to increase feelings of preparedness in these areas.

Fans teaching fans how to consume : the role of ritual in the consumption of entertainment

The status of entertainment as both a dimension of human culture, and a booming global industry is increasing. Given more recent consumer-centric definitions of entertainment, the entertainment consumer has grown in prominence and is now coming under closer scrutiny. However viewing entertainment consumers as always behaving in a similar fashion towards entertainment as to other products may be selling them short. For a start, entertainment consumers can exhibit a strong loyalty towards their favourite entertainment products that is the envy of the marketing world. Academic researchers and marketers who are keen to investigate entertainment consumers would benefit from a theoretical base from which to commence. This essay therefore, takes a consumer-oriented focus in defining entertainment and conceptualises a model of entertainment consumption. In approaching the study of entertainment one axiomatic question remains: how should we define it? Richard Dyer notes that, considering that the category of entertainment can include – by its own definition in the song ‘That’s entertainment!’ – everything from Hamlet and Oedipus Rex to ‘the clown with his pants falling down’ and ‘the lights on the lady in tights’, it doesn’t make much sense to try to define entertainment as being marked by particular textual features (as is done, for example, by Avrich, 2002). Dyer’s position is rather that ‘entertainment is not so much a category of things as an attitude towards things’ (Dyer, 1973: 9). He traces the modern conception of entertainment back to the writings of Molière. This writer defended the purpose of his plays against attacks from the church that they were not sufficiently edifying by insisting that, as entertainments he had no interest in edifying audiences – his ‘real purpose …was to provide people pleasure – and the definition of that was to be decided by “the people”’(Dyer, 1973: 9). In my own discipline of Marketing this approach has been embraced – Kaser and Oelkers, for example, define entertainment as ‘whatever people are willing to spend their money and spare time viewing’ (2008, 18). That is the approach taken in this paper, where I see entertainment as ‘consumer-driven culture’ (McKee and Collis, 2009) – a definition that is closely aligned with the marketing concept. Within a marketing framework I explore what the consumption of entertainment can tell us about the relationships between consumers and culture more generally. For entertainment offers an intriguing case study, and is often consumed in ways that challenge many of our assumptions about marketing and consumer behaviour.