Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

Australian universities and the challenges of internationalization

In a little over twenty years, Australia has succeeded in developing an industry in international education worth $15.5 billion Australian dollars. Most universities engaged in this industry see themselves as integrating an international, intercultural or global dimension into teaching, research and service. We examine the internationalization challenges faced by Australia's universities, and explore how curriculum and mobility are understood by academics interviewed at two case study universities.

How can partnerships between the universities and schools exploit new opportunities for pedagogies at the intersection of the arts/design and the sciences?

Driven by information accessibility-on-demand provided by the internet, education modes are changing from a teacher-led approach focused on content delivery and assessible outcomes, to a learner-based approach encouraging self-directed, peer-tutored, and cooperative learning. New pedagogies are required to extend learning beyond the classroom and traditional subject areas such as contemporary arts, in alignment with the cross disciplinary priorities of the Australian Curriculum and values of the International Baccalaureate Organisation. This research explores how partnerships with universities and cultural organisations are implicated in the generation of these new forms of pedagogy and contribute to the field of educational research within the context of Education Queensland’s Framework For Gifted Education. In particular, this paper explores a new pedagogical framework for highly capable year five to nine Queensland state school students at the intersection of arts, design and the sciences, which has arisen from an explicit secondary/ tertiary partnership between the Queensland University of Technology Creative Industries Faculty and Precincts and the Queensland Academies Young Scholars Program. The Young Scholars Program offers experiences in the International Baccalaureate and Australian Curriculum contexts to enhance outcomes via global understanding, unique industry partnerships and 21st century pedagogical innovation based not on 'content' but tacit/experiential learning concepts including immersive, creative, intellectual and social strategies. These strategies for highly capable students are centred around authentic opportunities, primary resources, transdisciplinary learning and relationships with likeminded peers including tertiary arts, design and STEM educators and students, professionals and researchers. The presentation details case studies which are hands-on real time workshops involving inquiry based challenges in the arts, design and sciences, mathematics, history, creative writing and other disciplines, with content drawn from collections from public institutions, academic research and tertiary pedagogy. Both programs implicate student collaboration and creative production as methodology/data capture for ongoing action research, in alignment with the Framework For Gifted Education’s emphasis on evidence-based practices. They also challenge gifted students “to continue their development through curricular activities that require depth of study, complexity of thinking, fast pace of learning, high-level skills development and/or creative and critical thinking (e.g. through independent investigations, tiered tasks, diverse real-world applications, mentors)”(Education Queensland, 2011:3). This presentation highlights the strengths of the ongoing collaboration between QUT Creative industries Faculty and Queensland Academies, which not only provides successful extra curricular activities for gifted students towards a place in the International Baccalaureate Program, but also provides mentoring opportunities for tertiary students in their field of endeavor to assist with their own learning, and unique research opportunities for the Faculty as it focuses on excellence in arts, design and creative education and research. Education Queensland.(2011). Framework For Gifted Education Revised Edition 2011 (accessed Nov 19 2011)

The ZMET Technique: A New Paradigm for Improving Marketing and Marketing Research

For decades, marketing and marketing research have been based on a concept of consumer behaviour that is deeply embedded in a linear notion of marketing activities. With increasing regularity, key organising frameworks for marketing and marketing activities are being challenged by academics and practitioners alike. In turn, this has led to the search for new approaches and tools that will help marketers understand the interaction among attitudes, emotions and product/brand choice. More recently, the approach developed by Harvard Professor, Gerald Zaltman, referred to as the Zaltman Metaphor Elicitation Technique (ZMET) has gained considerable interest. This paper seeks to demonstrate the effectiveness of this alternative qualitative method, using a non-conventional approach, thus providing a useful contribution to the qualitative research area.

Bridging technical and HCI research : creating usable ubiquitous computing

This paper describes methods used to support collaboration and communication between practitioners, designers and engineers when designing ubiquitous computing systems. We tested methods such as “Wizard of Oz” and design games in a real domain, the dental surgery, in an attempt to create a system that is: affordable; minimally disruptive of the natural flow of work; and improves human-computer interaction. In doing so we found that such activities allowed the practitioners to be on a ‘level playing ground’ with designers and engineers. The findings we present suggest that dentists are willing to engage in detailed exploration and constructive critique of technical design possibilities if the design ideas and prototypes are presented in the context of their work practice and are of a resolution and relevance that allow them to jointly explore and question with the design time. This paper is an extension of a short paper submitted to the Participatory Design Conference, 2004.

Literacy and identity : examining the metaphors in history and contemporary research

In this review, the authors interrogate the recent identity turn in literacy studies by asking the following: How do particular views of identity shape how researchers think about literacy and, conversely, how does the view of literacy taken by a researcher shape meanings made about identity? To address this question, the authors review various ways of conceptualizing identity by using five metaphors for identity documented in the identity literature: identity as (1) difference, (2) sense of self/subjectivity, (3) mind or consciousness, (4) narrative, and (5) position. Few literacy studies have acknowledged this range of perspectives on and views for conceptualizing identity and yet, subtle differences in identity theories have widely different implications for how one thinks about both how literacy matters to identity and how identity matters to literacy. The authors offer this review to encourage more theorizing of both literacy and identity as social practices and, most important, of how the two breathe life into each other.

Sampling perceptions; testing reality : an evidence-based approach to measurably improve information literacy and student research skills

Do commencing students possess the level of information literacy (IL) knowledge and skills they need to succeed at university? What impact does embedding IL within the engineering and design curriculum have? This paper reports on the self-perception versus the reality of IL knowledge and skills, across a large cohort of first year built environment and engineering students. Acting on the findings of this evaluation, the authors (a team of academic librarians) developed an intensive IL skills program which was integrated into a faculty wide unit. Perceptions, knowledge and skills were re-evaluated at the end of the semester to determine if embedded IL education made a difference. Findings reveal that both the perception and reality of IL skills were significantly and measurably improved.

The impact of “empirical facts” on legal scholarship and legal research training

Lawyers have traditionally viewed law as a closed system, and doctrinal research has been the research methodology used most widely in the profession. This reflects traditional concepts of legal reasoning. There is a wealth of reliable and valid social science data available to lawyers and judges. Judges in fact often refer to general facts about the world, society, institutions and human behaviour (‘empirical facts’). Legal education needs to prepare our students for this broader legal context. This paper examines how ‘empirical facts’ are used in Australian and other common law courts. Specifically, the paper argues that there is a need for enhanced training in non-doctrinal research methodologies across the law school curriculum. This should encompass a broad introduction to social science methods, with more attention being paid to a cross-section of methodologies such as content analysis, comparative law and surveys that are best applied to law.