Participatory analysis of mobile diaries to inform the design of ridesharing systems

In many “user centred design” methods, participants are used as informants to provide data but they are not involved in further analysis of that data. This paper investigates a participatory analysis approach in order to identify the strengths and weaknesses of involving participants collaboratively in the requirements analysis process. Findings show that participants are able to use information that they themselves have provided to analyse requirements and to draw upon that analysis for design, producing insights and suggestions that might not have been available otherwise to the design team. The contribution of this paper is to demonstrate an example of a participatory analysis process.

Large scale participatory acoustic sensor data analysis : tools and reputation models to enhance effectiveness

Acoustic sensors play an important role in augmenting the traditional biodiversity monitoring activities carried out by ecologists and conservation biologists. With this ability however comes the burden of analysing large volumes of complex acoustic data. Given the complexity of acoustic sensor data, fully automated analysis for a wide range of species is still a significant challenge. This research investigates the use of citizen scientists to analyse large volumes of environmental acoustic data in order to identify bird species. Specifically, it investigates ways in which the efficiency of a user can be improved through the use of species identification tools and the use of reputation models to predict the accuracy of users with unidentified skill levels. Initial experimental results are reported.

Semi-automated annotation of environmental acoustic recordings

Environmental sensors collect massive amounts of audio data. This thesis investigates computational methods to support human analysts in identifying faunal vocalisations from that audio. A series of experiments was conducted to trial the effectiveness of novel user interfaces. This research examines the rapid scanning of spectrograms, decision support tools for users, and cleaning methods for folksonomies. Together, these investigations demonstrate that providing computational support to human analysts increases their efficiency and accuracy; this allows bioacoustics projects to efficiently utilise their valuable human analysts.

Critically evaluating rural women’s participation and empowerment : An interdisciplinary feminist framework for research and analysis

Community development is increasingly using participatory processes that aim to be inclusive and empowering. However, researchers have found that such processes can have contradictory effects. Australian research has highlighted the significant leadership of rural women in sustainable community and economic development and in the adoption of new communication technologies such as the Internet. A focus on gender in participatory development may therefore lead to more effective programs and policies. This chapter outlines an interdisciplinary feminist framework for critically evaluating the participation and empowerment of rural women. This framework was found effective in evaluating an Australian project that aimed to enhance rural women’s access to communication technologies and to empower its participants. Its multiple theoretical and methodological approaches are outlined. The framework advocates an analysis of diversity and difference and the macro and micro contexts. Some principles and strategies for rural women’s inclusion, participation, empowerment, and for participatory feminist evaluation are outlined.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Co-creating games: A co-evolutionary analysis

ABSTRACT. The phenomenon of consumer co-creation is often framed in terms of whether either economic market forces or socio-cultural non-market forces ultimately dominate. We propose an alternate model of consumer co-creation in terms of co-evolution between markets and non-markets. Our model is based on a recent ethnographic study of a massively multiplayer online game through its development, release and ultimate failure, and cast in terms of two explanatory models: multiple games and social network markets. We conclude that consumer co-creation is indeed complex, but in ways that relate to both emergent market expectations and the evolution of markets, not to the transcendence of markets.

Research Monograph: Building Online Participatory Systems: Towards the Community Based Interactive Environmental Decision Support Systems

The importance of broadening community participation in environmental decision-making is widely recognized and lack of participation in this process appears to be a perennial problem. In this context, there have been calls from some academics for the more extensive use of geographic information systems (GIS) and distance learning technologies, accessible via the Internet, as a possible means to inform and empower communities. However, a number of problems exist. For instance, at present the scope for online interaction between policy-makers and citizens is currently limited. Contemporary web-based environmental information systems suffer from this lack of interactivity on the one hand and on the other hand from the apparent complexity for the lay user. This paper explores the issue of online community participation at the local level and attempts to construct a framework for a new (and potentially more effective) model of online participatory decision-making. The key components, system architecture and stages of such a model are introduced. This model, referred to as a ‘Community Based Interactive Environmental Decision Support System’, incorporates advanced information technologies, distance learning and community involvement tools which will be applied and evaluated in the field through a pilot project in Tokyo in the summer of 2002.

Using reputation management in participatory sensing for data classification

Participatory sensing enables collection, processing, dissemination and analysis of environmental sensory data by ordinary citizens, through mobile devices. Researchers have recognized the potential of participatory sensing and attempted applying it to many areas. However, participants may submit low quality, misleading, inaccurate, or even malicious data. Therefore, finding a way to improve the data quality has become a significant issue. This study proposes using reputation management to classify the gathered data and provide useful information for campaign organizers and data analysts to facilitate their decisions.

Using participatory action research in a community-based initiative addressing complex mental health needs

Objective: This paper describes the first phase of a larger project that utilizes participatory action research to examine complex mental health needs across an extensive group of stakeholders in the community. Method: Within an objective qualitative analysis of focus group discussions the social ecological model is utilized to explore how integrative activities can be informed, planned and implemented across multiple elements and levels of a system. Seventy-one primary care workers, managers, policy-makers, consumers and carers from across the southern metropolitan and Gippsland regions of Victoria, Australia took part in seven focus groups. All groups responded to an identical set of focusing questions. Results: Participants produced an explanatory model describing the service system, as it relates to people with complex needs, across the levels of social ecological analysis. Qualitative themes analysis identified four priority areas to be addressed in order to improve the system's capacity for working with complexity. These included: (i) system fragmentation; (ii) integrative case management practices; (iii) community attitudes; and (iv) money and resources. Conclusions: The emergent themes provide clues as to how complexity is constructed and interpreted across the system of involved agencies and interest groups. The implications these findings have for the development and evaluation of this community capacity-building project were examined from the perspective of constructing interventions that address both top-down and bottom-up processes.

Designerly analysis of a socio-physical design activity

The Making Design and Analysing Interaction track at the Participatory Innovation Conference calls for submissions from ‘Makers’ who will contribute examples of participatory innovation activities documented in video and ‘Analysts’ who will analyse those examples of participatory innovation activity. The aim of this paper is to open up for a discussion within the format of the track of the roles that designers could play in analysing the participatory innovation activities of others and to provide a starting point for this discussion through a concrete example of such ‘designerly analysis’. Designerly analysis opens new analytic frames for understanding participatory innovation and contributes to our understanding of design activities.

Provotypes for participatory innovation

Central to multi-stakeholder processes of participatory innovation is to generate knowledge about ‘users’ and to identify business opportunities accordingly. In these processes of collaborative analysis and synthesis, conflicting perceptions within and about a field of interest are likely to surface. Instead of the natural tendency to avoid these tensions, we demonstrate how tensions can be utilized by embodying them in provocative types (provotypes). Provotypes expose and embody tensions that surround a field of interest to support collaborative analysis and collaborative design explorations across stakeholders. In this paper we map how provotyping contributes to four related areas of contemporary Interaction Design practice. Through a case study that brings together stakeholders from the field of indoor climate, we provide characteristics of design provocations and design guidelines for provotypes for participatory innovation.

"Participation" in participatory design research

This thesis is about defining participation in the context of fostering research cohesion in the field of Participatory Design. The systematic and incremental building of new knowledge is the process by which science and research is advanced. This process requires a certain type of cohesion in the way research is undertaken for new knowledge to be built from the knowledge provided by previous projects and research. To support this process and to foster research cohesion three conditions are necessary. These conditions are: common ground between practitioners, problem-space positioning, and adherence to clear research criteria. The challenge of fostering research cohesion in Participatory Design is apparent in at least four themes raised in the literature: the role of politics within Participatory Design epistemology, the role of participation, design with users, and the ability to translate theory into practice. These four thematic challenges frame the context which the research gap is situated. These themes are also further investigated and the research gap – a general lack of research cohesion – along with one avenue for addressing this gap – a clear and operationalizable definition for participation – are identified. The intended contribution of this thesis is to develop a framework and visual tool to address this research gap. In particular, an initial approximation for a clear and operationalizable definition for participation will be proposed such that it can be used within the field of Participatory Design to run projects and foster research cohesion. In pursuit of this contribution, a critical lens is developed and used to analyse some of the principles and practices of Participatory Design that are regarded as foundational. This lens addresses how to define participation in a way that adheres to basic principles of scientific rigour – namely, ensuring that the elements of a theory are operationalizable, falsifiable, generalizable, and useful, and it also treats participation as a construct rather than treating the notion of participation as a variable. A systematic analysis is performed using this lens on the principles and practices that are considered foundational within the field. From this analysis, three components of the participation construct – impact, influence, and agency – are identified. These components are then broken down into two constituent variables each (six in all) and represented visually. Impact is described as the relationship between the quality and use of information. Influence is described as the relationship between the amount and scope of decision making. Agency is described as the relationship between the motivation of the participant and the solidarity of the group. Thus, as a construct, participation is described as the relationship between a participant’s impact, influence, and agency. In the concluding section, the value of this participation construct is explored for its utility in enhancing project work and fostering research cohesion. Three items of potential value that emerge are: the creation of a visual tool through the representation of these six constituent variables in one image; the elaboration of a common language for researchers based on the six constituent variables identified; and the ability to systematically identify and remedy participation gaps throughout the life of the project. While future research exploring the applicability of the participation construct in real world projects is necessary, it is intended that this initial approximation of a participation construct in the form of the visual tool will serve as the basis for a cohesive and rigorous discussion about participation in Participatory Design.

Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Tech-Savvy Youth and Participatory Research in “iScapes”

This chapter provides a theoretically and empirically grounded discussion of participatory research methodologies with respect to investigating the dynamic and evolving phenomenon of young people constructing identities and social relations in “iScapes”. We coin the term iScapes to refer to the online/offline interconnectedness of spaces in the fabric of everyday life. Specifically, we offer a critical analysis of the participatory research methods we used in our own research project to understand the ways in which high school students use new media and information communication technologies (ICTs) to construct identities, form social relations, and engage in creative practices as part of their everyday lives. The chapter concludes with reflexive deliberations on our approach to participatory research that may benefit other researchers who share a similar interest in youth and new media.

Using social media to create a participatory library service : an Australian study

Public libraries are increasingly using social media in an attempt to meet users in their own spaces. Social media can be useful when used to create a participatory library service – to engage with users. However, there has been little empirical investigation into the success of social media use by public libraries. This article reports on the findings of a research project that explored the use of social media by Australian public libraries. Two organisations participated in case studies that involved interviews, document analysis, and social media observation. To contextualise the use of social media in the case study organisations, a sub study was undertaking involving observation of an additional 24 public libraries across Australia. This article focuses on the findings from the observation sub study. It presents and applies a methodology for classifying social media content to determine whether the sample libraries’ social media use is indicative of a participatory approach to service delivery. This article explores how a range of social media platforms are used by the sample libraries and considers what ‘best practice’ in participatory library service looks like. The two case study organisations’ use of social media is highlighted as exemplary practice.