Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Lesser-known worlds : bridging the telematic flows with located human experience through game design

This paper represents a new theorization of the role of location-based games (LBGs) as potentially playing specific roles in peoples’ access to the culture of cities [22]. A LBG is a game that employs mobile technologies as tools for game play in real world environments. We argue that as a new genre in the field of mobile entertainment, research in this area tends to be preoccupied with the newness of the technology and its commercial possibilities. However, this overlooks its potential to contribute to cultural production. We argue that the potential to contribute to cultural production lies in the capacity of these experiences to enhance relationships between specific groups and new urban spaces. Given that developers can design LBGs to be played with everyday devices in everyday environments, what new creative opportunities are available to everyday people?

Professional ethics : the IT experience

IT professionals work in an environment which is under continual innovation, exerts a global influence and yet is relatively young. In such a context, how can professionals be effectively supported in their ethical practice? IT professional ethics has predominantly focussed on external standards or internal reasoning. However, attention also has to be paid to professionals’ experience of ethics, which influences how they interpret standards and construct reasoning. A comprehensive experience of ethics will embrace the professional’s inner circle, their employer, their client and humanity. In order to promote such a comprehensive view, we need to re-conceptualise a) the IT discipline, focussing on information users; b) professional ethics, adopting other-centred attitudes; and c) professional development, pursuing a change in lived experience. This book is written for those interested in professional ethics (practitioners, educators, professional bodies and employers), especially in the computing field.

New routes for the field trip

As with the broader field of education research, most writing on the subject of school excursions and field trips has centred around progressive/humanist concerns for building pupil’s self-esteem and for the development of the ‘whole child’. Such research has also stressed the importance of a broad, grounded, and experiential curriculum - as exemplified by subjects containing these extra-school activities - as well as the possibility of strengthening the relationship between student and teacher. Arguing that this approach to the field trip is both exhausted of ideas and conceptually flawed, this paper proposes some alternate routes into the area for the prospective researcher. First, it is argued that by historicising the subject matter, it can be seen that school excursions are not simply the product of the contemporary humanist desire for diverse and fulfilling educational experiences, rather they can, in part, be traced to eighteenth century beliefs among the English gentry that travel formed a crucial component of a good education, to the advent of an affordable public rail system, and to school tours associated with the Temperance movement. Second, field trips can be understood from within the associated framework of concerns over the governance of tourism and the organisation of disciplinary apparatuses for the production of an educated and regulated citizenry. Far from being a simple learning experience, museums and art galleries form part of a complex of disciplinary and power relations designed to produce a populace with very specific capacities, aspirations and styles of public conduct. Finally, rather than allowing children ‘freedom’ from the constraints of the classroom, on the contrary, through the medium of the field-trip, children can become accustomed to having their activities governed in the broader domain of the generalised community . School excursions thereby constitute an effective tactic through which young people have their conduct managed, and their social and scholastic identities shaped and administered.

Providing innovative planning education experience : teaching regional planning in an international context

Rapidly changing economic, social, and environmental conditions have created a need for urban and regional planning practitioners who are resilient, innovative, and able to cope with the increasingly complex and cosmopolitan nature of major metropolitan areas. This need should be reflected in planning education that allows students to experience a diverse range of approaches to problems and challenges, and that exposes students to the diverse array of perspectives on planning issues. This paper investigates the outcomes of a collaborative regional planning exercise organised jointly by planning academics from both Queensland University of Technology and the International Islamic University of Malaysia, and involving planning students from both universities. The regional planning exercise consisted of a regional appraisal and report topics of the area under investigation, Klang Valley – Kuala Lumpur, Malaysia. It culminated with the presentation of regional development strategies for the area, with a field trip to Malaysia being the cornerstone of the project. The collaborative exercise involved a series of workshops and seminars organised locally, in which both Australian and Malaysian planning students participated, as well as meetings with local and federal planning officials, and also a forum for Young Planners of Australian and Malaysian Planning Institutes. The experience attempted to bridge the teaching of theoretical concepts of regional planning and development and the regional, more professional knowledge of planning practice, as it relates to specific political, institutional and cultural contexts. A survey of participating students, from both Queensland University of Technology and the International Islamic University of Malaysia, highlights the benefits of such project in terms of leaning experience and exposure to different cultural contexts.

Emotional experience with portable interactive devices

This paper reports on a six month longitudinal study exploring people’s personal and social emotional experience with Portable Interactive Devices (PIDs). The study is concerned with the experience design approach and based on the theoretical framework of Activity Theory. The focus is on emotional experiences and how artefacts mediate and potentially enhance this experience. The outcomes of the study identified interesting aspects of PID interaction. Findings revealed people interact with PIDs emotionally both at a personal and a social level, supporting previous studies. Further, the social level impacts significantly on the emotional experience attained. If negative social experiences exceeded negative personal experiences the emotional experience was constant over six months. If negative personal experiences surpassed negative social experiences the emotional experience was varied over six months. The findings are discussed in regards to their significance to the field of design, their implication for future PID design and future research directions.

Passenger experience in an airport : an activity-centred approach

An airport is one of the largest and most complex systems in modern society. Observational field studies have been conducted to investigate passenger experiences in, and interactions within, an international airport. Based on these studies, this paper discusses how activities mediate people’s experiences in the airport. For example, moving through the security screening process is discussed from both passenger and staff perspectives. The applied coding scheme ensured research rigor. The findings illustrate that passenger activities are complex and shared, and only partially supported by current terminal design. Thus, this research has the potential to impact on airport design to facilitate passenger flow through airport precincts.

Field and Service Robotics Results of the 5th International Conference

The 5th International Conference on Field and Service Robotics (FSR05) was held in Port Douglas, Australia, on 29th - 31st July 2005, and brought together the worlds' leading experts in field and service automation. The goal of the conference was to report and encourage the latest research and practical results towards the use of field and service robotics in the community with particular focus on proven technology. The conference provided a forum for researchers, professionals and robot manufacturers to exchange up-to-date technical knowledge and experience. Field robots are robots which operate in outdoor, complex, and dynamic environments. Service robots are those that work closely with humans, with particular applications involving indoor and structured environments. There are a wide range of topics presented in this issue on field and service robots including: Agricultural and Forestry Robotics, Mining and Exploration Robots, Robots for Construction, Security & Defence Robots, Cleaning Robots, Autonomous Underwater Vehicles and Autonomous Flying Robots. This meeting was the fifth in the series and brings FSR back to Australia where it was first held. FSR has been held every 2 years, starting with Canberra 1997, followed by Pittsburgh 1999, Helsinki 2001 and Lake Yamanaka 2003.

Is length of experience an appropriate criterion to identify level of expertise?

Clinical experience plays an important role in the development of expertise, particularly when coupled with reflection on practice. There is debate, however, regarding the amount of clinical experience that is required to become an expert. Various lengths of practice have been suggested as suitable for determining expertise, ranging from five years to 15 years. This study aimed to investigate the association between length of experience and therapists’ level of expertise in the field of cerebral palsy with upper limb hypertonicity using an empirical procedure named Cochrane–Weiss–Shanteau (CWS). The methodology involved re-analysis of quantitative data collected in two previous studies. In Study 1, 18 experienced occupational therapists made hypothetical clinical decisions related to 110 case vignettes, while in Study 2, 29 therapists considered 60 case vignettes drawn randomly from those used in Study 1. A CWS index was calculated for each participant's case decisions. Then, in each study, Spearman's rho was calculated to identify the correlations between the duration of experience and level of expertise. There was no significant association between these two variables in both studies. These analyses corroborated previous findings of no association between length of experience and judgemental performance. Therefore, length of experience may not be an appropriate criterion for determining level of expertise in relation to cerebral palsy practice.

Getting that piece of paper : mental health nurses' experience of undertaking doctoral studies in Victoria, Australia

The aim of this study was to explore the experience of mental health nurses undertaking doctoral studies. The study was conducted in Victoria, Australia. A descriptive exploratory approach to inquiry was used for this study. Participants were mental health nurses who had successfully completed a doctoral qualification. Eligibility for inclusion required participants to be residing in Victoria (irrespective of where their doctoral studies were undertaken) and to have conducted their research within the domain of mental health and/or currently employed in the field of mental health nursing. Of the 20 potential participants invited, 16 accepted the invitation. Five emergent themes were explicated from narrative analyses. These themes were being a trail blazer, positioning for professional advancement, achieving a balance between competing priorities, maintaining a commitment to the development of the profession, and a point of affirmation. An understanding of the experience of undertaking doctoral studies can be used to influence the development of strategies to encourage more mental health nurses to consider undertaking a doctoral degree.

Work integrated learning as a component of the capstone experience in undergraduate law

Background: The “Curriculum renewal in legal education” project has been funded by the Australian Learning and Teaching Council with the core objectives being the articulation of a set of final year curriculum design principles, and the development of a model of a transferable final year program. Through these principles and the development of the model, it is anticipated that the final year experience for law students will provide greater opportunity for them to understand the relevance of their learning, and will enhance their capacity to make decisions regarding their career path. Discussion / Argument: This paper reports on the project’s progress to date, and presents an argument for the inclusion of work integrated learning (WIL) as a component of the final year experience in undergraduate law programs. The project has identified that the two principal objectives of capstone experiences are to provide closure and to facilitate transition to post-university life. Reflective practice and Bruner’s spiral curriculum model are the central theoretical foundations by which these objectives can be achieved. Experiential learning is also increasingly seen as an essential element of a capstone experience. WIL is consistent with the objectives of capstones in focusing on the transition to professional practice and providing opportunities for reflection. However, the ability of WIL to meet all of the objectives of capstones, particularly closure and integration, may be limited. Conclusions / Implications: The paper posits that while WIL should be considered as a potential component of a capstone experience, educators should ensure that WIL is not equated with a capstone experience unless it is carefully designed to ensure that all of the objectives of capstones are met. Keywords: Work-integrated learning, capstone, final year experience, law

Mobile phones in PNG villages : an island village experience

As a new communication technology expands in a disadvantaged, rural area of a developing country, changes take place in the lives of the people in the area. The paper examines the introduction of mobile telephony into a rural village in Papua New Guinea, and contains findings from field research conducted in February 2009. The analysis is undertaken through a social lens, providing an understanding of the roles of mobile phones in this community by foregrounding the feelings, thoughts and attitudes expressed by the village people. This in turn enables a deeper understanding of the sociological effects related to the uptake of mobile telephony.

Emotional experience with portable health devices

This paper reports on a six month longitudinal study exploring people’s personal and social emotional experience with health related portable interactive devices (PIDs). The focus is on emotions and how health PIDs mediate this experience in everyday contexts. The study reported here is an extension of a previous experiment conducted by the authors exploring media related PIDs [1]. The findings identified interesting aspects of health device interaction. Findings revealed people interact with health PIDs emotionally both at a personal and a social level. However, in contrast to media PIDs, participants reported significantly less social experiences than personal experiences. Nevertheless, the social level plays an important role such that negative social experiences had a significant influence on the perceived emotional experience over the course of six months. When no negative social experiences were reported the emotional experience over the course of six months became neutral. The findings are discussed in regards to their significance to the field of design, their implication for future health PID design and future research directions.