Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Review article : ecological approach in studying the relation of perception-action : review of the theoretical and empirical data

In daily activities people are using a number of available means for the achievement of balance, such as the use of hands and the co-ordination of balance. One of the approaches that explains this relationship between perception and action is the ecological theory that is based on the work of a) Bernstein (1967), who imposed the problem of ‘the degrees of freedom’, b) Gibson (1979), who referred to the theory of perception and the way which the information is received from the environment in order for a certain movement to be achieved, c) Newell (1986), who proposed that movement can derive from the interaction of the constraints that imposed from the environment and the organism and d) Kugler, Kelso and Turvey (1982), who showed the way which “the degrees of freedom” are connected and interact. According to the above mentioned theories, the development of movement co-ordination can result from the different constraints that imposed into the organism-environment system. The close relation between the environmental and organismic constraints, as well as their interaction is responsible for the movement system that will be activated. These constraints apart from shaping the co-ordination of specific movements can be a rate limiting factor, to a certain degree, in the acquisition and mastering of a new skill. This frame of work can be an essential tool for the study of catching an object (e.g., a ball). The importance of this study becomes obvious due to the fact that movements that involved in catching an object are representative of every day actions and characteristic of the interaction between perception and action.

Consumers' emotional appraisals and action tendencies arising from mobile viral marketing

This study examines consumers' emotional responses to receiving viral mobile marketing communications in comparison to receiving mobile marketing communications where permission has not been given. The study also examines the relationship between these experienced emotions and what action tendencies consumers might consider as a result of these emotions, as well as how they attribute causality for their emotions. Using scenarios in an experimental design, the findings show that there are differences in consumer emotions as a result of the two marketing approaches. The findings also identify relationships between consumers' causal attributions and action tendencies in relation to themselves, the friend sending the viral m-marketing communication and the company involved.

Rural and remote road safety study : final report

• Introduction: Concern and action for rural road safety is relatively new in Australia in comparison to the field of traffic safety as a whole. In 2003, a program of research was begun by the Centre for Accident Research and Road Safety - Queensland (CARRS-Q) and the Rural Health Research Unit (RHRU) at James Cook University to investigate factors contributing to serious rural road crashes in the North Queensland region. This project was funded by the Premier’s Department, Main Roads Department, Queensland Transport, QFleet, Queensland Rail, Queensland Ambulance Service, Department of Natural Resources and Queensland Police Service. Additional funding was provided by NRMA Insurance for a PhD scholarship. In-kind support was provided through the four hospitals used for data collection, namely Cairns Base Hospital, The Townsville Hospital, Mount Isa Hospital and Atherton Hospital.----- The primary aim of the project was to: Identify human factors related to the occurrence of serious traffic incidents in rural and remote areas of Australia, and to the trauma suffered by persons as a result of these incidents, using a sample drawn from a rural and remote area in North Queensland.----- The data and analyses presented in this report are the core findings from two broad studies: a general examination of fatalities and casualties from rural and remote crashes for the period 1 March 2004 until 30 June 2007, and a further linked case-comparison study of hospitalised patients compared with a sample of non-crash-involved drivers.----- • Method: The study was undertaken in rural North Queensland, as defined by the Australian Bureau of Statistics (ABS) statistical divisions of North Queensland, Far North Queensland and North-West Queensland. Urban areas surrounding Townsville, Thuringowa and Cairns were not included. The study methodology was centred on serious crashes, as defined by a resulting hospitalisation for 24 hours or more and/or a fatality. Crashes meeting this criteria within the North Queensland region between 1 March 2004 and 30 June 2007 were identified through hospital records and interviewed where possible. Additional data was sourced from coroner’s reports, the Queensland Transport road crash database, the Queensland Ambulance Service and the study hospitals in the region.----- This report is divided into chapters corresponding to analyses conducted on the collected crash and casualty data.----- Chapter 3 presents an overview of all crashes and casualties identified during the study period. Details are presented in regard to the demographics and road user types of casualties; the locations, times, types, and circumstances of crashes; along with the contributing circumstances of crashes.----- Chapter 4 presents the results of summary statistics for all casualties for which an interview was able to be conducted. Statistics are presented separately for drivers and riders, passengers, pedestrians and cyclists. Details are also presented separately for drivers and riders crashing in off-road and on-road settings. Results from questionnaire data are presented in relation to demographics; the experience of the crash in narrative form; vehicle characteristics and maintenance; trip characteristics (e.g. purpose and length of journey; periods of fatigue and monotony; distractions from driving task); driving history; alcohol and drug use; medical history; driving attitudes, intentions and behaviour; attitudes to enforcement; and experience of road safety advertising.----- Chapter 5 compares the above-listed questionnaire results between on-road crash-involved casualties and interviews conducted in the region with non-crash-involved persons. Direct comparisons as well as age and sex adjusted comparisons are presented.----- Chapter 6 presents information on those casualties who were admitted to one of the study hospitals during the study period. Brief information is given regarding the demographic characteristics of these casualties. Emergency services’ data is used to highlight the characteristics of patient retrieval and transport to and between hospitals. The major injuries resulting from the crashes are presented for each region of the body and analysed by vehicle type, occupant type, seatbelt status, helmet status, alcohol involvement and nature of crash. Estimates are provided of the costs associated with in-hospital treatment and retrieval.----- Chapter 7 describes the characteristics of the fatal casualties and the nature and circumstances of the crashes. Demographics, road user types, licence status, crash type and contributing factors for crashes are presented. Coronial data is provided in regard to contributing circumstances (including alcohol, drugs and medical conditions), cause of death, resulting injuries, and restraint and helmet use.----- Chapter 8 presents the results of a comparison between casualties’ crash descriptions and police-attributed crash circumstances. The relative frequency of contributing circumstances are compared both broadly within the categories of behavioural, environmental, vehicle related, medical and other groupings and specifically for circumstances within these groups.----- Chapter 9 reports on the associated research projects which have been undertaken on specific topics related to rural road safety.----- Finally, Chapter 10 reports on the conclusions and recommendations made from the program of research.---- • Major Recommendations : From the findings of these analyses, a number of major recommendations were made: + Male drivers and riders - Male drivers and riders should continue to be the focus of interventions, given their very high representation among rural and remote road crash fatalities and serious injuries.----- - The group of males aged between 30 and 50 years comprised the largest number of casualties and must also be targeted for change if there is to be a meaningful improvement in rural and remote road safety.----- + Motorcyclists - Single vehicle motorcycle crashes constitute over 80% of serious, on-road rural motorcycle crashes and need particular attention in development of policy and infrastructure.----- - The motorcycle safety consultation process currently being undertaken by Queensland Transport (via the "Motorbike Safety in Queensland - Consultation Paper") is strongly endorsed. As part of this process, particular attention needs to be given to initiatives designed to reduce rural and single vehicle motorcycle crashes.----- - The safety of off-road riders is a serious problem that falls outside the direct responsibility of either Transport or Health departments. Responsibility for this issue needs to be attributed to develop appropriate policy, regulations and countermeasures.----- + Road safety for Indigenous people - Continued resourcing and expansion of The Queensland Aboriginal Peoples and Torres Strait Islander Peoples Driver Licensing Program to meet the needs of remote and Indigenous communities with significantly lower licence ownership levels.----- - Increased attention needs to focus on the contribution of geographic disadvantage (remoteness) factors to remote and Indigenous road trauma.----- + Road environment - Speed is the ‘final common pathway’ in determining the severity of rural and remote crashes and rural speed limits should be reduced to 90km/hr for sealed off-highway roads and 80km/hr for all unsealed roads as recommended in the Austroads review and in line with the current Tasmanian government trial.----- - The Department of Main Roads should monitor rural crash clusters and where appropriate work with local authorities to conduct relevant audits and take mitigating action. - The international experts at the workshop reviewed the data and identified the need to focus particular attention on road design management for dangerous curves. They also indicated the need to maximise the use of audio-tactile linemarking (audible lines) and rumble strips to alert drivers to dangerous conditions and behaviours.----- + Trauma costs - In accordance with Queensland Health priorities, recognition should be given to the substantial financial costs associated with acute management of trauma resulting from serious rural and remote crashes.----- - Efforts should be made to develop a comprehensive, regionally specific costing formula for road trauma that incorporates the pre-hospital, hospital and post-hospital phases of care. This would inform health resource allocation and facilitate the evaluation of interventions.----- - The commitment of funds to the development of preventive strategies to reduce rural and remote crashes should take into account the potential cost savings associated with trauma.----- - A dedicated study of the rehabilitation needs and associated personal and healthcare costs arising from rural and remote road crashes should be undertaken.----- + Emergency services - While the study has demonstrated considerable efficiency in the response and retrieval systems of rural and remote North Queensland, relevant Intelligent Transport Systems technologies (such as vehicle alarm systems) to improve crash notification should be both developed and evaluated.----- + Enforcement - Alcohol and speed enforcement programs should target the period between 2 and 6pm because of the high numbers of crashes in the afternoon period throughout the rural region.----- + Drink driving - Courtesy buses should be advocated and schemes such as the Skipper project promoted as local drink driving countermeasures in line with the very high levels of community support for these measures identified in the hospital study.------ - Programs should be developed to target the high levels of alcohol consumption identified in rural and remote areas and related involvement in crashes.----- - Referrals to drink driving rehabilitation programs should be mandated for recidivist offenders.----- + Data requirements - Rural and remote road crashes should receive the same quality of attention as urban crashes. As such, it is strongly recommended that increased resources be committed to enable dedicated Forensic Crash Units to investigate rural and remote fatal and serious injury crashes.----- - Transport department records of rural and remote crashes should record the crash location using the national ARIA area classifications used by health departments as a means to better identifying rural crashes.----- - Rural and remote crashes tend to be unnoticed except in relatively infrequent rural reviews. They should receive the same level of attention and this could be achieved if fatalities and fatal crashes were coded by the ARIA classification system and included in regular crash reporting.----- - Health, Transport and Police agencies should collect a common, minimal set of data relating to road crashes and injuries, including presentations to small rural and remote health facilities.----- + Media and community education programmes - Interventions seeking to highlight the human contribution to crashes should be prioritised. Driver distraction, alcohol and inappropriate speed for the road conditions are key examples of such behaviours.----- - Promotion of basic safety behaviours such as the use of seatbelts and helmets should be given a renewed focus.----- - Knowledge, attitude and behavioural factors that have been identified for the hospital Brief Intervention Trial should be considered in developing safety campaigns for rural and remote people. For example challenging the myth of the dangerous ‘other’ or ‘non-local’ driver.----- - Special educational initiatives on the issues involved in rural and remote driving should be undertaken. For example the material used by Main Roads, the Australian Defence Force and local initiatives.

Middle years teacher education : new programs and research directions

Teacher education programs focussing on the development of specialist teachers for 'the middle years' have proliferated in Australian universities in recent years. This paper provides some insights into middle years' teacher education programs at the University of Queensland, Edith Cowan and Flinders Universities with regard to their: philosophical underpinnings; specific educational context; scope and nature of the program. In addition, some of the research directions and efficacy strategies utilised in conjunction with the programs will be shared, along with some early findings from a longitudinal study in one of the programs. We propose that the pattern of programmatic growth heralds a new time for teacher education, and we speculate about the production of new kinds of teacher identities as graduates take their place in the profession.

Social justice and high-quality human services : visioning the place of a contemporary professional association

The current world situation is plagued by “wicked problems” and a widespread sense of “things are going to get worse”. We confront the almost imponderable consequences of global habitat destruction and climate change, as well as the meltdown of the financial markets with their largely yet to be seen damage to the “real economy”. These things will have considerable negative impacts on the social system and people's lives, particularly the disadvantaged and socially excluded, and require innovative policy and program responses delivered by caring, intelligent, and committed practitioners. These gargantuan issues put into perspective the difficulties that confront social, welfare, and community work today. Yet, in times of trouble, social work and human services tend to do well. For example, although Australian Social Workers and Welfare and Community Workers have experienced phenomenal job growth over the past 5 years, they also have good prospects for future growth and above average salaries in the seventh and sixth deciles, respectively (Department of Education, Employment and Workplace Relations, 2008). I aim to examine the host of reasons why the pursuit of social justice and high-quality human services is difficult to attain in today's world and then consider how the broadly defined profession of social welfare practitioners may collectively take action to (a) respond in ways that reassert our role in compassionately assisting the downtrodden and (b) reclaim the capacity to be a significant body of professional expertise driving social policy and programs. For too long social work has responded to the wider factors it confronts through a combination of ignoring them, critiquing from a distance, and concentrating on the job at hand and our day-to-day responsibilities. Unfortunately, “holding the line” has proved futile and, little by little, the broad social mandate and role of social welfare has altered until, currently, most social programs entail significant social surveillance of troublesome or dangerous groups, rather than assistance. At times it almost seems like the word “help” has been lost in the political and managerial lexicon, replaced by “manage” and “control”. Our values, beliefs, and ethics are under real threat as guiding principles for social programs.

Kids, counsellors and troubles-telling : morality-in-action in talk on an Australian children’s helpline

This chapter investigates one instance of ‘morality-in-action’, which transpires when children describe their troubles to the adult counsellors at Kids Help Line, an Australian national helpline that deals specifically with callers aged approximately 5-18 years. We focus, in particular, on how a young female caller who has forged a medical certificate in relation to a problem with school attendance, determines both what to report, and how this should be disclosed. Throughout the call, the moral implications of the troubles talk are delicately managed by both caller and counsellor. The call takes the form of an extended story (Labov & Waletzky, 1997) that includes a preface (‘I have some problems at school’), an orientation (“I was sick, went to the doctor, stayed home”), a complicating action (“I went back to school and photocopied my certificate from last time”), result (“I got caught”) and evaluation (“I don’t know why it happened”). As the account unfolds, we observe how both the student and counsellor seek to make sense of these actions. While this account is partly about deception, both the caller and counsellor delicately sidestep naming this action, precluding this implication. For example, the counsellor lets stand the caller’s main assessment of the trouble. He simply asks, “so what happened then,” when the caller reports that her forgery was discovered. The caller, from the very beginning of the call, seeks to find out why she could have done this, “you see I don’t know why it happened”. As the call unfolds, the counsellor follows the opening provided by the caller and they put forward motives for consideration. By agreeing that the motives are to be explored, the act takes on a character other than deception.

The effectiveness of designated driver programs

Designated driver programs aim to reduce alcohol related crashes by encouraging and facilitating a safe means of transport for those who have been drinking and by influencing attitudes and knowledge. This review discusses the use and effectiveness of designated driver programs in preventing drink driving and ultimately reducing alcohol related road trauma. The limitations of studies examining designated driver programs and recommendations for further research are also discussed. The available evidence suggests that while designated driver campaigns can successfully increase the awareness and use of designated drivers, it is less clear whether these programs lead to a reduction in drink driving and/or alcohol related crashes. Differences in the way that designated driver programs have historically been implemented may account for the inconsistent evidence for their effectiveness in reducing drink driving. There are also a variety of methodological problems relating to the evaluation of designated driver programs which need to be addressed by future research.

Schools' guide : How to select providers of road safety education programs for senior school students

Road safety education is not just about safe driving. Best practice road safety education seeks to improve knowledge and change attitudes relating to being safe, and making sure others are safe on the road. Typical topics might include: • Strengthening attitudes toward safe road use behaviours and avoiding risks • Supporting behaviours to ensure others are safe • Promoting knowledge of traffic rules.

Developing capabilities for ongoing learning and change in intermediary programs

In dynamic environments, firms seek to build capabilities which will permit them to become innovation and change ready. Programs offered by intermediaries, while varying greatly in content and format, are designed to support those firms wishing to enhance their competitiveness. Firms which participate in intermediary programs have displayed their willingness to overcome deficiencies or barriers to competitiveness through acquiring knowledge which is external to the firm. This paper reports on interviews with 24 firms who were involved in a MAP or TAP program offered by QMI Solutions. The findings of the research suggest that knowledge intermediaries serve to disrupt organisational paths and in so doing establish mechanisms for ongoing learning and change. They do this first by disrupting the firm with a positive learning experience and also by establishing processes for developing new relationships and access to knowledge which are critical for learning and change. It is the experience of learning through knowledge exchange which can trigger the pursuit of new paths and it is the processes involving new relations and knowledge processing that provides the micro-foundations for ongoing learning and change. This suggests that the role of intermediaries goes well beyond merely knowledge transfer to include longer term effects on the capability of organisations to innovate, which is critical to economic competitiveness and the survival rate of firms.

Facilities management action agenda : the Australian government and industry working together for improvement

This paper provides an overview of the Australian Government’s Facilities Management (FM) Action Agenda as announced in 2004 as a key policy plank designed to facilitate growth of the FM industry. The resulting consultation with industry leaders has seen the criterion and release in April 2005 of the FM Action Agenda’s strategic plan entitled ‘Managing the Built Environment’. This framework, representing a collaboration between the Australian Government, public and private sector stakeholders and Facility Management Association of Australia (FMA Australia) and other allied bodies, sets out to achieve the vision of a more “…productive and sustainable built environment…” through improved innovation, education and standards. The 36 month implementation phase is now underway and will take a multi-pronged approach to enhancing the recognition of the FM industry and removing impediments to its growth with a 20 point action plan across the following platforms: • Innovation – Improved appreciation of facility life cycles, and greater understanding of the key drivers of workplace productivity, and the improved application of information technology. • Education and Training – Improved access to dedicated FM education and training opportunities and creation clear career pathways into the profession. • Regulatory Reform – Explore opportunities to harmonise cross jurisdictional regulatory compliance requirements that have an efficiency impact on FM. • Sustainability – Improved utilization of existing knowledge and the development of tools and opportunities to improve the environmental performance of facilities. Additional information is available at www.fma.com.au

Identifying programs to reduce road trauma to A.C.T. motorcyclists

A broad range of motorcycle safety programs and systems exist in Australia and New Zealand. These vary from statewide licensing and training systems run by government licensing and transport agencies to safety programs run in small communities and by individual rider groups. While the effectiveness of licensing and training has been reviewed and recommendations for improvement have been developed (e.g. Haworth & Mulvihill, 2005), little is known about many smaller or innovative programs, and their potential to improve motorcycle safety in the ACT.

Curriculum mapping of the Spatial Science Program, QUT : what was the cartography journey?

There are currently a number of issues of great importance affecting universities and the way in which their programs are now offered. Many issues are largely being driven top-down and impact both at a university-wide and at an individual discipline level. This paper provides a brief history of cartography and digital mapping education at the Queensland University of Technology (QUT). It also provides an overview of what is curriculum mapping and presents some interesting findings from the program review process. Further, this review process has triggered discussion and action for the review, mapping and embedding of graduate attributes within the spatial science major program. Some form of practical based learning is expected in vocationally oriented degrees that lead to professional accreditation and are generally regarded as a good learning exposure. With the restructure of academic programs across the Faculty of Built Environment and Engineering in 2006, spatial science and surveying students now undertake a formal work integrated learning unit. There is little doubt that students acquire the skills of their discipline (mapping science, spatial) by being immersed in the industry culture- learning how to process information and solve real-world problems within context. The broad theme of where geo-spatial mapping skills are embedded in this broad-based tertiary education course are examined with some focused discussion on the learning objectives, outcomes and examples of some student learning experiences

Comparing the ethical predisposition of university students in five English-speaking countries : an examination of 14 questionable business practices

Recent years have seen intense scrutiny focused on the reported ethical breaches of enterprises across the globe. At the forefront of the accompanying criticism are the actions of giant American firms such as WorldCom, Arthur Anderson, and Enron. However, such deviations from acceptable standards of conduct have not been confined to the American market. Australia endured its era of “corporate excess” in the 1980s [Milton-Smith, 1997]. As a result, a spate of ethics-based research was undertaken in the early 1990s. More recently, China has been identified as a major venue for behavior deemed to be unacceptable, even unsafe. Issues such as counterfeit fashion items, software, and automobile parts have been a concern for several years [Gonzalez, 2007]. Perhaps more disconcerting are the recent recalls of children’s products, many of which were produced for leading toy companies such as Mattel and Fisher-Price, because of the use of dangerous lead-based paint. As one might anticipate, news reports and consumer protection agencies have been quick to condemn any action that falls within the “controversial” category. Indeed, many segments of society characterize such actions as unethical behavior. One result of this increased level of concern is the higher level of attention given to ethics in higher education programs. Even accreditation bodies such as AACSB have virtually mandated the integration of ethics into the curriculum. As a consequence, academicians have ramped up their ethics-based research agendas.