A brief staff dementia education program : implementation and evaluation

Brief dementia education training programs appear to be effective in improving knowledge about dementia and self-confidence in interacting with patients with dementia. It is recommended that brief dementia training sessions be provided on a regular, on-going basis, particularly in view of frequent staff changes in the acute hospital environment.

Learner-focused evaluation cycles : facilitating learning using feedforward, concurrent and feedback evaluation

There is a growing trend to offer students learning opportunities that are flexible, innovative and engaging. As educators embrace student-centred agile teaching and learning methodologies, which require continuous reflection and adaptation, the need to evaluate students’ learning in a timely manner has become more pressing. Conventional evaluation surveys currently dominate the evaluation landscape internationally, despite recognition that they are insufficient to effectively evaluate curriculum and teaching quality. Surveys often: (1) fail to address the issues for which educators need feedback, (2) constrain student voice, (3) have low response rates and (4) occur too late to benefit current students. Consequently, this paper explores principles of effective feedback to propose a framework for learner-focused evaluation. We apply a three-stage control model, involving feedforward, concurrent and feedback evaluation, to investigate the intersection of assessment and evaluation in agile learning environments. We conclude that learner-focused evaluation cycles can be used to guide action so that evaluation is not undertaken simply for the benefit of future offerings, but rather to benefit current students by allowing ‘real-time’ learning activities to be adapted in the moment. As a result, students become co-producers of learning and evaluation becomes a meaningful, responsive dialogue between students and their instructors.

Evaluating NEXUS: A suicide prevention program for young people from refugee backgrounds (2007 – 2009)

Although suicide deaths in Australia continue to decline since the peak of 2,720 suicide deaths in 1997, youth suicide and self-harm are a major health issue. In 2006, in the 20 to 24 year age group, suicide accounted for approximately 21% of all male deaths and 14% of all female deaths. There is a lack of solid data on the rates of suicide and self-harm among young people from refugee backgrounds. However, this population faces a significant number of post-resettlement stressors that may add to their vulnerability and increase their risk of suicide and self-harm. The NEXUS program is an innovative strategy developed by the Queensland Program of Assistance to Survivors of Torture and Trauma (QPASTT) that aims to reduce risk factors for suicide and self-harm and to promote protective factors among youth from refugee backgrounds living in Brisbane and Toowoomba. QPASTT is a non-government organisation that provides culturally appropriate support services to refugee and humanitarian entrants to Australia. QPASTT’s primary function is to provide counselling, advocacy support and community development activities for survivors of torture and trauma at an individual, family and community level. Since 2002 the NEXUS program has been developed and implemented by QPASTT. Since then, this multi-component program has been funded by the Commonwealth Department of Health and Ageing through the National Suicide Prevention Strategy (NSPS). NSPS funding of local community suicide prevention activities will contribute to the outcomes specified in the strategic framework: Living is for Everyone (LIFE): A framework for prevention of suicide and self-harm in Australia. The focus of this report is the evaluation of the NEXUS program conducted by QPASTT between August 2007 and May 2009.

Retooling Chinese primary school teachers to use technology creatively to promote innovation and problem solving skills in science classrooms

This paper reports on the initial phase of a Professional Learning Program (PLP) undertaken by 100 primary school teachers in China that aimed to facilitate the development of adaptive expertise in using technology to facilitate innovative science teaching and learning such as that envisaged by the Chinese Ministry of Education’s (2010-2020) education reforms. Key principles derived from literature about professional learning and scaffolding of learning informed the design of the PLP. The analysis of data revealed that the participants had made substantial progress towards the development of adaptive expertise. This was manifested not only by advances in the participants’ repertoires of Subject Matter Knowledge and Pedagogical Content Knowledge but also in changes to their levels of confidence and identities as teachers. By the end of the initial phase of the PLP, the participants had coalesced into a professional learning community that readily engaged in the sharing, peer review, reuse and adaption, and collaborative design of innovative science learning and assessment activities. The findings from the study indicate that those engaged in the development of PLPs for teachers in China need to take cognizance of certain cultural factors and traditions idiosyncratic to the Chinese educational system. A set of revised principles is then presented to inform the future design and implementation of PLPs for teachers in China.

An outcome evaluation of the ‘Skipper’ designated driver program

The general aim of designated driver programs is to reduce the level of drink driving by encouraging potential drink drivers to travel with a driver who has abstained from (or at least limited) consuming alcohol. Designated driver programs appear to be quite widespread around the world, however a limited number have been subject to rigorous evaluation. This paper reports results from an outcome evaluation of a designated driver program called ‘Skipper’, which was trialled in a provincial city in Queensland, Australia. The outcome evaluation included surveys three weeks prior to (baseline), four months following (1st follow-up), and 16 months following (2nd follow-up) the commencement of the trial in both the ‘intervention area’ (baseline, n = 202; 1st follow-up, n = 211; 2nd follow-up, n = 200) and a ‘comparison area’(baseline, n = 203; 1st follow-up, n = 199; 2nd follow-up, n = 201); and a comparison of random breath testing and crash data before and after the trial. The survey results indicate that awareness of the program in the intervention area was quite high four months following its introduction and that this was maintained at 16 months. The results also suggest that the ‘Skipper’ program and the related publicity had positive impacts on behaviour with an increase in the proportion of people participating in designated driver as a passenger. It is less clear, however, whether the ‘Skipper’ program impacted on other behaviours of interest, such as drink driving or involvement in alcohol-related crashes. Suggestions for further research and program improvement are discussed as well as limitations of the research.

From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

Designing for collaborative learning spaces : an academic staff development pilot program

To prepare for the delivery of new Bachelor of Science units in collaborative learning spaces, academic and professional staff at Queensland University of Technology piloted an academic development program over the period of a semester. The program was informed by Rogers’ theory of innovation and diffusion (2003) and structured according to Wilson’s framework for faculty development (2007). Through a series of workshops and group mentoring activities, the program modelled inquiry-based learning in a collaborative learning space, and the participants designed and practiced the delivery of teaching activities. This paper provides a preliminary evaluation of the effectiveness of the pilot based on survey responses from participants, notes from the development team who coordinated the program and audience feedback from the final showcase session. The design and structure of the program is discussed as well as possible future directions.

Outcome evaluation framework for the Queensland Alcohol Ignition Interlock Program. Report to Queensland Department of Transport and Main Roads (TMR 3814)

The Queensland Department of Transport and Main Roads (TMR) required an evaluation framework for the Queensland Alcohol Ignition Interlock Program (AIIP). The objective of this project was to develop a framework to evaluate the AIIP in terms of its effect on road safety outcomes.

Improving wound management for residents in Residential Aged Care Facilities: National dissemination and implementation of the evidence based Champions for Skin Integrity Program

Overview The incidence of skin tears, pressure injuries and chronic wounds increases with age [1-4] and therefore is a serious issue for staff and residents in Residential Aged Care Facilities (RACFs). A pilot project funded in Round 2 of the Encouraging Best Practice in Residential Aged Care (EBPRAC) program by the then Australian Government Department of Health and Ageing found that a substantial proportion of residents in aged care facilities experienced pressure injuries, skin tears or chronic wounds. It also found the implementation of the evidence based Champions for Skin Integrity (CSI) model of wound care was successful in significantly decreasing the prevalence and severity of wounds in residents, improving staff skills and knowledge of evidence based wound management, increasing staff confidence with wound management, increasing implementation of evidence based wound management and prevention strategies, and increasing staff awareness of their roles in evidence based wound care at all levels [5]. Importantly, during the project, the project team developed a resource kit on evidence based wound management. Two critical recommendations resulting from the project were that: - The CSI model or a similar strategic approach should be implemented in RACFs to facilitate the uptake of evidence based wound management and prevention - The resource kit on evidence based wound management should be made available to all Residential Aged Care Facilities and interested parties A proposal to disseminate or rollout the CSI model of wound care to all RACFs across Australia was submitted to the department in 2012. The department approved funding from the Aged Care Services Improvement Healthy Ageing Grant (ACSIHAG) at the same time as the Round 3 of the Encouraging Better Practice in Aged Care (EBPAC) program. The dissemination involved two crucial elements: 1. The updating, refining and distribution of a Champions for Skin Integrity Resource Kit, more commonly known as a CSI Resource Kit and 2. The presentation of intensive one day Promoting Healthy Skin “Train the Trainer” workshops in all capital cities and major regional towns across Australia Due to demand, the department agreed to fund a second round of workshops focussing on regional centres and the completion date was extended to accommodate the workshops. Later, the department also decided to host a departmental website for a number of clinical domains, including wound management, so that staff from the residential aged care sector had easy access to a central repository of helpful clinical resource material that could be used for improving the health and wellbeing of their older adults, consumers and carers. CSI Resource Kit Upgrade and Distribution: At the start of the project, a full evidence review was carried out on the material produced during the EBPRAC-CSI Stage 1 project and the relevant evidence based changes were made to the documentation. At the same time participants in the EBPRAC-CSI Stage 1 project were interviewed for advice on how to improve the resource material. Following this the documentation, included in the kit, was sent to independent experts for peer review. When this process was finalised, a learning designer and QUT’s Visual Communications Services were engaged to completely refine and update the design of the resources, and combined resource kit with the goal of keeping the overall size of the kit suitable for bookshelf mounting and the cost at reasonable levels. Both goals were achieved in that the kit is about the same size as a 25 mm A4 binder and costs between $19.00 and $28.00 per kit depending on the size of the print run. The dissemination of the updated CSI resource kit was an outstanding success. Demand for the kits was so great that a second print run of 2,000 kits was arranged on top of the initial print run of 4,000 kits. All RACFs across Australia were issued with a kit, some 2,740 in total. Since the initial distribution another 1,100 requests for kits has been fulfilled as well as 1,619 kits being distributed to participants at the Promoting Healthy Skin workshops. As the project was winding up a final request email was sent to all workshop participants asking if they required additional kits or resources to distribute the remaining kits and resources. This has resulted in requests for 200 additional kits and resources. Feedback from the residential aged care sector and other clinical providers who have interest in wound care has been very positive regarding the utility of the kit, (see Appendix 4). Promoting Healthy Skin Workshops The workshops also exceeded the project team’s initial objective. Our goal of providing workshop training for staff from one in four facilities and 450 participants was exceeded, with overwhelming demand for workshop places resulting in the need to provide a second round of workshops across Australia. At the completion of the second round, 37 workshops had been given, with 1286 participants, representing 835 facilities. A number of strategies were used to promote the workshops ranging from invitations included in the kit, to postcard mail-outs, broadcast emailing to all facilities and aged care networks and to articles and paid advertising in aged care journals. The most effective method, by far, was directly phoning the facilities. This enabled the caller to contact the relevant staff member and enlist their support for the workshop. As this is a labour intensive exercise, it was only used where numbers needed bolstering, with one venue rising from 3 registrants before the calls to 53 registrants after. The workshops were aimed at staff who had the interest and the capability of implementing evidence-based wound management within their facility or organisation. This targeting was successful in that a large proportion (68%) of participants were Registered Nurses, Nurse Managers, Educators or Consultants. Twenty percent were Endorsed Enrolled Nurses with the remaining 12% being made up of Personal Care Workers or Allied Health Professionals. To facilitate long term sustainability, the workshop employed train-the-trainer strategies. Feedback from the EBPRAC-CSI Stage 1 interviews was used in the development of workshop content. In addition, feedback from the workshop conducted at the end of the EBPRAC-CSI Stage 1 project suggested that change management and leadership training should be included in the workshops. The program was trialled in the first workshop conducted in Brisbane and then rolled out across Australia. Participants were asked to complete pre and post workshop surveys at the beginning and end of the workshop to determine how knowledge and confidence improved over the day. Results from the pre and post surveys showed significant improvements in the level of confidence in attendees’ ability to implement evidence based wound management. The results also indicated a significant increase in the level of confidence in ability to implement change within their facility or organisation. This is an important indication that the inclusion of change management/leadership training with clinical instruction can increase staff capacity and confidence in translating evidence into practice. To encourage the transfer of the evidence based content of the workshop into practice, participants were asked to prepare an Action Plan to be followed by a simple one page progress report three months after the workshop. These reports ranged from simple (e.g. skin moisturising to prevent skin tears), to complex implementation plans for introducing the CSI model across the whole organisation. Outcomes described in the project reports included decreased prevalence of skin tears, pressure injuries and chronic wounds, along with increased staff and resident knowledge and resident comfort. As stated above, some organisations prepared large, complex plans to roll out the CSI model across their organisation. These plans included a review of the organisation’s wound care system, policies and procedures, the creation of new processes, the education of staff and clients, uploading education and resource material onto internal electronic platforms and setting up formal review and evaluation processes. The CSI Resources have been enthusiastically sought and incorporated into multiple health care settings, including aged care, acute care, Medicare Local intranets (e.g. Map of Medicine e-pathways), primary health care, community and home care organisations, education providers and New Zealand aged and community health providers. Recommendations: Recommendations for RACFs, aged care and health service providers and government  Skin integrity and the evidence-practice gap in this area should be recognised as a major health issue for health service providers for older adults, with wounds experienced by up to 50% of residents in aged care settings (Edwards et al. 2010). Implementation of evidence based wound care through the Champions for Skin Integrity model in this and the pilot project has demonstrated the prevalence of wounds, wound healing times and wound infections can be halved.  A national program and Centre for Evidence Based Wound Management should be established to: - expand the reach of the model to other aged care facilities and health service providers for older adults - sustain the uptake of models such as the Champions for Skin Integrity (CSI) model - ensure current resources, expertise and training are available for consumers and health care professionals to promote skin integrity for all older adults  Evidence based resources for the CSI program and similar projects should be reviewed and updated every 3 – 4 years as per NH&MRC recommendations  Leadership and change management training is fundamental to increasing staff capacity, at all levels, to promote within-organisation dissemination of skills and knowledge gained from projects providing evidence based training Recommendations for future national dissemination projects  A formal program of opportunities for small groups of like projects to share information and resources, coordinate activities and synergise education programs interactively would benefit future national dissemination projects - Future workshop programs could explore an incentive program to optimise attendance and reduce ‘no shows’ - Future projects should build in the capacity and funding for increased follow-up with workshop attendees, to explore the reasons behind those who are unable to translate workshop learnings into the workplace and identify factors to address these barriers.

Where to after Drink Rite: An evaluation of opportunities for police and community promotion of an anti-drink driving message in the licensed venue setting. Report to the National Drug Strategy Law Enforcement Funding Committee

Estimating the prevalence of drink driving is a difficult task. Self‐reported drink driving indicates that drink driving is far more common than official statistics suggest. In order to promote a responsible attitude towards alcohol consumption and drink driving within the Queensland community, the Queensland Police Service, Queensland Health and Queensland Transport developed the ‘Drink Rite’ program (Queensland Police Service information sheet, 2009). However, the feasibility of the program is now in doubt as the National Health and Medical Research Council’s guidelines for alcohol consumption changed in 2009 to state “For healthy men and women, drinking no more than four standard drinks on a single occasion reduces the risk of alcohol‐related injury arising from that occasion” (NHMRC Publication, 2009, p. 51). As such, adhering to the NHMRC guidelines places restrictions on how the existing Drink Rite program can be operated (i.e. by reducing the number of standard drinks provided to participants from eight to four). It is arguable that a reduction in the number of alcoholic drinks provided to participants in the program will result in a large reduction in observed BAC readings. This, in turn, will lead to a potential loss of message content when discussing the variation in the effects of alcohol.

Driving simulator evaluation of the failure of an audio in-vehicle warning for railway level crossings

It is impracticable to upgrade the 18,900 Australian passive crossings as such crossings are often located in remote areas, where power is lacking and with low road and rail traffic. The rail industry is interested in developing innovative in-vehicle technology interventions to warn motorists of approaching trains directly in their vehicles. The objective of this study was therefore to evaluate the benefits of the introduction of such technology. We evaluated the changes in driver performance once the technology is enabled and functioning correctly, as well as the effects of an unsafe failure of the technology? We conducted a driving simulator study where participants (N=15) were familiarised with an in-vehicle audio warning for an extended period. After being familiarised with the system, the technology started failing, and we tested the reaction of drivers with a train approaching. This study has shown that with the traditional passive crossings with RX2 signage, the majority of drivers complied (70%) and looked for trains on both sides of the rail track. With the introduction of the in-vehicle audio message, drivers did not approach crossings faster, did not reduce their safety margins and did not reduce their gaze towards the rail tracks. However participants’ compliance at the stop sign decreased by 16.5% with the technology installed in the vehicle. The effect of the failure of the in-vehicle audio warning technology showed that most participants did not experience difficulties in detecting the approaching train even though they did not receive any warning message. This showed that participants were still actively looking for trains with the system in their vehicle. However, two participants did not stop and one decided to beat the train when they did not receive the audio message, suggesting potential human factors issues to be considered with such technology.

The Steering Clear First Offender Drink Driving Program

This program is a research based, guided intervention program, designed for first time drink driving offenders which provides them with information and strategies to avoid drink driving in the future. It is an innovative program with the ability to tailor specific information to different individuals based on their level of risk of reoffending and help them develop their own plan to prevent them from drink driving. It aims to teach offenders the skills to implement their own plan when they determine they are at risk of future drink driving. The program provides information about: What a standard drink is and how blood alcohol content (BAC) is determined; How alcohol affects the body, reaction time, and decision making; The consequences of drink driving and what happens after a second offence; How to deal with risky drink driving situations in the future; How to build a personalised plan to avoid drink driving in the future, and; Levels of alcohol consumption and its impact on daily life. It also includes access to a mobile friendly web app that can be used anytime after completing the program. This is tool that will aid offenders in tracking their drinks and build on plans to prevent future drink driving.