Project evaluation SOU-estuTUtor: mentors’ perception

The introduction of new degrees in the Faculty of Education and the relevance of educational guidance comes to them, as a compulsory subject in all four grades started from 2009-2010, gives the opportunity to return and boost the University Guidance Service (UGS) as a means of consistency with the profile of their education and professional development of its students. The aim of the paper focuses on the evaluation of the results after the first year of implementing a peer mentoring project, SOU-estuTUtor Project, developed from UGS with all degree students of the Faculty of Education for Students new entrants. Program has been evaluated through the perception and satisfaction of the mentors on the organization, training, skills developed and adapted to the needs of students. After one academic year of implementation, the results show, on the one hand, the satisfaction and commitment of those involved and the partial response to the needs of the students served, as well as the optimization of the personal resources of the university but also some limitations that make it necessary to review the mentoring program in terms of control and duration of the process.

Co-evaluation as a strategy to improve working group dynamics: an experience in Sport Sciences

The aim of this study was to analyze if the perceptions of students before and after carrying out the work, that is, their perception of different aspects of the functioning of the group, the working skills acquired as well as those they think that need to be improved, varied depending on whether the contribution of the different members of the group was being co-evaluated or not. 144 students of Physical Activity and Sport Sciences participated in this study. In order to analyze the students' perception of group work the adapted questionnaire by Bourne et al. (2001) was used. Results showed that groups which implemented co-evaluation assessed more negatively the experience in general than those which did not. However, co-evaluation groups perceived their competence to work as a team had improved to a greater extent than the groups without co-evaluation, evaluating more positively both the performance and the result of work and increasing their knowledge of the other team members. Using a co-evaluation system seems to generate both a better assessment of the running of the team and the result of its work.

A healthy settings framework: an evaluation and comparison of midwives' responses to addressing domestic violence

Objectives: to compare and contrast how midwives working in either hospital- or community-based settings address domestic violence by evaluating their views on: prevalence of domestic violence; their role in addressing domestic violence; the acceptability of routine enquiry; and barriers encountered in asking clients questions about violence and abuse in pregnancy. Design: a postal survey questionnaire. Setting: Northern Ireland. Study population: 983 hospital and community midwives. Findings: overall, 488 midwives returned a completed questionnaire; a 57% response rate. Comparisons were made using descriptive, inferential statistics and cross-tabulation. Although there were significant differences between hospital- and community-based midwives in relation to domestic violence, both groups of midwives tended to underestimate its prevalence. Key conclusions: the findings suggest that midwives per se identify and respond to a fraction of the cases of domestic abuse in pregnancy, due to lack of confidence, education and training. This reinforces the need for both hospital and community midwives to gain further confidence and an understanding of the many psychosocial factors that surround domestic violence. Implications for practice: healthy settings theory can be used effectively to identify good practice with women who experience domestic violence. Effective investment for health care requires the gaps between hospital- and community-based practice to be bridged, and for work to be integrated.

Championing the interface between mental health and child protection: evaluation of a service initiative to improve joint working in Northern Ireland

The importance of establishing effective interagency working between adult mental health services and child care services in order to safeguard children has been repeatedly identified by research, policy, inquiries and inspection reports. This article reports on the evaluation of an initiative in one Health and Social Care Trust in Northern Ireland that aimed to facilitate joint working and so improve service provision and protection for children and families. The Champions Initiative involved identifying a champion in each multi-disciplinary community mental health team and in each family and child care team who would have responsibility for providing information, promoting joint working and identifying any obstacles to better co-operation. The evaluation of this initiative assessed levels of experience, training, confidence, understanding and awareness in the Champions and their team members at baseline. The Champions and their Team Leaders were then followed-up after six months to obtain their qualitative views of the impact of the initiative. The results include comparisons between mental health and child care staff, and crucially, views about whether the initiative has had any impact on working together. This study also generated recommendations for further service development in this complex and important area of practice.

Targeting social need in a divided society: an evaluation of a community-based adult education initiative

This article examines the impact of a community-based adult education initiative designed to target social need in Northern Ireland. Set against a backdrop of extreme civil unrest and disadvantageous socio-economic conditions a cohort of adults was identified to participate in a personal and social development programme. The initiative was funded from Peace and Reconciliation resources made available to Northern Ireland by the European Union. High levels of unemployment and negativity about previous learning experiences were characteristic features among participants. An evaluation of the effectiveness of the programme was carried out and a follow-up qualitative survey ensued 6 months after the completion of the training. Results indicate that the learner-centred methodology was effective in providing a gateway to further education and training and enhancing participants' self-esteem, confidence, motivation, tolerance, social skills, community involvement and

Best of the old alongside the new: training for part-time youth workers

Set against the dearth of published research into the effectiveness of youth leadership training programmes, the present study describes how a comprehensive evaluation model was utilised to evaluate one such programme in Northern Ireland over a 3-year period. The training welds together a traditional curriculum approach and a competence-based methodology to provide an integrated experience for the part-time youth worker participants (n = 128). Self-completion questionnaires and follow-up interviews with a random sample of these youth workers and their supervisors were used to collect data. Outcomes suggest that the synthesis of these two training strategies is not only effective in meeting the learning needs of youth workers, but also leads to identifiable improvements in the range and quality of youth work programmes available to young people

New Circus: the benefits of Circus Training for young people in a residential setting,

Circus 1 to 3 is a circus school, based on the concept of New Circus, for boys resident in St. Patrick's Training School, Northern Ireland. The project is designed, not only to teach Circus skills, but also to foster social and personal skills. This report details an evaluation undertaken to assess die extent to which this programme meets these aims. A study of participants Circus records indicated that significant gains in co-operative behaviour, team-work, attitude and participation, as rated by Circus tutors, were evident over the course of boys involvement. A qualitative study was also conducted. These interviews with Circus 1 to 3 participants indicated that this project enhanced the quality of life for boys resident in St. Patrick's Training School. In addition the project, through the use of positive feedback, provides opportunities for boys to develop their social and personal skills. This evaluation concludes that Circus 1 to 3 is a worthwhile and successful endeavour.

The Evaluation of an Interdisciplinary Pain Protocol in Long Term Care

Objectives: To evaluate the effectiveness of (1) dissemination strategies to improve clinical practice behaviors (eg, frequency and documentation of pain assessments, use of pain medication) among health care team members, and (2) the implementation of the pain protocol in reducing pain in long term care (LTC) residents. Design: A controlled before-after design was used to evaluate the effectiveness of the pain protocol, whereas qualitative interviews and focus groups were used to obtain additional context-driven data. Setting: Four LTC facilities in southern Ontario, Canada; 2 for the intervention group and 2 for the control group. Participants: Data were collected from 200 LTC residents; 99 for the intervention and 101 for the control group. Intervention: Implementation of a pain protocol using a multifaceted approach, including a site working group or Pain Team, pain education and skills training, and other quality improvement activities. Measurements: Resident pain was measured using 3 assessment tools: the Pain Assessment Checklist for Seniors with Limited Ability to Communicate, the Pain Assessment in the Communicatively Impaired Elderly, and the Present Pain Intensity Scale. Clinical practice behaviors were measured using a number of process indicators; for example, use of pain assessment tools, documentation about pain management, and use of pain medications. A semistructured interview guide was used to collect qualitative data via focus groups and interviews. Results: Pain increased significantly more for the control group than the intervention group over the 1-year intervention period. There were significantly more positive changes over the intervention period in the intervention group compared with the control group for the following indicators: the use of a standardized pain assessment tool and completed admission/initial pain assessment. Qualitative findings highlight the importance of reminding staff to think about pain as a priority in caring for residents and to be mindful of it during daily activities. Using onsite champions, in this case advanced practice nurses and a Pain Team, were key to successfully implementing the pain protocol. Conclusions: These study findings indicate that the implementation of a pain protocol intervention improved the way pain was managed and provided pain relief for LTC residents.

An Evaluation of the Effectiveness of an FE/HE Partnership in the Delivery of a Preparation for Practice Module within an Undergraduate Social Work Degree Programme

The Preparation for Practice module at the University of Ulster is delivered to 170 first year students via a collaborative arrangement between higher and further education institutions. In each of the five sites, students receive large group and small group teaching facilitated by social work training agency workers and academic tutor dyads. An evaluation of the module sought the perceptions of the agency and academic facilitators regarding the overall collaborative arrangement and the model of co-teaching involving social work academics and agency partners. Respondents were asked to complete a semi-structured questionnaire, which generated data from a Likert scale and also invited qualitative commentary. The Likert scale data were analysed via SPSS and the qualitative information was scrutinised using a manual thematic analysis technique. Findings indicated that continuous communication, consistency in programme content and the acknowledgement of the differences in organisation resources were key to a successful collaborative arrangement. It was also noted that a co-teaching model should be viewed as a positive vehicle for achieving module objectives in a safe learning environment.

A qualitative study exploring the perceived impact of supervision training on cognitive therapy supervisor practice

Although cognitive therapy (CT) has a large empirical base, research is lacking for CT supervision and supervision training, which presents an obstacle for evidence-based practice. A pilot CT supervision training programme, based on Milne’s (2007a, 2009) evidence-based supervision and Roth and Pilling (2008) supervision competences was developed by the Northern Ireland Centre for Trauma and Transformation (NICTT), an organisation specialising in CT therapy provision and training. This study qualitatively explores CT supervisors’ perceptions of the impact the training had on their practice. Semi-structured interviews were conducted with seven participants, transcribed verbatim and analysed using Burnard’s (1991) thematic content analysis.

Findings illustrated that experienced CT supervisors perceived benefit from training and that the majority of supervisors had implemented contracts, used specific supervision models and paid more attention to supervisee learning as a result of the training. Obstacles to ensuring good supervision included the lack of reliable user-friendly evaluation tools and supervisor consultancy structures.

Recommendations are also made for future research to establish the long-term effects of supervision training and its effect on patient outcomes. Implications for future training based on adult learning principles are discussed.

Awarding global grades in OSCEs: Evaluation of a novel eLearning resource for OSCE examiners

BACKGROUND:
A novel online resource has been developed to aid OSCE examiner training comprising a series of videos of OSCE performances that allow inter-examiner comparison of global grade decisions.

AIMS:
To evaluate this training resource in terms of usefulness and ability to improve examiner confidence in awarding global grades in OSCEs.

METHOD:
Data collected from the first 200 users included global grades awarded, willingness to change grades following peer comparison and confidence in awarding grades before and after training.

RESULTS:
Most (86.5%) agreed that the resource was useful in developing global grade scoring ability in OSCEs, with a significant improvement in confidence in awarding grades after using the training package (p<0.001).

CONCLUSIONS:
This is a useful and effective online training package. As an adjunct to traditional training it offers a practical solution to the problem of availability of examiners.

Tact training versus bi-directional intraverbal training in teaching a foreign language

The current study involved an evaluation of the emergence of untrained verbal relations as a function of between three different foreign-language teaching strategies. Two Spanish-speaking adults received foreign-language (English) tact-training as well as native-to-foreign and foreign-to-native intraverbal training. The results indicated that tact training and native-to-foreign intraverbal training are more likely to result in the emergence of untrained relations, and may thus be more efficient compared to foreign-to-native intraverbal training.

The efficacy of SMART Arm training early after stroke for stroke survivors with severe upper limb disability:a protocol for a randomised controlled trial

Recovery of upper limb function after stroke is poor. The acute to subacute phase after stroke is the optimal time window to promote the recovery of upper limb function. The dose and content of training provided conventionally during this phase is however, unlikely to be adequate to drive functional recovery, especially in the presence of severe motor disability. The current study concerns an approach to address this shortcoming, through evaluation of the SMART Arm, a non-robotic device that enables intensive and repetitive practice of reaching by stroke survivors with severe upper limb disability, with the aim of improving upper limb function. The outcomes of SMART Arm training with or without outcome-triggered electrical stimulation (OT-stim) to augment movement and usual therapy will be compared to usual therapy alone.

A Pilot Evaluation of the Palliative Performance Scale in Long Term Care: Tips for Success

Aims: Palliative care in long-term care (LTC) homes is an area of growing concern. Little work has been done to explore innovative ways to identify and care for residents who become palliative. The purpose of this intervention study was to evaluate the implementation of the Palliative Performance Scale (PPS) in LTC. Specifically we explored staff perceptions about implementing the PPS and how it cued staff to initiate palliative care discussion with residents and family when a resident’s health declined.

Methods: This study utilized a qualitative descriptive design that included data from four separate sources: journals of three ‘champions’ who were responsible for leading the implementation of the PPS; staff evaluations of three educational training sessions; minutes from meetings; and 11 interviews from key staff who were involved in the implementation process. Data were analyzed using thematic content analysis.

Results: Staff generally felt positively about using the PPS in LTC and stated that it increased awareness of palliative care and helped identify those residents who were nearing the end of life. There were some barriers to implementing it, such as staff resistance and lack of time to complete it. The importance of having a designated ‘champion’ and effective interdisciplinary communication in addition to widespread training, were identified as successful strategies to facilitate the implementation process.

Conclusion: These study findings support the use of the PPS in LTC and offer some perspective about ways to implement it successfully. Future work is needed to evaluate the PPS in LTC using more rigorous designs.