Effects of a demand-led evidence briefing service on the uptake and use of research evidence by commissioners of health services: protocol for a controlled before and after study

Background: Clinical Commissioning Groups (CCGs) are mandated to use research evidence effectively to ensure optimum use of resources by the National Health Service (NHS), both in accelerating innovation and in stopping the use of less effective practices and models of service delivery. We intend to evaluate whether access to a demand-led evidence service improves uptake and use of research evidence by NHS commissioners compared with less intensive and less targeted alternatives. 

Methods/design: This is a controlled before and after study involving CCGs in the North of England. Participating CCGs will receive one of three interventions to support the use of research evidence in their decision-making:1) consulting plus responsive push of tailored evidence; 2) consulting plus an unsolicited push of non-tailored evidence; or 3) standard service unsolicited push of non-tailored evidence. Our primary outcome will be changed at 12 months from baseline of a CCGs ability to acquire, assess, adapt and apply research evidence to support decision-making. Secondary outcomes will measure individual clinical leads and managers’ intentions to use research evidence in decision making. Documentary evidence of the use of the outputs of the service will be sought. A process evaluation will evaluate the nature and success of the interactions both within the sites and between commissioners and researchers delivering the service. 

Discussion: The proposed research will generate new knowledge of direct relevance and value to the NHS. The findings will help to clarify which elements of the service are of value in promoting the use of research evidence.Those involved in NHS commissioning will be able to use the results to inform how best to build the infrastructure they need to acquire, assess, adapt and apply research evidence to support decision-making and to fulfil their statutory duties under the Health and Social Care Act.

Hidden Gems: systematically searching electronic databases for research publications for social work and social care.

Context: Electronic bibliographic databases are a key source for professional publications about social work and community care more generally. This article describes and evaluates a method of identifying relevant articles as part of a systematic review of research evidence. Decision making about institutional and home care services for older people is used as an example. Method: Four databases (Social Science Citation Index, Medline, CINAHL, and Caredata) that abstract publications relevant to health and social services were searched systematically to identify relevant research studies. The items retrieved were appraised independently using a standard form developed for the purpose. The searches were compared in terms of sensitivity, precision, overlap between databases, and inter-rater reliability. Results: The search retrieved 525 articles, of which 276 were relevant. The four databases retrieved 55%, 41%, 19%, and 1% of the relevant articles respectively, achieving these sensitivities with precision levels of 54%, 48%, 84% and 94%. The databases retrieved 116, 73, 24 and 15 unique relevant articles respectively, showing the need to use a range of databases. Discussion: A general approach to creating a search to retrieve relevant research has been developed. The development of an international, indexed database dedicated to literature relevant to social services is a priority to enable progress in evidence-based policy and practice in social work. Editors and researchers should consider using structured abstracts in order to improve the retrieval and dissemination of research.

Evidence from a Baseline Study of Teachers and Young People in Northern Ireland: Implications for Peace Education.

Peace education initiatives in schools are often based on social psychological theories assuming that social identity affects ingroup and outgroup attitudes and, in turn, behaviors relating to relevant outgroups. However, research evidence on the role of young people’s social identity has often failed to take account of different social identity dimensions or to conceptualise outgroup behavior in the context of young people’s understandings of the social world. While recent research relating to bullying and bystander behavior amongst young people has addressed the latter point, this has rarely been considered in conjunction with a differentiated view of social identity. This paper is therefore distinctive as it will address the role of social identity dimensions with regards to behavior as captured in bystander scenarios relating to intergroup discrimination. This is particularly important in the context of divided societies, where peace education initiatives are crucial in promoting positive community relations for the future and where such initiative may be hampered by communities’ concerns about loss of identity and hardened intergroup attitudes. Furthermore, previous research frequently highlighted teachers’ fears to tackle outgroup attitudes in the classroom, especially in contexts where pupils and the wider school community are seen as entrenched in community divisions (Hughes, Donnelly, Hewstone, Gallagher & Carlisle, 2010). However, there is no research investigating the relationship between pupils’ attitudes and teacher confidence to talk about such issues in the classroom, which is explored in this paper.

In the context of Northern Ireland, a divided society emerging from sectarian conflict, social identity, outgroup attitudes and outgroup behaviours have been key concepts addressed by peace educators for many years. Building on this work, this paper provides a detailed picture of young people’s strength of group identification and their willingness to explore ingroup perspectives, sectarian attitudes and their reported willingness to challenge sectarian bullying. Using data from a baseline survey, which forms part of a randomized control trial investigating the effect of an educational intervention aimed to promote reconciliation, the sample involved young people of different denominational backgrounds, attending separate school sectors. The baseline data will be used to compare with post intervention data. Therefore, the data and its findings would be of particular interest to educators and policy makers in other European countries who are working to develop peace education interventions in societies emerging from conflict. Additionally, this paper considers the results from a baseline teacher survey, collected before training and teaching of the intervention began. The teacher survey focused on confidence in tackling sectarian issues in the classroom, previous experience of teaching such issues and their hopes and concerns for the reconciliation intervention.

This paper therefore set out to investigate the relationship between dimensional concept of social identity, sectarian attitudes and pupils’ reported willingness to challenge sectarian bullying and to compare this with their teachers’ attitudes to teaching about sectarian issues in the classroom.



Method

The pupil sample included 35 primary and post-primary schools and about 800 pupils from 8-11 years old who completed an online questionnaire in December 2011 and January 2012. Main instruments for young people’s survey included an adapted version of the Multi-ethnic identity measure (Phinney, 1992) incorporating the dimensions identity affirmation and exploration, outgroup attitude scales, including an adaptation of the social distance measure (Bogardus, 1947), as well as a measure adapted from Palmer and Cameron (2011) involving scenarios to capture pupils’ intentions in bystander situations relating to intergroup discrimination. Results are analysed using regression analysis and take account of potential gender and religious differences. The teacher questionnaire was completed by the 35 primary and post-primary teachers who will deliver the intervention. Results are analysed in terms of how teachers’ responses compare with their pupil attitudes by considering their confidence in tackling sectarian issues in the classroom and how their previous experience and training relate to their hopes and concerns for the intervention.


Expected Outcomes

Results from the young people’s survey are discussed in the light of the role of social identity dimensions and their relationship to sectarian attitudes and reported bystander behaviour in sectarian school incidents. Furthermore, results related to pupils’ sectarian attitudes will be compared with teachers’ reported confidence in tackling sectarianism in the classroom. The teacher questionnaire also presents interesting findings in relation to teachers’ previous training and experience and how this may influence different perspectives on peace and reconciliation interventions and their expectations of what these could achieve. The paper concludes with potential implications for peace education initiatives and related teacher training in Northern Ireland and beyond. The implications will be of particular interest to policy makers, educators and those working in the area of peace education to design and implement interventions.


References

Bogardus, E. S. (1947) Measurement of Personal-Group Relations. Sociometry, 10: 4: 306–311. Hughes, J., Donnelly, C., Hewstone, M., Gallagher, T. & Carlisle, K. (2010) School partnerships and reconciliation: An evaluation of school collaboration in Northern Ireland. Belfast: Queen’s University Belfast. Available online: http://www.schoolsworkingtogether.com/documents/School%20collaboration%20in%20NI%202010.pdf. (accessed 27th Jan 2010) Palmer, S. & Cameron, L. (2011, May). What are the moderators and mediators of children’s bystander behaviour in the context of intergroup discrimination? Paper session presented at the UNA Global Biennial Conference 2011: Building Peaceable Communities: The Power of Early Childhood, Amsterdam, Holland. Phinney, J. S. (1992). The Multigroup Ethnic Identity Measure: A new scale for use with diverse groups. Journal of Adolescent Research, 7, 156–176.

From theory to practice:Improving the impact of health services research

Background: While significant strides have been made in health research, the incorporation of research evidence into healthcare decision-making has been marginal. The purpose of this paper is to provide an overview of how the utility of health services research can be improved through the use of theory. Integrating theory into health services research can improve research methodology and encourage stronger collaboration with decision-makers. Discussion: Recognizing the importance of theory calls for new expectations in the practice of health services research. These include: the formation of interdisciplinary research teams; broadening the training for those who will practice health services research; and supportive organizational conditions that promote collaboration between researchers and decision makers. Further, funding bodies can provide a significant role in guiding and supporting the use of theory in the practice of health services research. Summary: Institutions and researchers should incorporate the use of theory if health services research is to fulfill its potential for improving the delivery of health care. © 2005 Brazil et al; licensee BioMed Central Ltd.

Collaborative practice:a strategy to improve the relevance of health services research.

Health services research has emerged as a tool for decision makers to make services more effective and efficient. While its value as a basis for decision making is well established, the incorporation of such evidence into decision making remains inconsistent. To this end, strengthening collaborative relationships between researchers and healthcare decision makers has been identified as a significant strategy for putting research evidence into practice.

Parenting Programmes: The Best Available Evidence

Parenting programmes have been provided to a wide range of child and parent groups across a number of countries, but are they effective? This aim of this paper is to examine the findings from a number of systematic reviews that summarise the best available research evidence on the impact of these programmes on a range of parental and child outcomes. In addition to examining the findings from systematic reviews, the paper also takes a selective look at the uptake of parenting programmes in the United Kingdom, the evidence for effectiveness and the efficacy of adopting a population-based approach to parent education.

The findings from systematic reviews indicate that parenting programmes can have a positive impact on a range of outcomes, including improved child behaviour, increased maternal self-esteem and relationship adjustment, improved mother–child interaction and knowledge and decreased maternal depression and stress. While there is a need for greater evaluation of the long-term impact of these programmes, preliminary evidence indicates that these positive results are maintained over time, with group-based, behaviourally orientated programmes tending to be more effective.

While several recent trials indicate that that these programmes can be effective within the United Kingdom, high drop-out rates may mean that they only reach a minority of parents. However, multi-level parent education strategies such as the Australian Triple P Positive Parenting Strategy that incorporate an array of mediums aimed at different levels of need may provide an opportunity to reach a wider range of parents. This approach is currently being evaluated in order to ascertain whether it is effective in improving child outcomes in the general population.

While there is no coherent strategy for parent training across the United Kingdom, within the Northern Ireland context there is a move towards the development of a family support strategy. While uptake of parent education and training is currently unknown the best available evidence highlights the positive impact that parent training can have, suggesting the importance of including parent education as one aspect of this strategy

Behaviour analysis and evidence-based education

Education has a powerful and long-term effect on people’s lives and therefore should be based on evidence of what works best. This assertion warrants a definition of what constitutes good research evidence. Two research designs that are often thought to come from diametrically opposed fields, single-subject research designs and randomised controlled-trials, are described and common features, such as the use of probabilistic assumptions and the aim of discovering causal relations are delineated. Differences between the two research designs are also highlighted and this is used as the basis to set out how these two research designs might better be used to complement one another. Recommendations for future action are made accordingly.

Bias in research

The aim of this article is to outline types of ‘bias’ across research designs, and consider strategies to minimise bias. Evidence-based nursing, defined as the “process by which evidence, nursing theory, and clinical expertise are critically evaluated and considered, in conjunction with patient involvement, to provide the delivery of optimum nursing care,”1 is central to the continued development of the nursing professional. Implementing evidence into practice requires nurses to critically evaluate research, in particular assessing the rigour in which methods were undertaken and factors that may have biased findings.

Young People and Mental Health, Policy and Research Review

This brief focuses on issues relating to young people’s mental health. It draws on published research evidence and discussion at a Roundtable event organised by YouthAction Northern Ireland (YANI) and ARK and held in December 2012. Roundtable participants included officials from a number of government departments, Health Trusts, representatives from a range of NGOs, academics, and young people from YouthAction Northern Ireland’s Right Here Fermanagh
project and Young Men Talking Project who opened the debate with a contribution on what they think is important for young people’s mental health. The event was conducted under the anonymity of reporting allowed under the Chatham House Rule to encourage open debate.

Knowledge translation in men’s health research: development and delivery of content for use online

Background: Men can be hard to reach with face-to-face health-related information, while increasingly, research shows that they are seeking health information from online sources. Recognizing this trend, there is merit in developing innovative online knowledge translation (KT) strategies capable of translating research on men’s health into engaging health promotion materials. While the concept of KT has become a new mantra for researchers wishing to bridge the gap between research evidence and improved health outcomes, little is written about the process, necessary skills, and best practices by which researchers can develop online knowledge translation.
Objective: Our aim was to illustrate some of the processes and challenges involved in, and potential value of, developing research knowledge online to promote men’s health.

Methods: We present experiences of KT across two case studies of men’s health. First, we describe a study that uses interactive Web apps to translate knowledge relating to Canadian men’s depression. Through a range of mechanisms, study findings were repackaged with the explicit aim of raising awareness and reducing the stigma associated with men’s depression and/or help-seeking. Second, we describe an educational resource for teenage men about unintended pregnancy, developed for delivery in the formal Relationship and Sexuality Education school curricula of Ireland, Northern Ireland (United Kingdom), and South Australia. The intervention is based around a Web-based interactive film drama entitled “If I Were Jack”.

Results: For each case study, we describe the KT process and strategies that aided development of credible and well-received online content focused on men’s health promotion. In both case studies, the original research generated the inspiration for the interactive online content and the core development strategy was working with a multidisciplinary team to develop this material through arts-based approaches. In both cases also, there is an acknowledgment of the need for gender and culturally sensitive information. Both aimed to engage men by disrupting stereotypes about men, while simultaneously addressing men through authentic voices and faces. Finally, in both case studies we draw attention to the need to think beyond placement of content online to delivery to target audiences from the outset.

Conclusions: The case studies highlight some of the new skills required by academics in the emerging paradigm of translational research and contribute to the nascent literature on KT. Our approach to online KT was to go beyond dissemination and diffusion to actively repackage research knowledge through arts-based approaches (videos and film scripts) as health promotion tools, with optimal appeal, to target male audiences. Our findings highlight the importance of developing a multidisciplinary team to inform the design of content, the importance of adaptation to context, both in terms of the national implementation context and consideration of gender-specific needs, and an integrated implementation and evaluation framework in all KT work.

Behind the Headlines: Media Representation of Children and Young People in Northern Ireland:Summary of Research Findings

Funded by the Economic and Social Research Council this partnership project between the Childhood, Transition and Social Justice Initiative at Queen’s University and Include Youth focuses on the negative stereotyping of children and young people and the role and responsibilities of the media in the creation and transmission of negative images. Engaging with children, young people, organisations working with children and young people and media representatives, the project uses research evidence to explore negative media representation and its consequences for children’s rights, public reaction and policy initiatives in Northern Ireland. This report represents a summary of the findings of engagement with 141 children and young people. It outlines how they feel they are presented by the media and the impacts of this. It concludes by noting ways forward in challenging negative portrayals.