Where there is smoke, there is (the potential for) fire: soft indicators of research and policy impact

There is a growing literature examining the impact of research on informing policy, and of research and policy on practice. Research and policy do not have the same types of impact on practice but can be evaluated using similar approaches. Sometimes the literature provides a platform for methodological debate but mostly it is concerned with how research can link to improvements in the process and outcomes of education, how it can promote innovative policies and practice, and how it may be successfully disseminated. Whether research-informed or research-based, policy and its implementation is often assessed on such 'hard' indicators of impact as changes in the number of students gaining five or more A to C grades in national examinations or a percentage fall in the number of exclusions in inner city schools. Such measures are necessarily crude, with large samples smoothing out errors and disguising instances of significant success or failure. Even when 'measurable' in such a fashion, however, the impact of any educational change or intervention may require a period of years to become observable. This paper considers circumstances in which short-term change may be implausible or difficult to observe. It explores how impact is currently theorized and researched and promotes the concept of 'soft' indicators of impact in circumstances in which the pursuit of conventional quantitative and qualitative evidence is rendered impractical within a reasonable cost and timeframe. Such indicators are characterized by their avowedly subjective, anecdotal and impressionistic provenance and have particular importance in the context of complex community education issues where the assessment of any impact often faces considerable problems of access. These indicators include the testimonies of those on whom the research intervention or policy focuses (for example, students, adult learners), the formative effects that are often reported (for example, by head teachers, community leaders) and media coverage. The collation and convergence of a wide variety of soft indicators (Where there is smoke …) is argued to offer a credible means of identifying subtle processes that are often neglected as evidence of potential and actual impact (… there is fire).

Sustainability-related media coverage and socioeconomic development: a regional and North–South perspective

Abstract. With this paper we discuss the differences between sustainability-related media agendas across different countries and regions. Utilising a sample of 115 leading national newspapers covering forty-one countries, we show that typically no homogeneous global trends exist with regard to sustainability-related media agendas. Instead, significant differences exist regarding the national-level prioritisations of sustainability-related issues in the countries under review. To some extent, these observed differences can be attributed to different levels of socioeconomic development as measured by Human Development Index scores and gross domestic product per capita. Here, generic differences can be identified between newspapers from the Global North and South, with a range of issues such as climate change emerging as typically Northern issues, whereas issues such as corruption and poverty show significantly higher levels of coverage across newspapers from the Global South. We conclude with a discussion of the results in the context of global environmental governance.

Behind the Headlines: Media Representation of Children and Young People in Northern Ireland:Summary of Research Findings

Funded by the Economic and Social Research Council this partnership project between the Childhood, Transition and Social Justice Initiative at Queen’s University and Include Youth focuses on the negative stereotyping of children and young people and the role and responsibilities of the media in the creation and transmission of negative images. Engaging with children, young people, organisations working with children and young people and media representatives, the project uses research evidence to explore negative media representation and its consequences for children’s rights, public reaction and policy initiatives in Northern Ireland. This report represents a summary of the findings of engagement with 141 children and young people. It outlines how they feel they are presented by the media and the impacts of this. It concludes by noting ways forward in challenging negative portrayals.

The influence that politicians, community leaders and the media have on confidence in the police in Northern Ireland

n January 2014, the Northern Ireland Policing Board (NIPB) commissioned the University of Ulster to conduct research into public confidence in policing to help inform the work of the Board and its oversight of police service delivery. More specifically, the research team were tasked with exploring ‘the influence that politicians, community leaders and the media have on public confidence in policing in Northern Ireland’. To date, the subject of ‘confidence in policing’ within a Northern Ireland context has been relatively under researched, both in academic and policy terms. Thus, the present research is the first empirical research to be produced in Northern Ireland which considers the issue of confidence in policing from the perspective of community leaders, politicians and the media – including the key influences and dynamics which underpin police confidence at a community level.

The report begins with a comprehensive review of academic literature, policy documents and contemporary events related to confidence in policing. The research then provides an overview of the methodology used to undertake the research, with the remainder of the report comprised of the findings from the discussions with representatives from the media, political parties and the community and voluntary sector who participated. The report concludes with an overview of the central findings along with a series of recommendations.