Where there is smoke, there is (the potential for) fire: soft indicators of research and policy impact

There is a growing literature examining the impact of research on informing policy, and of research and policy on practice. Research and policy do not have the same types of impact on practice but can be evaluated using similar approaches. Sometimes the literature provides a platform for methodological debate but mostly it is concerned with how research can link to improvements in the process and outcomes of education, how it can promote innovative policies and practice, and how it may be successfully disseminated. Whether research-informed or research-based, policy and its implementation is often assessed on such 'hard' indicators of impact as changes in the number of students gaining five or more A to C grades in national examinations or a percentage fall in the number of exclusions in inner city schools. Such measures are necessarily crude, with large samples smoothing out errors and disguising instances of significant success or failure. Even when 'measurable' in such a fashion, however, the impact of any educational change or intervention may require a period of years to become observable. This paper considers circumstances in which short-term change may be implausible or difficult to observe. It explores how impact is currently theorized and researched and promotes the concept of 'soft' indicators of impact in circumstances in which the pursuit of conventional quantitative and qualitative evidence is rendered impractical within a reasonable cost and timeframe. Such indicators are characterized by their avowedly subjective, anecdotal and impressionistic provenance and have particular importance in the context of complex community education issues where the assessment of any impact often faces considerable problems of access. These indicators include the testimonies of those on whom the research intervention or policy focuses (for example, students, adult learners), the formative effects that are often reported (for example, by head teachers, community leaders) and media coverage. The collation and convergence of a wide variety of soft indicators (Where there is smoke …) is argued to offer a credible means of identifying subtle processes that are often neglected as evidence of potential and actual impact (… there is fire).

Money matters: using qualitative research for policy influencing on gender and welfare reform

The UK government has been considering the design and delivery of the proposed “universal credit”, the centerpiece of its welfare reforms. The authors draw on findings from their own research, about how low/moderate-income couples manage money and negotiate gender roles, to demonstrate their relevance to exploring the gender implications of the proposals for universal credit. Findings from this and other similar studies are used to explore the value of qualitative research to policy design and debates – in particular to supplement economic modeling, which has been highly influential in driving the current UK government's thinking on welfare reform. The authors discuss the reasons why insights about gender relations within the household revealed by such qualitative research appear to have been resisted in the reform.

Child Welfare: Connecting Research, Policy and Practice,

Chapter explores the literature as it relates to kinship and foster care outcomes. The chapter analyses the similarities and differences between the two placements and provides a framework for practice, policy and future research.