Assessing the Societal Impact of Research: The Relational Engagement Approach

Marketing and policy researchers seeking to increase the societal impact of their scholarship should engage directly with relevant stakeholders. For maximum societal effect, this engagement needs to occur both within the research process and throughout the complex process of knowledge transfer. A relational engagement approach to research impact is proposed as complementary and building upon traditional approaches. Traditional approaches to impact employ bibliometric measures and focus on the creation and use of journal articles by scholarly audiences, an important but incomplete part of the academic process. The authors suggest expanding the strategies and measures of impact to include process assessments for specific stakeholders across the entire course of impact: from the creation, awareness, and use of knowledge to societal impact. This relational engagement approach involves the co-creation of research with audiences beyond academia. The authors hope to begin a dialogue on the strategies researchers can make to increase the potential societal benefits of their research.

Impact of PSA testing and prostatic biopsy on cancer incidence and mortality: comparative study between the Republic of Ireland and Northern Ireland

Objectives: To investigate the impact of different PSA testing policies and health-care systems on prostate cancer incidence and mortality in two countries with similar populations, the Republic of Ireland (RoI) and Northern Ireland (NI).

Methods: Population-level data on PSA tests, prostate biopsies and prostate cancer cases 1993–2005 and prostate cancer deaths 1979–2006 were compiled. Annual percentage change (APC) was estimated by joinpoint regression.

Results: Prostate cancer rates were similar in both areas in 1994 but increased rapidly in RoI compared to NI. The PSA testing rate increased sharply in RoI (APC = +23.3%), and to a lesser degree in NI (APC = +9.7%) to reach 412 and 177 tests per 1,000 men in 2004, respectively. Prostatic biopsy rates rose in both countries, but were twofold higher in RoI. Cancer incidence rates rose significantly, mirroring biopsy trends, in both countries reaching 440 per 100,000 men in RoI in 2004 compared to 294 in NI. Median age at diagnosis was lower in RoI (71 years) compared to NI (73 years) (p < 0.01) and decreased significantly over time in both countries. Mortality rates declined from 1995 in both countries (APC = -1.5% in RoI, -1.3% in NI) at a time when PSA testing was not widespread.

Conclusions: Prostatic biopsy rates, rather than PSA testing per se, were the main driver of prostate cancer incidence. Because mortality decreases started before screening became widespread in RoI, and mortality remained low in NI, PSA testing is unlikely to be the explanation for declining mortality.

Impact of operator experience on information feedback and reusability

Keeping a record of operator experience remains a challenge to operation management and a major source of inefficiency in information management. The objective is to develop a framework that enables an explicit presentation of experience based on information use. A purposive sampling method is used to select four small and medium-sized enterprises as case studies. The unit of analysis is the production process in the machine shop. Data collection is by structured interview, observation and documentation. A comparative case analysis is applied. The findings suggest experience is an accumulation of tacit information feedback, which can be made explicit in information use interoperatability matrix. The matrix is conditioned upon information use typology, which is strategic in waste reduction. The limitations include difficulty of participant anonymity where the organisation nominates a participant. Areas for further research include application of the concepts to knowledge management and shop floor resource management.

The Role of Subjectivity and Knowledge Power Struggles in the Formation of Public Policy

There is a growing incentive for sociologists to demonstrate the use value of their research. Research ‘impact’ is a driver of research funding and a measure of academic standing. Academic debate on this issue has intensified since Burawoy’s (2004) call for a ‘public’ sociology. However the academy is no longer the sole or primary producer of knowledge and empirical sociologists need to contend with the ‘huge swathes’ of social data that now exist (Savage and Burrows, 2007). This article furthers these debates by considering power struggles between competing forms of knowledge. Using a case study, it specifically considers the power struggle between normative and empirical knowledge, and how providers of knowledge assert legitimacy for their truth claims. The article concludes that the idea of ‘impact’ and ‘use-value’ are extremely complex and depends in the policy context on knowledge power struggles, and on how policy makers want to view the world. © The Author(s) 2012

Civic engagement and the arts and humanities: a UK perspective

Higher education in the UK is in a state of flux and this is having particular impact on the humanities. On the one hand the pressure to support a STEM agenda is seen by some as forcing higher education down a narrow economic agenda, while government requirements for assessing the social and economic impact of research has raised concerns about excessive utilitarianism and a downgrading of ‘disinterested enquiry’. This paper argues that these concerns may be misplaced. The research impact agenda has the potential to promote more socially engaged research and more democratic engagement in the creation and dissemination of knowledge. In the US concerns about the democratic role of higher education more often seem to focus on the student experience. By contrast, in the UK concerns about citizenship education and democratic participation more often focus on high school students, perhaps because university students are more likely to have a formal role in institutional governance. The paper concludes that the papers in this forum have a very American feel, but the issues they address resonate on a much wider scale.

Where there is smoke, there is (the potential for) fire: soft indicators of research and policy impact

There is a growing literature examining the impact of research on informing policy, and of research and policy on practice. Research and policy do not have the same types of impact on practice but can be evaluated using similar approaches. Sometimes the literature provides a platform for methodological debate but mostly it is concerned with how research can link to improvements in the process and outcomes of education, how it can promote innovative policies and practice, and how it may be successfully disseminated. Whether research-informed or research-based, policy and its implementation is often assessed on such 'hard' indicators of impact as changes in the number of students gaining five or more A to C grades in national examinations or a percentage fall in the number of exclusions in inner city schools. Such measures are necessarily crude, with large samples smoothing out errors and disguising instances of significant success or failure. Even when 'measurable' in such a fashion, however, the impact of any educational change or intervention may require a period of years to become observable. This paper considers circumstances in which short-term change may be implausible or difficult to observe. It explores how impact is currently theorized and researched and promotes the concept of 'soft' indicators of impact in circumstances in which the pursuit of conventional quantitative and qualitative evidence is rendered impractical within a reasonable cost and timeframe. Such indicators are characterized by their avowedly subjective, anecdotal and impressionistic provenance and have particular importance in the context of complex community education issues where the assessment of any impact often faces considerable problems of access. These indicators include the testimonies of those on whom the research intervention or policy focuses (for example, students, adult learners), the formative effects that are often reported (for example, by head teachers, community leaders) and media coverage. The collation and convergence of a wide variety of soft indicators (Where there is smoke …) is argued to offer a credible means of identifying subtle processes that are often neglected as evidence of potential and actual impact (… there is fire).

The impact of adversity in childhood on outcomes in adulthood: research lessons and limitations

Summary: Current UK Government policy is concerned with the possible connections between childhood adversity, social exclusion and negative outcomes in adulthood. Understanding the impact of adverse childhood experiences on outcomes in adulthood is therefore key to informing effective policy and practice. In this article, the research on the impact of childhood adversity on outcomes in adulthood is reviewed in the broad categories of: mental health and social functioning; physical health; offending; service use; and economic impact. The literature on resilience that focuses on those who experience adversity, but do not have associated negative outcomes is also briefly considered. The strengths and limitations of the range of research methods used are then examined. Findings: Previous studies have tended to focus on specific forms of adversity, predominantly abuse and neglect, and either: specific populations and specific outcomes; specific populations and general outcomes; or general populations and specific outcomes. This means there may be incomplete understanding of the inputs (the range of adverse experiences in childhood), the processes (how these may affect people) and the outcomes (across domains in adulthood). Applications: It is concluded that it is important for social work researchers to engage in the current debate about how to prevent harmful childhood adversity and there is an important gap in the research for more interdisciplinary large-scale general population studies that consider the full range of childhood adversity and associated impacts across time and the possible processes involved.

A work-based research assessment of the impact of 'lean manufacturing' on health and safety education within an SME

Globalisation has had a major impact on the engineering industry as pacific Rim countries undercut manufacturing costs and provide a more cost-effective location for many businesses. Engineering in Nortehrn Ireland has mostly declined owing to increased competition from these countries. Engineering companies are now forced to streamline their production processes and employ cost-reducing practices in order to meet customer demands at reduced prices. This article aims to analyse the effects of one such streamlining endeavour which was first introduced after World War II in Japan- 'lean manufacturing' . 'Lean manufacturing' aims to reduce all wasteful activities within the production process in order to improve productivity, while reducing manufacturing costs. The work-based project under consideration was concerned with the impact 'lean manufacturing' may have on health and safety performance and education within an engineering company. The focus of the project was to determine through work-based research, and quantitative analysis, the employee perception on health and safety: has it changed (either positively or negatively), as a consequence of implementing 'lean manufacturing'.

Assessing and measuring impact of a digital collection in the humanities: An analysis of the SPHERE (Stormont Parliamentary Hansards: Embedded in Research and Education) Project

Although a substantial corpus of digital materials is now available to scholarship across the disciplines, objective evidence of their use, impact, and value, based on a robust assessment, is sparse. Traditional methods of assessment of impact in the humanities, notably citation in scholarly publications, are not an effective way of assessing impact of digital content. These issues are problematic in the field of Digital Humanities where there is a need to effectively assess impact to justify its continued funding and existence. A number of qualitative and quantitative methods exist that can be used to monitor the use of digital resources in various contexts although they have yet to be applied widely. These have been made available to the creators, managers, and funders of digital content in an accessible form through the TIDSR (Toolkit for the Impact of Digital Scholarly Resources) developed by the Oxford Internet Institute. In 2011, the authors of this article developed the SPHERE project (Stormont Parliamentary Hansards: Embedded in Research and Education) specifically to use TIDSR to evaluate the use and impact of The Stormont Papers, a digital collection of the Hansards of the Stormont Northern Irish Parliament from 1921 to 1972. This article presents the methodology, findings, and analysis of the project. The authors argue that TIDSR is a useful and, critically, transferrable method to understand and increase the impact of digital resources. The findings of the project are modified into a series of wider recommendations on protecting the investment in digital resources by increasing their use, value, and impact. It is reasonable to suggest that effectively showing the impact of Digital Humanities is critical to its survival.

From theory to practice:Improving the impact of health services research

Background: While significant strides have been made in health research, the incorporation of research evidence into healthcare decision-making has been marginal. The purpose of this paper is to provide an overview of how the utility of health services research can be improved through the use of theory. Integrating theory into health services research can improve research methodology and encourage stronger collaboration with decision-makers. Discussion: Recognizing the importance of theory calls for new expectations in the practice of health services research. These include: the formation of interdisciplinary research teams; broadening the training for those who will practice health services research; and supportive organizational conditions that promote collaboration between researchers and decision makers. Further, funding bodies can provide a significant role in guiding and supporting the use of theory in the practice of health services research. Summary: Institutions and researchers should incorporate the use of theory if health services research is to fulfill its potential for improving the delivery of health care. © 2005 Brazil et al; licensee BioMed Central Ltd.