Accumulating research: a systematic account of how cumulative meta-analyses would have provided knowledge, improved health, reduced harm and saved resources

BACKGROUND: "Cumulative meta-analysis" describes a statistical procedure to calculate, retrospectively, summary estimates from the results of similar trials every time the results of a further trial in the series had become available. In the early 1990 s, comparisons of cumulative meta-analyses of treatments for myocardial infarction with advice promulgated through medical textbooks showed that research had continued long after robust estimates of treatment effects had accumulated, and that medical textbooks had overlooked strong, existing evidence from trials. Cumulative meta-analyses have subsequently been used to assess what could have been known had new studies been informed by systematic reviews of relevant existing evidence and how waste might have been reduced.

METHODS AND FINDINGS: We used a systematic approach to identify and summarise the findings of cumulative meta-analyses of studies of the effects of clinical interventions, published from 1992 to 2012. Searches were done of PubMed, MEDLINE, EMBASE, the Cochrane Methodology Register and Science Citation Index. A total of 50 eligible reports were identified, including more than 1,500 cumulative meta-analyses. A variety of themes are illustrated with specific examples. The studies showed that initially positive results became null or negative in meta-analyses as more trials were done; that early null or negative results were over-turned; that stable results (beneficial, harmful and neutral) would have been seen had a meta-analysis been done before the new trial; and that additional trials had been much too small to resolve the remaining uncertainties.

CONCLUSIONS: This large, unique collection of cumulative meta-analyses highlights how a review of the existing evidence might have helped researchers, practitioners, patients and funders make more informed decisions and choices about new trials over decades of research. This would have led to earlier uptake of effective interventions in practice, less exposure of trial participants to less effective treatments, and reduced waste resulting from unjustified research.

Research-informed design, management and maintenance of infrastructure slopes: development of a multi-scalar approach

The UK’s transport infrastructure is one of the most heavily used in the world. The performance of these networks is critically dependent on the performance of cutting and embankment slopes which make up £20B of the £60B asset value of major highway infrastructure alone. The rail network in particular is also one of the oldest in the world: many of these slopes are suffering high incidents of instability (increasing with time). This paper describes the development of a fundamental understanding of earthwork material and system behaviour, through the systematic integration of research across a range of spatial and temporal scales. Spatially these range from microscopic studies of soil fabric, through elemental materials behaviour to whole slope modelling and monitoring and scaling up to transport networks. Temporally, historical and current weather event sequences are being used to understand and model soil deterioration processes, and climate change scenarios to examine their potential effects on slope performance in futures up to and including the 2080s. The outputs of this research are being mapped onto the different spatial and temporal scales of infrastructure slope asset management to inform the design of new slopes through to changing the way in which investment is made into aging assets. The aim ultimately is to help create a more reliable, cost effective, safer and more resilient transport system.

Picturing Probation: Exploring the utility of visual methods in comparative research

A previous review of research on the practice of offender supervision identified the predominant use of interview-based methodologies and limited use of other research approaches (Robinson and Svensson, 2013). It also found that most research has tended to be locally focussed (i.e. limited to one jurisdiction) with very few comparative studies. This article reports on the application of a visual method in a small-scale comparative study. Practitioners in five European countries participated and took photographs of the places and spaces where offender supervision occurs. The aims of the study were two-fold: firstly to explore the utility of a visual approach in a comparative context; and secondly to provide an initial visual account of the environment in which offender supervision takes place. In this article we address the first of these aims. We describe the application of the method in some depth before addressing its strengths and weaknesses. We conclude that visual methods provide a useful tool for capturing data about the environments in which offender supervision takes place and potentially provide a basis for more normative explorations about the practices of offender supervision in comparative contexts.

The Changing Context for Planning Education in the UK and the Prospects for Research-Led, Practice-Engaged Teaching

The UK’s Royal Town Planning Institute (RTPI) has celebrated its centenary in 2014, marking 100 years of close relationships between university-based planning schools and a professional body focused on planning practice. During this period, the context for university education and the very idea of planning have changed dramatically contributing to a continual renegotiation of the relationships between the planning profession and the educational institutions it accredits. These changes have been particularly pronounced in the last 10 years where a number of factors have forced a rapid change in the nature of planjavascript:void(0);ning education in the UK. This has included a boom and then slump in the number of planning students linked to the dynamics of national economic situation, a reorganization of many planning school curricula, and their merger with cognate disciplines such as geography and an increased focus on research output, rather than professional engagement as the key indicator of institutional success. This last factor adds a particularly new dimension to the profession-university relationship, which could potentially lead to either straining of tensions or a synergy through research-led teaching that could significantly benefit both. This chapter will briefly review the evolution of UK planning schools and of the main ideas informing planning education. It will then describe the current profile of UK planning schools, based on an extensive national survey conducted on behalf of the Royal Town Planning Institute. The paper will then critically review the main challenges and opportunities facing UK planning schools in the context of changes in both planning practice and higher education. It will then move on to the concept of research-led teaching, drawing on current practice in the UK and review how well this concept serves students and the idea of developing reflective planning practitioners. Finally, the paper will seek to draw broad lessons from the experience of the UK and reflect on the type of planning education that can best serve planning professions in a variety of international contexts in the future.

The Promise of Peace:Revisiting the Northern Irish Model

The Northern Ireland peace process is often eulogized as a successful model of conflict transformation. Although the process exhibited many of the problems that beset other societies seeking to move from conflict to a negotiated peace (including disagreements over the functioning of institutions and the meanings of cultural symbols, unresolved issues relating to the effects of political violence on victims and survivors and society at large; and the residual presence of violent and political ‘spoiler’ groups), the resilience of political dialogue has proven remarkable.
This collection revisits the promise of ‘a truly historic opportunity for a new beginning’ a decade and a half on from the signing of the Belfast/Good Friday Agreement in 1998. The book will bring together academics from across a number of disciplines, including management and organizational behaviour, law, politics, sociology, archaeology and literature.

The different contributions aim to assess what impact it has made in the legal, policy, and institutional areas it specifically targeted: political reform, human rights and equality provision, working through legacies of the past (including police reform, prisoner release and victims' rights) and the building of new relationships within the island of Ireland and between Ireland and Britain. With the emergence of first-time voters who had no direct experience of the violence the book explores what the Agreement offers for future generations.

The book is the culmination of a 12-month research project sponsored by the British Academy and Leverhulme that addressed the following aspects of the peace process:
Peace walls: The euphemistically named peace walls remain one of the most visible reminders of Northern Ireland’s divisions and they are famously the only material manifestations of the conflict that have grown in number and extent since the 1998 Agreement. They were originally placed between antagonistic neighbouring communities – often at their request – at times of heightened tensions. Research under this theme explored the lack of ongoing engagement with their continuing presences, evolving meanings and impact on the communities that reside beside them needs to be overtly addressed.
Cultural division: Cultural differences have often been seen as lying at the heart of the ‘Irish problem’. Despite this, art and artists have increasingly been seen as having the potential to develop new discourses. Research explored the following questions: What role can the arts play in re-imagining the spaces opened up by the promises of the 1998 Agreement? What implication does the confrontation with the legacies of conflict have for artistic practices? What impact do the arts have on constructions of identity, on narratives of history, and on electoral politics?
Institutional transformation: This strand of research explored the significance of the process of organizational change which followed the establishment of the 1998 on political and other public policy institutions such as the police and prison services. It suggested that the experience and lessons learned from such periods of transition have much to contribute to how Northern Ireland begins to address political polarization in other areas of public service infrastructure, chiefly around the sectarian monoliths of education and housing.
Working through the past: ‘Legacy’ issues have gained increasing prominence since 1998: issues to do with public symbolism (particularly relating to the flying of flags and parading), defining victimhood, securing victims’ rights, recovery of the ‘disappeared’, reintegrating ex- prisoners back into society, and the possibilities for truth recovery and reconciliation have all acquired salient and emotive force. Although the 1998 Agreement promised to ‘honour the dead’ through a ‘new beginning’, it is increasingly unclear as to whether an agreed narrative about the past is possible – or even worthwhile pursuing. Research under this theme looked at the complex relationship between memory, commemoration and violence; how commemorative events are performed, organized, policed and represented. It also addressed the fraught issue of how to come to terms with Northern Ireland’s divided and bloodied past.

The editors are in the process of guiding contributors to adapt their papers, which were presented to a series of workshops on the above themes, to the purposes of the book. In particular, the contributors will be guided to focus on the related aims of assessing the extent of change that has occurred and providing an assessment of what remains to be done. To that end, contributors are asked to engage directly with the questions that close the ‘Introduction’, namely: To what extent has the ‘promise’ of the 1998 Agreement been fulfilled? To what extent has the 1998 Agreement given rise to forms of exclusion? To what extent has the 1998 Agreement shaped new forms of debate, dispute and engagement? In the absence of that guidance having been sent out yet, the outlines below are, for the time being, the abstracts of their original papers.

The metamorphosis of authority: a case study of the Aga Khan Development Network and the Ismaili Imamate

This research is a study of modern developments of the institutions of the Nizārī Ismaili imamate during the time of the present Ismaili Imam, Shāh Karīm al-Ḥusaynī, Aga Khan IV, as the 49th hereditary living Imam of Shiʿi Nizārī Ismaili Muslims, particularly addressing the formation of the Aga Khan Development Network (AKDN) and the functions of the Community institutions. Using the case study of the Aga Khan Development Network and the Nizārī Ismaili imamate, this research demonstrates that the three ideal types of authority as proposed by Weber, namely the traditional, charismatic and legal-bureaucratic types, are not sufficient to explain the dynamics of authority among Muslims. This is partly due to Weber’s belief in the uniqueness of Western civilisation, which is a product of his thesis on Protestant Ethics and partly because his ideal typical system does not work in the case of the Muslim societies. The Ismaili imamate with its multifarious institutions in contemporary times is the most suitable counter-example by which to powerfully demonstrate that Weberian models of authority fail to explain this phenomenon and it would indeed appear as a paradoxical institution if viewed with Weberian theses. The Ismaili imamate in contemporary times represents a paradigm shift and a transmutation not only as regards the Weberian models but also when viewed from inside the tradition of Shiʿi Muslim history. This evolutionary leap forward, which has been crystallised over the course of the past half a century, in the Ismaili imamate suggests the development of a new form of authority which is unprecedented. There are clearly various elements in this form of authority which could be discerned as rooted in tradition and history; however the distinctive elements of this new form of authority give it a defining and exciting dimension. There are several qualities which are peculiar to the contemporary condition of the Ismaili imamate and its style of leadership which are distinctive. Most importantly, while some central features, like succession by way of designation (naṣṣ) has not changed, there is one overarching quality which can best capture all these elements and that is the transmutation of the Ismaili imamate from the person of the Imam into the office of imamate and thus we are now facing the institutionalisation of the imamate and the office being the embodiment of the authority of the Imam. I have described this new development as a metamorphosis of the authority because it gives an entirely new form and content to the previously familiar concept of authority in the Shiʿi Ismaili Muslim tradition.

Reflections Upon the Experience of Longitudinal Research into Cultural Event Production in a Developing Destination

Longitudinal studies have the capacity to provide more nuanced explanations of tourism and event phenomena, taking account of complexity, change and context. This paper is a self-reflexive, methodological study of research practice. It investigates my experience of engaging with cultural event producers in an emerging destination over a seven-year period. Focussing on my research journey, it considers the social and relational dynamics associated with longitudinal research. Reciprocal relations and co-production of cultural events reveal nuanced information and expose fluid relationships and networks. Long-term engagement uncovers evolving practices and develops understanding of event processes embedded within their wider context.

Initial dilemmas in IST research: design science and design research, a clarification of concepts

The inter-disciplinarity of information systems, applied discipline and activity of design, and the study from different paradigms perspectives explains the diversity of problems addressed. The context is broad and includes important issues beyond technology, as the application, use, effectiveness, efficiency and their organizational and social impacts. In design science, the research interest is in contributing to the improvement of the processes of the design activity itself. The relevance of research in design science is associated with the result obtained for the improvement of living conditions in organizational, inter-organizational and Society contexts. In the research whose results are artifacts, the adoption of design research as a process of research is crucial to ensure discipline, rigor and transparency. Based on a literature review, this paper clarifies the terms of design science and design research. This is the main motivation for presenting this paper, determinant for the phase in research in technologies and information systems which are the three research projects presented. As a result the three projects are discussed in relation to the concepts of design science and design research.

Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries

BACKGROUND: The synthesis of published research in systematic reviews is essential when providing evidence to inform clinical and health policy decision-making. However, the validity of systematic reviews is threatened if journal publications represent a biased selection of all studies that have been conducted (dissemination bias). To investigate the extent of dissemination bias we conducted a systematic review that determined the proportion of studies published as peer-reviewed journal articles and investigated factors associated with full publication in cohorts of studies (i) approved by research ethics committees (RECs) or (ii) included in trial registries. METHODS AND FINDINGS: Four bibliographic databases were searched for methodological research projects (MRPs) without limitations for publication year, language or study location. The searches were supplemented by handsearching the references of included MRPs. We estimated the proportion of studies published using prediction intervals (PI) and a random effects meta-analysis. Pooled odds ratios (OR) were used to express associations between study characteristics and journal publication. Seventeen MRPs (23 publications) evaluated cohorts of studies approved by RECs; the proportion of published studies had a PI between 22% and 72% and the weighted pooled proportion when combining estimates would be 46.2% (95% CI 40.2%-52.4%, I2 = 94.4%). Twenty-two MRPs (22 publications) evaluated cohorts of studies included in trial registries; the PI of the proportion published ranged from 13% to 90% and the weighted pooled proportion would be 54.2% (95% CI 42.0%-65.9%, I2 = 98.9%). REC-approved studies with statistically significant results (compared with those without statistically significant results) were more likely to be published (pooled OR 2.8; 95% CI 2.2-3.5). Phase-III trials were also more likely to be published than phase II trials (pooled OR 2.0; 95% CI 1.6-2.5). The probability of publication within two years after study completion ranged from 7% to 30%. CONCLUSIONS: A substantial part of the studies approved by RECs or included in trial registries remains unpublished. Due to the large heterogeneity a prediction of the publication probability for a future study is very uncertain. Non-publication of research is not a random process, e.g., it is associated with the direction of study findings. Our findings suggest that the dissemination of research findings is biased.

International Partnering strategy for e-learning provider in emerging economies: Evidence from East Africa learning institutions

International partnership has received growing interest in the literature during the past decades due to globalization, increased technological approaches and rapid changes in competitive environments. The study specifically determines the support provided by international partners on promotion of e-learning in East Africa, assess the motives of partner selection criteria, the determinants of selecting partners, partner models and partner competence of e-learning provider. The study also evaluates obstacles of e-learning partnering strategy in East Africa learning institutions. The research adopts a descriptive survey design. Target population involved East Africa learning institutions with a list of potential institutions generated from the Ministry of Higher Education database. Through a targeted reduction of the initial database, consisting of all learning institutions, both public and private, the study created a target sample base of 200 learning institutions. Structured questionnaires scheduled were used to collect primary data. Study findings showed the approach way East African communities in selecting their e-learning partners depend on international reputation of partners, partner with ability to negotiate with foreign governments, partner with international and local experiences, nationality of foreign partner and partners with local market knowledge.

Gaining a better understanding of how Outward Bound Western Canada course outcomes are achieved : a research study /

This study examined how Outward Bound Western Canada (OBWC) course outcomes are achieved by exploring the relationships among course components, students' characteristics, and course outcomes. OBWC is a wilderness-based adventure education organization that helps students achieve outcomes such as increased self-awareness, self-confidence, motivation, interpersonal skills, concern for others, and concern for the environment. This study explored the ways in which the various components of courses and the characteristics of students contribute to determining the outcomes students experience as a result of their courses. The purpose of the study was to gain a better understanding of how OBWC course outcomes are achieved in order to strengthen adventure education theory, enhance practice at OBWC and other adventure education organizations, and provide a foundation for further research on this topic. As an interpretive case study, this study sought to describe how OBWC course outcomes are achieved and to provide interpretations of the research findings. Data was gathered from OBWC students and instructors using the quantitative and qualitative data collection techniques of questionnaire, interview, and observation. Data collected from 98 participants ensured a considerable breadth to the study, while interviews with a number of participants also enabled the collection of in-depth data. Analysis and triangulation of the data from the various sources allowed discernment of the research findings. A comprehensive and detailed picture of how course outcomes are achieved emerged from the findings. Twenty-nine course components were found to influence course outcomes, including various aspects of course activities, the physical environment, instructors, and the group. The findings indicated that certain course components were most influential in determining increases to students' self-awareness, self-confidence, self-reliance, self-esteem, self-concept, motivation, self-responsibility, interpersonal skills, concern for others, and concern for the environment. A number of course components were found to indirectly contribute to positive course outcomes by helping maximize the effectiveness of other components, by increasing students' motivation while on course, or by facilitating the processing and transference of new information. The findings also suggested that several course components either directly or indirectly affected course outcomes in negative ways. In addition, the gender, age, population, and expectations of students were found to play a role in determining the course outcomes they experienced and in determining which course components caused those outcomes. Interpretation of the findings resulted in the generation of research-based theory. The main theoretical argument derived from the results of the study was that course outcomes are influenced by a combination of course components and characteristics of students. More specifically, the theory generated by the study indicated that five groupings of factors contribute to course outcomes, including course activities, the physical environment, instructors, the group, and students' characteristics. The study was considered in relation to existing adventure education literature and larger theoretical issues. The generated theory and research findings were then used to develop suggestions for improving practice at OBWC and other adventure education organizations, as well as for enhancing future research studies.

Examining the Nature of Published Research About Mentoring in Higher Education

The various forms of mentoring relationships in higher education have all proven to be valuable, offering numerous benefits to mentors and protégés. Research into mentoring provides critical insight into aspects of these relationships, which can be used to advance theoretical and practical understandings of the topic. However, little is known about the methodological characteristics of the mentoring research itself. Using descriptive quantitative content analysis, I examined five years of articles published in five scholarly journals to determine the prevalence of research about mentoring in higher education. Not surprisingly, the prevalence of these articles differed significantly among journals in higher education (1.07% to 3.13%) compared to the considerably higher prevalence rate of 53.15% for the mentoring journal, Mentoring & Tutoring [χ2 (4, N = 82) = 143.98, p < .01]. I also report findings related to the prevalence of different empirical research traditions, research designs, and data sources, as well as various populations, such as faculty members or graduate students who serve as mentors or protégés. Given the limited number of mentoring articles published in higher education journals, I was unable to compare methodological characteristics across journals. Implications for theory, research, and practice in the area of mentoring in higher education are also suggested. Understanding the methodological characteristics of the current literature allows researchers to tailor their current studies by either continuing with existing trends in methodological approaches or seeking opportunities to incorporate under-utilized research traditions, designs, or data sources, with the aim of continuing to improve mentoring knowledge and outcomes.

A Case Study of Doctoral Research Assistantships: Access and Experiences of Full-Time and Part-Time Education Students

Graduate students’ development as researchers is a key objective in higher education. Research assistantships provide distinctive spaces where graduate students can be nurtured and shaped as novice researchers as they develop theoretical and methodological knowledge. However, few scholars have investigated graduate student research assistants’ experiences and the ways these experiences are influenced by institutional regulations, informal practices, and social relations. The purpose of this case-within-a-case study was to explore the research assistantship experiences of full-time and part-time doctoral students in Education at an Ontario university. I present separate subcases for full-time and part-time students, and an overarching case of research assistantships in one program at a specific period of time. The main question was how do institutional regulations, informal practices, and social relations influence full-time and part-time doctoral students’ access to and experiences within research assistantships. My objective was to draw from interviews and documents to acquire a thorough understanding of the organizational characteristics of research assistantships (i.e., structures of access, distribution, and coordination of participation) to explore the ways institutional regulations, informal practices, and social relations promote, prevent, or limit full-time and part-time students’ legitimate peripheral participation in research assistantships. Although I devoted particular attention to the ways students’ full-time and part-time status shaped their decisions, relationships, and experiences, I was conscious that other factors such as gender, age, and cultural background may have also influenced doctoral research assistant experiences.

The role of NGOs in global health research for development

Affiliation: Hélène Delisle: Département de nutrition, Faculté de médecine, Université de Montréal

Legal aspects of animal-human combinations in Canada

This article examines the current legal regime applicable to animal-human combinations under the Assisted Human Reproduction Act (Canada). The Act prohibits as criminal offences the use of non-human reproductive material in humans, the use in humans of human reproductive material previously transplanted into a non-human life form, the creation of chimeras made from human embryos, and the creation for reproductive purposes of human/non-human hybrids. Additional animal-human combinations, such as transgenic life forms, may be regulated pursuant to section 11 of the Act in the future. The underlying concerns of the Act in establishing this regime appear to be the protection of human health and safety, human dignity and individuality, and the human genome. The Act seems calibrated to prohibit the creation of animal-human combinations that are currently unsafe and scientifically and ethically problematic, while leaving open the possibility of regulating other such combinations with more immediate scientific potential, although these also raise ethical questions. Currently, certain differences subsist in Canada between what is permissible for researchers and institutions funded by federal agencies and those in privately funded research. The development of the regulatory framework under the Act will reveal how freedom of research will be balanced against the need for scientifically valid and ethically justifiable research, and whether these differences will continue to apply.