Meta-analysis: a unifying meta-likelihood approach framing unobserved heterogeneity, study covariates, publication bias, and study quality

OBJECTIVES: This contribution provides a unifying concept for meta-analysis integrating the handling of unobserved heterogeneity, study covariates, publication bias and study quality. It is important to consider these issues simultaneously to avoid the occurrence of artifacts, and a method for doing so is suggested here. METHODS: The approach is based upon the meta-likelihood in combination with a general linear nonparametric mixed model, which lays the ground for all inferential conclusions suggested here. RESULTS: The concept is illustrated at hand of a meta-analysis investigating the relationship of hormone replacement therapy and breast cancer. The phenomenon of interest has been investigated in many studies for a considerable time and different results were reported. In 1992 a meta-analysis by Sillero-Arenas et al. concluded a small, but significant overall effect of 1.06 on the relative risk scale. Using the meta-likelihood approach it is demonstrated here that this meta-analysis is due to considerable unobserved heterogeneity. Furthermore, it is shown that new methods are available to model this heterogeneity successfully. It is argued further to include available study covariates to explain this heterogeneity in the meta-analysis at hand. CONCLUSIONS: The topic of HRT and breast cancer has again very recently become an issue of public debate, when results of a large trial investigating the health effects of hormone replacement therapy were published indicating an increased risk for breast cancer (risk ratio of 1.26). Using an adequate regression model in the previously published meta-analysis an adjusted estimate of effect of 1.14 can be given which is considerably higher than the one published in the meta-analysis of Sillero-Arenas et al. In summary, it is hoped that the method suggested here contributes further to a good meta-analytic practice in public health and clinical disciplines.

Alkene-arene meta photocycloadditions with a four-carbon-atom tether: efficient approach toward the polycyclic ring systems of aphidicolin and stemodinone

At the end of its tether! The fusion of a six-membered ring onto the four-carbon-atom tether of substrate 1 provides an efficient approach toward the polycyclic ring systems of the natural products aphidicolin and stemodinone. The reaction represents a unique example of a preference for product formation from an endo exciplex in an intramolecular system (exo:endo 2:3=1.0:1.2).

Design of a turn-linker-turn foldamer by incorporating meta-amino benzoic acid in the middle of a helix forming hexapeptide sequence: A helix breaking approach

Single crystal X-ray diffraction studies reveal that the incorporation of meta-amino benzoic acid in the middle of a helix forming hexapeptide sequence such as in peptide I Boc-Ile(1)-Aib(2)-Val(3)-m-ABA(4)-Ile(5)-Aib(6)-Leu(7)-OMe (Aib: alpha-amino isobutyric acid: m-ABA: meta-amino benzoic acid) breaks the helix propagation to produce a turn-linker-turn (T-L-T) foldamer in the solid state. In the crystalline state two conformational isomers of peptide I self-assemble in antiparallel fashion through intermolecular hydrogen bonds and aromatic pi-pi interactions to form a molecular duplex. The duplexes are further interconnected through intermolecular hydrogen bonds to form a layer of peptides. The layers are stacked one on top of the other through van der Waals interactions to form hydrophilic channels filled with solvent methanol. (C) 2009 Elsevier B.V. All rights reserved.

Revisiting youden’s index as a useful measure of the misclassification error in meta-analysis of diagnostic studies

The paper considers meta-analysis of diagnostic studies that use a continuous score for classification of study participants into healthy or diseased groups. Classification is often done on the basis of a threshold or cut-off value, which might vary between studies. Consequently, conventional meta-analysis methodology focusing solely on separate analysis of sensitivity and specificity might be confounded by a potentially unknown variation of the cut-off value. To cope with this phenomena it is suggested to use, instead, an overall estimate of the misclassification error previously suggested and used as Youden’s index and; furthermore, it is argued that this index is less prone to between-study variation of cut-off values. A simple Mantel–Haenszel estimator as a summary measure of the overall misclassification error is suggested, which adjusts for a potential study effect. The measure of the misclassification error based on Youden’s index is advantageous in that it easily allows an extension to a likelihood approach, which is then able to cope with unobserved heterogeneity via a nonparametric mixture model. All methods are illustrated at hand of an example on a diagnostic meta-analysis on duplex doppler ultrasound, with angiography as the standard for stroke prevention.

Revisiting Youden's index as a useful measure of the misclassification error in meta-analysis of diagnostic studies

The paper considers meta-analysis of diagnostic studies that use a continuous Score for classification of study participants into healthy, or diseased groups. Classification is often done on the basis of a threshold or cut-off value, which might vary between Studies. Consequently, conventional meta-analysis methodology focusing solely on separate analysis of sensitivity and specificity might he confounded by a potentially unknown variation of the cut-off Value. To cope with this phenomena it is suggested to use, instead an overall estimate of the misclassification error previously suggested and used as Youden's index and; furthermore, it is argued that this index is less prone to between-study variation of cut-off values. A simple Mantel-Haenszel estimator as a summary measure of the overall misclassification error is suggested, which adjusts for a potential study effect. The measure of the misclassification error based on Youden's index is advantageous in that it easily allows an extension to a likelihood approach, which is then able to cope with unobserved heterogeneity via a nonparametric mixture model. All methods are illustrated at hand of an example on a diagnostic meta-analysis on duplex doppler ultrasound, with angiography as the standard for stroke prevention.

A comparison of three different models for estimating relative risk in meta-analysis of clinical trials under unobserved heterogeneity

We focus on the comparison of three statistical models used to estimate the treatment effect in metaanalysis when individually pooled data are available. The models are two conventional models, namely a multi-level and a model based upon an approximate likelihood, and a newly developed model, the profile likelihood model which might be viewed as an extension of the Mantel-Haenszel approach. To exemplify these methods, we use results from a meta-analysis of 22 trials to prevent respiratory tract infections. We show that by using the multi-level approach, in the case of baseline heterogeneity, the number of clusters or components is considerably over-estimated. The approximate and profile likelihood method showed nearly the same pattern for the treatment effect distribution. To provide more evidence two simulation studies are accomplished. The profile likelihood can be considered as a clear alternative to the approximate likelihood model. In the case of strong baseline heterogeneity, the profile likelihood method shows superior behaviour when compared with the multi-level model. Copyright (C) 2006 John Wiley & Sons, Ltd.

The competition–performance relation: a meta-analytic review and test of the opposing processes model of competition and performance

What is the relation between competition and performance? The present research addresses this important multidisciplinary question by conducting a meta-analysis of existing empirical work and by proposing a new conceptual model—the opposing processes model of competition and performance. This model was tested by conducting an additional meta-analysis and 3 new empirical studies. The first meta-analysis revealed that there is no noteworthy relation between competition and performance. The second meta-analysis showed, in accord with the opposing processes model, that the absence of a direct effect is the result of inconsistent mediation via achievement goals: Competition prompts performance-approach goals which, in turn, facilitate performance; and competition also prompts performance-avoidance goals which, in turn, undermine performance. These same direct and mediational findings were also observed in the 3 new empirical studies (using 3 different conceptualizations of competition and attending to numerous control variables). Our findings provide both interpretational clarity regarding past research and conceptual guidance regarding future research on the competition–performance relation.

Meta-morphs: – being a mediator of the ‘thin’ place and ‘thin’ experience in the HE classroom. A paper on the experience of creating transformations in HE teaching and learning

The research which underpins this paper began as a doctoral project exploring archaic beliefs concerning Otherworlds and Thin Places in two particular landscapes - the West Coast of Wales and the West Coast of Ireland. A Thin Place is an ancient Celtic Christian term used to describe a marginal, liminal realm, beyond everyday human experience and perception, where mortals could pass into the Otherworld more readily, or make contact with those in the Otherworld more willingly. To encounter a Thin Place in ancient folklore was significant because it engendered a state of alertness, an awakening to what the theologian John O’ Donohue (2004: 49) called “the primal affection.” These complex notions and terms will be further explored in this paper in relation to Education. Thin Teaching is a pedagogical approach which offers students the space to ruminate on the possibility that their existence can be more and can mean more than the categories they believed they belonged to or felt they should inhabit. Central to the argument then, is that certain places and their inhabitants can become revitalised by sensitively considered teaching methodologies. This raises interesting questions about the role spirituality plays in teaching practice as a tool for healing in the twenty first century.

Mastery-approach goals eliminate retrieval-induced forgetting: the role of achievement goals in memory inhibition

The present study examined how achievement goals affect retrieval-induced forgetting. Researchers have suggested that mastery-approach goals (i.e., developing one’s own competence) promote a relational encoding, whereas performance-approach goals (i.e., demonstrating one’s ability in comparison to others) promote item-specific encoding. These different encoding processes may affect the degree to which participants integrate the exemplars within a category and, as a result, we expected that retrieval-induced forgetting may be reduced or eliminated under mastery-approach goals. Three experiments were conducted using a retrieval-practice paradigm with different stimuli, where participants’ achievement goals were manipulated through brief written instructions. A meta-analysis that synthesized the results of the three experiments showed that retrieval-induced forgetting was not statistically significant in the mastery-approach goal condition, whereas it was statistically significant in the performance-approach goal condition. These results suggest that mastery-approach goals eliminate retrieval-induced forgetting, but performance-approach goals do not, demonstrating that motivation factors can influence inhibition and forgetting.

Meta-analysis to integrate effect sizes within a paper: Possible misuse and Type-1 error inflation

In recent years an increasing number of papers have employed meta-analysis to integrate effect sizes of researchers’ own series of studies within a single paper (“internal meta-analysis”). Although this approach has the obvious advantage of obtaining narrower confidence intervals, we show that it could inadvertently inflate false-positive rates if researchers are motivated to use internal meta-analysis in order to obtain a significant overall effect. Specifically, if one decides whether to stop or continue a further replication experiment depending on the significance of the results in an internal meta-analysis, false-positive rates would increase beyond the nominal level. We conducted a set of Monte-Carlo simulations to demonstrate our argument, and provided a literature review to gauge awareness and prevalence of this issue. Furthermore, we made several recommendations when using internal meta-analysis to make a judgment on statistical significance.