Testing the allegiance bias hypothesis: a meta-analysis

This meta-analysis investigated whether the association between researcher allegiance (RA) and the relative effect of two psychotherapies can be explained through the methodological weaknesses of the treatment comparisons. Seventy-nine comparisons of psychotherapies for depression or posttraumatic stress disorder (PTSD) were included. Methodological quality (MQ) was investigated as both a moderator and a mediator of the RA-outcome association. MQ included balanced nonspecific factors, balanced specific factors, conceptual quality, patients-per-therapist ratio, randomization to conditions and outcome assessment. The RA-outcome association was stronger when the MQ was low, suggesting a buffering effect of MQ. In addition, differences in the conceptual quality of treatments mediated the effect of RA on outcome. The results support the view that RA acts as a bias in treatment comparisons.

Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? a meta-analysis

Many meta-analyses of comparative outcome studies found a substantial association of researcher allegiance (RA) and relative treatment effects. Therefore, RA is regarded as a biasing factor in comparative outcome research (RA bias hypothesis). However, the RA bias hypothesis has been criticized as causality might be reversed. That is, RA might be a reflection of true efficacy differences between treatments (true efficacy hypothesis). Consequently, the RA-outcome association would not be indicative of bias but an epiphenomenon of true efficacy differences. This meta-analysis tested the validity of the true efficacy hypothesis. This was done by controlling the RA-outcome association for true efficacy differences by restricting analysis to direct comparisons of treatments with equivalent efficacy. We included direct comparisons of different versions of trauma-focused therapy (TFT) in the treatment of posttraumatic stress disorder (PTSD). RA was measured from the research reports. Relative effect sizes for symptoms of PTSD were calculated. Random effects meta-regression was conducted. Twenty-nine comparisons of TFTs from 20 studies were identified. Initial heterogeneity among relative effect sizes was low. RA was a significant predictor of outcome and explained 12% of the variance in outcomes. The true efficacy hypothesis predicted the RA-outcome association to be zero; however, a substantial association was found. Thus, this study does not support the true efficacy hypothesis. Given findings from psychotherapy research and other fields that support a biasing influence of researcher preferences, RA should be regarded as a causal factor and conceptualized as a threat to the validity of conclusions from comparative outcome studies.

Researcher allegiance in psychotherapy outcome research: an overview of reviews

Researcher allegiance (RA) is widely discussed as a risk of bias in psychotherapy outcome research. The relevance attached to RA bias is related to meta-analyses demonstrating an association of RA with treatment effects. However, recent meta-analyses have yielded mixed results. To provide more clarity on the magnitude and robustness of the RA-outcome association this article reports on a meta-meta-analysis summarizing all available meta-analytic estimates of the RA-outcome association. Random-effects methods were used. Primary study overlap was controlled. Thirty meta-analyses were included. The mean RA-outcome association was r=.262 (p=.002, I(2)=28.98%), corresponding to a moderate effect size. The RA-outcome association was robust across several moderating variables including characteristics of treatment, population, and the type of RA assessment. Allegiance towards the RA bias hypothesis moderated the RA-outcome association. The findings of this meta-meta-analysis suggest that the RA-outcome association is substantial and robust. Implications for psychotherapy outcome research are discussed.

The efficacy of non-directive supportive therapy for adult depression: A meta-analysis

The effects of non-directive supportive therapy (NDST) for adult depression have been examined in a considerable number of studies, but no meta-analysis of these studies has been conducted. We selected 31 studies on NDST from a comprehensive database of trials, examining psychotherapies for adult depression, and conducted meta-analyses in which NDST was compared with control groups, other psychotherapies and pharmacotherapy. We found that NDST is effective in the treatment of depression in adults (g=0.58; 95% CI: 0.45-0.72). NDST was less effective than other psychological treatments (differential effect size g=-0.20; 95% CI: -0.32 to -0.08, p<0.01), but these differences were no longer present after controlling for researcher allegiance. We estimated that extra-therapeutic factors (those processes operating in waiting-list and care-as-usual controls) were responsible for 33.3% of the overall improvement, non-specific factors (the effects of NDST compared with control groups) for 49.6%, and specific factors (the effects of NDST compared with other therapies) for 17.1%. NDST has a considerable effect on symptoms of depression. Most of the effect of therapy for adult depression is realized by non-specific factors, and our results suggest that the contribution of specific effects is limited at best.

Combination of Psychological Intervention and Phosphodiesterase-5 Inhibitors for Erectile Dysfunction: A Narrative Review and Meta-Analysis

INTRODUCTION Erectile dysfunction (ED) is an increasing health problem that demands effective treatment. There is evidence that phosphodiesterase-5 inhibitors (PDE5-Is) and psychological intervention (PI) are effective treatment options; however, little is known about their comparative efficacy and the efficacy of combined treatments. AIM The aim of this systematic review and meta-analysis is to evaluate the comparative efficacy of PI, PDE5-Is, and their combination in the treatment of ED. MAIN OUTCOME MEASURES Primary outcome was ED symptoms, and secondary outcome was sexual satisfaction of the patient. METHODS A systematic literature search was conducted in order to identify relevant articles published between 1998 and 2012. We included randomized controlled trials and controlled trials comparing PI with PDE5-I treatment or one of them against a combination of both. RESULTS Eight studies with a total number of 562 patients were included in the meta-analysis. The results of the included studies are inconclusive, though they show a trend towards a larger effect of combined treatment compared with PI or PDE5-I treatment alone. The meta-analysis found that, overall, combined treatment was more efficacious for ED symptoms than PDE5-I treatment or PI alone. Combined treatment was more efficacious than PDE5-I use alone on sexual satisfaction. No differences were found between PDE5-Is and PI as stand-alone treatments. None of the moderators (treatment duration, methodological quality, or researcher allegiance) altered the effects. CONCLUSIONS The combination of PI and PDE5-Is is a promising strategy for a favorable outcome in ED and can be considered as a first-choice option for ED patients. Stronger RCTs are required to confirm this initial finding. Schmidt HM, Munder T, Gerger H, Frühauf S, and Barth J. Combination of psychological intervention and phosphodiesterase-5 inhibitors for erectile dysfunction: A narrative review and meta-analysis. J Sex Med **;**:**-**.

Towards a taxonomy of common factors in psychotherapy-results of an expert survey

BACKGROUND: How change comes about is hotly debated in psychotherapy research. One camp considers 'non-specific' or 'common factors', shared by different therapy approaches, as essential, whereas researchers of the other camp consider specific techniques as the essential ingredients of change. This controversy, however, suffers from unclear terminology and logical inconsistencies. The Taxonomy Project therefore aims at contributing to the definition and conceptualization of common factors of psychotherapy by analyzing their differential associations to standard techniques. METHODS: A review identified 22 common factors discussed in psychotherapy research literature. We conducted a survey, in which 68 psychotherapy experts assessed how common factors are implemented by specific techniques. Using hierarchical linear models, we predicted each common factor by techniques and by experts' age, gender and allegiance to a therapy orientation. RESULTS: Common factors differed largely in their relevance for technique implementation. Patient engagement, Affective experiencing and Therapeutic alliance were judged most relevant. Common factors also differed with respect to how well they could be explained by the set of techniques. We present detailed profiles of all common factors by the (positively or negatively) associated techniques. There were indications of a biased taxonomy not covering the embodiment of psychotherapy (expressed by body-centred techniques such as progressive muscle relaxation, biofeedback training and hypnosis). Likewise, common factors did not adequately represent effective psychodynamic and systemic techniques. CONCLUSION: This taxonomic endeavour is a step towards a clarification of important core constructs of psychotherapy. KEY PRACTITIONER MESSAGE: This article relates standard techniques of psychotherapy (well known to practising therapists) to the change factors/change mechanisms discussed in psychotherapy theory. It gives a short review of the current debate on the mechanisms by which psychotherapy works. We provide detailed profiles of change mechanisms and how they may be generated by practice techniques.

Bedeutung der Arbeitsallianz in der Psychotherapie

Das pantheoretische Konzept der Arbeitsallianz stellt die kollaborative Qualität der an der Therapie beteiligten Personen (i. e. zumeist der Patient und der Therapeut) in den Mittelpunkt. Die Arbeitsallianz ist die weltweit am besten untersuchte Prozessvariable in der Psychotherapie. Die vorliegende Arbeit bietet einen Überblick über den aktuellen metaanalytischen Wissensstand. Basierend auf 200 Primärstudien mit 14.000 teilnehmenden Patienten wurde der Zusammenhang zwischen Arbeitsallianz und Therapieerfolg metaanalytisch untersucht. Die Arbeitsallianz erweist sich als äußerst robuster Prädiktor, der moderate 8 % der Varianz des Therapieerfolgs erklärt. Der Zusammenhang über die verschiedenen Psychotherapietraditionen hinweg zeigte sich sowohl unter randomisierten kontrollierten, manualisierten Studienbedingungen als auch unter naturalistischen Voraussetzungen. Der Effekt fand sich zudem in den störungsspezifischen Erfolgseinschätzungen und den generelleren Erfolgsmaßen. Die moderaten Therapeuteneffekte in den Primärstudien konnten metaanalytisch bestätigt werden. Soziokulturelle Aspekte wie Substanzmissbrauch und ethnische Minoritäten moderieren den Einfluss zwischen Arbeitsallianz und Therapieerfolg. Die Nähe der Forscher zum Allianzkonzept („allegiance“) beeinflusst die Vorhersagekraft der frühen Allianz zwar statistisch bedeutsam, jedoch nicht substanziell.

Die Arbeitsallianz – eine aktuelle meta-analytische Übersicht

Das pantheoretische Konzept der Arbeitsallianz stellt die kollaborative Qualität der an der Therapie beteiligten Personen (i. e. zumeist der Patient und der Therapeut) in den Mittelpunkt. Die Arbeitsallianz ist die weltweit am besten untersuchte Prozessvariable in der Psychotherapie. Basierend auf 200 Primärstudien mit 14.000 eingeschlossenen Patienten wurde der Zusammenhang zwischen Arbeitsallianz und Therapieerfolg metaanalytisch untersucht. Die Arbeitsallianz erweist sich als äußerst robuster Prädiktor, der moderate 8% des Therapieerfolgs erklärt. So zeigte sich der Zusammenhang über die verschiedenen Psychotherapietraditionen hinweg sowohl unter randomisiert-kontrollierten, manualisierten Studienbedingungen als auch unter naturalistischeren Voraussetzungen. Der Effekt zeigte sich sowohl in den störungsspezifischen Erfolgseinschätzungen als auch in generelleren Erfolgsmaßen. Die moderaten Therapeuteneffekte in den Primärstudien konnten in metaanalytisch bestätigt werden. Soziokulturelle Aspekte wie Substanzmissbrauch und ethnische Minoritäten moderieren den Einfluss zwischen Arbeitsallianz und Therapieerfolg. Die Nähe der Forscher zum Allianzkonzept (allegiance) beeinflusst die Vorhersagekraft zwar statistisch bedeutsam, jedoch nicht substantiell.

Psychological therapies for panic disorder with or without agoraphobia in adults: a network meta-analysis.

BACKGROUND Panic disorder is characterised by the presence of recurrent unexpected panic attacks, discrete periods of fear or anxiety that have a rapid onset and include symptoms such as racing heart, chest pain, sweating and shaking. Panic disorder is common in the general population, with a lifetime prevalence of 1% to 4%. A previous Cochrane meta-analysis suggested that psychological therapy (either alone or combined with pharmacotherapy) can be chosen as a first-line treatment for panic disorder with or without agoraphobia. However, it is not yet clear whether certain psychological therapies can be considered superior to others. In order to answer this question, in this review we performed a network meta-analysis (NMA), in which we compared eight different forms of psychological therapy and three forms of a control condition. OBJECTIVES To assess the comparative efficacy and acceptability of different psychological therapies and different control conditions for panic disorder, with or without agoraphobia, in adults. SEARCH METHODS We conducted the main searches in the CCDANCTR electronic databases (studies and references registers), all years to 16 March 2015. We conducted complementary searches in PubMed and trials registries. Supplementary searches included reference lists of included studies, citation indexes, personal communication to the authors of all included studies and grey literature searches in OpenSIGLE. We applied no restrictions on date, language or publication status. SELECTION CRITERIA We included all relevant randomised controlled trials (RCTs) focusing on adults with a formal diagnosis of panic disorder with or without agoraphobia. We considered the following psychological therapies: psychoeducation (PE), supportive psychotherapy (SP), physiological therapies (PT), behaviour therapy (BT), cognitive therapy (CT), cognitive behaviour therapy (CBT), third-wave CBT (3W) and psychodynamic therapies (PD). We included both individual and group formats. Therapies had to be administered face-to-face. The comparator interventions considered for this review were: no treatment (NT), wait list (WL) and attention/psychological placebo (APP). For this review we considered four short-term (ST) outcomes (ST-remission, ST-response, ST-dropouts, ST-improvement on a continuous scale) and one long-term (LT) outcome (LT-remission/response). DATA COLLECTION AND ANALYSIS As a first step, we conducted a systematic search of all relevant papers according to the inclusion criteria. For each outcome, we then constructed a treatment network in order to clarify the extent to which each type of therapy and each comparison had been investigated in the available literature. Then, for each available comparison, we conducted a random-effects meta-analysis. Subsequently, we performed a network meta-analysis in order to synthesise the available direct evidence with indirect evidence, and to obtain an overall effect size estimate for each possible pair of therapies in the network. Finally, we calculated a probabilistic ranking of the different psychological therapies and control conditions for each outcome. MAIN RESULTS We identified 1432 references; after screening, we included 60 studies in the final qualitative analyses. Among these, 54 (including 3021 patients) were also included in the quantitative analyses. With respect to the analyses for the first of our primary outcomes, (short-term remission), the most studied of the included psychological therapies was CBT (32 studies), followed by BT (12 studies), PT (10 studies), CT (three studies), SP (three studies) and PD (two studies).The quality of the evidence for the entire network was found to be low for all outcomes. The quality of the evidence for CBT vs NT, CBT vs SP and CBT vs PD was low to very low, depending on the outcome. The majority of the included studies were at unclear risk of bias with regard to the randomisation process. We found almost half of the included studies to be at high risk of attrition bias and detection bias. We also found selective outcome reporting bias to be present and we strongly suspected publication bias. Finally, we found almost half of the included studies to be at high risk of researcher allegiance bias.Overall the networks appeared to be well connected, but were generally underpowered to detect any important disagreement between direct and indirect evidence. The results showed the superiority of psychological therapies over the WL condition, although this finding was amplified by evident small study effects (SSE). The NMAs for ST-remission, ST-response and ST-improvement on a continuous scale showed well-replicated evidence in favour of CBT, as well as some sparse but relevant evidence in favour of PD and SP, over other therapies. In terms of ST-dropouts, PD and 3W showed better tolerability over other psychological therapies in the short term. In the long term, CBT and PD showed the highest level of remission/response, suggesting that the effects of these two treatments may be more stable with respect to other psychological therapies. However, all the mentioned differences among active treatments must be interpreted while taking into account that in most cases the effect sizes were small and/or results were imprecise. AUTHORS' CONCLUSIONS There is no high-quality, unequivocal evidence to support one psychological therapy over the others for the treatment of panic disorder with or without agoraphobia in adults. However, the results show that CBT - the most extensively studied among the included psychological therapies - was often superior to other therapies, although the effect size was small and the level of precision was often insufficient or clinically irrelevant. In the only two studies available that explored PD, this treatment showed promising results, although further research is needed in order to better explore the relative efficacy of PD with respect to CBT. Furthermore, PD appeared to be the best tolerated (in terms of ST-dropouts) among psychological treatments. Unexpectedly, we found some evidence in support of the possible viability of non-specific supportive psychotherapy for the treatment of panic disorder; however, the results concerning SP should be interpreted cautiously because of the sparsity of evidence regarding this treatment and, as in the case of PD, further research is needed to explore this issue. Behaviour therapy did not appear to be a valid alternative to CBT as a first-line treatment for patients with panic disorder with or without agoraphobia.