The significance of "nonsignificance" in randomized controlled studies: a discussion inspired by a double-blinded study on St. John's Wort (Hypericum perforatum L.) for premenstrual symptoms

Objectives: This study aimed to investigate the efficacy of St. John's wort extract (SJW) as a treatment for premenstrual symptoms. Design: The study was a randomized, double-blinded, placebo-controlled trial, with two parallel treatment groups. After a no-treatment baseline cycle, volunteers were randomized to either SJW or placebo for a further two menstrual cycles. Settings/location: A postal trial conducted from The University of Reading, Berkshire, England. Subjects: One hundred and sixty-nine (169) normally menstruating women who experienced recurrent premenstrual symptoms were recruited onto the study. One hundred and twenty-five (125) completed the protocol and were included in the analysis. Interventions: Six hundred milligrams (600) mg of SJW (standardized to contain 1800 mug of hypericin) or placebo (containing lactose and cellulose). Outcome measure: A menstrual diary was used to assess changes in premenstrual symptoms. The anxiety-related subgroup of symptoms of this instrument was used as the primary outcome measure. Results: After averaging the effects of treatment over both treatment cycles it was found that there was a trend for SJW to be superior to placebo. However, this finding was not statistically significant. Conclusion: The possibility that this nonsignificant finding resulted from insufficient statistical power in the study, rather than a lack of efficacy of SJW, is discussed. Following this discussion the recommendation is made that, in future, similar studies should be powered to detect a minimum clinically relevant difference between treatments.

The significance of "nonsignificance" in randomized controlled studies: a discussion inspired by a double-blinded study on St. John's Wort (Hypericum perforatum L.) for premenstrual symptoms

Objectives: This study aimed to investigate the efficacy of St. John's wort extract (SJW) as a treatment for premenstrual symptoms. Design: The study was a randomized, double-blinded, placebo-controlled trial, with two parallel treatment groups. After a no-treatment baseline cycle, volunteers were randomized to either SJW or placebo for a further two menstrual cycles. Settings/location: A postal trial conducted from The University of Reading, Berkshire, England. Subjects: One hundred and sixty-nine (169) normally menstruating women who experienced recurrent premenstrual symptoms were recruited onto the study. One hundred and twenty-five (125) completed the protocol and were included in the analysis. Interventions: Six hundred milligrams (600) mg of SJW (standardized to contain 1800 mug of hypericin) or placebo (containing lactose and cellulose). Outcome measure: A menstrual diary was used to assess changes in premenstrual symptoms. The anxiety-related subgroup of symptoms of this instrument was used as the primary outcome measure. Results: After averaging the effects of treatment over both treatment cycles it was found that there was a trend for SJW to be superior to placebo. However, this finding was not statistically significant. Conclusion: The possibility that this nonsignificant finding resulted from insufficient statistical power in the study, rather than a lack of efficacy of SJW, is discussed. Following this discussion the recommendation is made that, in future, similar studies should be powered to detect a minimum clinically relevant difference between treatments.

A pilot randomised, open, uncontrolled, clinical study of two dosages of St John's wort (Hypericum perforatum) herb extract (LI-160) as an aid to motivational/behavioural support in smoking cessation

There is an association between smoking and depression, yet the herbal antidepressant St John's wort (Hypericum perforatum L.: SJW) herb extract has not previously been investigated as an aid in smoking cessation. In this open, uncontrolled, pilot study, 28 smokers of 10 or more cigarettes per day for at least one year were randomised to receive SJW herb extract (LI-160) 300mg once or twice daily taken for one week before and continued for 3 months after a target quit date. In addition, all participants received motivational/behavioural support from a trained pharmacist. At 3 months, the point prevalence and continuous abstinence rates were both 18%, and at 12 months were 0%. Fifteen participants (54%) reported 23 adverse events up to the end of the 3-month follow-up period. There was no statistically significant difference in the frequency of adverse events for participants taking SJW once or twice daily (p > 0.05). Most adverse events were mild, transient and non-serious. This preliminary study has not provided convincing evidence that a SJW herb extract plus individual motivational/behavioural support is likely to be effective as an aid in smoking cessation. However, it may be premature to rule out a possible effect on the basis of a single, uncontrolled pilot study, and other approaches involving SJW extract may warrant investigation.

Herbal medicine: the science of the art

In the last 50 years science has provided new perspectives on the ancient art of herbal medicine. The present article discusses ways in which the evidence base for the professional use of 'Western' herbal medicine, as therapy to treat disease, known as phytotherapy, can be strengthened and developed. The evidence base for phytotherapy is small and lags behind that for the nutritional sciences, mainly because phytochemicals are ingested as complex mixtures that are incompletely characterised and have only relatively recently been subject to scientific scrutiny. While some methodologies developed for the nutritional sciences can inform phytotherapy research, opportunities for observational studies are more limited, although greater use could be made of patient case notes. Randomised clinical trials of single-herb interventions are relatively easy to undertake and increasing numbers of such studies are being published. Indeed, enough data are available on three herbs (ginkgo (Ginkgo biloba), St John's wort (Hypericum perforatum) and saw palmetto (Serenoa repens)) for meta-analyses to have been undertaken. However, phytotherapy is holistic therapy, using lifestyle advice, nutrition and individually-prescribed mixtures of herbs aimed at reinstating homeostasis. While clinical experience shows that this approach is applicable to a wide range of conditions, including chronic disease, evidence of its efficacy is scarce. Strategies for investigating the full holistic approach of phytotherapy and its main elements are discussed and illustrated through the author's studies at the University of Reading.