The significance of "nonsignificance" in randomized controlled studies: a discussion inspired by a double-blinded study on St. John's Wort (Hypericum perforatum L.) for premenstrual symptoms

Objectives: This study aimed to investigate the efficacy of St. John's wort extract (SJW) as a treatment for premenstrual symptoms. Design: The study was a randomized, double-blinded, placebo-controlled trial, with two parallel treatment groups. After a no-treatment baseline cycle, volunteers were randomized to either SJW or placebo for a further two menstrual cycles. Settings/location: A postal trial conducted from The University of Reading, Berkshire, England. Subjects: One hundred and sixty-nine (169) normally menstruating women who experienced recurrent premenstrual symptoms were recruited onto the study. One hundred and twenty-five (125) completed the protocol and were included in the analysis. Interventions: Six hundred milligrams (600) mg of SJW (standardized to contain 1800 mug of hypericin) or placebo (containing lactose and cellulose). Outcome measure: A menstrual diary was used to assess changes in premenstrual symptoms. The anxiety-related subgroup of symptoms of this instrument was used as the primary outcome measure. Results: After averaging the effects of treatment over both treatment cycles it was found that there was a trend for SJW to be superior to placebo. However, this finding was not statistically significant. Conclusion: The possibility that this nonsignificant finding resulted from insufficient statistical power in the study, rather than a lack of efficacy of SJW, is discussed. Following this discussion the recommendation is made that, in future, similar studies should be powered to detect a minimum clinically relevant difference between treatments.

The significance of "nonsignificance" in randomized controlled studies: a discussion inspired by a double-blinded study on St. John's Wort (Hypericum perforatum L.) for premenstrual symptoms

Objectives: This study aimed to investigate the efficacy of St. John's wort extract (SJW) as a treatment for premenstrual symptoms. Design: The study was a randomized, double-blinded, placebo-controlled trial, with two parallel treatment groups. After a no-treatment baseline cycle, volunteers were randomized to either SJW or placebo for a further two menstrual cycles. Settings/location: A postal trial conducted from The University of Reading, Berkshire, England. Subjects: One hundred and sixty-nine (169) normally menstruating women who experienced recurrent premenstrual symptoms were recruited onto the study. One hundred and twenty-five (125) completed the protocol and were included in the analysis. Interventions: Six hundred milligrams (600) mg of SJW (standardized to contain 1800 mug of hypericin) or placebo (containing lactose and cellulose). Outcome measure: A menstrual diary was used to assess changes in premenstrual symptoms. The anxiety-related subgroup of symptoms of this instrument was used as the primary outcome measure. Results: After averaging the effects of treatment over both treatment cycles it was found that there was a trend for SJW to be superior to placebo. However, this finding was not statistically significant. Conclusion: The possibility that this nonsignificant finding resulted from insufficient statistical power in the study, rather than a lack of efficacy of SJW, is discussed. Following this discussion the recommendation is made that, in future, similar studies should be powered to detect a minimum clinically relevant difference between treatments.

A pilot randomised, open, uncontrolled, clinical study of two dosages of St John's wort (Hypericum perforatum) herb extract (LI-160) as an aid to motivational/behavioural support in smoking cessation

There is an association between smoking and depression, yet the herbal antidepressant St John's wort (Hypericum perforatum L.: SJW) herb extract has not previously been investigated as an aid in smoking cessation. In this open, uncontrolled, pilot study, 28 smokers of 10 or more cigarettes per day for at least one year were randomised to receive SJW herb extract (LI-160) 300mg once or twice daily taken for one week before and continued for 3 months after a target quit date. In addition, all participants received motivational/behavioural support from a trained pharmacist. At 3 months, the point prevalence and continuous abstinence rates were both 18%, and at 12 months were 0%. Fifteen participants (54%) reported 23 adverse events up to the end of the 3-month follow-up period. There was no statistically significant difference in the frequency of adverse events for participants taking SJW once or twice daily (p > 0.05). Most adverse events were mild, transient and non-serious. This preliminary study has not provided convincing evidence that a SJW herb extract plus individual motivational/behavioural support is likely to be effective as an aid in smoking cessation. However, it may be premature to rule out a possible effect on the basis of a single, uncontrolled pilot study, and other approaches involving SJW extract may warrant investigation.