Quality of reporting of randomized clinical trials in abstracts of the 2005 annual meeting of the American College of Rheumatology.

Objective: To determine the quality of abstracts reporting randomized clinical trials (RCT) at the 2005 Annual Scientific Meeting of the American College of Rheumatology.

Methods: All 2005 abstracts including late-breaking abstracts were assessed. An abstract was deemed to be reporting an RCT if it indicated that participants were randomized in the title or body of the abstract. RCT were excluded if they included only pharmacokinetic data. The CONSORT checklist was applied and relevant data extracted. We defined manufacturer support as acknowledgment of industry support or industry employee as co-author.

Results: Of 2146 abstracts, 143 (6.7%) reported RCT. Of these, 78.3% were drug trials, and 63.6% indicated manufacturer support. Only 30.8% of abstracts used "randomized" in the title, 44.1% did not explicitly state whether blinding was undertaken, and only 7.0% clearly stated who was blinded. Thirty percent of studies did not give an explicit definition of eligibility criteria of participants. While 84.6% explicitly described the experimental intervention, only 37.1% explicitly described the comparator intervention. Only 21% explicitly stated that an intention to treat analysis was performed. Baseline demographic and clinical characteristics were reported in 48.3%. While most abstracts reported summary results for each treatment group, only 35.7% reported effect size with its precision.

Conclusion: The quality of reporting is suboptimal in many RCT abstracts. Abstracts reporting RCT would benefit from a structured approach that ensures more detailed reporting of eligibility criteria, active and comparator interventions, flow of participants, and adequate summary and precision of results.

Do we need to flick the switch? The need for a broader conceptualization of iatrogenic course aggravation in clinical trials of bipolar disorder?

The term ‘switching’ is often used in bipolar disorder when describing polarity changes in bipolar disorder, but this term is ambiguous and imprecise, and is sometimes used interchangeably with the term ‘cycling’. Furthermore, polarity changes in bipolar disorder can be understood in different ways, because their clinical manifestations range from the emergence of subthreshold symptoms to a full episode of the opposite pole. Besides the need to tighten the meaning of the term ‘switching’, this paper also argues that switching does not adequately describe the complex phenomena that occur with course aggravation of bipolar disorder, such as alteration in episode frequency or amplitude. A more-fine grained approach to course aggravation in bipolar disorder is proposed, which incorporates trans-polar switching, index polarity aggravation, as well as alterations in episodic amplitude, episodic duration, and interepisode length. This approach has the potential to capture a broader, more fine-grained and clinically relevant picture of the process of aggravation of the bipolar cycle.

Quality of life in restless legs syndrome: A systematic review of clinical trials and a critical review of instruments

Restless legs syndrome (RLS) is a neurological movement disorder characterized by sensory symptoms and motor disturbances. While the underlying cause remains unknown, it is suggested that 20–25% of people with RLS are affected seriously enough to require pharmacological treatment. Dopamine agonists (DAs) are the most common treatment and act by increasing the low levels of dopamine to which RLS is often attributed. A growing literature highlights the debilitating and distressing nature of this condition from the patient's perspective. While sleep problems are most commonly reported, the impact of RLS on quality of life (QOL) is wide ranging, affecting relationships with partners, sex life, family life, social life, leisure activities, friendships, everyday activities, concentration, travel, career/work, sleep, and health.

We conducted a systematic review of clinical trials in which DAs have been evaluated in terms of RLS-specific QOL, i.e. their impact on the QOL of people with RLS, and critically reviewed the development history and measurement properties of RLS-specific QOL instruments.

A systematic search using terms synonymous with RLS, DAs and QOL was conducted using Scopus software, which includes MEDLINE, PsycINFO, EMBASE, and CINAHL. Our search covered publications from 2000 (prior to which RLS-specific QOL measures did not exist) to August 2009. Trials were included in our review if they evaluated DAs for the treatment of adults with RLS and reported evaluation using an RLS-specific QOL measure. We also ran citation searches to identify papers reporting the development history and measurement properties of the identified RLS-specific QOL instruments.

Three measures of RLS-specific QOL have been developed in recent years and are reviewed here: the Restless Legs Syndrome Quality of Life (RLSQOL) questionnaire, the Restless Legs Syndrome Quality of Life Instrument (RLS-QLI), and the Quality of Life Restless Legs Syndrome (QOL-RLS) measure. Critical review indicates that each has limitations (particularly in terms of published developmental history and content validity). Eleven trials of DAs were identified that included assessment of RLS-specific QOL (nine using the RLSQOL and two using the QOL-RLS). In all studies, significant improvements in RLS-specific QOL were observed, although these were mostly short term (12 weeks) and large placebo effects were also noted.

In people with RLS, the use of DAs has been shown to improve RLS-specific QOL. Longer-term, large-scale studies may be needed to confirm these findings and demonstrate statistically significant improvements in RLS-specific QOL at lower doses. Further development of the RLS-specific QOL measures is needed to ensure that the full impact of RLS (and the full benefit of new treatments) on aspects of life identified as important to individuals is captured in future studies.

The suitability of polycystic ovary syndrome-specific questionnaires for measuring the impact of PCOS on quality of life in clinical trials

Objectives: Generic patient-reported outcome (PRO) measures underestimate the impact of polycystic ovary syndrome (PCOS) on quality of life (QoL). The aim of this review was to identify PCOS-specific QoL measures and establish whether their development history and measurement properties support their use in clinical trials.

Methods: A systematic search was conducted using terms synonymous with “PCOS” and “QoL.” Following identification of measures, further searches were undertaken using the questionnaire name and abbreviation to explore its use, development history, and demonstrated measurement properties.

Results: Of 56 abstracts screened, 21 reported using PRO measures. One PCOS-specific QoL measure was identified: the PolyCystic Ovary Syndrome Questionnaire (PCOSQ). Nine papers show that the PCOSQ’s development history is somewhat incomplete, and that it does not have good content validity. The PCOSQ subscales demonstrate acceptable levels of reliability (0.70–0.97) and partial known-groups validity as well as convergent/divergent validity with other PRO instruments. Responsiveness
to change is variable and minimally important differences have not been established.

Conclusions: The PCOSQ is the only condition-specific measure of the impact of PCOS on QoL. Additional research is required to ensure its comprehensiveness, sensitivity, and to guide interpretation prior to including in clinical trials.

Patient use of smartphones to communicate subjective data in clinical trials

Purpose. Various methods have been used in clinical trials to collect time-sensitive subjective responses, including study diaries, telephone interviews, and use of text messaging. However, all of these methods are limited by the uncertainty of when the participants enrolled in the study actually record their responses. This technical note reports on the utility of the BlackBerry smartphone to collect such data and why such a system provides advantages over other methods to report subjective ratings in clinical studies.

Methods. The Centre for Contact Lens Research developed an on-line web-enabled system that permits participants to record and immediately transmit subjective rating scores in numerical form directly into a web-enabled database. This, combined with the utility of BlackBerrys, enabled time-specific e-mail requests to be sent to the study participants and then for that data to be simultaneously transmitted to the web-enabled database. This system has been used in several clinical trials conducted at the Centre for Contact Lens Research, in which data were collected at various times and in several specific locations or environments.

Results. In the clinical trials conducted using this system, participants provided responses on 97.5% of occasions to the requests for data generated by the automated system. When the request was for data on a set date, this method resulted in responses of 84.1% of the time.

Conclusions. The series of clinical trials reported here show the benefits of the utilization of the BlackBerry to collect time- or environment-sensitive data via a web-enabled system.

Zinc for treating of children and adolescents with attention-deficit hyperactivity disorder : a systematic review of randomized controlled clinical trials

This study systematically reviews the randomized clinical trials examining the effect of zinc on attention-deficit hyperactivity disorder (ADHD), searching the PubMed/Medline and Scholar Google databases. All randomized controlled trials that examined zinc as the intervention, and ADHD as the primary outcome were included. Only three randomized controlled trials, one which included a community sample and two that included clinical samples, met inclusion criteria. The only trial that was well controlled and randomized according to the baseline zinc level showed that using zinc, either alone or in combination with stimulants, did not improve ADHD. Considering the lack of clear evidence for the effect of zinc on ADHD and the possible effect of zinc on the nervous system, more clinical studies are needed to prove or disprove the effect of zinc as a monotherapy or adjuvant therapy.

A new framework for interpreting the outcomes of imperfectly blinded controlled clinical trials

It is well known that the outcome of an intervention is affected both by the inherent effects of the intervention and the patient's expectations. For this reason in comparative clinical trials an effort is made to conceal the nature of the administered intervention from the participants in the trial i.e. to blind the trial. Yet, in practice perfect blinding is impossible to ensure or even verify post hoc. The current clinical standard is to follow up the trial with an auxiliary questionnaire, which allows trial participants to express in closed form their belief concerning the intervention, i.e. trial group assignment (treatment or control). Auxiliary questionnaire responses are then used to compute the extent of blinding in the trial in the form of a blinding index. If the estimated extent of blinding exceeds a particular threshold the trial is deemed sufficiently blinded; otherwise, the strength of evidence of the trial is brought into question. This may necessitate that the trial is repeated. In this paper we make several contributions. Firstly, we identify a series of problems of the aforesaid clinical practice and discuss them in context of the most commonly used blinding indexes. Secondly, we formulate a novel approach for handling imperfectly blinded trials. We adopt a feedback questionnaire of the same form as that which is currently in use, but interpret the collected data using a novel statistical method, significantly different from that proposed in the previous work. Unlike the previously proposed approaches, our method is void of any ad hoc free parameters and robust to small changes in the participants' feedback responses. Our method also does not discard any data and is not predicated on any strong assumptions used to interpret participants' feedback. The key idea behind the present method is that it is meaningful to compare only the corresponding treatment and control participant sub-groups, that is, sub-groups matched by their auxiliary responses. A series of experiments on simulated trials is used to demonstrate the effectiveness of the proposed approach and its superiority over those currently in use.

Assessing blinding in clinical trials

The interaction between the patient's expected outcome of an intervention and the inherent effects of that intervention can have extraordinary effects. Thus in clinical trials an effort is made to conceal the nature of the administered intervention from the participants in the trial i.e. to blind it. Yet, in practice perfect blinding is impossible to ensure or even verify. The current standard is follow up the trial with an auxiliary questionnaire, which allows trial participants to express their belief concerning the assigned intervention and which is used to compute a measure of the extent of blinding in the trial. If the estimated extent of blinding exceeds a threshold the trial is deemed sufficiently blinded; otherwise, the trial is deemed to have failed. In this paper we make several important contributions. Firstly, we identify a series of fundamental problems of the aforesaid practice and discuss them in context of the most commonly used blinding measures. Secondly, motivated by the highlighted problems, we formulate a novel method for handling imperfectly blinded trials. We too adopt a post-trial feedback questionnaire but interpret the collected data using an original approach, fundamentally different from those previously proposed. Unlike previous approaches, ours is void of any ad hoc free parameters, is robust to small changes in auxiliary data and is not predicated on any strong assumptions used to interpret participants' feedback.

Application of the gradient boosted method in randomised clinical trials: participant variables that contribute to depression treatment efficacy of duloxetine, SSRIs or placebo

Randomised, placebo-controlled trials of treatments for depression typically collect outcomes data but traditionally only analyse data to demonstrate efficacy and safety. Additional post-hoc statistical techniques may reveal important insights about treatment variables useful when considering inter-individual differences amongst depressed patients. This paper aims to examine the Gradient Boosted Model (GBM), a statistical technique that uses regression tree analyses and can be applied to clinical trial data to identify and measure variables that may influence treatment outcomes.