Pre-validation methods for developing a patient reported outcome instrument

BACKGROUND: Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology.

METHODS: The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains.

RESULTS: The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items.

CONCLUSIONS: This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.

Choosing appropriate patient-reported outcomes instrument for glaucoma research: a systematic review of vision instruments

PURPOSE: To identify vision Patient-Reported Outcomes instruments relevant to glaucoma and assess their content validity.

METHODS: MEDLINE, MEDLINE in Process, EMBASE and SCOPUS (to January 2009) were systematically searched. Observational studies or randomised controlled trials, published in English, reporting use of vision instruments in glaucoma studies involving adults were included. In addition, reference lists were scanned to identify additional studies describing development and/or validation to ascertain the final version of the instruments. Instruments' content was then mapped onto a theoretical framework, the World Health Organization International Classification of Functioning, Disability and Health. Two reviewers independently evaluated studies for inclusion and quality assessed instrument content.

RESULTS: Thirty-three instruments were identified. Instruments were categorised into thirteen vision status, two vision disability, one vision satisfaction, five glaucoma status, one glaucoma medication related to health status, five glaucoma medication side effects and six glaucoma medication satisfaction measures according to each instruments' content. The National Eye Institute Visual Function Questionnaire-25, Impact of Vision Impairment and Treatment Satisfaction Survey-Intraocular Pressure had the highest number of positive ratings in the content validity assessment.

CONCLUSION: This study provides a descriptive catalogue of vision-specific PRO instruments, to inform the choice of an appropriate measure of patient-reported outcomes in a glaucoma context.

The effectiveness of early lens extraction with intraocular lens implantation for the treatment of primary angle-closure glaucoma (EAGLE): Study protocol for a randomized controlled trial

BACKGROUND: Glaucoma is the leading cause of irreversible blindness. Although primary open-angle glaucoma is more common, primary angle-closure glaucoma (PACG) is more likely to result in irreversible blindness. By 2020, 5·3 million people worldwide will be blind because of PACG. The current standard care for PACG is a stepped approach of a combination of laser iridotomy surgery (to open the drainage angle) and medical treatment (to reduce intraocular pressure). If these treatments fail, glaucoma surgery (eg, trabeculectomy) is indicated. It has been proposed that, because the lens of the eye plays a major role in the mechanisms leading to PACG, early clear lens extraction will improve glaucoma control by opening the drainage angle. This procedure might reduce the need for drugs and glaucoma surgery, maintain good visual acuity, and improve quality of life compared with standard care.EAGLE aims to evaluate whether early lens extraction improves patient-reported, clinical outcomes, and cost-effectiveness, compared with standard care.

METHODS/DESIGN: EAGLE is a multicentre pragmatic randomized trial. All people presenting to the recruitment centres in the UK and east Asia with newly diagnosed PACG and who are at least 50 years old are eligible.The primary outcomes are EQ-5D, intraocular pressure, and incremental cost per quality adjusted life year (QALY) gained. Other outcomes are: vision and glaucoma-specific patient-reported outcomes, visual acuity, visual field, angle closure, number of medications, additional surgery (e.g., trabeculectomy), costs to the health services and patients, and adverse events.A single main analysis will be done at the end of the trial, after three years of follow-up. The analysis will be based on all participants as randomized (intention to treat). 400 participants (200 in each group) will be recruited, to have 90% power at 5% significance level to detect a difference in EQ-5D score between the two groups of 0·05, and a mean difference in intraocular pressure of 1·75 mm Hg. The study will have 80% power to detect a difference of 15% in the glaucoma surgery rate.

TRIAL REGISTRATION: ISRCTN44464607.

Keratinocyte growth factor in acute lung injury to reduce pulmonary dysfunction--a randomised placebo-controlled trial (KARE):study protocol

Acute lung injury is a common, devastating clinical syndrome associated with substantial mortality and morbidity with currently no proven therapeutic interventional strategy to improve patient outcomes. The objectives of this study are to test the potential therapeutic effects of keratinocyte growth factor for patients with acute lung injury on oxygenation and biological indicators of acute inflammation, lung epithelial and endothelial function, protease:antiprotease balance, and lung extracellular matrix degradation and turnover.

Solvent induced phase inversion-based in situ forming controlled release drug delivery implants

In situ forming (ISF) drug delivery implants have gained tremendous levels of interest over the last few decades. This is due to their wide range of biomedical applications such as in tissue engineering, cell encapsulation, microfluidics, bioengineering and drug delivery. Drug delivery implants forming upon injection has shown a range of advantages which include localized drug delivery, easy and less invasive application, sustained drug action, ability to tailor drug delivery, reduction in side effects associated with systemic delivery and also improved patient compliance and comfort. Different factors such as temperature, pH, ions, and exchange of solvents are involved in in situ implant formation. This review especially focuses on ISF implants that are formed through solvent induced phase inversion (SPI) technique. The article critically reviews and compares a wide range of polymers, solvents, and co-solvents that have been used in SPI implant preparation for control release of a range of drug molecules. Major drawback of SPI systems has been their high burst release. In this regard, the article exhaustively discusses factors that affect the burst release and different modification strategies that has been utilised to reduce the burst effect from these implants. Performance and controversial issues associated with the use of different biocompatible solvents in SPI systems is also discussed. Biodegradation, formulation stability, methods of characterisation and sterilisation techniques of SPI systems is comprehensively reviewed. Furthermore, the review also examines current SPI-based marketed products, their therapeutic application and associated clinical data. It also exemplifies the interest of multi-billion dollar pharma companies worldwide for further developments of SPI systems to a range of therapeutic applications. The authors believe that this will be the first review article that extensively investigate and discusses studies done to date on SPI systems. In so doing, this article will undoubtedly serve as an enlightening tool for the scientists working in the concerned area.

A feasibility study testing four hypotheses with phase II outcomes in advanced colorectal cancer (MRC FOCUS3): a model for randomised controlled trials in the era of personalised medicine?

Background: Molecular characteristics of cancer vary between individuals. In future, most trials will require assessment of biomarkers to allocate patients into enriched populations in which targeted therapies are more likely to be effective. The MRC FOCUS3 trial is a feasibility study to assess key elements in the planning of such studies.

Patients and methods: Patients with advanced colorectal cancer were registered from 24 centres between February 2010 and April 2011. With their consent, patients' tumour samples were analysed for KRAS/BRAF oncogene mutation status and topoisomerase 1 (topo-1) immunohistochemistry. Patients were then classified into one of four molecular strata; within each strata patients were randomised to one of two hypothesis-driven experimental therapies or a common control arm (FOLFIRI chemotherapy). A 4-stage suite of patient information sheets (PISs) was developed to avoid patient overload.

Results: A total of 332 patients were registered, 244 randomised. Among randomised patients, biomarker results were provided within 10 working days (w.d.) in 71%, 15 w.d. in 91% and 20 w.d. in 99%. DNA mutation analysis was 100% concordant between two laboratories. Over 90% of participants reported excellent understanding of all aspects of the trial. In this randomised phase II setting, omission of irinotecan in the low topo-1 group was associated with increased response rate and addition of cetuximab in the KRAS, BRAF wild-type cohort was associated with longer progression-free survival.

Conclusions: Patient samples can be collected and analysed within workable time frames and with reproducible mutation results. Complex multi-arm designs are acceptable to patients with good PIS. Randomisation within each cohort provides outcome data that can inform clinical practice.

Effectiveness of a programme of exercise on physical function in survivors of critical illness following discharge from the ICU: study protocol for a randomised controlled trial (REVIVE)

Background: Following discharge home from the ICU, patients often suffer from reduced physical function, exercise capacity, health-related quality of life and social functioning. There is usually no support to address these longer term problems, and there has been limited research carried out into interventions which could improve patient outcomes. The aim of this study is to investigate the effectiveness and cost-effectiveness of a 6-week programme of exercise on physical function in patients discharged from hospital following critical illness compared to standard care.

Methods/Design: The study design is a multicentre prospective phase II, allocation-concealed, assessor-blinded, randomised controlled clinical trial. Participants randomised to the intervention group will complete three exercise sessions per week (two sessions of supervised exercise and one unsupervised session) for 6 weeks. Supervised sessions will take place in a hospital gymnasium or, if this is not possible, in the participants home and the unsupervised session will take place at home. Blinded outcome assessment will be conducted at baseline after hospital discharge, following the exercise intervention, and at 6 months following baseline assessment (or equivalent time points for the standard care group). The primary outcome measure is physical function as measured by the physical functioning subscale of the Short-Form-36 health survey following the exercise programme. Secondary outcomes are health-related quality of life, exercise capacity, anxiety and depression, self efficacy to exercise and healthcare resource use. In addition, semi-structured interviews will be conducted to explore participants’ perceptions of the exercise programme, and the feasibility (safety, practicality and acceptability) of providing the exercise programme will be assessed. A within-trial cost-utility analysis to assess the cost-effectiveness of the intervention compared to standard care will also be conducted.

Discussion: If the exercise programme is found to be effective, this study will improve outcomes that are meaningful to patients and their families. It will inform the design of a future multicentre phase III clinical trial of exercise following recovery from critical illness. It will provide useful information which will help the development of services for patients after critical illness.

Overview of clinical outcome measures used in glaucoma randomised controlled trials (RCTs)

Background: In clinical trials the selection of appropriate outcomes is crucial to the assessment of whether one intervention is better than another. Glaucoma is a chronic eye disease and the leading cause of irreversible blindness in the world. A variety of outcomes has been used and reported in glaucoma RCTs.

Objectives: The purpose of this review is to identify different clinical outcome measures used in glaucoma RCTs between January 2006 and March 2012.

Methods: A systematic review was conducted using standard methodology. We searched for RCTs in glaucoma published in English with no restrictions on the population type or size, or applied interventions. All clinical outcomes were included. Patient-reported, pharmacokinetic and economic outcomes were excluded.

Results: The search strategy identified 4288 potentially relevant abstracts. There were 315 publications retrieved, of which 233 RCTs were included. A total of 967 clinical measures were reported. There were large variations in the definitions used to describe different outcomes and their measures. Intraocular pressure (IOP) was the most commonly reported outcome (used in 201 RCTs, 86%) with a total of 422 measures (44%). Amongst the IOPrelated measures, the most commonly used was mean IOP (n=143, 15% of all measures). Safety outcomes were commonly reported, in 145 RCTs (62%) whereas visual field outcomes were utilized in 38 RCTs (16%).

Conclusions: There is a large variability in clinical outcomes used for glaucoma RCTs and in the way each outcome is reported. This lack of standardisation may impair the ability to evaluate the evidence of glaucoma interventions.

Latanoprost for open-angle glaucoma (UKGTS): a randomised, multicentre, placebo-controlled trial

Background
Treatments for open-angle glaucoma aim to prevent vision loss through lowering of intraocular pressure, but to our knowledge no placebo-controlled trials have assessed visual function preservation, and the observation periods of previous (unmasked) trials have typically been at least 5 years. We assessed vision preservation in patients given latanoprost compared with those given placebo.

Methods
In this randomised, triple-masked, placebo-controlled trial, we enrolled patients with newly diagnosed open-angle glaucoma at ten UK centres (tertiary referral centres, teaching hospitals, and district general hospitals). Eligible patients were randomly allocated (1:1) with a website-generated randomisation schedule, stratified by centre and with a permuted block design, to receive either latanoprost 0·005% (intervention group) or placebo (control group) eye drops. Drops were administered from identical bottles, once a day, to both eyes. The primary outcome was time to visual field deterioration within 24 months. Analyses were done in all individuals with follow-up data. The Data and Safety Monitoring Committee (DSMC) recommended stopping the trial on Jan 6, 2011 (last patient visit July, 2011), after an interim analysis, and suggested a change in primary outcome from the difference in proportions of patients with incident progression between groups to time to visual field deterioration within 24 months. This trial is registered, number ISRCTN96423140.

Findings
We enrolled 516 individuals between Dec 1, 2006, and March 16, 2010. Baseline mean intraocular pressure was 19·6 mm Hg (SD 4·6) in 258 patients in the latanoprost group and 20·1 mm Hg (4·8) in 258 controls. At 24 months, mean reduction in intraocular pressure was 3·8 mm Hg (4·0) in 231 patients assessed in the latanoprost group and 0·9 mm Hg (3·8) in 230 patients assessed in the placebo group. Visual field preservation was significantly longer in the latanoprost group than in the placebo group: adjusted hazard ratio (HR) 0·44 (95% CI 0·28–0·69; p=0·0003). We noted 18 serious adverse events, none attributable to the study drug.

Interpretation
This is the first randomised placebo-controlled trial to show preservation of the visual field with an intraocular-pressure-lowering drug in patients with open-angle glaucoma. The study design enabled significant differences in vision to be assessed in a relatively short observation period

Patient-reported 'ever had' and 'current' long term physical symptoms following prostate cancer treatments

OBJECTIVE: To document prostate cancer patient reported 'ever experienced' and 'current' prevalence of disease specific physical symptoms stratified by primary treatment received.
PATIENTS: 3,348 prostate cancer survivors 2-15 years post diagnosis.
METHODS: Cross-sectional, postal survey of 6,559 survivors diagnosed 2-15 years ago with primary, invasive PCa (ICD10-C61) identified via national, population based cancer registries in Northern Ireland and Republic of Ireland. Questions included symptoms at diagnosis, primary treatments and physical symptoms (impotence/urinary incontinence/bowel problems/breast changes/loss of libido/hot flashes/fatigue) experienced 'ever' and at questionnaire completion ("current"). Symptom proportions were weighted by age, country and time since diagnosis. Bonferroni corrections were applied for multiple comparisons.
RESULTS: Adjusted response rate 54%; 75% reported at least one 'current' physical symptom ('ever':90%), with 29% reporting at least three. Prevalence varied by treatment; overall 57% reported current impotence; this was highest following radical prostatectomy (RP)76% followed by external beam radiotherapy with concurrent hormone therapy (HT); 64%. Urinary incontinence (overall 'current' 16%) was highest following RP ('current'28%, 'ever'70%). While 42% of brachytherapy patients reported no 'current' symptoms; 43% reported 'current' impotence and 8% 'current' incontinence. 'Current' hot flashes (41%), breast changes (18%) and fatigue (28%) were reported more often by patients on HT.
CONCLUSION: Symptoms following prostate cancer are common, often multiple, persist long-term and vary by treatment. They represent a significant health burden. An estimated 1.6% of men over 45 is a prostate cancer survivor currently experiencing an adverse physical symptom. Recognition and treatment of physical symptoms should be prioritised in patient follow-up. This information should facilitate men and clinicians when deciding about treatment as differences in survival between radical treatments is minimal.

The impact of rehabilitation using removable partial dentures and functionally orientated treatment on oral health-related quality of life: a randomised controlled clinical trial

OBJECTIVES: This study aimed to compare two different tooth replacement strategies for partially dentate older patients; namely functionally orientated treatment according to the principles of the shortened dental arch (SDA) and conventional treatment using removable partial dentures (RPDs) using a randomised controlled clinical trial. The primary outcome measure for this study was impact on oral health-related quality of life (OHRQoL) measured using the short form of the oral health impact profile (OHIP-14).

METHODS: Patients aged 65 years and older were randomly allocated to two different treatment groups: the RPD group and the SDA group. For the RPD group each patient was restored to complete arches with cobalt-chromium RPDs used to replace missing teeth. For the SDA group, patients were restored to a premolar occlusion of 10 occluding pairs of natural and replacement teeth using resin bonded bridgework (RBB). OHRQoL was measured using the OHIP-14 questionnaire administered at baseline, 1 month, 6 months and 12 months after treatment intervention.

RESULTS: In total, 89 patients completed the RCT: 44 from the RPD group and 45 from the SDA group. Analysis using a mixed model of covariance (ANCOVA) illustrated that treatment according to the SDA concept resulted in significantly better mean OHIP-14 scores compared with RPD treatment (p<0.05). This result was replicated in both treatment centres used in the study.

CONCLUSIONS: In terms of impact on OHRQoL, treatment based on the SDA concept achieved significantly better results than that based on RPDs 12 months after treatment intervention (trial registration no. ISRCTN26302774).

CLINICAL SIGNIFICANCE: Functionally orientated treatment delivery resulted in significantly better outcomes compared to removable dentures in terms of impact on OHRQoL.

Comparison of functionally orientated tooth replacement and removable partial dentures on the nutritional status of partially dentate older patients: a randomised controlled clinical trial

OBJECTIVES: The aims of this study were to conduct a randomised controlled clinical trial (RCT) of partially dentate older adults comparing functionally orientated treatment based on the SDA concept with conventional treatment using RPDs to replace missing natural teeth. The two treatment strategies were evaluated according to their impact on nutritional status measured using haematological biomarkers.

METHODS: A randomised controlled clinical trial (RCT) was conducted of partially dentate patients aged 65 years and older (Trial Registration no. ISRCTN26302774). Each patient provided haematological samples which were screened for biochemical markers of nutritional status. Each sample was tested in Cork University Hospital for serum Albumin, serum Cholesterol, Ferritin, Folate, Vitamin B12 and 25-hydroxycholecalciferol (Vitamin D).

RESULTS: A mixed model analysis of covariance (ANCOVA) indicated that for Vitamin B12 (p=0.9392), serum Folate (p=0.5827), Ferritin (p=0.6964), Albumin (p=0.8179), Serum Total Cholesterol (p=0.3670) and Vitamin D (p=0.7666) there were no statistically significant differences recorded between the two treatment groups. According to the mixed model analysis of covariance (ANCOVA) for Vitamin D there was a significant difference between levels recorded at post-operative time points after treatment intervention (p=0.0470). There was an increase of 7% in 25-hydroxycholecalciferol levels recorded at 6 months compared to baseline (p=0.0172). There was no further change in recorded levels at 12 months (p=0.6482) and these increases were similar within the two treatment groups (p>0.05).

CONCLUSIONS: The only measure which illustrated consistent significant improvements in nutritional status for either group were Vitamin D levels. However no significant difference was recorded between the two treatment groups.

CLINICAL SIGNIFICANCE: Functionally orientated prosthodontic rehabilitation for partially dentate older patients was no worse than conventional removable partial dentures in terms of impact on nutritional status.

Cost-effectiveness of tooth replacement strategies for partially dentate elderly: a randomized controlled clinical trial

OBJECTIVE: To conduct a cost-effectiveness analysis comparing two different tooth replacement strategies for partially dentate older patients, namely partial removable dental prostheses (RDP) and functionally orientated treatment based on the shortened dental arch concept (SDA).

METHODS: Ninety-two partially dentate older patients completed a randomized controlled clinical trial. Patients were randomly allocated to two treatment groups: the RDP group and the SDA group. Treatment effect was measured using impact on oral health-related quality of life (OHrQOL), and the costs involved in providing and maintaining care were recorded for all patients. Patients were followed for 12 months after treatment intervention. All treatment was provided by a single operator.

RESULTS: The total cost of achieving the minimally important clinical difference (MID) in OHrQOL for an average patient in the RDP group was €464.64. For the SDA group, the cost of achieving the MID for an average patient was €252.00. The cost-effectiveness ratio was therefore 1:1.84 in favour of SDA treatment.

CONCLUSION: With an increasingly ageing population, many patients will continue to benefit from removable prostheses to replace their missing natural teeth. From a purely economic standpoint, the results from this analysis suggest that the treatment of partially dentate older adults should be focused on functionally orientated treatment because it is simply more cost-effective.

Randomized controlled trial assessing the effect of simvastatin in primary biliary cirrhosis

Background This study evaluated the effect of statins in Primary biliary cirrhosis (PBC) on endothelial function, anti-oxidant status and vascular compliance. Methods Primary biliary cirrhosis patients with hypercholesterolaemia were randomized to receive 20mg simvastatin or placebo in a single blind, randomized controlled trial. Body mass index, blood pressure, glucose, liver function, lipid profile, immunoglobulin levels, serological markers of endothelial function and anti-oxidant status were measured as well as vascular compliance, calculated from pulse wave analysis and velocity, at recruitment and again at 3, 6, 9 and 12months. Results Twenty-one PBC patients (F=20, mean age = 55) were randomized to simvastatin 20mg (n=11) or matched placebo (n=10). At completion of the trial, serum cholesterol levels in the simvastatin group were significantly lower compared with the placebo group (4.91mmol/L vs. 6.15mmol/L, P=0.01). Low-density lipoprotein (LDL) levels after 12months were also significantly lower in the simvastatin group (2.33mmol/L vs. 3.53mmol/L, P=0.01). After 12months of treatment, lipid hydroperoxides were lower (0.49mol/L vs. 0.59mol/L, P=0.10) while vitamin C levels were higher (80.54mol/L vs. 77.40mol/L, P=0.95) in the simvastatin group. Pulse wave velocity remained similar between treatment groups at 12months (8.45m/s vs. 8.80m/s, P=0.66). Only one patient discontinued medication owing to side effects. No deterioration in liver transaminases was noted in the simvastatin group. Conclusions Statin therapy in patients with PBC appears safe and effective towards overall reductions in total cholesterol and LDL levels. Our initial study suggests that simvastatin may also confer advantageous effects on endothelial function and antioxidant status.

Evaluating early administration of the hydroxymethylglutaryl-CoA reductase inhibitor simvastatin in the prevention and treatment of delirium in critically ill ventilated patients (MoDUS trial): Study protocol for a randomized controlled trial

Background: The incidence of delirium in ventilated patients is estimated at up to 82%, and it is associated with longer intensive care and hospital stays, and long-term cognitive impairment and mortality. The pathophysiology of delirium has been linked with inflammation and neuronal apoptosis. Simvastatin has pleiotropic properties; it penetrates the brain and, as well as reducing cholesterol, reduces inflammation when used at clinically relevant doses over the short term. This is a single centre randomised, controlled trial which aims to test the hypothesis that treatment with simvastatin will modify delirium incidence and outcomes. 

Methods/Design: The ongoing study will include 142 adults admitted to the Watford General Hospital Intensive Care Unit who require mechanical ventilation in the first 72 hours of admission. The primary outcome is the number of delirium- and coma-free days in the first 14 days. Secondary outcomes include incidence of delirium, delirium- and coma-free days in the first 28 days, days in delirium and in coma at 14 and 28 days, number of ventilator-free days at 28 days, length of critical care and hospital stay, mortality, cognitive decline and healthcare resource use. Informed consent will be taken from patient's consultee before randomisation to receive either simvastatin (80 mg) or placebo once daily. Daily data will be recorded until day 28 after randomisation or until discharge from the ICU if sooner. Surviving patients will be followed up on at six months from discharge. Plasma and urine samples will be taken to investigate the biological effect of simvastatin on systemic markers of inflammation, as related to the number of delirium- and coma-free days, and the potential of cholinesterase activity and beta-amyloid as predictors of the risk of delirium and long-term cognitive impairment. 

Discussion: This trial will test the efficacy of simvastatin on reducing delirium in the critically ill. If patients receiving the statin show a reduced number of days in delirium compared with the placebo group, the inflammatory theory implicated in the pathogenesis of delirium will be strengthened.