Pre-validation methods for developing a patient reported outcome instrument

BACKGROUND: Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology.

METHODS: The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains.

RESULTS: The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items.

CONCLUSIONS: This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.

The outcome of the functioning filter after subsequent cataract extraction

OBJECTIVE: To evaluate and compare the outcome of functioning filtration surgery followed by cataract surgery with posterior intraocular lens implantation by both phacoemulsification and extracapsular cataract extraction (ECCE) techniques in glaucomatous eyes. PATIENTS AND METHODS: We retrospectively evaluated the clinical course of 77 eyes (68 patients) that after successful trabeculectomy, underwent cataract surgery by either phacoemulsification or ECCE techniques. We determined the frequency of partial and absolute failure following cataract surgery by either phacoemulsification or ECCE in eyes with functioning trabeculectomies. Partial failure of intraocular pressure (IOP), control after cataract extraction was defined as the need for an increased number of antiglaucoma medications or argon laser trabeculoplasty to maintain IOP =21mm Hg. Complete failure of IOP control after cataract surgery was defined as an IOP >21 mm Hg on at least two consecutive measurements one or more weeks apart or the performance of additional filtration surgery. Failure rates were calculated using the Kaplan-Meier actuarial method. Failure rates between phacoemulsification and ECCE subgroups were compared using the log rank test. RESULTS: The probability of partial failure by the third postoperative year after cataract surgery was 39.5% in the phacoemulsification subgroup and 37.3% in the ECCE subgroup. This small difference is not statistically significant (P = 0.48). The probability of complete failure by the fourth postoperative year after cataract surgery was 12.0% in the phacoemulsification subgroup and 12.5% in the ECCE subgroup. This difference is also not statistically significant (P = 0.77). At the 6-month follow-up visit, visual acuity of both groups improved one or more lines in 87.0% of patients, and worsened one or more lines in 3.9% of patients. Sixty-one percent achieved visual acuity of 20/40 or better. The most frequent complication was posterior capsular opacification requiring laser capsulotomy that occurred in 31.2% of patients. CONCLUSION: Cataract extraction by either phacoemulsification or ECCE following trabeculectomy surgery may be associated with a partial loss of the previously functioning filter and the need for more antiglaucoma medications to control IOP.

Association Study of 167 Candidate Genes for Schizophrenia Selected by a Multi-Domain Evidence-Based Prioritization Algorithm and Neurodevelopmental Hypothesis

Integrating evidence from multiple domains is useful in prioritizing disease candidate genes for subsequent testing. We ranked all known human genes (n = 3819) under linkage peaks in the Irish Study of High-Density Schizophrenia Families using three different evidence domains: 1) a meta-analysis of microarray gene expression results using the Stanley Brain collection, 2) a schizophrenia protein-protein interaction network, and 3) a systematic literature search. Each gene was assigned a domain-specific p-value and ranked after evaluating the evidence within each domain. For comparison to this
ranking process, a large-scale candidate gene hypothesis was also tested by including genes with Gene Ontology terms related to neurodevelopment. Subsequently, genotypes of 3725 SNPs in 167 genes from a custom Illumina iSelect array were used to evaluate the top ranked vs. hypothesis selected genes. Seventy-three genes were both highly ranked and involved in neurodevelopment (category 1) while 42 and 52 genes were exclusive to neurodevelopment (category 2) or highly ranked (category 3), respectively. The most significant associations were observed in genes PRKG1, PRKCE, and CNTN4 but no individual SNPs were significant after correction for multiple testing. Comparison of the approaches showed an excess of significant tests using the hypothesis-driven neurodevelopment category. Random selection of similar sized genes from two independent genome-wide association studies (GWAS) of schizophrenia showed the excess was unlikely by chance. In a further meta-analysis of three GWAS datasets, four candidate SNPs reached nominal significance. Although gene ranking using integrated sources of prior information did not enrich for significant results in the current experiment, gene selection using an a priori hypothesis (neurodevelopment) was superior to random selection. As such, further development of gene ranking strategies using more carefully selected sources of information is warranted.

SMART Arm with outcome-triggered electrical stimulation:a pilot randomized clinical trial

The SMART (SensoriMotor Active Rehabilitation Training) Arm is a nonrobotic device designed to allow stroke survivors with severe paresis to practice reaching. It can be used with or without outcome-triggered electrical stimulation (OT-stim) to augment movement. The aim of this study was to evaluate the efficacy of SMART Arm training when used with or without OT-stim, in addition to usual care, as compared with usual care alone during inpatient rehabilitation.

Hyperglycemia and Adverse Pregnancy Outcome (HAPO) study:preeclampsia

Objective: The purpose of this study was to examine associations of fasting C-peptide, body mass index (BMI), and maternal glucose with the risk of preeclampsia in a multicenter multinational study. Study Design: We conducted a secondary analysis of a blinded observational cohort study. Subjects underwent a 75-g oral glucose tolerance test at 24-32 weeks' gestation. Associations of preeclampsia with fasting C-peptide, BMI, and maternal glucose were assessed with the use of multiple logistic regression analyses and adjustment for potential confounders. Results: Of 21,364 women who were included in the analyses, 5.2% had preeclampsia. Adjusted odds ratios for preeclampsia for 1 SD higher fasting C-peptide (0.87 ug/L), BMI (5.1 kg/m), and fasting (6.9 mg/dL), 1-hour (30.9 mg/dL), and 2-hour plasma glucose (23.5 mg/dL) were 1.28 (95% confidence interval [CI], 1.20-1.36), 1.60 (95% CI, 1.60-1.71), 1.08 (95% CI, 1.00-1.16), 1.19 (95% CI, 1.11-1.28), and 1.21 (95% CI,1.13-1.30), respectively. Conclusion: Results indicate strong, independent associations of fasting C-peptide and BMI with preeclampsia. Maternal glucose levels (below diabetes mellitus) had weaker associations with preeclampsia, particularly after adjustment for fasting C-peptide and BMI. © 2010 Mosby, Inc. All rights reserved.

AXL Is a Key Regulator of Inherent and Chemotherapy-Induced Invasion and Predicts a Poor Clinical Outcome in Early-Stage Colon Cancer

Purpose: Despite the use of 5-fluorouracil (5-FU)–based adjuvant treatments, a large proportion of patients with high-risk stage II/III colorectal cancer will relapse. Thus, novel therapeutic strategies are needed for early-stage colorectal cancer. Residual micrometastatic disease from the primary tumor is a major cause of patient relapse.

Experimental Design: To model colorectal cancer tumor cell invasion/metastasis, we have generated invasive (KRASMT/KRASWT/+chr3/p53-null) colorectal cancer cell subpopulations. Receptor tyrosine kinase (RTK) screens were used to identify novel proteins that underpin the migratory/invasive phenotype. Migration/invasion was assessed using the XCELLigence system. Tumors from patients with early-stage colorectal cancer (N = 336) were examined for AXL expression.

Results: Invasive colorectal cancer cell subpopulations showed a transition from an epithelial-to-mesenchymal like phenotype with significant increases in migration, invasion, colony-forming ability, and an attenuation of EGF receptor (EGFR)/HER2 autocrine signaling. RTK arrays showed significant increases in AXL levels in all invasive sublines. Importantly, 5-FU treatment resulted in significantly increased migration and invasion, and targeting AXL using pharmacologic inhibition or RNA interference (RNAi) approaches suppressed basal and 5-FU–induced migration and invasion. Significantly, high AXL mRNA and protein expression were found to be associated with poor overall survival in early-stage colorectal cancer tissues.

Conclusions: We have identified AXL as a poor prognostic marker and important mediator of cell migration/invasiveness in colorectal cancer. These findings provide support for the further investigation of AXL as a novel prognostic biomarker and therapeutic target in colorectal cancer, in particular in the adjuvant disease in which EGFR/VEGF–targeted therapies have failed.

Outcome Measures in Glaucoma:A Systematic Review of Cochrane Reviews and Protocols

In clinical trials, the selection of appropriate outcomes is crucial for the assessment of whether one intervention is better than another. Selection of inappropriate outcomes can compromise the utility of a trial. However, the process of selecting the most suitable outcomes to include can be complex. Ideally, glaucoma trials aim to evaluate important outcomes for clinicians and patients. A high variability in the selection of outcomes suggests that there is no consensus on how best to evaluate the effect of glaucoma interventions. Further, it makes evidence synthesis difficult. The purpose of this review is to determine the extent of clinical outcome measures used in published glaucoma Cochrane Reviews and Protocols.

Changes in management and outcome of patients with rectal cancer in northern ireland:1996-2006

Aim This study aimed to document developments in rectal cancer services in a UK population and evaluate changes in outcome over a 10-year period.

Method Patients diagnosed with primary rectal carcinoma in 1996, 2001 and 2006 were identified by the Northern Ireland Cancer Registry. Data were retrospectively collected on presentation, investigation, treatment and staging. Differences over the period were analysed using the chi-squared test; Kaplan–Meier and Cox regression tests were used for survival analysis.

Results After exclusions there were 636 patients, including 187 presenting in 1996, 203 in 2001 and 246 in 2006. The use of preoperative MRI of the rectum, endorectal ultrasound and abdominal CT increased during the study period. For patients treated by surgery, total mesorectal excision (TME) increased from 19% in 1996 to 64% in 2006 (P < 0.001). The use of radiotherapy (27% in 1996, 47% in 2006) and chemotherapy (21% in 1996, 32% in 2006) increased. The overall 5-year survival improved significantly between 1996 and 2006 from 34% in 1996 to 45% in 2006 (P = 0.02). Among patients having surgery, 5-year survival increased from 43% in 1996 to 63% in 2006 (P < 0.001). Multivariate analysis showed that the improvement in survival was associated with TME and chemotherapy, while radiotherapy was not.

Conclusion Survival of patients with rectal cancer in Northern Ireland has improved significantly over the last decade, probably due to the increased use of TME and chemotherapy.

Keywords Surgery, rectum, oncology

What does this paper add to the literature?
This population-based study demonstrates a significant improvement in survival over recent years of rectal cancer patients in Northern Ireland. It concludes that surgical resection with TME and chemotherapy have had a significant impact on survival and that the improvement was not due to a stage-migration effect.

Task-switching deficits and repetitive behaviour in genetic neurodevelopmental disorders: Data from children with Prader-Willi syndrome chromosome 15 q11-q13 deletion and boys with Fragile X syndrome

Prader-Willi syndrome (PWS) and Fragile X syndrome (FraX) are associated with distinctive cognitive and behavioural profiles. We examined whether repetitive behaviours in the two syndromes were associated with deficits in specific executive functions. PWS, FraX, and typically developing (TD) children were assessed for executive functioning using the Test of Everyday Attention for Children and an adapted Simon spatial interference task. Relative to the TD children, children with PWS and FraX showed greater costs of attention switching on the Simon task, but after controlling for intellectual ability, these switching deficits were only significant in the PWS group. Children with PWS and FraX also showed significantly increased preference for routine and differing profiles of other specific types of repetitive behaviours. A measure of switch cost from the Simon task was positively correlated to scores on preference for routine questionnaire items and was strongly associated with scores on other items relating to a preference for predictability. It is proposed that a deficit in attention switching is a component of the endophenotypes of both PWS and FraX and is associated with specific behaviours. This proposal is discussed in the context of neurocognitive pathways between genes and behaviour.

PET-CT as a predictor of outcome in resectable colorectal liver metastases

Introduction
PET-computed tomography (PET-CT) is a useful staging imaging modality in colorectal liver metastases (CRLM). This study aimed to determine whether PET-CT parameters, standardized uptake value (SUV) and reconstructed tumour volume (RTV), are predictors of prognosis and survival.

Methods
A study of all resectable CRLM patients in the regional HPB unit from 2007–2009 was performed. Preoperative PET-CT scans were retrospectively reviewed; SUV, diameter and RTV for each lesion was recorded. Correlation analysis was performed with other pathological and biochemical parameters, by Pearson’s correlation analysis. Survival analysis was performed using Cox regression hazard model. A P value of less than 0.05 was considered statistically significant.

Results
A total of 79 patients were included. SUV moderately correlated with tumour diameter, both PET-CT (r=0.4927; P<0.0001) and histology (r=0.4513; P=0.0003); RTV (r=0.4489; P<0.001), preoperative carcinoembryonic antigen (CEA) (r=0.4977; P=0.0001), and postoperative CEA (r=0.3727; P=0.004). Multivariate analysis found that an independent predictor of SUVmax was preoperative CEA (P=0.03). RTV strongly correlated with preoperative CEA (r=0.9389; P<0.0001). SUV and RTV had a negative effect on survival.

Conclusion
PET-CT, in the setting of CRLM, may have a prognostic role in assessing survival. Although no definite conclusions can be drawn regarding the prognostic role of SUV and RTV, it acts to reinforce the need for further prospective studies to validate these findings.