The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.

Patient-reported quality-of-life analysis of radium-223 dichloride from the phase III ALSYMPCA study

BACKGROUND: Radium-223 dichloride (radium-223), a first-in-class α-emitting radiopharmaceutical, is recommended in both pre- and post-docetaxel settings in patients with castration-resistant prostate cancer (CRPC) and symptomatic bone metastases based on overall survival benefit demonstrated in the phase III ALSYMPCA study. ALSYMPCA included prospective measurements of health-related quality of life (QOL) using two validated instruments: the general EuroQoL 5D (EQ-5D) and the disease-specific Functional Assessment of Cancer Therapy-Prostate (FACT-P).

PATIENTS AND METHODS: Analyses were conducted to determine treatment effects of radium-223 plus standard of care (SOC) versus placebo plus SOC on QOL using FACT-P and EQ-5D. Outcomes assessed were percentage of patients experiencing improvement, percentage of patients experiencing worsening, and mean QOL scores during the study.

RESULTS: Analyses were carried out on the intent-to-treat population of patients randomized to receive radium-223 (n = 614) or placebo (n = 307). The mean baseline EQ-5D utility and FACT-P total scores were similar between treatment groups. A significantly higher percentage of patients receiving radium-223 experienced meaningful improvement in EQ-5D utility score on treatment versus placebo {29.2% versus 18.5%, respectively; P = 0.004; odds ratio (OR) = 1.82 [95% confidence interval (CI) 1.21-2.74]}. Findings were similar for FACT-P total score [24.6% versus 16.1%, respectively; P = 0.020; OR = 1.70 (95% CI 1.08-2.65)]. A lower percentage of patients receiving radium-223 experienced meaningful worsening versus placebo measured by EQ-5D utility score and FACT-P total score. Prior docetaxel use and current bisphosphonate use did not affect these findings. Treatment was a significant predictor of EQ-5D utility score, with radium-223 associated with higher scores versus placebo (0.56 versus 0.50, respectively; P = 0.002). Findings were similar for FACT-P total score (99.08 versus 95.22, respectively; P = 0.004).

CONCLUSIONS: QOL data from ALSYMPCA demonstrated that improved survival with radium-223 is accompanied by significant QOL benefits, including a higher percentage of patients with meaningful QOL improvement and a slower decline in QOL over time in patients with CRPC.

Patient expectations, outcomes and satisfaction : related, relevant or redundant?

Abstract Study design: A prospective investigation of patients undergoing lumbar spine surgery. Objective: Is there a correlation between patient’s expectations before lumbar surgery, postoperative outcomes and satisfaction levels? Methods: A prospective study of 145 patients undergoing primary, single-level surgery for degenerative lumbar conditions was conducted. Oswestry Disability Index (ODI), back visual analogue scale (VAS) and leg VAS were assessed pre-operatively and at 6 weeks and 6 months post-surgery. Patients’ expectations were measured pre-operatively by asking them to score the level of pain and disability that would be least acceptable for them to undergo surgery and be satisfied. Satisfaction was assessed six weeks post-operatively with a Likert scale. Differences in patient expectations between actual and expected improvements were quantified. Results: Most patients had a clinically relevant improvement, but only about half achieved their expectation. Satisfaction did not correlate with pre-operative pain or disability, or with patient expectation of improvement. Instead, satisfaction correlated with positive outcomes. Conclusions Patient expectations have little bearing on final outcome and satisfaction.

Patient reported adherence to hypertension treatment: A revalidation study

Background Adherence to hypertension management in patients with hypertension is known to influence their blood pressure control. It is important to measure patients’ adherence behaviours to assist with designing appropriate interventions to improve blood pressure control. Aims The purposes of this study were to use confirmatory factor analysis to revalidate the Therapeutic Adherence Scale for Hypertensive Patients (TASHP), and to calculate the cut-off score for classifying adherence behaviours into two groups: satisfactory and low adherence behaviours. Methods Systematic random sampling was used to recruit patients with hypertension in China. Demographic characteristics, the TASHP and blood pressure were collected. The psychometric tests of the TASHP included: construct validity, criteria-related validity, internal reliability, and split-half reliability. The area under the receiver operating characteristics curve and Youden index were used to identify the cut-off score of the TASHP for blood pressure control. Results This study involved 366 patients. Confirmatory factor analysis supported the four-component structure of the TASHP proposed in the original scale development study. The TASHP has a satisfactory internal reliability (Cronbach’s α > 0.7) and a satisfactory split-half reliability (Spearman–Brown coefficients > 0.7). The patients with overall scores of the TASHP ⩾ 109 points were considered to have satisfactory adherence behaviours. Conclusion The TASHP is a validated and reliable instrument to measure the adherence to hypertension management in Chinese patients with hypertension. The cut-off score of 109 points can be considered as an effective measure to classify the level of adherence into satisfactory and low adherence behaviours.

Comparison of treatment effect sizes associated with surrogate and final patient relevant outcomes in randomised controlled trials: meta-epidemiological study

Objective To quantify and compare the treatment effect and risk of bias of trials reporting biomarkers or intermediate outcomes (surrogate outcomes) versus trials using final patient relevant primary outcomes. Design Meta-epidemiological study. Data sources All randomised clinical trials published in 2005 and 2006 in six high impact medical journals: Annals of Internal Medicine, BMJ, Journal of the American Medical Association, Lancet, New England Journal of Medicine, and PLoS Medicine. Study selection Two independent reviewers selected trials. Data extraction Trial characteristics, risk of bias, and outcomes were recorded according to a predefined form. Two reviewers independently checked data extraction. The ratio of odds ratios was used to quantify the degree of difference in treatment effects between the trials using surrogate outcomes and those using patient relevant outcomes, also adjusted for trial characteristics. A ratio of odds ratios >1.0 implies that trials with surrogate outcomes report larger intervention effects than trials with patient relevant outcomes. Results 84 trials using surrogate outcomes and 101 using patient relevant outcomes were considered for analyses. Study characteristics of trials using surrogate outcomes and those using patient relevant outcomes were well balanced, except for median sample size (371 v 741) and single centre status (23% v 9%). Their risk of bias did not differ. Primary analysis showed trials reporting surrogate endpoints to have larger treatment effects (odds ratio 0.51, 95% confidence interval 0.42 to 0.60) than trials reporting patient relevant outcomes (0.76, 0.70 to 0.82), with an unadjusted ratio of odds ratios of 1.47 (1.07 to 2.01) and adjusted ratio of odds ratios of 1.46 (1.05 to 2.04). This result was consistent across sensitivity and secondary analyses. Conclusions Trials reporting surrogate primary outcomes are more likely to report larger treatment effects than trials reporting final patient relevant primary outcomes. This finding was not explained by differences in the risk of bias or characteristics of the two groups of trials.

A systematic review of quantitative studies reporting selected patient experienced outcomes, with a specific focus on gender differences in people with colorectal cancer

Men with colorectal cancer have a higher mortality rate than their female counterparts. Despite this, there is a limited understanding of the impact gender has on the experience of colorectal cancer.

Pre-validation methods for developing a patient reported outcome instrument

BACKGROUND: Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting) should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items) that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology.

METHODS: The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ). The five steps are: 1) Generation of a pool of items; 2) Item de-duplication (three phases); 3) Item reduction (two phases); 4) Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF); and 5) qualitative exploration of the target populations' views of the new instrument and the items it contains.

RESULTS: The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study) resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items.

CONCLUSIONS: This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped after the item generation phase, our method ensures that the AGQ is developed in a transparent, replicable manner and is fit for validation. We recommend this method to enhance the likelihood that new PRO instruments will be appropriate to the research context in which they are used, acceptable to research participants and likely to generate valid data.

Patient-reported 'ever had' and 'current' long term physical symptoms following prostate cancer treatments

OBJECTIVE: To document prostate cancer patient reported 'ever experienced' and 'current' prevalence of disease specific physical symptoms stratified by primary treatment received.
PATIENTS: 3,348 prostate cancer survivors 2-15 years post diagnosis.
METHODS: Cross-sectional, postal survey of 6,559 survivors diagnosed 2-15 years ago with primary, invasive PCa (ICD10-C61) identified via national, population based cancer registries in Northern Ireland and Republic of Ireland. Questions included symptoms at diagnosis, primary treatments and physical symptoms (impotence/urinary incontinence/bowel problems/breast changes/loss of libido/hot flashes/fatigue) experienced 'ever' and at questionnaire completion ("current"). Symptom proportions were weighted by age, country and time since diagnosis. Bonferroni corrections were applied for multiple comparisons.
RESULTS: Adjusted response rate 54%; 75% reported at least one 'current' physical symptom ('ever':90%), with 29% reporting at least three. Prevalence varied by treatment; overall 57% reported current impotence; this was highest following radical prostatectomy (RP)76% followed by external beam radiotherapy with concurrent hormone therapy (HT); 64%. Urinary incontinence (overall 'current' 16%) was highest following RP ('current'28%, 'ever'70%). While 42% of brachytherapy patients reported no 'current' symptoms; 43% reported 'current' impotence and 8% 'current' incontinence. 'Current' hot flashes (41%), breast changes (18%) and fatigue (28%) were reported more often by patients on HT.
CONCLUSION: Symptoms following prostate cancer are common, often multiple, persist long-term and vary by treatment. They represent a significant health burden. An estimated 1.6% of men over 45 is a prostate cancer survivor currently experiencing an adverse physical symptom. Recognition and treatment of physical symptoms should be prioritised in patient follow-up. This information should facilitate men and clinicians when deciding about treatment as differences in survival between radical treatments is minimal.

Are clinical documents optimised for patient safety? A critical analysis of patient safety outcomes using the EDA error model

Iatrogenic errors and patient safety in clinical processes are an increasing concern. The quality of process information in hardcopy or electronic form can heavily influence clinical behaviour and decision making errors. Little work has been undertaken to assess the safety impact of clinical process planning documents guiding the clinical actions and decisions. This paper investigates the clinical process documents used in elective surgery and their impact on latent and active clinical errors. Eight clinicians from a large health trust underwent extensive semi- structured interviews to understand their use of clinical documents, and their perceived impact on errors and patient safety. Samples of the key types of document used were analysed. Theories of latent organisational and active errors from the literature were combined with the EDA semiotics model of behaviour and decision making to propose the EDA Error Model. This model enabled us to identify perceptual, evaluation, knowledge and action error types and approaches to reducing their causes. The EDA error model was then used to analyse sample documents and identify error sources and controls. Types of knowledge artefact structures used in the documents were identified and assessed in terms of safety impact. This approach was combined with analysis of the questionnaire findings using existing error knowledge from the literature. The results identified a number of document and knowledge artefact issues that give rise to latent and active errors and also issues concerning medical culture and teamwork together with recommendations for further work.

What is important for you? A qualitative interview study of living with diabetes and experiences of diabetes care to establish a basis for a tailored Patient-Reported Outcome Measure for the Swedish National Diabetes Register

OBJECTIVES: There is a growing emphasis on the perspective of individuals living with diabetes and the need for a more person-centred diabetes care. At present, the Swedish National Diabetes Register (NDR) lacks patient-reported outcome measures (PROMs) based on the perspective of the patient. As a basis for a new PROM, the aim of this study was to describe important aspects in life for adult individuals with diabetes. DESIGN: Semistructured qualitative interviews analysed using content analysis. SETTING: Hospital-based outpatient clinics and primary healthcare clinics in Sweden. PARTICIPANTS: 29 adults with type 1 diabetes mellitus (DM) (n=15) and type 2 DM (n=14). INCLUSION CRITERIA: Swedish adults (≥18 years) living with type 1 DM or type 2 DM (duration ≥5 years) able to describe their situation in Swedish. Purposive sampling generated heterogeneous characteristics. RESULTS: To live a good life with diabetes is demanding for the individual, but experienced barriers can be eased by support from others in the personal sphere, and by professional support from diabetes care. Diabetes care was a crucial resource to nurture the individual's ability and knowledge to manage diabetes, and to facilitate life with diabetes by supplying support, guidance, medical treatment and technical devices tailored to individual needs. The analysis resulted in the overarching theme 'To live a good life with diabetes' constituting the two main categories 'How I feel and how things are going with my diabetes' and 'Support from diabetes care in managing diabetes' including five different categories. CONCLUSIONS: Common aspects were identified including the experience of living with diabetes and support from diabetes care. These will be used to establish a basis for a tailored PROM for the NDR.