Patient-reported outcomes in meta-analyses - part 2: methods for improving interpretability for decision-makers

Systematic reviews and meta-analyses of randomized trials that include patient-reported outcomes (PROs) often provide crucial information for patients, clinicians and policy-makers facing challenging health care decisions. Based on emerging methods, guidance on improving the interpretability of meta-analysis of patient-reported outcomes, typically continuous in nature, is likely to enhance decision-making. The objective of this paper is to summarize approaches to enhancing the interpretability of pooled estimates of PROs in meta-analyses. When differences in PROs between groups are statistically significant, decision-makers must be able to interpret the magnitude of effect. This is challenging when, as is often the case, clinical trial investigators use different measurement instruments for the same construct within and between individual randomized trials. For such cases, in addition to pooling results as a standardized mean difference, we recommend that systematic review authors use other methods to present results such as relative (relative risk, odds ratio) or absolute (risk difference) dichotomized treatment effects, complimented by presentation in either: natural units (e.g. overall depression reduced by 2.4 points when measured on a 50-point Hamilton Rating Scale for Depression); minimal important difference units (e.g. where 1.0 unit represents the smallest difference in depression that patients, on average, perceive as important the depression score was 0.38 (95%CI 0.30 to 0.47) units less than the control group); or a ratio of means (e.g. where the mean in the treatment group is divided by the mean in the control group, the ratio of means is 1.27, representing a 27%relative reduction in the mean depression score).

A patient-reported outcome measure to identify occurrence and distress of post-surgery symptoms of WOMen with vulvAr Neoplasia (WOMAN-PRO) - a cross sectional study.

OBJECTIVE The aim of the study was to describe the (a) symptom experience of women with vulvar intraepithelial neoplasia and vulvar cancer (vulvar neoplasia) during the first week after hospital discharge, and (b) associations between age, type of disease, stage of disease, the extent of surgical treatment and symptom experience. METHODS This cross-sectional study was conducted in eight hospitals in Germany and Switzerland (Clinical Trial ID: NCT01300663). Symptom experience after surgical treatment in women with vulvar neoplasia was measured with our newly developed WOMAN-PRO instrument. Outpatients (n=65) rated 31 items. We used descriptive statistics and regression analysis. RESULTS The average number of symptoms reported per patient was 20.2 (SD 5.77) with a range of 5 to 31 symptoms. The three most prevalent wound-related symptoms were 'swelling' (n=56), 'drainage' (n=54) and 'pain' (n=52). The three most prevalent difficulties in daily life were 'sitting' (n=63), 'wearing clothes' (n=56) and 'carrying out my daily activities' (n=51). 'Tiredness' (n=62), 'insecurity' (n=54) and 'feeling that my body has changed' (n=50) were the three most prevalent psychosocial symptoms/issues. The most distressing symptoms were 'sitting' (Mean 2.03, SD 0.88), 'open spot (e.g. opening of skin or suture)' (Mean 1.91, SD 0.93), and 'carrying out my daily activities' (Mean 1.86, SD 0.87), which were on average reported as 'quite a bit' distressing. Negative associations were found between psychosocial symptom experience and age. CONCLUSIONS WOMAN-PRO data showed a high symptom prevalence and distress, call for a comprehensive symptom assessment, and may allow identification of relevant areas in symptom management.

Patient-reported outcomes in borderline personality disorder.

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes.

Patient-reported outcomes of maxillary implant-supported overdentures compared with conventional dentures

OBJECTIVE The aim of the present prospective clinical study was to compare patient-reported outcomes for maxillary conventional dentures and maxillary implant-supported dentures. MATERIAL AND METHODS Twenty-one patients (6 women and 15 men) being edentulous in the maxilla and encountering problems with their existing dentures were included. Twelve patients (4 women and 8 men) received a new set of conventional dentures, due to insufficient dentures. In nine patients (2 women and 7 men), the existing dentures were adjusted by means of relining or rebasing. All patients received implant-supported dentures on two retentive anchors. In total, 42 implants were inserted in the anterior maxilla. The participants rated their satisfaction on their existing conventional dentures, 2 months after insertion of new conventional dentures and 2 months after insertion of implant-supported dentures. Thereby, patients responded to questionnaires capturing the oral health impact profile (OHIP) using visual analog scales. Seven domains (functional limitation, physical pain, psychological discomfort, physical, psychological and social disability and handicap) were assessed. Higher scores implied poorer patient satisfaction. In addition, the questionnaire involved the evaluation of cleaning ability, general satisfaction, speech, comfort, esthetics, stability, and chewing ability. Higher scores implied higher patient satisfaction. RESULTS Patient satisfaction significantly increased for implant-supported dentures compared with old dentures in all seven OHIP subgroups, as well as for cleaning ability, general satisfaction, ability to speak, comfort, esthetics, and stability (P < 0.05). The comparison of new conventional dentures and implant-supported dentures revealed a statistically significantly increased satisfaction for functional limitation (difference of 33.2 mm), psychological discomfort (difference of 36.7 mm), physical disability (difference of 36.3 mm), and social disability (difference of 23.5 mm), (P < 0.05). Additionally, general satisfaction, chewing ability, speech, and stability significantly improved in implant-supported dentures (P < 0.05). CONCLUSIONS Within the limits of this study, maxillary dentures retained by two implants provided some significant short-term improvements over conventional dentures in oral- and health-related quality of life.

Risk factors for patient-reported medical errors in eleven countries

OBJECTIVES The aim of this study was to identify common risk factors for patient-reported medical errors across countries. In country-level analyses, differences in risks associated with error between health care systems were investigated. The joint effects of risks on error-reporting probability were modelled for hypothetical patients with different health care utilization patterns. DESIGN Data from the Commonwealth Fund's 2010 lnternational Survey of the General Public's Views of their Health Care System's Performance in 11 Countries. SETTING Representative population samples of 11 countries were surveyed (total sample = 19,738 adults). Utilization of health care, coordination of care problems and reported errors were assessed. Regression analyses were conducted to identify risk factors for patients' reports of medical, medication and laboratory errors across countries and in country-specific models. RESULTS Error was reported by 11.2% of patients but with marked differences between countries (range: 5.4-17.0%). Poor coordination of care was reported by 27.3%. The risk of patient-reported error was determined mainly by health care utilization: Emergency care (OR = 1.7, P < 0.001), hospitalization (OR = 1.6, P < 0.001) and the number of providers involved (OR three doctors = 2.0, P < 0.001) are important predictors. Poor care coordination is the single most important risk factor for reporting error (OR = 3.9, P < 0.001). Country-specific models yielded common and country-specific predictors for self-reported error. For high utilizers of care, the probability that errors are reported rises up to P = 0.68. CONCLUSIONS Safety remains a global challenge affecting many patients throughout the world. Large variability exists in the frequency of patient-reported error across countries. To learn from others' errors is not only essential within countries but may also prove a promising strategy internationally.

Short-term functional versus patient-reported outcome of the bicruciate stabilized total knee arthroplasty: prospective consecutive case series

BACKGROUND The main goals of the standard treatment for advanced symptomatic knee osteoarthritis, total knee arthroplasty (TKA), are pain reduction and restoration of knee motion.The aim of this study was to analyse the outcome of the patient-based Knee Injury and Osteoarthritis Outcome Score (KOOS), and the surgeon-based Knee Society Score (KSS) and its Knee Score (KS) and Knee Functional Score (KFS) components after (TKA) using the Journey knee prosthesis, and to assess the correlation of these scores with range of motion (ROM). METHODS In a prospective case series study between August 1st 2008 and May 31st 2011, 99 patients, all operated by a single surgeon, received Journey bicruciate stabilized total knee prostheses. The female/male ratio was 53/34, the mean patient age at surgery was 68 years (range 41-83 years), and the left/right knee ratio was 55/44. The KOOS, range of motion, and KS and KFS were obtained preoperatively and at 1-year follow-up. The pre- and postoperative levels of the outcome measures were compared using the Wilcoxon signed-rank test. Correlation between ROM and patient outcomes was analysed with the Spearman coefficient. RESULTS All KOOS subscores improved significantly. Ninety percent of patients improved by at least the minimum clinically relevant difference of 10 points in stiffness and other symptoms, 94.5% in pain, 94.5% in activities of daily living, 84.9% in sports and recreation, and 90% in knee-related quality of life. The mean passive and active ROM improved from 122.4° (range 90-145°) and 120.4° (range 80-145°) preoperatively to 129.4° (range 90-145°) and 127.1° (range 100-145°) postoperatively. The highest correlation coefficients for ROM and KOOS were observed for the activity and pain subscores. Very low or no correlation was seen for the sport subscore.There was a significant and clinically relevant improvement of KSS (preop/postop 112.2/174.5 points), and its KS (preop/postop 45.6/86.8 points) and KFS (preop/postop 66.6/87.8 points) components. CONCLUSIONS The Journey bicruciate stabilized knee prosthesis showed good 1-year postoperative results in terms of both functional and patient-based outcome. However, higher knee ROM correlates only moderately with patient-based outcome, implying that functionality afforded by the Journey bicruciate TKA is not equivalent to patient satisfaction.

Consensus on the Need for a Hierarchical List of Patient-reported Pain Outcomes for Metaanalyses of Knee Osteoarthritis Trials: An OMERACT Objective.

OBJECTIVE Although protocol registration for systematic reviews is still not mandatory, reviewers should be strongly encouraged to register the protocol to identify the methodological approach, including all outcomes of interest. This will minimize the likelihood of biased decisions in reviews, such as selective outcome reporting. A group of international experts convened to address issues regarding the need to develop hierarchical lists of outcome measurement instruments for a particular outcome for metaanalyses. METHODS Multiple outcome measurement instruments exist to measure the same outcome. Metaanalysis of knee osteoarthritis (OA) trials, and the assessment of pain as an outcome, was used as an exemplar to assess how Outcome Measures in Rheumatology (OMERACT), the Cochrane Collaboration, and other international initiatives might contribute in this area. The meeting began with formal presentations of background topics, empirical evidence from the literature, and a brief introduction to 2 existing hierarchical lists of pain outcome measurement instruments recommended for metaanalyses of knee OA trials. RESULTS After discussions, most participants agreed that there is a need to develop a methodology for generation of hierarchical lists of outcome measurement instruments to guide metaanalyses. Tools that could be used to steer development of such a prioritized list are the COSMIN checklist (Consensus-based Standards for the selection of health status Measurement Instruments) and the OMERACT Filter 2.0. CONCLUSION We list meta-epidemiological research agenda items that address the frequency of reported outcomes in trials, as well as methodologies to assess the best measurement properties (i.e., truth, discrimination, and feasibility).

Open-Source Computerized Patient-Reported Outcomes: Case Studies Illustrating Fifteen Years of Evolution

Thesis (Master's)--University of Washington, 2016-06

Evaluation of clinically relevant changes in patient reported outcomes in knee and hip osteoarthritis: the minimal clinically important improvement

Background: In clinical trials, at the group level, results are usually reported as mean and standard deviation of the change in score, which is not meaningful for most readers. Objective: To determine the minimal clinically important improvement (MCII) of pain, patient's global assessment of disease activity, and functional impairment in patients with knee and hip osteoarthritis (OA). Methods: A prospective multicentre 4 week cohort study involving 1362 outpatients with knee or hip OA was carried out. Data on assessment of pain and patient's global assessment, measured on visual analogue scales, and functional impairment, measured on the Western Ontario McMaster Universities Osteoarthritis Index (WOMAC) function subscale, were collected at baseline and final visits. Patients assessed their response to treatment on a five point Likert scale at the final visit. An anchoring method based on the patient's opinion was used. The MCII was estimated in a subgroup of 814 patients ( 603 with knee OA, 211 with hip OA). Results: For knee and hip OA, MCII for absolute ( and relative) changes were, respectively, ( a) -19.9 mm (-40.8%) and -15.3 mm (-32.0%) for pain; ( b) -18.3 mm ( - 39.0%) and -15.2 mm ( -32.6%) for patient's global assessment; ( c) -9.1 ( -26.0%) and -7.9 ( -21.1%) for WOMAC function subscale score. The MCII is affected by the initial degree of severity of the symptoms but not by age, disease duration, or sex. Conclusion: Using criteria such as MCII in clinical trials would provide meaningful information which would help in interpreting the results by expressing them as a proportion of improved patients.

Evaluation of clinically relevant states in patient reported outcomes in knee and hip osteoarthritis: the patient acceptable symptom state

Background: The patient acceptable symptom state ( PASS) is the value beyond which patients can consider themselves well. This concept can help in interpreting results of clinical trials. Objective: To determine the PASS estimate for patients with knee and hip osteoarthritis (OA) by assessing pain, patient's global assessment of disease activity, and functional impairment. Methods: A 4 week prospective multicentre cohort study of 1362 outpatients with knee or hip OA was carried out. Data on assessment of pain and patient's global assessment of disease, measured on visual analogue scales, and functional impairment, measured on the Western Ontario McMaster Universities Osteoarthritis Index (WOMAC) function subscale, were collected at baseline and final visits. The patients assessed their satisfaction with their current state at the final visit. An anchoring method based on the patient's opinion was used. Results: For patients with knee and hip OA, the estimates of PASS were, respectively, 32.3 and 35.0 mm for pain, 32.0 and 34.6 mm for patient global assessment of disease activity, and 31.0 and 34.4 points for WOMAC function score. The PASS varied moderately across the tertiles of baseline scores but not across age, disease duration, or sex. Conclusion: The use of PASS in clinical trials would provide more meaningful results expressed as a proportion of patients in an acceptable symptom state.

Patient-reported outcome measures for asthma:a systematic review

BACKGROUND: Patient-reported outcome measures (PROMs) are measures of the outcome of treatment(s) reported directly by the patient or carer. There is increasing international policy interest in using these to assess the impact of clinical care. AIMS: To identify suitably validated PROMs for asthma and examine their potential for use in clinical settings. METHODS: We systematically searched MEDLINE, EMBASE and Web of Science databases from 1990 onwards to identify PROMs for asthma. These were critically appraised, then narratively synthesised. We also identified the generic PROMs commonly used alongside asthma-specific PROMs. RESULTS: We identifi ed 68 PROMs for asthma, 13 of which were selected through screening as being adequately developed to warrant full-quality appraisal: 8 for adults, 4 for children and 1 for a child's caregiver. The PROMs found to be sufficiently well validated to offer promise for use in clinical settings were the Asthma Quality of Life Questionnaire (AQLQ) and mini-AQLQ for adults, and Pediatric Asthma Quality of Life Questionnaire for children. Rhinasthma was considered promising in simultaneously assessing the impact of asthma and rhinitis in those with coexistent disease. We identified 28 generic PROMs commonly used in conjunction with asthma-specific instruments. CONCLUSIONS: We identified asthma PROMs that offer the greatest potential for use in clinical settings. Further work is needed to assess whether these are fit-for-purpose for use in clinical practice with individual patients. In particular, there is a need to ensure these are validated for use in clinical settings, acceptable to patients, caregivers and clinicians, and yield meaningful outcomes. © 2014 Primary Care Respiratory Society/Macmillan Publishers Limited.

Tradução e adaptação transcultural do domínio função física do Patient-Reported Outcomes Measurement Information System – PROMIS® - versão para a língua portuguesa

In 2004, the National Institutes of Health made available the Patient-Reported Outcomes Measurement Information System – PROMIS®, which is constituted of innovative item banks for health assessment. It is based on classical, reliable Patient-Reported Outcomes (PROs) and includes advanced statistical methods, such as Item Response Theory and Computerized Adaptive Test. One of PROMIS® Domain Frameworks is the Physical Function, whose item bank need to be translated and culturally adapted so it can be used in Portuguese speaking countries. This work aimed to translate and culturally adapt the PROMIS® Physical Function item bank into Portuguese. FACIT (Functional Assessment of Chronic Illness Therapy) translation methodology, which is constituted of eight stages for translation and cultural adaptation, was used. Fifty subjects above the age of 18 years participated in the pre-test (seventh stage). The questionnaire was answered by the participants (self-reported questionnaires) by using think aloud protocol, and cognitive and retrospective interviews. In FACIT methodology, adaptations can be done since the beginning of the translation and cultural adaption process, ensuring semantic, conceptual, cultural, and operational equivalences of the Physical Function Domain. During the pre-test, 24% of the subjects had difficulties understanding the items, 22% of the subjects suggested changes to improve understanding. The terms and concepts of the items were totally understood (100%) in 87% of the items. Only four items had less than 80% of understanding; for this reason, it was necessary to chance them so they could have correspondence with the original item and be understood by the subjects, after retesting. The process of translation and cultural adaptation of the PROMIS® Physical Function item bank into Portuguese was successful. This version of the assessment tool must have its psychometric properties validated before being made available for clinical use.

The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.