New methods can extend the use of minimal important difference units in meta-analyses of continuous outcome measures

For continuous outcomes measured using instruments with an established minimally important difference (MID), pooled estimates can be usefully reported in MID units. Approaches suggested thus far omit studies that used instruments without an established MID. We describe an approach that addresses this limitation.

The reliability, accuracy and minimal detectable difference of a multi-segment kinematic model of the foot-shoe complex

Kinematic models are commonly used to quantify foot and ankle kinematics, yet no marker sets or models have been proven reliable or accurate when wearing shoes. Further, the minimal detectable difference of a developed model is often not reported. We present a kinematic model that is reliable, accurate and sensitive to describe the kinematics of the foot–shoe complex and lower leg during walking gait. In order to achieve this, a new marker set was established, consisting of 25 markers applied on the shoe and skin surface, which informed a four segment kinematic model of the foot–shoe complex and lower leg. Three independent experiments were conducted to determine the reliability, accuracy and minimal detectable difference of the marker set and model. Inter-rater reliability of marker placement on the shoe was proven to be good to excellent (ICC = 0.75–0.98) indicating that markers could be applied reliably between raters. Intra-rater reliability was better for the experienced rater (ICC = 0.68–0.99) than the inexperienced rater (ICC = 0.38–0.97). The accuracy of marker placement along each axis was <6.7 mm for all markers studied. Minimal detectable difference (MDD90) thresholds were defined for each joint; tibiocalcaneal joint – MDD90 = 2.17–9.36°, tarsometatarsal joint – MDD90 = 1.03–9.29° and the metatarsophalangeal joint – MDD90 = 1.75–9.12°. These thresholds proposed are specific for the description of shod motion, and can be used in future research designed at comparing between different footwear.

Minimum important difference between patients with rheumatoid arthritis : the patient's perspective

OBJECTIVE: To determine the point at which differences in clinical assessment scores on physical ability, pain and overall condition are sufficiently large to correspond to a subjective perception of a meaningful difference from the perspective of the patient. METHODS: Forty patients with a diagnosis of rheumatoid arthritis participated in an evening of clinical assessment and one-on-one conversations with each other regarding their arthritic condition. The assessments included tender and swollen joint counts, clinician and patient global assessments, participant assessment of pain and the Health Assessment Questionnaire (HAQ) on physical ability. After each conversation, participants rated themselves relative to their conversational partner on physical ability, pain and overall condition. These subjective comparative ratings were compared to the differences of the individual clinical assessments. RESULTS: In total there were 120 conversations. Generally participants judged themselves as less disabled than others. They rated themselves as "somewhat better" than their conversation partner when they had a (mean) 7% better score on the HAQ, 6% less pain, and 9% better global assessment. In contrast, they rated themselves as "somewhat worse" when they had a (mean) 16% worse score on the HAQ, 16% more pain, and 29% worse global assessment. CONCLUSIONS: Patients view clinically important differences in an asymmetric manner. These results can provide guidance in interpreting results and planning clinical trials.

Evaluating minimal important differences for the FACT-Melanoma quality of life questionnaire

Objectives. Minimal Important Differences (MIDs) establish benchmarks for interpreting mean differences in clinical trials involving quality of life outcomes and inform discussions of clinically meaningful change in patient status. As such, the purpose of this study was to assess MIDs for the Functional Assessment of Cancer Therapy–Melanoma (FACT-M). ^ Methods. A prospective validation study of the FACT-M was performed with 273 patients with stage I to IV melanoma. FACT-M, Karnofsky Performance Status (KPS), and Eastern Cooperative Oncology Group Performance Status (ECOG-PS) scores were obtained at baseline and 3 months following enrollment. Anchor- and distribution-based methods were used to assess MIDs, and the correspondence between MID ranges derived from each method was evaluated. ^ Results. This study indicates that an approximate range for MIDs of the FACT-M subscales is between 5 to 8 points for the Trial Outcome Index, 4 to 5 points for the Melanoma Combined Subscale, 2 to 4 points for the Melanoma Subscale, and 1 to 2 points for the Melanoma Surgery Subscale. Each method produced similar but not identical ranges of MIDs. ^ Conclusions. The properties of the anchor instrument employed to derive MIDs directly affect resulting MID ranges and point values. When MIDs are offered as supportive evidence of a clinically meaningful change, the anchor instrument used to derive thresholds should be clearly stated along with evidence supporting the choice of anchor instrument as the most appropriate for the domain of interest. In this analysis, the KPS was a more appropriate measure than the ECOG-PS for assessing MIDs. ^

Adolescent-parent disagreement on health-related quality of life of food-allergic adolescents:who makes the difference?

Background: Food-allergic adolescents are at highest risk for food allergy fatalities, which may be partly due to compromised self-management behavior. Such behavior may be negatively influenced by conflictual situations caused by adolescent–parent disagreement on the adolescent’s health-related quality of life (HRQL). Comparisons of adolescent-self-reported and parent-proxy-reported HRQL of food-allergic adolescents have never extensively been studied. The aims of this study were to investigate disagreement in adolescent-self-reports and parent-proxy-reports on the HRQL of food-allergic adolescents and to investigate the factors influencing adolescent–parent disagreement. Methods: Teenager Form (TF) and Parent Form (PFA) of the Food Allergy Quality of Life Questionnaire (FAQLQ), Food Allergy Independent Measure (FAIM), and Brief-Illness Perception Questionnaire (Brief-IPQ) were sent to food-allergic Dutch adolescents (13–17 years) and their parents. ICCs, t-tests, and Bland–Altman plots were used to investigate adolescent–parent disagreement. Participant characteristics, illness expectations, and illness perceptions influencing adolescent–parent disagreement were studied using regression analysis. Results: Seventy adolescent–parent pairs were included. There were a moderate correlation (ICC = 0.61, P < 0.001) and no significant difference (3.78 vs 3.56, P = 0.103) between adolescent-self-reported and parent-proxy-reported HRQL at group level. However, Bland–Altman plots showed relevant differences (exceeding the minimal important difference) for 63% of all adolescent–parent pairs. Adolescent’s age (>15 years), poorer adolescent-reported illness comprehension (Brief-IPQ-TF, coherence), and higher adolescent-reported perceived disease severity (Food Allergy Independent Measure-Teenager Form & -Parent Form) were associated with adolescent–parent disagreement. Conclusions: Adolescent–parent disagreement on the adolescent’s HRQL was mainly associated with adolescents’ rather than parents’ perceptions and characteristics. Illness comprehension of the adolescent may be an important target for intervention aimed at reducing adolescent–parent disagreement.

Diaphragmatic Breathing Training Program Improves Abdominal Motion During Natural Breathing in Patients With Chronic Obstructive Pulmonary Disease: A Randomized Controlled Trial

Yamaguti WP, Claudino RC, Neto AP, Chammas MC, Gomes AC, Salge TM, Moriya HT, Cukier A, Carvalho CR. Diaphragmatic breathing training program improves abdominal motion during natural breathing in patients with chronic obstructive pulmonary disease: a randomized controlled trial. Arch Phys Med Rehabil 2012;93:571-7. Objective: To investigate the effects of a diaphragmatic breathing training program (DBTP) on thoracoabdominal motion and functional capacity in patients with chronic obstructive pulmonary disease. Design: A prospective, randomized controlled trial. Setting: Academic medical center. Participants: Subjects (N=30; forced expiratory volume in Is, 4270 +/- 13% predicted) were randomly allocated to either a training group (TG) or a control group (CG). Interventions: Subjects in the TG completed a 4-week supervised DBTP (3 individualized weekly sessions), while those in the CG received their usual care. Main Outcome Measures: Effectiveness was assessed by amplitude of the rib cage to abdominal motion ratio (RC/ABD ratio) (primary outcome) and diaphragmatic mobility (secondary outcome). The RC/ABD ratio was measured using respiratory inductive plethysmography during voluntary diaphragmatic breathing and natural breathing. Diaphragmatic mobility was measured by ultrasonography. A 6-minute walk test and health-related quality of life were also evaluated. Results: Immediately after the 4-week DBTP, the TG showed a greater abdominal motion during natural breathing quantified by a reduction in the RC/ABD ratio when compared with the CG (F=8.66; P<.001). Abdominal motion during voluntary diaphragmatic breathing after the intervention was also greater in the TG than in the CG (F=4.11; P<.05). The TG showed greater diaphragmatic mobility after the 4-week DBTP than did the CG (F=15.08; P<.001). An improvement in the 6-minute walk test and in health-related quality of life was also observed in the TG. Conclusions: DBTP for patients with chronic obstructive pulmonary disease induced increased diaphragm participation during natural breathing, resulting in an improvement in functional capacity.

Patient-reported outcomes in meta-analyses - part 2: methods for improving interpretability for decision-makers

Systematic reviews and meta-analyses of randomized trials that include patient-reported outcomes (PROs) often provide crucial information for patients, clinicians and policy-makers facing challenging health care decisions. Based on emerging methods, guidance on improving the interpretability of meta-analysis of patient-reported outcomes, typically continuous in nature, is likely to enhance decision-making. The objective of this paper is to summarize approaches to enhancing the interpretability of pooled estimates of PROs in meta-analyses. When differences in PROs between groups are statistically significant, decision-makers must be able to interpret the magnitude of effect. This is challenging when, as is often the case, clinical trial investigators use different measurement instruments for the same construct within and between individual randomized trials. For such cases, in addition to pooling results as a standardized mean difference, we recommend that systematic review authors use other methods to present results such as relative (relative risk, odds ratio) or absolute (risk difference) dichotomized treatment effects, complimented by presentation in either: natural units (e.g. overall depression reduced by 2.4 points when measured on a 50-point Hamilton Rating Scale for Depression); minimal important difference units (e.g. where 1.0 unit represents the smallest difference in depression that patients, on average, perceive as important the depression score was 0.38 (95%CI 0.30 to 0.47) units less than the control group); or a ratio of means (e.g. where the mean in the treatment group is divided by the mean in the control group, the ratio of means is 1.27, representing a 27%relative reduction in the mean depression score).

Do clinicians understand the size of treatment effects? A randomized survey across 8 countries.

BACKGROUND Meta-analyses of continuous outcomes typically provide enough information for decision-makers to evaluate the extent to which chance can explain apparent differences between interventions. The interpretation of the magnitude of these differences - from trivial to large - can, however, be challenging. We investigated clinicians' understanding and perceptions of usefulness of 6 statistical formats for presenting continuous outcomes from meta-analyses (standardized mean difference, minimal important difference units, mean difference in natural units, ratio of means, relative risk and risk difference). METHODS We invited 610 staff and trainees in internal medicine and family medicine programs in 8 countries to participate. Paper-based, self-administered questionnaires presented summary estimates of hypothetical interventions versus placebo for chronic pain. The estimates showed either a small or a large effect for each of the 6 statistical formats for presenting continuous outcomes. Questions addressed participants' understanding of the magnitude of treatment effects and their perception of the usefulness of the presentation format. We randomly assigned participants 1 of 4 versions of the questionnaire, each with a different effect size (large or small) and presentation order for the 6 formats (1 to 6, or 6 to 1). RESULTS Overall, 531 (87.0%) of the clinicians responded. Respondents best understood risk difference, followed by relative risk and ratio of means. Similarly, they perceived the dichotomous presentation of continuous outcomes (relative risk and risk difference) to be most useful. Presenting results as a standardized mean difference, the longest standing and most widely used approach, was poorly understood and perceived as least useful. INTERPRETATION None of the presentation formats were well understood or perceived as extremely useful. Clinicians best understood the dichotomous presentations of continuous outcomes and perceived them to be the most useful. Further initiatives to help clinicians better grasp the magnitude of the treatment effect are needed.

The Effects of Reduction Mammaplasty

Symptomatic hypertrophic breasts cause a health burden with physical and psychosocial morbidity. The value of reduction mammaplasty in the treatment of symptomatic breast hypertrophy has been consistently reported by patients and has been well recognised by plastic surgeons for a long time. However, the scientific evidence of the effects of reduction mammaplasty has been weak or lacking. During the design of this study most of the previous studies were retrospective and the few prospective studies had methodological limitations. Therefore, an obvious need for prospective randomised studies was present. Nevertheless, practical and ethical considerations seemed to make this study design impossible, because the waiting time for the operation was several years. The legislation and subsequent introduction of the uniform criteria for access to non-emergency treatment in Finland removed these obstacles, as all patients received their treatment within a reasonable time. As a result, a randomised controlled trial with a six-month follow-up time was designed and conducted. In addition, a follow-up study with two to five years follow-up was also carried out later. The effects of reduction mammaplasty on the patients breast-related symptoms, psychological symptoms, pain and quality of life was assessed. In addition, factors affecting the outcome were investigated. This study was carried out in the Hospital District of Helsinki and Uusimaa, Finland. Eighty-two out of the approximately 300 patients on the waiting list in 2004 agreed to participate in the study. Patients were randomised either to be operated (40 patients) on or to be followed up (42 patients). The follow-up time for both groups was six months. The patients were operated on by plastic surgeons or trainees at the Department of Plastic Surgery at Helsinki University Central Hospital or at the Department of Surgery at Hyvinkää Hospital. The patients completed five questionnaires: the SF-36 and the 15D quality of life questionnaires, the Finnish Breast-Associated Symptoms questionnaire (FBAS), a mood questionnaire (Raitasalo s modification of the short form of the Beck Depression Inventory, RBDI), and a pain questionnaire (The Finnish Pain Questionnaire, FPQ). Sixty-two out of the original 82 patients agreed to participate in the prospective follow-up study. In this study, patients completed the 15D quality of life questionnaire, the Finnish Breast-Associated Symptoms questionnaire, and the RBDI mood questionnaire. After six months follow-up, patients who had undergone reduction mammaplasty had a significantly better quality of life, fewer breast-associated symptoms and less pain, and they were less depressed or anxious when compared to patients who had not undergone surgery. The change in quality of life was more than two times the minimal clinically important difference. The patients preoperative quality of life was significantly inferior when compared to the age-standardised general population. This health burden was removed with reduction mammaplasty. The health loss related to symptomatic breast hypertrophy was comparable to that of patients with major joint arthrosis. In terms of change in quality of life, the intervention effect of reduction mammaplasty was comparable to that of hip joint replacement and more pronounced than that of knee joint replacement surgery. The outcome of reduction mammaplasty was affected more by preoperative psychosocial factors than by changes in breast dimensions. The effects of reduction mammaplasty remained stable at two to five years follow-up. In terms of quality of life, symptomatic breast hypertrophy causes a considerable health loss comparable to that of major joint arthrosis. Patients who undergo surgery have fewer breast-associated symptoms and less pain, and they are less depressed or anxious and have an improved quality of life. The intervention effect is comparable to that of major joint replacement surgery, and it remains stable at two to five years follow-up. The outcome of reduction mammaplasty is affected by preoperative psychosocial factors.

Determining the minimum clinically important differences for outcomes in the DOMINO trial

Although less likely to be reported in clinical trials than expressions of the statistical significance of differences in outcomes, whether or not a treatment has delivered a specified minimum clinically important difference (MCID) is also relevant to patients and their caregivers and doctors. Many dementia treatment randomised controlled trials (RCTs) have not reported MCIDs and, where they have been done, observed differences have not reached these.

Mesures subjectives et épidémiologie : problèmes méthodologiques liés à l'utilisation des techniques psychométriques

L’utilisation des mesures subjectives en épidémiologie s’est intensifiée récemment, notamment avec la volonté de plus en plus affirmée d’intégrer la perception qu’ont les sujets de leur santé dans l’étude des maladies et l’évaluation des interventions. La psychométrie regroupe les méthodes statistiques utilisées pour la construction des questionnaires et l’analyse des données qui en sont issues. Ce travail de thèse avait pour but d’explorer différents problèmes méthodologiques soulevés par l’utilisation des techniques psychométriques en épidémiologie. Trois études empiriques sont présentées et concernent 1/ la phase de validation de l’instrument : l’objectif était de développer, à l’aide de données simulées, un outil de calcul de la taille d’échantillon pour la validation d’échelle en psychiatrie ; 2/ les propriétés mathématiques de la mesure obtenue : l’objectif était de comparer les performances de la différence minimale cliniquement pertinente d’un questionnaire calculée sur des données de cohorte, soit dans le cadre de la théorie classique des tests (CTT), soit dans celui de la théorie de réponse à l’item (IRT) ; 3/ son utilisation dans un schéma longitudinal : l’objectif était de comparer, à l’aide de données simulées, les performances d’une méthode statistique d’analyse de l’évolution longitudinale d’un phénomène subjectif mesuré à l’aide de la CTT ou de l’IRT, en particulier lorsque certains items disponibles pour la mesure différaient à chaque temps. Enfin, l’utilisation de graphes orientés acycliques a permis de discuter, à l’aide des résultats de ces trois études, la notion de biais d’information lors de l’utilisation des mesures subjectives en épidémiologie.

Fatores associados à diferença clinicamente significativa da qualidade de vida relacionada à saúde após condicionamento físico em pacientes com DPOC

OBJETIVO: Investigar os fatores associados à diferença clinicamente significativa da qualidade de vida (DCSQV) após condicionamento físico em pacientes com DPOC. MÉTODOS: Trinta e cinco pacientes foram submetidos a 12 semanas de condicionamento físico, envolvendo treinamento de força e exercício aeróbio leve. Composição corporal, teste incremental e de endurance em esteira, teste de caminhada de seis minutos, força muscular periférica, PImáx, baseline dyspnea index (BDI) e Saint George's Respiratory Questionnaire (SGRQ) foram avaliados antes e após o treinamento, e suas alterações (Δ) foram calculadas. A DCSQV foi definida como a redução > 4% no escore total do SGRQ. Os pacientes que responderam ao treinamento, apresentando DCSQV, foram alocados no grupo respondedores (R; n = 24), e os demais pacientes foram alocados no grupo não-respondedores (NR; n = 11). RESULTADOS: Os seguintes resultados foram significativamente maiores no grupo R que no grupo NR (p < 0,05): VEF1 (1,48 ± 0,54 L vs. 1,04 ± 0,34 L), VEF1/CVF (47,9 ± 11,7% vs. 35,5 ± 10,7%), PaO2 (74,1 ± 9,7 mmHg vs. 65,0 ± 8,9mmHg) e ΔBDI [mediana (interquartil); 2,0 (0,0-3,5) vs. 0,0 (0,0-1,0)]. Houve correlação significativa (p < 0,01) de ΔSGRQ-sintomas (r = 0,44), ΔSGRQ-atividade (r = 0,62) e ΔSGRQ-total (r = 0,60) com ΔBDI. Após regressão logística, apenas ΔBDI foi selecionado como determinante da DCSQV. CONCLUSÕES: A DCSQV após o condicionamento físico está associada principalmente à redução da dispneia nos pacientes com DPOC. Portanto, são necessárias estratégias de tratamento visando interromper o ciclo dispneia-sedentarismo-dispneia nesses pacientes.

A new short and simple health-related quality of life measurement for paediatric rheumatic diseases: initial validation in juvenile idiopathic arthritis

Objective. To develop and validate a new short and simple measure of health-related quality of life (HRQL) in children with juvenile idiopathic arthritis (JIA).Methods. The Paediatric Rheumatology Quality of Life Scale (PRQL) is a 10-item questionnaire that explores HRQL in two domains: physical health (PhH) and psychosocial health (PsH). Validation of the parent proxy report and child self-report versions of the instrument was accomplished by evaluating 472 JIA patients and similar to 800 healthy children. Validation analyses included assessment of feasibility, face and content validity; construct and discriminative ability; internal structure and consistency; test-retest reliability; responsiveness to clinical change; and minimal clinically important difference.Results. The PRQL was found to be feasible and to possess both face and content validity. The PRQL score correlated in the predicted range with most of the other JIA outcome measures, thereby demonstrating good construct validity, and discriminated well between different levels of disease severity. Assessment of internal structure (factor analysis) revealed that the PhH and PsH subscales identify two unambiguously separated domains. The internal consistency (Cronbach's alpha) was 0.86. The intraclass correlation coefficient for test-retest reliability was 0.91. The PRQL revealed fair responsiveness, with a standardized response mean of 0.67 in improved patients. Overall, the PRQL appeared to be more able to capture physical HRQL than psychosocial HRQL.Conclusion. The PRQL was found to possess good measurement properties and is, therefore, a valid instrument for the assessment of HRQL in children with JIA. This tool is primarily proposed for use in standard clinical care.

Development of a documentation instrument for the conservative treatment of spinal disorders in the International Spine Registry, Spine Tango

Spine Tango is the first and only International Spine Registry in operation to date. So far, only surgical spinal interventions have been recorded and no comparable structured and comprehensive documentation instrument for conservative treatments of spinal disorders is available. This study reports on the development of a documentation instrument for the conservative treatment of spinal disorders by using the Delphi consensus method. It was conducted with a group of international experts in the field. We also assessed the usability of this new assessment tool with a prospective feasibility study on 97 outpatients and inpatients with low back or neck pain undergoing conservative treatment. The new 'Spine Tango conservative' questionnaire proved useful and suitable for the documentation of pathologies, conservative treatments and outcomes of patients with low back or neck problems. A follow-up questionnaire seemed less important in the predominantly outpatient setting. In the feasibility study, between 43 and 63% of patients reached the minimal clinically important difference in pain relief and Core Outcome Measures Index at 3 months after therapy; 87% of patients with back pain and 85% with neck pain were satisfied with the received treatment. With 'Spine Tango conservative' a first step has been taken to develop and implement a complementary system for documentation and evaluation of non-surgical spinal interventions and outcomes within the framework of the International Spine Registry. It proved useful and feasible in a first pilot study, but it will take the experience of many more cases and therapists to develop a version similarly mature as the surgical instruments of Spine Tango.

Effects of glucosamine, chondroitin, or placebo in patients with osteoarthritis of hip or knee: network meta-analysis

OBJECTIVE: To determine the effect of glucosamine, chondroitin, or the two in combination on joint pain and on radiological progression of disease in osteoarthritis of the hip or knee. Design Network meta-analysis. Direct comparisons within trials were combined with indirect evidence from other trials by using a Bayesian model that allowed the synthesis of multiple time points. MAIN OUTCOME MEASURE: Pain intensity. Secondary outcome was change in minimal width of joint space. The minimal clinically important difference between preparations and placebo was prespecified at -0.9 cm on a 10 cm visual analogue scale. DATA SOURCES: Electronic databases and conference proceedings from inception to June 2009, expert contact, relevant websites. Eligibility criteria for selecting studies Large scale randomised controlled trials in more than 200 patients with osteoarthritis of the knee or hip that compared glucosamine, chondroitin, or their combination with placebo or head to head. Results 10 trials in 3803 patients were included. On a 10 cm visual analogue scale the overall difference in pain intensity compared with placebo was -0.4 cm (95% credible interval -0.7 to -0.1 cm) for glucosamine, -0.3 cm (-0.7 to 0.0 cm) for chondroitin, and -0.5 cm (-0.9 to 0.0 cm) for the combination. For none of the estimates did the 95% credible intervals cross the boundary of the minimal clinically important difference. Industry independent trials showed smaller effects than commercially funded trials (P=0.02 for interaction). The differences in changes in minimal width of joint space were all minute, with 95% credible intervals overlapping zero. Conclusions Compared with placebo, glucosamine, chondroitin, and their combination do not reduce joint pain or have an impact on narrowing of joint space. Health authorities and health insurers should not cover the costs of these preparations, and new prescriptions to patients who have not received treatment should be discouraged.