Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

Tractament psicològic del dolor crònic en nens i adolescents

L'objectiu d'aquest projecte és que els nens i adolescents amb dolor crònic puguin gaudir d'una millor qualitat de vida. El projecte té dues línies de recerca complementàries. El primer objectiu específic és crear i adaptar instruments per avaluar l’experiència dolorosa a la població infantil. Dues són les mesures que s'han estudiat en escolars: l'escala numèrica verbal (vNRS-11) tant en paper com en format electrònic, i una versió modificada de la versió pediàtrica del Survey of Pain Attitudes (Peds-SOPA). El segon objectiu específic és avaluar els efectes de la teràpia cognitiva (TC) en una mostra de nens de 12 a 18 anys que pateixen dolor crònic. En concret, volem estudiar si algunes característiques personals i familiars dels joves (per exemple, creences relacionades amb la salut, intensitat del dolor, estratègies d'afrontament, expectatives del tractament) estan associades a l'adherència a les recomanacions terapèutiques i, en conseqüència, són variables que afavoreixen la recuperació d’aquests pacients. Un tractament de 10 sessions es porta a terme per aconseguir aquest objectiu. S’ofereix als pacients un conjunt d'habilitats i estratègies específiques per a què puguin exercir un major control dels seus símptomes i reduir l'impacte d'aquests en les seves vides. Els resultats d'aquests estudis seran de gran interès per millorar el maneig del dolor infantil. A més, els resultats determinaran quines són les variables associades amb l’adherència a les prescripcions terapèutiques. Aquest és un tema particularment d’interès pel fet de que un factor determinant de l’èxit clínic és el grau en què una persona s'adhereix a les recomanacions. D'altra banda, el desenvolupament de les mesures de dolor pediàtric és de gran rellevància tant per a clínics com per a investigadors, ja que moltes de les decisions clíniques es basen en allò que el pacient ha informat sobre el seu dolor.

The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content

Background: The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties of health-related patient reported outcomes (HR-PROs). In this paper, we explain our choices for the design requirements and preferred statistical methods for which no evidence is available in the literature or on which the Delphi panel members had substantial discussion. Methods: The issues described in this paper are a reflection of the Delphi process in which 43 panel members participated. Results: The topics discussed are internal consistency (relevance for reflective and formative models, and distinction with unidimensionality), content validity (judging relevance and comprehensiveness), hypotheses testing as an aspect of construct validity (specificity of hypotheses), criterion validity (relevance for PROs), and responsiveness (concept and relation to validity, and (in) appropriate measures).Conclusions: We expect that this paper will contribute to a better understanding of the rationale behind the items, thereby enhancing the acceptance and use of the COSMIN checklist.

Effects of cobalt-chromium everolimus eluting stents or bare metal stent on fatal and non-fatal cardiovascular events: patient level meta-analysis

Objectives: To examine the safety and effectiveness of cobalt-chromium everolimus eluting stents compared with bare metal stents. Design: Individual patient data meta-analysis of randomised controlled trials. Cox proportional regression models stratified by trial, containing random effects, were used to assess the impact of stent type on outcomes. Hazard ratios with 95% confidence interval for outcomes were reported. Data sources and study selection: Medline, Embase, the Cochrane Central Register of Controlled Trials. Randomised controlled trials that compared cobalt-chromium everolimus eluting stents with bare metal stents were selected. The principal investigators whose trials met the inclusion criteria provided data for individual patients. Primary outcomes: The primary outcome was cardiac mortality. Secondary endpoints were myocardial infarction, definite stent thrombosis, definite or probable stent thrombosis, target vessel revascularisation, and all cause death. Results: The search yielded five randomised controlled trials, comprising 4896 participants. Compared with patients receiving bare metal stents, participants receiving cobalt-chromium everolimus eluting stents had a significant reduction of cardiac mortality (hazard ratio 0.67, 95% confidence interval 0.49 to 0.91; P=0.01), myocardial infarction (0.71, 0.55 to 0.92; P=0.01), definite stent thrombosis (0.41, 0.22 to 0.76; P=0.005), definite or probable stent thrombosis (0.48, 0.31 to 0.73; P<0.001), and target vessel revascularisation (0.29, 0.20 to 0.41; P<0.001) at a median follow-up of 720 days. There was no significant difference in all cause death between groups (0.83, 0.65 to 1.06; P=0.14). Findings remained unchanged at multivariable regression after adjustment for the acuity of clinical syndrome (for instance, acute coronary syndrome v stable coronary artery disease), diabetes mellitus, female sex, use of glycoprotein IIb/IIIa inhibitors, and up to one year v longer duration treatment with dual antiplatelets. Conclusions: This meta-analysis offers evidence that compared with bare metal stents the use of cobalt-chromium everolimus eluting stents improves global cardiovascular outcomes including cardiac survival, myocardial infarction, and overall stent thrombosis.

Effects of cobalt-chromium everolimus eluting stents or bare metal stent on fatal and non-fatal cardiovascular events: patient level meta-analysis

Objectives: To examine the safety and effectiveness of cobalt-chromium everolimus eluting stents compared with bare metal stents. Design: Individual patient data meta-analysis of randomised controlled trials. Cox proportional regression models stratified by trial, containing random effects, were used to assess the impact of stent type on outcomes. Hazard ratios with 95% confidence interval for outcomes were reported. Data sources and study selection: Medline, Embase, the Cochrane Central Register of Controlled Trials. Randomised controlled trials that compared cobalt-chromium everolimus eluting stents with bare metal stents were selected. The principal investigators whose trials met the inclusion criteria provided data for individual patients. Primary outcomes: The primary outcome was cardiac mortality. Secondary endpoints were myocardial infarction, definite stent thrombosis, definite or probable stent thrombosis, target vessel revascularisation, and all cause death. Results: The search yielded five randomised controlled trials, comprising 4896 participants. Compared with patients receiving bare metal stents, participants receiving cobalt-chromium everolimus eluting stents had a significant reduction of cardiac mortality (hazard ratio 0.67, 95% confidence interval 0.49 to 0.91; P=0.01), myocardial infarction (0.71, 0.55 to 0.92; P=0.01), definite stent thrombosis (0.41, 0.22 to 0.76; P=0.005), definite or probable stent thrombosis (0.48, 0.31 to 0.73; P<0.001), and target vessel revascularisation (0.29, 0.20 to 0.41; P<0.001) at a median follow-up of 720 days. There was no significant difference in all cause death between groups (0.83, 0.65 to 1.06; P=0.14). Findings remained unchanged at multivariable regression after adjustment for the acuity of clinical syndrome (for instance, acute coronary syndrome v stable coronary artery disease), diabetes mellitus, female sex, use of glycoprotein IIb/IIIa inhibitors, and up to one year v longer duration treatment with dual antiplatelets. Conclusions: This meta-analysis offers evidence that compared with bare metal stents the use of cobalt-chromium everolimus eluting stents improves global cardiovascular outcomes including cardiac survival, myocardial infarction, and overall stent thrombosis.

Chronic intestinal pseudoobstruction and ophthalmoplegia in a patient with mitochondrial myopathy

A 38 year old woman having chronic intestinal pseudoobstruction associated with mitochondrial myopathy is reported. The clinical and radiographic features suggested the diagnosis of chronic intestinal pseudoobstruction. Muscular atrophy and ophthalmoplegia led to muscle biopsy, which disclosed accumulation of normal and abnormal mitochondria ('ragged red fibres'), characteristic of mitochondrial myopathy.

Standardizing admission and discharge processes to improve patient flow: A cross sectional study

Background: The aim of this study was to evaluate how hospital capacity was managed focusing on standardizing the admission and discharge processes. Methods: This study was set in a 900-bed university affiliated hospital of the National Health Service, near Barcelona (Spain). This is a cross-sectional study of a set of interventions which were gradually implemented between April and December 2008. Mainly, they were focused on standardizing the admission and discharge processes to improve patient flow. Primary administrative data was obtained from the 2007 and 2009 Hospital Database. Main outcome measures were median length of stay, percentage of planned discharges, number of surgery cancellations and median number of delayed emergency admissions at 8:00 am. For statistical bivariate analysis, we used a Chi-squared for linear trend for qualitative variables and a Wilcoxon signed ranks test and a Mann–Whitney test for non-normal continuous variables. Results: The median patients’ global length of stay was 8.56 days in 2007 and 7.93 days in 2009 (p<0.051). The percentage of patients admitted the same day as surgery increased from 64.87% in 2007 to 86.01% in 2009 (p<0.05). The number of cancelled interventions due to lack of beds was 216 patients in 2007 and 42 patients in 2009. The median number of planned discharges went from 43.05% in 2007 to 86.01% in 2009 (p<0.01). The median number of emergency patients waiting for an in-hospital bed at 8:00 am was 5 patients in 2007 and 3 patients in 2009 (p<0.01). Conclusions: In conclusion, standardization of admission and discharge processes are largely in our control. There is a significant opportunity to create important benefits for increasing bed capacity and hospital throughput.

Standardizing admission and discharge processes to improve patient flow: A cross sectional study

Background: The aim of this study was to evaluate how hospital capacity was managed focusing on standardizing the admission and discharge processes. Methods: This study was set in a 900-bed university affiliated hospital of the National Health Service, near Barcelona (Spain). This is a cross-sectional study of a set of interventions which were gradually implemented between April and December 2008. Mainly, they were focused on standardizing the admission and discharge processes to improve patient flow. Primary administrative data was obtained from the 2007 and 2009 Hospital Database. Main outcome measures were median length of stay, percentage of planned discharges, number of surgery cancellations and median number of delayed emergency admissions at 8:00¿am. For statistical bivariate analysis, we used a Chi-squared for linear trend for qualitative variables and a Wilcoxon signed ranks test and a Mann¿Whitney test for non-normal continuous variables. Results:The median patients' global length of stay was 8.56 days in 2007 and 7.93 days in 2009 (p<0.051). The percentage of patients admitted the same day as surgery increased from 64.87% in 2007 to 86.01% in 2009 (p<0.05). The number of cancelled interventions due to lack of beds was 216 patients in 2007 and 42 patients in 2009. The median number of planned discharges went from 43.05% in 2007 to 86.01% in 2009 (p<0.01). The median number of emergency patients waiting for an in-hospital bed at 8:00¿am was 5 patients in 2007 and 3 patients in 2009 (p<0.01). Conclusions: In conclusion, standardization of admission and discharge processes are largely in our control. There is a significant opportunity to create important benefits for increasing bed capacity and hospital throughput.

Available evidence and outcome of off-label use of rituximab in clinical practice

Purpose: To analyze the therapeutic indications for off-label use of rituximab, the available evidence for its use, the outcomes, and the cost. Methods: This was a retrospective analysis of patients treated with rituximab for off-label indications from January 2007 to December 2009 in two tertiary hospitals. Information on patient characteristics, medical conditions, and therapeutic responses was collected from medical records. Available evidence for the efficacy of rituximab in each condition was reviewed, and the cost of treatment was calculated. Results: A total of 101 cases of off-label rituximab use were analyzed. The median age of the patients involved was 53 [interquartile range (IQR) 37.568.0] years; 55.4 % were women. The indications for prescribing rituximab were primarily hematological diseases (46 %), systemic connective tissue disorders (27 %), and kidney diseases (20 %). Available evidence supporting rituximab treatment for these indications mainly came from individual cohort studies (53.5 % of cases) and case series (25.7 %). The short-term outcome (median 3 months, IQR 24 months) was a complete response in 38 % of cases and partial response in 32.6 %. The highest short-term responses were observed for systemic lupus erythematosus and membranous glomerulonephritis, and the lowest was for neuromyelitis optica, idiopathic thrombocytopenic purpura, and miscellaneous indications. Some response was maintained in long-term follow-up (median 23 months IQR 1230months) in 69.2%of patients showing a short-term response. Median cost per patient was 5,187.5 (IQR 5,187.57,781.3). Conclusions: In our study, off-label rituximab was mainly used for the treatment of hematological, kidney, and systemic connective tissue disorders, and the response among our patient cohort was variable depending on the specific disease. The level of evidence supporting the use of rituximab for these indications was low and the cost was very high. We conclude that more clinical trials on the off-label use of rituximab are needed, although these may be difficult to conduct in some rare diseases. Data from observational studies may provide useful information to assist prescribing in clinical practice.

Available evidence and outcome of off-label use of rituximab in clinical practice

Purpose: To analyze the therapeutic indications for off-label use of rituximab, the available evidence for its use, the outcomes, and the cost. Methods: This was a retrospective analysis of patients treated with rituximab for off-label indications from January 2007 to December 2009 in two tertiary hospitals. Information on patient characteristics, medical conditions, and therapeutic responses was collected from medical records. Available evidence for the efficacy of rituximab in each condition was reviewed, and the cost of treatment was calculated. Results: A total of 101 cases of off-label rituximab use were analyzed. The median age of the patients involved was 53 [interquartile range (IQR) 37.5-68.0] years; 55.4 % were women. The indications for prescribing rituximab were primarily hematological diseases (46 %), systemic connective tissue disorders (27 %), and kidney diseases (20 %). Available evidence supporting rituximab treatment for these indications mainly came from individual cohort studies (53.5 % of cases) and case series (25.7 %). The short-term outcome (median 3 months, IQR 2-4 months) was a complete response in 38 % of cases and partial response in 32.6 %. The highest short-term responses were observed for systemic lupus erythematosus and membranous glomerulonephritis, and the lowest was for neuromyelitis optica, idiopathic thrombocytopenic purpura, and miscellaneous indications. Some response was maintained in long-term follow-up (median 23 months IQR 12-30months) in 69.2%of patients showing a short-term response. Median cost per patient was 5,187.5 (IQR 5,187.5-7,781.3). Conclusions: In our study, off-label rituximab was mainly used for the treatment of hematological, kidney, and systemic connective tissue disorders, and the response among our patient cohort was variable depending on the specific disease. The level of evidence supporting the use of rituximab for these indications was low and the cost was very high. We conclude that more clinical trials on the off-label use of rituximab are needed, although these may be difficult to conduct in some rare diseases. Data from observational studies may provide useful information to assist prescribing in clinical practice.