Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

The AO comprehensive classification of pediatric long-bone fractures: a web-based multicenter agreement study.

The first AO comprehensive pediatric long-bone fracture classification system has been proposed following a structured path of development and validation with experienced pediatric surgeons. A Web-based multicenter agreement study involving 70 surgeons in 15 clinics and 5 countries was conducted to assess the reliability and accuracy of this classification when used by a wide range of surgeons with various levels of experience. Training was provided at each clinic before the session. Using the Internet, participants could log in at any time and classify 275 supracondylar, radius, and tibia fractures at their own pace. The fracture diagnosis was made following the hierarchy of the classification system using both clinical terminology and codes. kappa coefficients for the single-surgeon diagnosis of epiphyseal, metaphyseal, or diaphyseal fracture type were 0.66, 0.80, and 0.91, respectively. Median accuracy estimates for each bone and type were all greater than 80%. Depending on their experience and specialization, surgeons greatly varied in their ability to classify fractures. Pediatric training and at least 2 years of experience were associated with significant improvement in reliability and accuracy. Kappa coefficients for diagnosis of specific child patterns were 0.51, 0.63, and 0.48 for epiphyseal, metaphyseal, and diaphyseal fractures, respectively. Identified reasons for coding discrepancies were related to different understandings of terminology and definitions, as well as poor quality radiographic images. Results supported some minor adjustments in the coding of fracture type and child patterns. This classification system received wide acceptance and support among the surgeons involved. As long as appropriate training could be performed, the system classification was reliable, especially among surgeons with a minimum of 2 years of clinical experience. We encourage broad-based consultation between surgeons' international societies and the use of this classification system in the context of clinical practice as well as prospectively for clinical studies.

Examining the Agreement of Structural Loss Measured With Heidelberg Retinal Tomograhy and Functional Loss With Standard Automated Perimetry (SAP; Octopus), Pulsar Perimetry (PP), and Moorfields Motion Displacement Test (MDT) Perimetry

Purpose: To examine the relationship of functional measurements with structural measures. Methods: 146 eyes of 83 test subjects underwent Heidelberg Retinal Tomography (HRTIII) (disc area<2.43, mphsd<40), and perimetry testing with Octopus (SAP; Dynamic), Pulsar (PP; TOP) and Moorfields MDT (ESTA). Glaucoma was defined as progressive structural or functional loss (20 eyes). Perimetry test points were grouped into 6 sectors based on the estimated optic nerve head angle into which the associated nerve fiber bundle enters (Garway-Heath map). Perimetry summary measures (PSM) (MD SAP/ MD PP/ PTD MDT) were calculated from the average total deviation of each measured threshold from the normal for each sector. We calculated the 95% significance level of the sectorial PSM from the respective normative data. We calculated the percentage agreement with group1 (G1), healthy on HRT and within normal perimetric limits, and group 2 (G2), abnormal on HRT and outside normal perimetric limits. We also examined the relationship of PSM and rim area (RA) in those sectors classified as abnormal by MRA (Moorfields Regression Analysis) of HRT. Results: The mean age was 65 (range= [37, 89]). The global sensitivity versus specificity of each instrument in detecting glaucomatous eyes was: MDT 80% vs. 88%, SAP 80% vs. 80%, PP 70% vs. 89% and HRT 80% vs. 79%. Highest percentage agreement of HRT (respectively G1, G2, sector) with PSM were MDT (89%, 57%, nasal superior), SAP (83%, 74%, temporal superior), PP (74%, 63%, nasal superior). Globally percentage agreement (respectively G1, G2) was MDT (92%, 28%), SAP (87%, 40%) and PP (77%, 49%). Linear regression showed there was no significant trend globally associating RA and PSM. However, sectorally the supero-nasal sector had a statistically significant (p<0.001) trend with each instrument, the associated r2 coefficients are (MDT 0.38 SAP 0.56 and PP 0.39). Conclusions: There were no significant differences in global sensitivity or specificity between instruments. Structure-function relationships varied significantly between instruments and were consistently strongest supero-nasally. Further studies are required to investigate these relationships in detail.

SPOC Collective Bargaining Agreement 2007-2009, July 2007

This Agreement made and entered into this 1st day of July 2007 at Des Moines, Iowa, pursuant to the provisions of Chapter 20 of the Iowa Code, by and between the State of Iowa (hereinafter referred to as the Employer) and the State Police Officers Council, and its appropriate affiliated sub-organizations (hereinafter referred to as the Council), as representatives of employees employed by the State of Iowa, as set forth specifically in the Recognition Clause.

AFSCME Collective Bargaining Agreement 2007-2009, July 2007

This Agreement made and entered into this 1st day of July 2007, at Des Moines, Iowa, pursuant to the provisions of Chapter 20 of the Code of Iowa, by and between the State of Iowa (hereinafter referred to as the Employer) and the American Federation of State, County, and Municipal Employees, Iowa Public Employees Council 61, AFL-CIO (hereinafter referred to as the Union), and its appropriate affiliated locals, as representatives of employees employed by the State of Iowa, as set forth specifically in Appendix A.

IUP Science Unit collective Bargainging Agreement, July 2007

This Agreement made and entered i into this 1 1st day of July 2007, at Des Moines, Iowa, pursuant to the provisions of Chapter 20 of the Iowa Code, by and between the State of Iowa (hereinafter referred to as the Employer) and UE Local 893/Iowa United Professionals, and its appropriate affiliated locals, as representatives of employees employed by the State of Iowa, as set forth specifically in Appendix A (hereinafter referred to as the Union).

IUP Social Services Collective Bargaining Agreement, July 2007

This agreement made and entered in to this 1st day of July 2007, at Des Moines, Iowa pursuant to the provisions of Chapter 20 of the Iowa code, by and between the State of Iowa (hereinafter referred to as the Employer) and UE Local 893/Iowa United Professionals, and it's appropriate affiliated locals, as representatives of employees employed by the State of Iowa, as set forth specifically in appendix A (hereinafter referred to as the Union).

Comparison of the interobserver variability of 2 different methods of dietary assessment in a geriatric ward: a pilot study.

BACKGROUND: Protein-energy malnutrition is highly prevalent in aged populations. Associated clinical, economic, and social burden is important. A valid screening method that would be robust and precise, but also easy, simple, and rapid to apply, is essential for adequate therapeutic management. OBJECTIVES: To compare the interobserver variability of 2 methods measuring food intake: semiquantitative visual estimations made by nurses versus calorie measurements performed by dieticians on the basis of standardized color digital photographs of servings before and after consumption. DESIGN: Observational monocentric pilot study. SETTING/PARTICIPANTS: A geriatric ward. The meals were randomly chosen from the meal tray. The choice was anonymous with respect to the patients who consumed them. MEASUREMENTS: The test method consisted of the estimation of calorie consumption by dieticians on the basis of standardized color digital photographs of servings before and after consumption. The reference method was based on direct visual estimations of the meals by nurses. Food intake was expressed in the form of a percentage of the serving consumed and calorie intake was then calculated by a dietician based on these percentages. The methods were applied with no previous training of the observers. Analysis of variance was performed to compare their interobserver variability. RESULTS: Of 15 meals consumed and initially examined, 6 were assessed with each method. Servings not consumed at all (0% consumption) or entirely consumed by the patient (100% consumption) were not included in the analysis so as to avoid systematic error. The digital photography method showed higher interobserver variability in calorie intake estimations. The difference between the compared methods was statistically significant (P < .03). CONCLUSIONS: Calorie intake measures for geriatric patients are more concordant when estimated in a semiquantitative way. Digital photography for food intake estimation without previous specific training of dieticians should not be considered as a reference method in geriatric settings, as it shows no advantages in terms of interobserver variability.

2009-2011 Collective Bargaining Agreement Between State of Iowa and Local 893; Science Unit, July 1, 2009

This Agreement made and entered i into this 1 1st day of July 2009, at Des Moines, Iowa, pursuant to the provisions of Chapter 20 of the Iowa Code, by and between the State of Iowa (hereinafter referred to as the Employer) and UE Local 893/Iowa United Professionals, and its appropriate affiliated locals, as representatives of employees employed by the State of Iowa, as set forth specifically in Appendix A (hereinafter referred to as the Union).

2009-2011 Collective Bargaining Agreement Between State of Iowa and Local 893; Social Services, July 1, 2009

This Agreement made and entered i into this 1 1st day of July 2009, at Des Moines, Iowa, pursuant to the provisions of Chapter 20 of the Iowa Code, by and between the State of Iowa (hereinafter referred to as the Employer) and UE Local 893/Iowa United Professionals, and its appropriate affiliated locals, as representatives of employees employed by the State of Iowa.

2009-2011 Agreement Between State of Iowa and State Police Officers Council, July 1, 2009

This Agreement made and entered into this 1st day of July 2009 at Des Moines, Iowa, pursuant to the provisions of Chapter 20 of the Iowa Code, by and between the State of Iowa (hereinafter referred to as the Employer) and the State Police Officers Council, and its appropriate affiliated sub-organizations (hereinafter referred to as the Council), as representatives of employees employed by the State of Iowa.

Validity of an arterial pressure waveform analysis device: does the puncture site play a role in the agreement with intermittent pulmonary artery catheter thermodilution measurements?

OBJECTIVE: The measurement of cardiac output is a key element in the assessment of cardiac function. Recently, a pulse contour analysis-based device without need for calibration became available (FloTrac/Vigileo, Edwards Lifescience, Irvine, CA). This study was conducted to determine if there is an impact of the arterial catheter site and to investigate the accuracy of this system when compared with the pulmonary artery catheter using the bolus thermodilution technique (PAC). DESIGN: Prospective study. SETTING: The operating room of 1 university hospital. PARTICIPANTS: Twenty patients undergoing cardiac surgery. INTERVENTIONS: CO was determined in parallel by the use of the Flotrac/Vigileo systems in the radial and femoral position (CO_rad and CO_fem) and by PAC as the reference method. Data triplets were recorded at defined time points. The primary endpoint was the comparison of CO_rad and CO_fem, and the secondary endpoint was the comparison with the PAC. MEASUREMENTS AND MAIN RESULTS: Seventy-eight simultaneous data recordings were obtained. The Bland-Altman analysis for CO_fem and CO_rad showed a bias of 0.46 L/min, precision was 0.85 L/min, and the percentage error was 34%. The Bland-Altman analysis for CO_rad and PAC showed a bias of -0.35 L/min, the precision was 1.88 L/min, and the percentage error was 76%. The Bland-Altman analysis for CO_fem and PAC showed a bias of 0.11 L/min, the precision was 1.8 L/min, and the percentage error was 69%. CONCLUSION: The FloTrac/Vigileo system was shown to not produce exactly the same CO data when used in radial and femoral arteries, even though the percentage error was close to the clinically acceptable range. Thus, the impact of the introduction site of the arterial catheter is not negligible. The agreement with thermodilution was low.

Beyond the Toledo agreement : the intergenerational impact of the spanish pension reform

The paper examines the intergenerational impact of the Spanish public pension system after the 1997 Pension Reform Act. Working within a Generational Accounting framework, we find that maintaining the new legal setting could leave future generations with liabilities as high as 176 percent of base year GDP. As the recent reform measures have been insufficient to achieve the sustainability of the current pension system, we also analyse the impact of alternative reform strategies. Within the current pay-as-you-go setting, a further improvement to tax-benefit linkage in line with the original spirit of the Toledo Agreement is shown to yield and intergenerationally more balanced outcome,than an increase in the retirement age or an expansion of public subsidies financed through indirect taxes. Finally, we examine the generational impact of a move toward a partially funded pension system which might restore theintergenerational balance

Beyond the Toledo agreement : the intergenerational impact of the spanish pension reform

The paper examines the intergenerational impact of the Spanish public pension system after the 1997 Pension Reform Act. Working within a Generational Accounting framework, we find that maintaining the new legal setting could leave future generations with liabilities as high as 176 percent of base year GDP. As the recent reform measures have been insufficient to achieve the sustainability of the current pension system, we also analyse the impact of alternative reform strategies. Within the current pay-as-you-go setting, a further improvement to tax-benefit linkage in line with the original spirit of the Toledo Agreement is shown to yield and intergenerationally more balanced outcome,than an increase in the retirement age or an expansion of public subsidies financed through indirect taxes. Finally, we examine the generational impact of a move toward a partially funded pension system which might restore theintergenerational balance