Special Investigation of the Fourth Judicial District Department of Correctional Services (District) Headquartered in Council Bluffs, July 1st, 2003 through August 31, 2004

Other Audit Report - Special Investigation

A Review of the State's Leased Space and the Leasing Process, General Services Enterprise of the Department of Administrative Services, July 1, 1998 through June 30, 2003

Other Audit Reports - State Leasing

Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

Iowa Department of Human Services - Case Management Unit, Independent Auditor's Reports, Basic Financial Statements and Supplementary Information, June 30, 2004

State Agency Audit Report

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

Report of Recommendations to the Iowa Department of Human Services - Central Distribution Center, June 30, 2004

State Audit Reports - DHS Institutions

Report of Recommendations to the Iowa Department of Human Services, June 30, 2004

State Audit Reports

Report of Recommendations to the Iowa Department of Administrative Services, June 30, 2004

State Audit Reports

Report of Recommendations to the Iowa Department of Administrative Services on the Review of General and Application Controls over the HRIS and Payroll Systems, May 10, 2004 through June 4, 2004

State Audit Reports

Combined Report of Recommendations to the Eight Judicial District Departments of Correctional Services, June 30, 2004

Other Audit Reports - Judicial

Iowa Department of Administrative Services Agency Performance Plan, FY 2004

Agency Performance Plan

Combined Report on the Institutions Under the Control of the Iowa Department of Human Services, Schedules, Findings and Recommendations, June 30, 2004

State Audit Reports

Report of Recommendations to the Iowa Department of Human Services - Central Distribution Center, June 30, 2005

Other Audit Reports - DHS Institutions

Iowa Department of Human Services - Case Management Unit, Independent Auditor's Reports, Basic Financial Statements and Supplementary Information, June 30, 2005

State Audit Reports

Report of Recommendations to the Iowa Department of Human Services, June 30, 2005

State Audit Reports