The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content

Background: The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties of health-related patient reported outcomes (HR-PROs). In this paper, we explain our choices for the design requirements and preferred statistical methods for which no evidence is available in the literature or on which the Delphi panel members had substantial discussion. Methods: The issues described in this paper are a reflection of the Delphi process in which 43 panel members participated. Results: The topics discussed are internal consistency (relevance for reflective and formative models, and distinction with unidimensionality), content validity (judging relevance and comprehensiveness), hypotheses testing as an aspect of construct validity (specificity of hypotheses), criterion validity (relevance for PROs), and responsiveness (concept and relation to validity, and (in) appropriate measures).Conclusions: We expect that this paper will contribute to a better understanding of the rationale behind the items, thereby enhancing the acceptance and use of the COSMIN checklist.

Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

The Larned A. Waterman Iowa Nonprofit Resource Center eNewsletter, July 2004

Newsletter produced by Iowa Nonprofit Resource Center

The Larned A. Waterman Iowa Nonprofit Resource Center eNewsletter, May 2005

Newsletter produced by Iowa Non Profit Resource Center

The Larned A. Waterman Iowa Nonprofit Resource Center eNewsletter, February 2003

Newsletter produced by Iowa Nonprofit Resource Center

The Larned A. Waterman Iowa Nonprofit Resource Center eNewsletter, April 2004

Newsletter produced by Iowa Nonprofit Resource Center

ExPASy: SIB bioinformatics resource portal.

ExPASy (http://www.expasy.org) has worldwide reputation as one of the main bioinformatics resources for proteomics. It has now evolved, becoming an extensible and integrative portal accessing many scientific resources, databases and software tools in different areas of life sciences. Scientists can henceforth access seamlessly a wide range of resources in many different domains, such as proteomics, genomics, phylogeny/evolution, systems biology, population genetics, transcriptomics, etc. The individual resources (databases, web-based and downloadable software tools) are hosted in a 'decentralized' way by different groups of the SIB Swiss Institute of Bioinformatics and partner institutions. Specifically, a single web portal provides a common entry point to a wide range of resources developed and operated by different SIB groups and external institutions. The portal features a search function across 'selected' resources. Additionally, the availability and usage of resources are monitored. The portal is aimed for both expert users and people who are not familiar with a specific domain in life sciences. The new web interface provides, in particular, visual guidance for newcomers to ExPASy.

Kinship in entrepreneur networks: Performance effects of resource assembly in Africa

We examine the relationship between structural social capital, resource assembly, and firm performance of entrepreneurs in Africa. We posit that social capital primarily composed of kinship or family ties helps the entrepreneur to raise resources, but it does so at a cost. Using data drawn from small firms in Kampala, Uganda, we explore how shared identity among the entrepreneur's social network moderates this relationship. A large network contributed a higher quantity of resources raised, but at a higher cost when shared identity was high. We discuss the implications of these findings for the role of family ties and social capital in resource assembly, with an emphasis on developing economies.

State of Iowa Improving Transition Outcomes Resource Mapping Workshops, 2003-2004

Iowa Vocational Rehabilitation Services, a Division of the State of Iowa Department of Education, in partnership with seven other state agencies, applied for and was awarded funding for “Improving Transition Outcomes for Youth with Disabilities Through the Use of Intermediaries.” This Innovative State Alignment Grant is funded by the Department of Labor, Office of Disability Employment Policy. For clarity and brevity, the Iowa team chose to use “Improving Transition Outcomes” as the project name, thus providing the acronym ITO. Grant funding began October 1, 2003 with the possibility of renewal for five years.

NRS State Data Quality Standards Checklist, 2002

The NRS state data quality standards identify the policies, processes and materials that states and local programs should have in place to collect valid and reliable data for the National Reporting System (NRS). The Division of Adult Education (DAEL) within the Office of Vocational and Adult Education developed the standards to define the characteristics of high quality state and local data collection systems for the NRS. The standards provide an organized way for DAEL to understand the quality of NRS data collection within the states and also provide guidance to states on how to improve their systems. States are to complete this checklist, which incorporates the standards, with their annual NRS data submission to rate their level of implementation of the standards. The accompanying policy document describes DAEL’s requirements for state conformance to the standards and explains the use of the information from this checklist.

Narrative interviews: an important resource in qualitative research

Objetives This methodological study explain and emphasize the extent and fertility of the narrative interview in qualitative research. Methods To describe the narrative method within the qualitative research. Results The qualitative research method is characterized by addressing issues related to the singularities of the field and individuals investigated, being the narrative interviews a powerful method for use by researchers who aggregate it. They allow the deepening of research, the combination of life stories with socio-historical contexts, making the understanding of the senses that produce changes in the beliefs and values that motivate and justify the actions of possible informants. Conclusion The use of narrative is an advantageous investigative resource in qualitative research, in which the narrative is a traditional form of communication whose purpose is to serve content from which the subjective experiences can be transmitted.

Report on a review of selected general and application controls over the Iowa Department of Transportation’s Resource Management System for the period May 5, 2006 through August 4, 2006.

Report on a review of selected general and application controls over the Iowa Department of Transportation’s Resource Management System for the period May 5, 2006 through August 4, 2006.

The InterPro protein families database: the classification resource after 15 years.

The InterPro database (http://www.ebi.ac.uk/interpro/) is a freely available resource that can be used to classify sequences into protein families and to predict the presence of important domains and sites. Central to the InterPro database are predictive models, known as signatures, from a range of different protein family databases that have different biological focuses and use different methodological approaches to classify protein families and domains. InterPro integrates these signatures, capitalizing on the respective strengths of the individual databases, to produce a powerful protein classification resource. Here, we report on the status of InterPro as it enters its 15th year of operation, and give an overview of new developments with the database and its associated Web interfaces and software. In particular, the new domain architecture search tool is described and the process of mapping of Gene Ontology terms to InterPro is outlined. We also discuss the challenges faced by the resource given the explosive growth in sequence data in recent years. InterPro (version 48.0) contains 36 766 member database signatures integrated into 26 238 InterPro entries, an increase of over 3993 entries (5081 signatures), since 2012.

MyHits: improvements to an interactive resource for analyzing protein sequences.

The MyHits web site (http://myhits.isb-sib.ch) is an integrated service dedicated to the analysis of protein sequences. Since its first description in 2004, both the user interface and the back end of the server were improved. A number of tools (e.g. MAFFT, Jacop, Dotlet, Jalview, ESTScan) were added or updated to improve the usability of the service. The MySQL schema and its associated API were revamped and the database engine (HitKeeper) was separated from the web interface. This paper summarizes the current status of the server, with an emphasis on the new services.

Human Resource Information System; individual Users with Work Reporting Guide, April 2003

Guide manual for using the Human Resource Information System for the state of Iowa.