Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

A Case Study of China’s Commercial Pork Value Chain, August 2005

In China, with the cost of improved technology rising, surplus labor shrinking, and demand for food quality and safety increasing, it will be just a matter of time before the country’s hog production sector will be commercialized like that of developed countries. However, even if China’s cost of production converges to international levels, as shown in this case study, China may continue to retain some competitive advantage because of the labor-intensive nature of the marketing services involved in hog processing and meat distribution. The supply of variety meats offers the most promising market opportunity for foreign suppliers in China. The market may open further if the tariff rate for variety meats is reduced from 20% and harmonized with the pork muscle meat rate of 12%, and if the value-added tax of 13% is applied equally to both imported and domestic products. The fast-growing Western-style family restaurant and higher-end dining sector is another market opportunity for high-quality imported pork.

Parallel Research, Multiple Intellectual Property Right Protection Instruments, and the Correlation among R&D Projects, September 2005

The choice of a research path in attacking scientific and technological problems is a significant component of firms’ R&D strategy. One of the findings of the patent races literature is that, in a competitive market setting, firms’ noncooperative choices of research projects display an excessive degree of correlation, as compared to the socially optimal level. The paper revisits this question in a context in which firms have access to trade secrets, in addition to patents, to assert intellectual property rights (IPR) over their discoveries. We find that the availability of multiple IPR protection instruments can move the paths chosen by firms engaged in an R&D race toward the social optimum.

Taajuusmuuttajien suorituskyvyn automaattinen testausympäristö

Tämä insinöörityö tehtiin ABB Oy, Drivesin Product AC -tulosyksikön tuotekehitysosastolle Helsingissä. Työssä kehitettiin taajuusmuuttajien suorituskyvyn automaattinen testausympäristö. ABB:n taajuusmuuttajien suorituskykytestejä ei ole aikaisemmin automatisoitu. Testit on tehty käsin ja niiden suorittamiseen ja tulosten käsittelyyn on kulunut paljon aikaa. Automaattisella testauksella pyrittiin testien suorittamiseen ja tulosten käsittelyyn kuluvan ajan huomattavaan pienentymiseen. Työssä ei ollut tarkoituksena tehdä suorituskykytestejä vaan kehittää automaattinen testausympäristö eli suorituskykytestipenkki, jossa suorituskykytestit on mahdollista suorittaa. Työssä keskityttiin taajuusmuuttajan nopeus- ja momenttisäätäjien suorituskykyyn. Työ toteutettiin suunnittelu- ja ohjelmointityönä. Testausympäristön laitteisto perustuu ABB:n tuotekehityslaboratorioiden olemassaoleviin testipaikkoihin. Testausympäristössä käytetään taajuusmuuttajien lisäksi pääasiassa kolmivaiheisia oikosulkumoottoreita. Lisäksi laitteistoon kuuluu ACS800-sarjan taajuusmuuttaja kuormakäyttönä, momenttianturi ja takometri eli kierrosnopeusmittari. Ohjelmointi tehtiin National Instrumentsin LabVIEW-ohjelmointiympäristön versiolla 8.0. Testausympäristön käyttöliittymänä toimii saman yrityksen TestStand-testausohjelmiston versio 3.5. Testattavien taajuusmuuttajien ohjausta ja momenttianturin lukemista varten ohjelmoitiin virtuaali-instrumentteja. Virtuaali-instrumentteja kutsutaan TestStand-testisekvensseistä. Testisekvenssit luodaan TestStandin sekvenssieditorilla ja suoritetaan sekvenssieditorissa tai operaattorin käyttöliittymässä. Työn tuloksena syntyi taajuusmuuttajien suorituskyvyn automaattinen testausympäristö. Testausympäristöä voidaan hyödyntää sekä nykyisen että seuraavan sukupolven taajuusmuuttajien testauksessa. Sillä on mahdollista suorittaa yleisimmät taajuusmuuttajien suorituskykytestit, kuten nopeus- ja momenttisäätöjen staattinen ja dynaaminen tarkkuus, hyvin kattavasti. Testit voidaan automaattisesti suorittaa koko testikäytön sallimalla pyörimisnopeus- ja kuormitusalueella. Näytteenottotaajuus voi olla enintään 1 kHz luettaessa pyörimisnopeutta ACS800-sarjan taajuusmuuttajan kautta ja momenttianturia samanaikaisesti. Virtuaali-instrumenteista koostuvia testisekvenssejä voidaan vapaasti muokata ja kehittää testejä edelleen tai luoda kokonaan uusia testejä. Testausympäristö perustuu teollisuudessa yleisesti käytettyihin ohjelmistoihin ja tarjoaa hyvät mahdollisuudet jatkokehitykselle.

Avaruusinstrumentin mekaniikkasuunnittelu

Tämän insinöörityön tarkoituksena on kehittää avaruusinstrumentti, joka on osa Euroopan avaruusjärjestön ESA:n ja Japanin avaruusjärjestön JAXA:n BepiColombo-yhteistyöhanketta. Satelliitti lähetetään Merkurius-planeetan kiertoradalle vuonna 2013. Avaruusaluksen matka Merkuriukseen kestää yhteensä kuusi vuotta ja on perillä vuonna 2019. Yksi BepiColombo-satelliitin tieteellisistä instrumenteista on Oxford Instruments Analytical Oy:n kehittämä SIXS-instrumentti (Solar Intensity X-ray and particle Spectrometer). Instrumentin tarkoituksena on mitata auringosta tulevaa röntgen- ja partikkelisäteilyä. Se toimii yhteistyössä Merkuriuksen pintaa mittaavan MIXS-instrumentin (Mercury Imaging X-ray Spectrometer) kanssa. Tuloksista pystytään analysoimaan ne alkuaineet, joista Merkuriuksen pinta koostuu. Työn alussa esitellään teoriataustaa alkuaineiden mittauksesta niiltä osin, kuin se tämän työn kannalta on tarpeellista. Työssä syvennytään tarkemmin auringosta tulevan säteilyn mittauksesta vastaavan instrumentin tekniikkaan ja mekaniikkasuunnitteluun. Instrumentin lämpöteknisestä suunnittelusta, värähtelymittauksista ja lujuusanalyysista on työhön sisällytetty pääasiat. Työn tuloksena on kehitetty instrumenttiin tulevan partikkelidetektorin prototyyppi sekä instrumenttikotelon malli. Lopullisen koon instrumenttikotelolle määrittää vaadittavan elektroniikan viemä tila. Mittalaitteen kehitystyö jatkuu Oxford Instruments Analytical Oy:ssä vuoteen 2011 saakka.

Measuring Instruments In Cardiology Adapted Into Portuguese Language Of Brazil: A Systematic Review

This was a systematic review aimed at identifying and characterizing measuring instruments, developed in the context of cardiology, which were adapted into Portuguese language of Brazil. Systematic searches were performed in six databases. Information extracted included cultural adaptation process and measurement properties. To assess the methodological quality of studies, criteria based on international guidelines for cultural adaptation of instruments were used. Among the 114 articles found, 14 were eligible for review. Of these, most evaluated quality of life (35.7%) and health knowledge/learning (28.6%). Most studies followed all stages of the adaptation process recommended in the literature. With respect to measurement properties, internal consistency, verified by Cronbach’s alpha, was the property reported in the majority of the studies, as well as construct and criterion validity. This study is expected to provide to the scientific community a critical evaluation of adapted questionnaires available in the context of cardiology.


Management of basic health units in municipalities of different size: profile and management instruments

Objective To identify the characteristics of managers and their use of management instruments in primary care and to analyze differences in these features among municipalities of different sizes. Method The present cross-sectional descriptive study was conducted at 108 basic health units from 21 municipalities in northern Paraná, Brazil. The data were collected using a semi-structured questionnaire during the second half of 2010. Results Most managers had graduate degrees and were female and nurses. The managers from the small municipalities were younger, their payment was lower, and they had less work experience. The use of management instruments was expressive for both the organization and work management; however, the instruments were used less in the small municipalities. Conclusion The managers were committed to their role; it is recommended that policies and guidance should be formulated at the federal and state levels to support small municipalities.

Use of patients’ classification instruments: analysis of the brazilian production of knowledge

Objective To analyze the production of scientific knowledge about the use of patients’ classification instruments in care and management practice in Brazil. Method Integrative literature review with databases search in: Latin American and Caribbean Literature on Health Sciences (LILACS), Medical Literature Analysis and Retrieval System on-line (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL) and SCOPUS, between January 2002 through December 2013. Results 1,194 studies were found, 31 met the inclusion criteria. We observed a higher number of studies in the category care plans and workload (n=15), followed by the category evaluation of psychometric properties (n=14). Conclusion Brazilian knowledge production has not yet investigated some purposes of using instruments for classifying patients in professional nursing practice. The identification of unexplored areas can guide future research on the topic.