Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

Pseudogenes in the ENCODE regions: consensus annotation, analysis of transcription, and evolution

Arising from either retrotransposition or genomic duplication of functional genes, pseudogenes are “genomic fossils” valuable for exploring the dynamics and evolution of genes and genomes. Pseudogene identification is an important problem in computational genomics, and is also critical for obtaining an accurate picture of a genome’s structure and function. However, no consensus computational scheme for defining and detecting pseudogenes has been developed thus far. As part of the ENCyclopedia Of DNA Elements (ENCODE) project, we have compared several distinct pseudogene annotation strategies and found that different approaches and parameters often resulted in rather distinct sets of pseudogenes. We subsequently developed a consensus approach for annotating pseudogenes (derived from protein coding genes) in the ENCODE regions, resulting in 201 pseudogenes, two-thirds of which originated from retrotransposition. A survey of orthologs for these pseudogenes in 28 vertebrate genomes showed that a significant fraction (∼80%) of the processed pseudogenes are primate-specific sequences, highlighting the increasing retrotransposition activity in primates. Analysis of sequence conservation and variation also demonstrated that most pseudogenes evolve neutrally, and processed pseudogenes appear to have lost their coding potential immediately or soon after their emergence. In order to explore the functional implication of pseudogene prevalence, we have extensively examined the transcriptional activity of the ENCODE pseudogenes. We performed systematic series of pseudogene-specific RACE analyses. These, together with complementary evidence derived from tiling microarrays and high throughput sequencing, demonstrated that at least a fifth of the 201 pseudogenes are transcribed in one or more cell lines or tissues.

Médecines complémentaires: vers un consensus "evidence-based" à l'hôpital universitaire. [Complementary and alternative medicines (CAM): towards an "evidence-based" consensus in the University hospital]

Après la votation fédérale demandant de prendre en compte les médecines complémentaires, un consensus a été recherché dans quatorze services et unités du Centre hospitalier universitaire vaudois (CHUV). Confrontés aux données de la littérature (Plus de 2000 publications en "Evidence-based complementary medicine" depuis 1998), les soignants étaient tous surpris par l'ampleur des résultats cliniques disponibles actuellement. Tous identifiaient un besoin en formation et en informations sur le sujet. Une prise de position officielle de l'institution était aussi souhaitée, instituant l'enseignement et la recherche sur les médecines complémentaires et assurant la production d'informations rigoureuses et pertinentes pour la clinique. [Abstract] While a popular vote supported a new article on complementary and alternative medicines (CAM) in the Swiss Constitution, this assessment in 14 wards of the University Hospital of Lausanne, Switzerland, attempted at answering the question: How can CAM use be better taken into account and patients informed with more rigor and respect for their choices? Confronted with a review of the literature (> 2000 publications in "Evidence-based cornplementary medicine" since 1998), respondents declared their ignorance of the clinical data presently available on CAM. All were in favour of more teaching and information on the subject, plus an official statement from the Hospital direction, ensuring production and diffusion of rigorous and cJinically significant information on CAM.

Communication skills training in oncology: a position paper based on a consensus meeting among European experts in 2009.

BACKGROUND: Communication in cancer care has become a major topic of interest. Since there is evidence that ineffective communication affects both patients and oncology clinicians (physicians and nurses), so-called communication skills trainings (CSTs) have been developed over the last decade. While these trainings have been demonstrated to be effective, there is an important heterogeneity with regard to implementation and with regard to evidence of different aspects of CST. METHODS: In order to review and discuss the scientific literature on CST in oncology and to formulate recommendations, the Swiss Cancer League has organised a consensus meeting with European opinion leaders and experts in the field of CST, as well as oncology clinicians, representatives of oncology societies and patient organisations. On the basis of a systematic review and a meta-analysis, recommendations have been developed and agreed upon. RESULTS: Recommendations address (i) the setting, objectives and participants of CST, (ii) its content and pedagogic tools, (iii) organisational aspects, (iv) outcome and (v) future directions and research. CONCLUSION: This consensus meeting, on the basis of European expert opinions and a systematic review and meta-analysis, defines key elements for the current provision and future development and evaluation of CST in oncology.

Minimizing recombinations in consensus networks for phylogeographic studies

Background: We address the problem of studying recombinational variations in (human) populations. In this paper, our focus is on one computational aspect of the general task: Given two networks G1 and G2, with both mutation and recombination events, defined on overlapping sets of extant units the objective is to compute a consensus network G3 with minimum number of additional recombinations. We describe a polynomial time algorithm with a guarantee that the number of computed new recombination events is within ϵ = sz(G1, G2) (function sz is a well-behaved function of the sizes and topologies of G1 and G2) of the optimal number of recombinations. To date, this is the best known result for a network consensus problem.Results: Although the network consensus problem can be applied to a variety of domains, here we focus on structure of human populations. With our preliminary analysis on a segment of the human Chromosome X data we are able to infer ancient recombinations, population-specific recombinations and more, which also support the widely accepted 'Out of Africa' model. These results have been verified independently using traditional manual procedures. To the best of our knowledge, this is the first recombinations-based characterization of human populations. Conclusion: We show that our mathematical model identifies recombination spots in the individual haplotypes; the aggregate of these spots over a set of haplotypes defines a recombinational landscape that has enough signal to detect continental as well as population divide based on a short segment of Chromosome X. In particular, we are able to infer ancient recombinations, population-specific recombinations and more, which also support the widely accepted 'Out of Africa' model. The agreement with mutation-based analysis can be viewed as an indirect validation of our results and the model. Since the model in principle gives us more information embedded in the networks, in our future work, we plan to investigate more non-traditional questions via these structures computed by our methodology.

Development of the first disease activity index for eosinophilic esophagitis: update on the EEsAI in 2012

Background and Aims: The international E EsAI s tudy g roup is currently d eveloping the first activity index ( EEsAI) specific for E osinophilic Esophagitis (EoE). G oal: T o develop, e valuate and validate the EEsAI. Methods: T he development c omprises three p hases: 1. Selection of c andidate items ( completed); 2. Evaluation of t he activity index i n a first patient cohort (in progress, p atient recruitment completed); and 3. Validation in a s econd EoE patient cohort. F ocus group interviews with patients were used in p hase 1 to g enerate patient r eported outcomes (PRO) according to g uidelines o f regulatory authorities (FDA a nd EMA), whereas the section of biologic items was developed by Delphi rounds o f international E oE experts from E urope and North America. Results: T he EEsAI has a modular c omposition to a ssess the following components o f EoE activity: p atient r eported outcomes, e ndoscopic activity, histologic activity, laboratory activity, a nd quality of l ife (QoL). Definitions for a ll aspects o f endoscopic and histologic appearance were e stablished by consensus r ounds a mong E oE experts. S ymptom a ssessment tools were c reated that t ake into account d ifferent food consistencies as w ell as f ood avoidance and specific processing strategies. The EEsAI i s currently e valuated in a cohort of a dult EoE patients since M arch 2 011 (patient recruitment completed). Conclusions: The EEsAI standardizes outcome assessment in EoE t rials. T he collaboration with i nternational E oE e xperts a s well as f ollowing o f the guidelines f rom regulatory authorities will lead to its wide applicability.

Hindsight judgement on ambiguous episodes of suspected infection in critically ill children: poor consensus amongst experts?

Few episodes of suspected infection observed in paediatric intensive care are classifiable without ambiguity by a priori defined criteria. Most require additional expert judgement. Recently, we observed a high variability in antibiotic prescription rates, not explained by the patients' clinical data or underlying diseases. We hypothesised that the disagreement of experts in adjudication of episodes of suspected infection could be one of the potential causes for this variability. During a 5-month period, we included all patients of a 19-bed multidisciplinary, tertiary, neonatal and paediatric intensive care unit, in whom infection was clinically suspected and antibiotics were prescribed ( n=183). Three experts (two senior ICU physicians and a specialist in infectious diseases) were provided with all patient data, laboratory and microbiological findings. All experts classified episodes according to a priori defined criteria into: proven sepsis, probable sepsis (negative cultures), localised infection and no infection. Episodes of proven viral infection and incomplete data sets were excluded. Of the remaining 167 episodes, 48 were classifiable by a priori criteria ( n=28 proven sepsis, n= 20 no infection). The three experts only achieved limited agreement beyond chance in the remaining 119 episodes (kappa = 0.32, and kappa = 0.19 amongst the ICU physicians). The kappa is a measure of the degree of agreement beyond what would be expected by chance alone, with 0 indicating the chance result and 1 indicating perfect agreement. CONCLUSION: agreement of specialists in hindsight adjudication of episodes of suspected infection is of questionable reliability.

Research priorities for nursing care of infants, children and adolescents: a West Australian Delphi study.

This paper describes a study that aimed to identify research priorities for the care of infants, children and adolescents at the sole tertiary referral hospital for children in Western Australia. The secondary aim was to stimulate nurses to explore clinical problems that would require further inquiry. Background. Planning for research is an essential stage of research development; involving clinicians in this exercise is likely to foster research partnerships that are pertinent to clinical practice. Nursing research priorities for the paediatric population have not previously been reported in Australia. Design. Delphi study. Method. Over 12 months in 2005-2006, a three-round questionnaire, using the Delphi technique, was sent to a randomly selected sample of registered nurses. This method was used to identify and prioritise nursing research topics relevant to the patient and the family. Content analysis was used to analyse Round I data and descriptive statistics for Round II and III data. Results. In Round I, 280 statements were identified and reduced to 37 research priorities. Analysis of data in subsequent rounds identified the top two priority research areas as (1) identification of strategies to reduce medication incidents (Mean = 6 center dot 47; SD 0 center dot 88) and (2) improvement in pain assessment and management (Mean = 6; SD 1 center dot 38). Additional comments indicated few nurses access the scientific literature or use research findings because of a lack of time or electronic access. Conclusions. Thirty-seven research priorities were identified. The identification of research priorities by nurses provided research direction for the health service and potentially other similar health institutions for children and adolescents in Australia and internationally. Relevance to clinical practice. The nurse participants showed concern about the safety of care and the well-being of children and their families. This study also enabled the identification of potential collaborative research and development of pain management improvement initiatives.

Professional competencies in primary health care for attending to older adults

Objective To identify and analyze the necessary competencies in primary health care for attending to older adults. Method An exploratory, descriptive, and quali-quantitative study was developed. Three rounds of the Delphi Technique were conducted with participants from primary health care services and a multidisciplinary committee. The first questionnaire asked participants to indicate the competencies needed for attending to older adults in primary health care. They were compiled into a list and added to a Likert Scale (from 1 to 5) for the second and third questionnaires. A consensus criterion of 70% was adopted. Results Twenty eight competencies were reached by consensus and were classified into twelve domains. Conclusion The competencies reflect Brazilian health care policy and constitute a reference for professional health practice and education when caring for the older adult in primary health care.

Technological competencies in cardiovascular nursing education

Abstract OBJECTIVE To identify the perception of the coordinators of the Specialization Courses in Cardiovascular Nursing about inserting content from Information and Communication Technology (ICT) and analyze them in relation to the technological competencies and regarding its applicability, relevance and importance in assisting, teaching and management. METHOD Descriptive study with 10 coordinators of the Specialization course in Cardiologic Nursing, who replied to the questionnaire for the development of technological competency adapted from the Technology Initiative Guidelines Education Reforms (TIGER), and analyzed using the Delphi technique for obtaining consensus and scored according to the relevance, pertinence and applicability using Likert scale according to degree of agreement. RESULTS Six courses developed ICT content. The contents of the TIGER were considered relevant, pertinent and applicable. CONCLUSION The coordinators recognize the need for technological competencies of the Cardiovascular Nurse for healthcare applicability.

Nursing Activities Score: an updated guideline for its application in the Intensive Care Unit

ABSTRACT Objective To describe nursing workload in Intensive Care Units (ICU) in different countries according to the scores obtained with Nursing Activities Score (NAS) and to verify the agreement among countries on the NAS guideline interpretation. Method This cross-sectional study considered 1-day measure of NAS (November 2012) obtained from 758 patients in 19 ICUs of seven countries (Norway, the Netherlands, Spain, Poland, Egypt, Greece and Brazil). The Delphi technique was used in expertise meetings and consensus. Results The NAS score was 72.8% in average, ranging from 44.5% (Spain) to 101.8% (Norway). The mean NAS score from Poland, Greece and Egypt was 83.0%, 64.6% and 57.1%, respectively. The NAS score was similar in Brazil (54.0%) and in the Netherlands (51.0%). There were doubts in the understanding of five out 23 items of the NAS (21.7%) which were discussed until researchers’ consensus. Conclusion NAS score were different in the seven countries. Future studies must verify if the fine standardization of the guideline can have a impact on differences in the NAS results.

Cerebrospinal fluid in the diagnosis of multiple sclerosis: a consensus report.

The Committee of the European Concerted Action for Multiple Sclerosis (Charcot Foundation) organised five workshops to discuss CSF analytical standards in the diagnosis of multiple sclerosis. This consensus report from 12 European countries summarises the results of those workshops. It is hoped that neurologists will confer with their colleagues in clinical chemistry to arrange the best possible local practice. The most sensitive method for the detection of oligoclonal immunoglobulin bands is isoelectric focusing. The same amounts of IgG in parallel CSF and serum samples are used and oligoclonal bands are revealed with IgG specific antibody staining. All laboratories performing isoelectric focusing should check their technique at least annually using "blind" standards for the five different CSF and serum patterns. Quantitative measurements of IgG production in the CNS are less sensitive than isoelectric focusing. The preferred method for detection of blood-CSF barrier dysfunction is the albumin quotient. The CSF albumin or total protein concentrations are less satisfactory. These results must be interpreted with reference to the age of the patient and the local method of determination. Cells should be counted. The normal value is no more than 4 cells/microliters. Among evolving optional tests, measurement of the combined local synthesis of antibodies against measles, rubella, and/or varicella zoster could represent a significant advance if it offers higher specificity (not sensitivity) for identifying chronic rather than acute inflammation. Other tests that may have useful correlations with clinical indices include those for oligoclonal free light chains, IgM, IgA, or myelin basic protein concentrations.