The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content

Background: The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties of health-related patient reported outcomes (HR-PROs). In this paper, we explain our choices for the design requirements and preferred statistical methods for which no evidence is available in the literature or on which the Delphi panel members had substantial discussion. Methods: The issues described in this paper are a reflection of the Delphi process in which 43 panel members participated. Results: The topics discussed are internal consistency (relevance for reflective and formative models, and distinction with unidimensionality), content validity (judging relevance and comprehensiveness), hypotheses testing as an aspect of construct validity (specificity of hypotheses), criterion validity (relevance for PROs), and responsiveness (concept and relation to validity, and (in) appropriate measures).Conclusions: We expect that this paper will contribute to a better understanding of the rationale behind the items, thereby enhancing the acceptance and use of the COSMIN checklist.

Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

Addressing Sea Surface Salinity retrieval at different spatial resolution. Feasibility study using OCCAM data within SEPS simulator and L2 processor tools

Projecte de recerca elaborat a partir d’una estada a la National Oceanography Centre of Southampton (NOCS), Gran Bretanya, entre maig i juliol del 2006. La possibilitat d’obtenir una estimació precissa de la salinitat marina (SSS) és important per a investigar i predir l’extensió del fenòmen del canvi climàtic. La missió Soil Moisture and Ocean Salinity (SMOS) va ser seleccionada per l’Agència Espacial Europea (ESA) per a obtenir mapes de salinitat de la superfície marina a escala global i amb un temps de revisita petit. Abans del llençament de SMOS es preveu l’anàlisi de la variabilitat horitzontal de la SSS i del potencial de les dades recuperades a partir de mesures de SMOS per a reproduir comportaments oceanogràfics coneguts. L’objectiu de tot plegat és emplenar el buit existent entre les fonts de dades d’entrada/auxiliars fiables i les eines desenvolupades per a simular i processar les dades adquirides segons la configuració de SMOS. El SMOS End-to-end Performance Simulator (SEPS) és un simulador adhoc desenvolupat per la Universitat Politècnica de Catalunya (UPC) per a generar dades segons la configuració de SMOS. Es va utilitzar dades d’entrada a SEPS procedents del projecte Ocean Circulation and Climate Advanced Modeling (OCCAM), utilitzat al NOCS, a diferents resolucions espacials. Modificant SEPS per a poder fer servir com a entrada les dades OCCAM es van obtenir dades de temperatura de brillantor simulades durant un mes amb diferents observacions ascendents que cobrien la zona seleccionada. Les tasques realitzades durant l’estada a NOCS tenien la finalitat de proporcionar una tècnica fiable per a realitzar la calibració externa i per tant cancel•lar el bias, una metodologia per a promitjar temporalment les diferents adquisicions durant les observacions ascendents, i determinar la millor configuració de la funció de cost abans d’explotar i investigar les posibiltats de les dades SEPS/OCCAM per a derivar la SSS recuperada amb patrons d’alta resolució.

Blood levels of brain-derived neurotrophic factor correlate with several psychopathological symptoms in anorexia nervosa patients

Background: Evidence of a role of brain-derived neurotrophic factor (BDNF) in the pathophysiology of eating disorders (ED) has been provided by association studies and by murine models. BDNF plasma levels have been found altered in ED and in psychiatric disorders that show comorbidity with ED. Aims: Since the role of BDNF levels in ED-related psychopathological symptoms has not been tested, we investigatedthe correlation of BDNF plasma levels with the Symptom Checklist 90 Revised (SCL-90R) questionnaire in a total of 78 ED patients. Methods: BDNF levels, measured bythe enzyme-linked immunoassay system, and SCL-90R questionnaire, were assessed in a total of 78 ED patients. The relationship between BDNF levels and SCL-90R scales was calculated using a general linear model. Results: BDNF plasma levels correlated with the Global Severity Index and the Positive Symptom Distress Index global scales and five of the nine subscales in the anorexia nervosa patients. BDNF plasma levels were able to explain, in the case of the Psychoticism subscale, up to 17% of the variability (p = 0.006). Conclusion: Our data suggest that BDNF levels could be involved in the severity of the disease through the modulation of psychopathological traits that are associated with the ED phenotype.

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

Taula de punts de verificació de les directrius per a l'accessibilitat al contingut de pàgines web, versió 1.0

El World-Wide Web Consortium (W3C), organisme encarregat de la normalització del web, va començar a preocupar-se fa uns anys dels problemes d'accessibilitat que poden presentar les pàgines web a les persones amb discapacitats. Com a resultat d'aquesta preocupació, va posar en marxa la Iniciativa sobre Accessibilitat al Web (WAI), amb el fi d'estudiar el tema i elaborar directrius d'actuació i altres materials d'ajuda. El document més important sorgit de la Iniciativa són les Directrius per a l'accessibilitat al contingut de pàgines web, versió 1.0, que ja va ser traduït al català en aquesta mateixa revista.2 Com a complement, el W3C ha publicat altres documents que volen facilitar-ne la implementació; en destaca el document que a continuació publiquem traduït, la Taula de punts de verificació de les Directrius per a l'accessibilitat al contingut de pàgines web, versió 1.0. La Taula de punts de verificació està pensada per actuar com un annex a les Directrius; sota la forma de llista de control (checklist) presenta un llistat classificat per nivells de prioritat de les pautes que s'haurien de seguir per crear pàgines web accessibles per tothom. La Taula vol ser, per tant, una eina ràpida per a la detecció manual dels problemes que puguin aparèixer, i que es descriuen amb més detalls a les Directrius.

Web content accessibility guidelines: from 1.0 to 2.0

This poster explains the changes introduced in the Web Content Accessibility Guidelines (WCAG) 2.0 from WCAG 1.0 and proposes a checklist for adapting existing websites. Finally, it describes the most common criticisms of the WCAG and places them in the context of its origin and initial aims.

Training referential communicative skills to individuals with autism spectrum disorder: a pilot study

Summary. The present study reports the effects of referential communication training in individuals formally diagnosed with autism spectrum disorder (ASD). Participants were 20 children with ASD (M age = 14.3 yr., SD = 4.2; 6 girls, 14 boys) in the role of speakers and 20 control children, who acted as listeners. They were all enrolled in mainstream compulsory education. Inclusion/exclusion criteria were defined according to the clinical diagnosis of ASD, the presence or absence of additional or associated disability, previous training in referential communication, and any drug treatment. Speakers were randomly assigned to one of two groups (trained vs untrained). Linguistic age, cognitive level, and autistic symptoms were analyzed, respectively, with the Peabody Picture Vocabulary Test (PPVT), the Wechsler Intelligence Scale (WISCR or WAISIII), and the Autistic Behavior Checklist (ABC). Communicative abilities were analyzed through two indexes related to message complexity and self-regulation. The trained group was trained in referential communication tasks (task analysis, role taking, and task evaluation), while the untrained group took part in a communicative game but without any specific communicative training. The results showed that the complexity of emitted messages had improved statistically significantly in the trained group as an effect of training. Ecological referential communication is shown to be an appropriate paradigm for studying the communicative process and its products and could be used to develop and implement a training program focused on those skills in which individuals with ASD are most deficient.

Family burden related to clinical and functional variables of people with intellectual disability with and without a mental disorder

Few studies have been found that to assess the factors that explain higher levels of familyburden in adults with intellectualdisability (ID) and intellectualdisability and mental disorders (ID-MD). The aims of this study were to assess familyburden in people with ID and ID-MD and to determine which sociodemographic, clinical and functionaldisabilityvariables account for familyburden. The sample is composed of pairs of 203 participants with disability and their caregivers, of which 33.5% are caregivers of people with ID and 66.5% of ID-MD. Assessments were performed using scales of clinical and functionaldisability as the following instruments: Weschler Adult Intelligence Scale-III (WAIS-III), Inventory for Client and Agency Planning (ICAP), Psychiatric Assessment Schedule for Adults with Development Disability (PAS-ADD checklist), Disability Assessment Schedule of the World Health Organization (WHO-DAS-II) and familyburden (Subjective and Objective FamilyBurden Inventory - SOFBI/ECFOS-II). People with ID-MD presented higher levels of functionaldisability than those with ID only. Higher levels of familyburden were related to higher functionaldisability in all the areas (p < 0.006-0.001), lower intelligence quotient (p < 0.001), diagnosis of ID-MD (p < 0.001) and presence of organic, affective, psychotic and behavioral disorders (p < 0.001). Stepwise multiple regression showed that behavioral problems, affective and psychotic disorder, disability in participation in society, disability in personal care and presence of ID-MD explained more than 61% of the variance in familyburden. An integrated approach using effective multidimensional interventions is essential for both people with ID and ID-MD and their caregivers in order to reduce familyburden.

Symptom Check-List-90-R: fiabilidad, datos normativos y estructura factorial en estudiantes universitarios

El Symptom Checklist-90-R (SCL-90-R) es uno de los instrumentos más ampliamente utilizados en la medición de la sintomatología psicopatológica en población clínica y en población general. Ya que gran parte de la investigación en psicopatología se realiza con estudiantes universitarios, este estudio instrumental pretende proporcionar datos de referencia para esta población. Analizamos las propiedades psicométricas de esta escala en una muestra representativa de 1.277 estudiantes de la Universidad de Girona. Las dimensiones con puntuaciones más elevadas para el total de la muestra son Obsesividad-compulsividad, Depresión y Sensibilidad interpersonal. Los resultados muestran diferencias significativas entre hombres y mujeres. La fiabilidad de la escala resulta muy aceptable, con unos coeficientes de consistencia interna de las nueve dimensiones primarias y del GSI, que oscilan entre 0,69 y 0,97. El análisis de la estructura factorial y la fuerte interdependencia entre las escalas primarias cuestionan la multidimensionalidad del SCL-90-R y refuerzan la idea de que el instrumento proporciona una medida de distrés general, es decir, es un indicador unidimensional de malestar psicológico más que una medida de dimensiones psicopatológicas diferenciadas

The psychosocial difficulties in brain disorders that explain short term changes in health outcomes.

BACKGROUND: This study identifies a set of psychosocial difficulties that are associated with short term changes in health outcomes across a heterogeneous set of brain disorders, neurological and psychiatric. METHODS: Longitudinal observational study over approximately 12 weeks with three time points of assessment and 741 patients with depression, bipolar disorders, multiple sclerosis, parkinson's disease, migraine, traumatic brain injury and stroke. The data on disability was collected with the checklist of the International Classification of Functioning, Disability and Health. The selected health outcomes were the Short Form 36 and the World Health Organization Disability Assessment Schedule. Multilevel models for change were applied controlling for age, gender and disease severity. RESULTS: The psychosocial difficulties that explain the variability and change over time of the selected health outcomes were energy and drive, sleep, and emotional functions, and a broad range of activities and participation domains, such as solving problems, conversation, areas of mobility and self-care, relationships, community life and recreation and leisure. CONCLUSIONS: Our findings are of interest to researchers and clinicians for interventions and health systems planning as they show that in addition to difficulties that are diagnostic criteria of these disorders, there are other difficulties that explain small changes in health outcomes over short periods of time.

Acerca de los tipos de dos Veronica rifeñas.

Hace unos años, se publicó en esta misma sección una nota sobre Veronica rosea (Soriano, 1996), en la que se anticipaba el tratamiento de este taxón en la checklist de la fl ora del norte de Marruecos (Valdés & al. 2002; Soriano, 2002). Entre otras cosas, se formalizaba en ella la descripción de V. rosea subsp. atlantica var. macrantha, propuesta por Pau como V. rosea var. macrantha y distribuida por Font Quer en el Iter maroccanum de 1930, aunque sin la diagnosis correspondiente.

Acerca de los tipos de dos Veronica rifeñas.

Hace unos años, se publicó en esta misma sección una nota sobre Veronica rosea (Soriano, 1996), en la que se anticipaba el tratamiento de este taxón en la checklist de la fl ora del norte de Marruecos (Valdés & al. 2002; Soriano, 2002). Entre otras cosas, se formalizaba en ella la descripción de V. rosea subsp. atlantica var. macrantha, propuesta por Pau como V. rosea var. macrantha y distribuida por Font Quer en el Iter maroccanum de 1930, aunque sin la diagnosis correspondiente.

Acerca de los tipos de dos Veronica rifeñas.

Hace unos años, se publicó en esta misma sección una nota sobre Veronica rosea (Soriano, 1996), en la que se anticipaba el tratamiento de este taxón en la checklist de la fl ora del norte de Marruecos (Valdés & al. 2002; Soriano, 2002). Entre otras cosas, se formalizaba en ella la descripción de V. rosea subsp. atlantica var. macrantha, propuesta por Pau como V. rosea var. macrantha y distribuida por Font Quer en el Iter maroccanum de 1930, aunque sin la diagnosis correspondiente.

Acerca de los tipos de dos Veronica rifeñas.

Hace unos años, se publicó en esta misma sección una nota sobre Veronica rosea (Soriano, 1996), en la que se anticipaba el tratamiento de este taxón en la checklist de la fl ora del norte de Marruecos (Valdés & al. 2002; Soriano, 2002). Entre otras cosas, se formalizaba en ella la descripción de V. rosea subsp. atlantica var. macrantha, propuesta por Pau como V. rosea var. macrantha y distribuida por Font Quer en el Iter maroccanum de 1930, aunque sin la diagnosis correspondiente.