The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content

Background: The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties of health-related patient reported outcomes (HR-PROs). In this paper, we explain our choices for the design requirements and preferred statistical methods for which no evidence is available in the literature or on which the Delphi panel members had substantial discussion. Methods: The issues described in this paper are a reflection of the Delphi process in which 43 panel members participated. Results: The topics discussed are internal consistency (relevance for reflective and formative models, and distinction with unidimensionality), content validity (judging relevance and comprehensiveness), hypotheses testing as an aspect of construct validity (specificity of hypotheses), criterion validity (relevance for PROs), and responsiveness (concept and relation to validity, and (in) appropriate measures).Conclusions: We expect that this paper will contribute to a better understanding of the rationale behind the items, thereby enhancing the acceptance and use of the COSMIN checklist.

Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

The Employment Precariousness Scale (EPRES): psychometric properties of a new tool for epidemiological studies among waged and salaried workers

Background: Despite the fact that labour market flexibility has resulted in an expansion of precarious employment in industrialized countries, to date there is limited empirical evidence about its health consequences. The Employment Precariousness Scale (EPRES) is a newly developed, theory-based, multidimensional questionnaire specifically devised for epidemiological studies among waged and salaried workers. Objective: To assess acceptability, reliability and construct validity of EPRES in a sample of waged and salaried workers in Spain. Methods: Cross-sectional study, using a sub-sample of 6.968 temporary and permanent workers from a population-based survey carried out in 2004-2005. The survey questionnaire was interviewer administered and included the six EPRES subscales, measures of the psychosocial work environment (COPSOQ ISTAS21), and perceived general and mental health (SF-36). Results: A high response rate to all EPRES items indicated good acceptability; Cronbach’s alpha coefficients, over 0.70 for all subscales and the global score, demonstrated good internal consistency reliability; exploratory factor analysis using principal axis analysis and varimax rotation confirmed the six-subscale structure and the theoretical allocation of all items. Patterns across known groups and correlation coefficients with psychosocial work environment measures and perceived health demonstrated the expected relations, providing evidence of construct validity. Conclusions: Our results provide evidence in support of the psychometric properties of EPRES, which appears to be a promising tool for the measurement of employment precariousness in public health research.

Validation française de l'échelle d'expérience temporelle du plaisir [Validation of the Temporal Experience of Pleasure Scale (TEPS) in a French-speaking environment.]

INTRODUCTION: Anhedonia is defined as a diminished capacity to experience pleasant emotion and is commonly included among the negative symptoms of schizophrenia. However, if patients report experiencing a lower level of pleasure than controls, they report experiencing as much pleasure as controls with online measurements of emotion. OBJECTIVE: The Temporal Experience of Pleasure Scale (TEPS) measures pleasure experienced in the moment and in anticipation of future activities. The TEPS is an 18-item self-report measurement of anticipatory (10 items) and consummatory (eight items) pleasure. The goal of this paper is to assess the psychometric characteristics of the French translation of this scale. METHODS: A control sample was composed of 60 women and 22 men, with a mean age of 38.1 years (S.D.: 10.8). Thirty-six were without qualification and 46 with qualified professional diploma. A sample of 21 patients meeting DSM IV-TR criteria for schizophrenia was recruited among the community psychiatry service of the department of psychiatry in Lausanne. They were five women and 16 men; mean age was of 34.1 years (S.D.: 7.5). Ten obtained a professional qualification and 11 were without qualification. None worked in competitive employment. Their mean dose of chlorpromazine equivalent was 431mg (S.D.: 259). All patients were on atypical antipsychotics. The control sample fulfilled the TEPS and the Physical Anhedonia Scale (PAS). The patient sample fulfilled the TEPS and was independently rated on the Calgary Depression Scale and the Scale for Assessment of Negative Symptoms. For comparison with controls, patients were matched on age, sex and professional qualification. This required the supplementary recruitment of two control subjects. RESULTS: Results with the control sample indicate that the TEPS presents an acceptable internal validity with Crombach alphas of 0.84 for the total scale, 0.74 for the anticipatory pleasure scale and 0.79 for the consummatory pleasure scale. The confirmatory factor analysis indicated that the model is well adapted to our data (chi(2)/dl=1.333; df=134; p<0.0006; root mean square residual, RMSEA=0.064). External validity measured with the PAS showed R=-0.27 (p<0.05) for the consummatory scale and R=-0.26 for the total score. Comparisons between patients and matched controls indicated that patients were significantly lower than control on anticipatory pleasure (t=2.7, df(40), 2-tailed p=0.01; cohen's d=0.83) and on total score of the TEPS (t=2.8, df (40), 2-tailed p=0.01; cohen's d=0.87). The two samples did not differ on consummatory pleasure. The anticipatory pleasure factor and the total TEPS showed significant negative correlation with the SANS anhedonia, respectively R=-0.78 (p<0.01) for the anticipatory factor and R=-0.61 (p<0.01) for the total TEPS. There was also a negative correlation between the anticipatory factor and the SANS avolition of R=-0.50 (p<0.05). These correlations were maintained, with partial correlations controlling for depression and chlorpromazine equivalents. CONCLUSION: The results of this validation show that the French version of the TEPS has psychometric characteristics similar to the original version. These results highlight the discrepancy between results of direct or indirect report of experienced pleasure in patients with schizophrenia. Patients may have difficulties in anticipating the pleasure of future enjoyable activities, but not in experiencing pleasure once in an enjoyable activity. Medication and depression do not seems to modify our results, but this should be better controlled in a longitudinal study. The anticipatory versus consummatory pleasure distinction appears to be useful for the development of new psychosocial interventions, tailored to improve desire in patients suffering from schizophrenia. Major limitations of the study are the small size of patient sample and the under representation of men in the control sample.

The occurrence of reptiles in Barn Owl diet in Europe

Capsule We present a review of the propensity to eat reptiles in the Barn Owl Tyto alba in Europe. Based on the analysis of 591 published studies reporting 3.07 million prey items identified in pellets, only 2402 reptiles (0.08%) were found. Reptiles were most often captured in southern parts of the European continent and on islands. A large proportion of the 1304 identified reptiles to the species level were nocturnal Gekkonidae (77.1%).

Investigating Gaze of Children with ASD in Naturalistic Settings.

BACKGROUND: Visual behavior is known to be atypical in Autism Spectrum Disorders (ASD). Monitor-based eye-tracking studies have measured several of these atypicalities in individuals with Autism. While atypical behaviors are known to be accentuated during natural interactions, few studies have been made on gaze behavior in natural interactions. In this study we focused on i) whether the findings done in laboratory settings are also visible in a naturalistic interaction; ii) whether new atypical elements appear when studying visual behavior across the whole field of view. METHODOLOGY/PRINCIPAL FINDINGS: Ten children with ASD and ten typically developing children participated in a dyadic interaction with an experimenter administering items from the Early Social Communication Scale (ESCS). The children wore a novel head-mounted eye-tracker, measuring gaze direction and presence of faces across the child's field of view. The analysis of gaze episodes to faces revealed that children with ASD looked significantly less and for shorter lapses of time at the experimenter. The analysis of gaze patterns across the child's field of view revealed that children with ASD looked downwards and made more extensive use of their lateral field of view when exploring the environment. CONCLUSIONS/SIGNIFICANCE: The data gathered in naturalistic settings confirm findings previously obtained only in monitor-based studies. Moreover, the study allowed to observe a generalized strategy of lateral gaze in children with ASD when they were looking at the objects in their environment.

Validation of diagnosis criteria for acquired sensory neuronopathy. a francophone multicenter study

Recently published criteria using clinical (ataxia or asymmetrical distribution at onset or full development, and sensory loss not restricted to the lower limbs) and electrophysiological items (less than two abnormal lower limb motor nerves and at least an abolished SAP or three SAP below 30% of lower limit of normal in the upper limbs) were sensitive and specific for the diagnosis of sensory neuronopathy (SNN) (Camdessanche et al., Brain, 2009). However, these criteria need to be validated on a large multicenter population. For this, a database collecting cases from fifteen Reference Centers for Neuromuscular diseases in France and Switzerland is currently developed. So far, data from 120 patients with clinically pure sensory neuropathy have been collected. Cases were classified independently from the evaluated criteria as SNN (53), non-SNN (46) or suspected SNN (21) according to the expert's diagnosis. Using the criteria, SNN was possible in 83% (44/53), 23.9% (11/46) and 71.4% (15/21) of cases, respectively. In the non-SSN group, half of the patients with a diagnosis of possible SSN had an ataxic form of inflammatory demyelinating neuropathy. In the SNN group, half of those not retained as possible SNN had CANOMAD, paraneoplasia, or B12 deficiency. In a second step, after application of the items necessary to reach the level of probable SNN (no biological or electrophysiological abnormalities excluding SNN; presence of onconeural antibody, cisplatin treatment, Sj ¨ ogren's syndrome or spinal cord MRI high signal in the posterior column), a final diagnosis of possible or probable SNN was obtained in, respectively, 90.6% (48/53), 8.8% (4/45), and 71.4% (15/21) of patients in the three groups. Among the 5 patients with a final non-SNN but initial SNN diagnosis, 3 had motor conduction abnormalities (one with CANOMAD) and among the 4 patients with a final SNN but initial non-SSN diagnosis, one had anti-Hu antibody and one was discussed as a possible ataxic CIDP. These preliminary results confirm the sensitivity and specificity of the proposed criteria for the diagnosis of SNN.

Validation of the Addiction Severity Index in French-speaking alcoholic patients.

OBJECTIVE: Evaluation of a French translation of the Addiction Severity Index (ASI) in 100 (78 male) alcoholic patients. METHOD: Validity of the instrument was assessed by measuring test-retest and interrater reliability, internal consistency and convergence and discrimination between items and scales. Concurrent validity was assessed by comparing the scores from the ASI with those obtained from three other clinimetric instruments. RESULTS: Test-retest reliability of ASI scores (after a 10-day interval) was good (r = 0.63 to r = 0.95). Interrater reliability was evaluated using six video recordings of patient interviews. Severity ratings assigned by six rates were significantly different (p < .05), but 72% of the ratings assigned by those who viewed the videos were within two points of the interviewer's severity ratings. Cronbach alpha coefficient of internal consistency varied from 0.58 to 0.81 across scales. The average item-to-scale convergent validity (r value) was 0.49 (range 0.0 to 0.84) for composite scores and 0.35 (range 0.00 to 0.68) for severity ratings, whereas discriminant validity was 0.11 on average (range-0.19 to 0.46) for composite scores and 0.12 (range-0.20 to 0.52) for severity ratings. Finally, concurrent validity with the following instruments was assessed: Severity of Alcoholism Dependence Questionnaire (40% shared variance with ASI alcohol scale), Michigan Alcoholism Screening Test (2% shared variance with ASI alcohol scale) and Hamilton Depression Rating Scale (31% shared variance with ASI psychiatric scale). CONCLUSIONS: The Addiction Severity Index covers a large scope of problems encountered among alcoholics and quantifies need for treatment. This French version presents acceptable criteria of reliability and validity.

The externalisation of the asylum function in the European Union

This paper aims to identify and assess the main items in the strategy followed by the EU and its member states on the externalisation of their asylum function. First, it analyses the European harmonisation of the return to safe third countries and to countries of first asylum, which is carried out by means of readmission agreements. Second, it refers to the strategies defined by the Hague and the Stockholm programs concerning the External Aspects of the European Union Asylum Policy, on the detention centres for illegal immigrants abroad, and on the proposals for delocalisation of asylum applications processing centres beyond the EU borders. Finally, this paper considers whether the strategy of externalisation of the function of asylum sometimes lacks legitimacy, and to what extent there is a fair balance between the interests of the states and the protection of the human rights of refugees and asylum seekers.

Development of the first disease activity index for eosinophilic esophagitis: update on the EEsAI in 2012

Background and Aims: The international E EsAI s tudy g roup is currently d eveloping the first activity index ( EEsAI) specific for E osinophilic Esophagitis (EoE). G oal: T o develop, e valuate and validate the EEsAI. Methods: T he development c omprises three p hases: 1. Selection of c andidate items ( completed); 2. Evaluation of t he activity index i n a first patient cohort (in progress, p atient recruitment completed); and 3. Validation in a s econd EoE patient cohort. F ocus group interviews with patients were used in p hase 1 to g enerate patient r eported outcomes (PRO) according to g uidelines o f regulatory authorities (FDA a nd EMA), whereas the section of biologic items was developed by Delphi rounds o f international E oE experts from E urope and North America. Results: T he EEsAI has a modular c omposition to a ssess the following components o f EoE activity: p atient r eported outcomes, e ndoscopic activity, histologic activity, laboratory activity, a nd quality of l ife (QoL). Definitions for a ll aspects o f endoscopic and histologic appearance were e stablished by consensus r ounds a mong E oE experts. S ymptom a ssessment tools were c reated that t ake into account d ifferent food consistencies as w ell as f ood avoidance and specific processing strategies. The EEsAI i s currently e valuated in a cohort of a dult EoE patients since M arch 2 011 (patient recruitment completed). Conclusions: The EEsAI standardizes outcome assessment in EoE t rials. T he collaboration with i nternational E oE e xperts a s well as f ollowing o f the guidelines f rom regulatory authorities will lead to its wide applicability.

Integració del motor APIS de qüestionaris on-line en una plataforma d'eLearning basada en serveis

El projecte Integració del motor APIS de qüestionaris on-line en una plataformad'eLearning basada en serveis descriu el procés d'anàlisi i implementació del codi necessari per integrar dins de la plataforma d'eLearning SLeD tot el motor d'APIS de manera que SLeD pugui reproduir preguntes o items i exàmens complets o tests dins d'una UOL o unitat d'aprenentatge. Això permetrà dotar a APIS d'un control de sessió d'usuari i permetrà una utilitat que fins ara no tenia, la possibilitat de entrar al món online mitjançant SLeD. Tot aixòs’implementa gràcies a la connexió WebServices amb el mòdul CCSI de CopperCore i SLeD que s'encarrega de donar facilitats al programador de cara a ampliar el ventall d'eines que ofereix aquesta plataforma i fomentar encara més la idea del codi lliure (open source) i la utilitat globalitzadora d'e-Learning.

Bayesian networks for evaluating forensic DNA profiling evidence: a review and guide to literature

Almost 30 years ago, Bayesian networks (BNs) were developed in the field of artificial intelligence as a framework that should assist researchers and practitioners in applying the theory of probability to inference problems of more substantive size and, thus, to more realistic and practical problems. Since the late 1980s, Bayesian networks have also attracted researchers in forensic science and this tendency has considerably intensified throughout the last decade. This review article provides an overview of the scientific literature that describes research on Bayesian networks as a tool that can be used to study, develop and implement probabilistic procedures for evaluating the probative value of particular items of scientific evidence in forensic science. Primary attention is drawn here to evaluative issues that pertain to forensic DNA profiling evidence because this is one of the main categories of evidence whose assessment has been studied through Bayesian networks. The scope of topics is large and includes almost any aspect that relates to forensic DNA profiling. Typical examples are inference of source (or, 'criminal identification'), relatedness testing, database searching and special trace evidence evaluation (such as mixed DNA stains or stains with low quantities of DNA). The perspective of the review presented here is not exclusively restricted to DNA evidence, but also includes relevant references and discussion on both, the concept of Bayesian networks as well as its general usage in legal sciences as one among several different graphical approaches to evidence evaluation.

Reliability and validity of the cross-culturally adapted French version of the Core Outcome Measures Index (COMI) in patients with low back pain.

PURPOSE: To conduct a cross-cultural adaptation of the Core Outcome Measures Index (COMI) into French according to established guidelines. METHODS: Seventy outpatients with chronic low back pain were recruited from six spine centres in Switzerland and France. They completed the newly translated COMI, and the Roland Morris disability (RMQ), Dallas Pain (DPQ), adjectival pain rating scale, WHO Quality of Life, and EuroQoL-5D questionnaires. After ~14 days RMQ and COMI were completed again to assess reproducibility; a transition question (7-point Likert scale; "very much worse" through "no change" to "very much better") indicated any change in status since the first questionnaire. RESULTS: COMI whole scores displayed no floor effects and just 1.5% ceiling effects. The scores for the individual COMI items correlated with their corresponding full-length reference questionnaire with varying strengths of correlation (0.33-0.84, P < 0.05). COMI whole scores showed a very good correlation with the "multidimensional" DPQ global score (Rho = 0.71). 55 patients (79%) returned a second questionnaire with no/minimal change in their back status. The reproducibility of individual COMI 5-point items was good, with test-retest differences within one grade ranging from 89% for 'social/work disability' to 98% for 'symptom-specific well-being'. The intraclass correlation coefficient for the COMI whole score was 0.85 (95% CI 0.76-0.91). CONCLUSIONS: In conclusion, the French version of this short, multidimensional questionnaire showed good psychometric properties, comparable to those reported for German and Spanish versions. The French COMI represents a valuable tool for future multicentre clinical studies and surgical registries (e.g. SSE Spine Tango) in French-speaking countries.

8

Objective: To assess the factorial validity of the Portuguese version of the Maslach Burnout Inventory - Human Services Survey (MBI-HSS). Methods: Between November 2010 and November 2011 a Portuguese version of the MBI-HSS was applied to 151 Portuguese family doctors (55% women, median age 54 years). The factorial structure of the MBI-HSS was examined by principal component analysis (PCA) and confirmatory factor analysis (CFA). Internal consistency estimates of the MBI-HSS were determined with Cronbach's alpha. Results: The fit of the hypothesized three-factor model to the data was superior to the alternative two-factor and four-factor models. CFA supported MBI-HSS as an acceptable measure to evaluate burnout and deletion of items 12 and 16 improved the goodness of fit of the model. In PCA, the three-factor model explained 50.58% of the variance and the four-factor model did not lead to understandable components. Item 12 was also found to be problematic in PCA. The Cronbach's alpha was satisfactory for emotional exhaustion (alpha=0.90), lack of personal accomplishment (alpha=0.73), and depersonalization (alpha=0.64). Conclusion: The Portuguese version of the MBI-HSS was found to be reliable to measure burnout among Portuguese medical doctors. We also recommend the deletion of items 12 and 16 from the MBI-HSS.

PACIC Instrument: disentangling dimensions using published validation models.

OBJECTIVE: To better understand the structure of the Patient Assessment of Chronic Illness Care (PACIC) instrument. More specifically to test all published validation models, using one single data set and appropriate statistical tools. DESIGN: Validation study using data from cross-sectional survey. PARTICIPANTS: A population-based sample of non-institutionalized adults with diabetes residing in Switzerland (canton of Vaud). MAIN OUTCOME MEASURE: French version of the 20-items PACIC instrument (5-point response scale). We conducted validation analyses using confirmatory factor analysis (CFA). The original five-dimension model and other published models were tested with three types of CFA: based on (i) a Pearson estimator of variance-covariance matrix, (ii) a polychoric correlation matrix and (iii) a likelihood estimation with a multinomial distribution for the manifest variables. All models were assessed using loadings and goodness-of-fit measures. RESULTS: The analytical sample included 406 patients. Mean age was 64.4 years and 59% were men. Median of item responses varied between 1 and 4 (range 1-5), and range of missing values was between 5.7 and 12.3%. Strong floor and ceiling effects were present. Even though loadings of the tested models were relatively high, the only model showing acceptable fit was the 11-item single-dimension model. PACIC was associated with the expected variables of the field. CONCLUSIONS: Our results showed that the model considering 11 items in a single dimension exhibited the best fit for our data. A single score, in complement to the consideration of single-item results, might be used instead of the five dimensions usually described.