Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist

Background: The COSMIN checklist is a tool for evaluating the methodological quality of studies on measurement properties of health-related patient-reported outcomes. The aim of this study is to determine the inter-rater agreement and reliability of each item score of the COSMIN checklist (n = 114). Methods: 75 articles evaluating measurement properties were randomly selected from the bibliographic database compiled by the Patient-Reported Outcome Measurement Group, Oxford, UK. Raters were asked to assess the methodological quality of three articles, using the COSMIN checklist. In a one-way design, percentage agreement and intraclass kappa coefficients or quadratic-weighted kappa coefficients were calculated for each item. Results: 88 raters participated. Of the 75 selected articles, 26 articles were rated by four to six participants, and 49 by two or three participants. Overall, percentage agreement was appropriate (68% was above 80% agreement), and the kappa coefficients for the COSMIN items were low (61% was below 0.40, 6% was above 0.75). Reasons for low inter-rater agreement were need for subjective judgement, and accustom to different standards, terminology and definitions.Conclusions: Results indicated that raters often choose the same response option, but that it is difficult on item level to distinguish between articles. When using the COSMIN checklist in a systematic review, we recommend getting some training and experience, completing it by two independent raters, and reaching consensus on one final rating. Instructions for using the checklist are improved.

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

Impact Of Severe Haemophilia A On Patients' Health Status: Results From The Guardian(™) 1 Clinical Trial Of Turoctocog Alfa (novoeight(®) ).

Haemophilia and its treatment interfere with patients' life and may affect adherence to treatment. This study explored the impact of severe haemophilia A on patients' health status, especially in young adults (YA), using data from guardian(™) 1, a multinational, open-label, non-controlled phase 3 trial investigating safety and efficacy of turoctocog alfa (NovoEight(®) ) in previously treated patients aged 12 years and older with severe haemophilia A (FVIII ≤ 1%). Health status was assessed using the EuroQoL-5 dimensions (EQ-5D-3L), covering 5 dimensions of health (mobility, self-care, usual activities, pain/discomfort and anxiety/depression), and a visual analogue scale (VAS) measuring self-rated overall health status. EQ-5D was administered pretreatment (screening/baseline) and posttreatment (end-of-trial). Baseline responses to the EQ-5D dimensions and VAS were described overall and by age and compared to reference values from UK general population. Guardian(™) 1 included 150 patients (16 adolescents, 83 YA aged 16-29 and 51 adults aged 30+). All five dimensions of patients' health status were impacted at baseline. The percentage of haemophilia patients reporting problems was consistently significantly greater than age-matched general population reference values. Likewise, for all age groups mean baseline EQ-5D VAS score was significantly lower for haemophilia patients (YA: 78.0) than for the general population (YA aged 18-29: 87.3). The health status of patients with severe haemophilia A entering guardian(™) 1 was markedly poorer than that of the general population, particularly regarding mobility and pain. YA patients reported better health status than older patients, but considerably lower than that of the general YA population.

Psychometric properties of the Child Health Assessment Questionnaire (CHAQ) applied to children and adolescents with cerebral palsy

Background: Cerebral palsy (CP) patients have motor limitations that can affect functionality and abilities for activities of daily living (ADL). Health related quality of life and health status instruments validated to be applied to these patients do not directly approach the concepts of functionality or ADL. The Child Health Assessment Questionnaire (CHAQ) seems to be a good instrument to approach this dimension, but it was never used for CP patients. The purpose of the study was to verify the psychometric properties of CHAQ applied to children and adolescents with CP. Methods: Parents or guardians of children and adolescents with CP, aged 5 to 18 years, answered the CHAQ. A healthy group of 314 children and adolescents was recruited during the validation of the CHAQ Brazilian-version. Data quality, reliability and validity were studied. The motor function was evaluated by the Gross Motor Function Measure (GMFM). Results: Ninety-six parents/guardians answered the questionnaire. The age of the patients ranged from 5 to 17.9 years (average: 9.3). The rate of missing data was low(< 9.3%). The floor effect was observed in two domains, being higher only in the visual analogue scales (<= 35.5%). The ceiling effect was significant in all domains and particularly high in patients with quadriplegia (81.8 to 90.9%) and extrapyramidal (45.4 to 91.0%). The Cronbach alpha coefficient ranged from 0.85 to 0.95. The validity was appropriate: for the discriminant validity the correlation of the disability index with the visual analogue scales was not significant; for the convergent validity CHAQ disability index had a strong correlation with the GMFM (0.77); for the divergent validity there was no correlation between GMFM and the pain and overall evaluation scales; for the criterion validity GMFM as well as CHAQ detected differences in the scores among the clinical type of CP (p < 0.01); for the construct validity, the patients' disability index score (mean: 2.16; SD: 0.72) was higher than the healthy group ( mean: 0.12; SD: 0.23)(p < 0.01). Conclusion: CHAQ reliability and validity were adequate to this population. However, further studies are necessary to verify the influence of the ceiling effect on the responsiveness of the instrument.

Electronic medical records may be inadequate for improving population health status through general practice: cervical smears as a case study

Objective: To determine whether routine electronic records are an accurate source of population health data in general practice through reviewing cervical smears rates in four South Australian practices. Methods: The cervical screening rate in a purposive sample of four general practices (three rural and one urban) was obtained using an audit of medical records and a telephone follow-up. Results: The cervical screening rate using only immediately available electronic medical records indicated an overall low rate for the participating practices (44.9%). However, telephone follow-up and adjustments to the denominator indicated the real rate to be 85.7%. The offer of appointments during the telephone follow-up further improved this rate for eligible women (93.8%). Conclusions and implications: Electronic medical records may be inadequate in preventive screening in general practice, without ensuring their accuracy. Updating records by telephone or personal follow-up produces a much more accurate denominator.

Living with osteoarthritis: Patient expenditures, health status, and social impact

Objective. To determine out-of-pocket expenditures related to osteoarthritis (OA) and to explore whether demographic details, health status scores (Medical Outcomes Study 36-item Short Form [SF-36] and Western Ontario and McMaster Universities Osteoarthritis Index [WOMAC]), or perception of social effect were expenditure determinants. Methods. A prospective cohort study of community-dwelling subjects with OA completed 4 consecutive 3-month cost diaries. In addition, subjects completed the SF-36 and WOMAC at baseline and at 12 months. Social impact at baseline was collected. Four groups categorized by age and sex were compared. Patients undergoing joint replacement were excluded. Results. Differences in health status were defined more by age than by sex, especially for physical function. The costs to the patients were high, particularly for women, who spent more on medications and special equipment. Women also reported receiving more assistance from family and friends. Higher disease-related expenditures were associated with greater pain levels, poorer social function and mental health, and longer duration of disease. Significant independent predictors of total patient expenditures related to OA were being female and having joint stiffness. Conclusion. Despite having heavily subsidized health care and access to the Pharmaceutical Benefits Scheme, out-of-pocket costs for patients with OA in Australia are considerable. Higher expenditures for patients with OA are related to more advanced disease, especially for women.

Poverty levels and children's health status: study of risk factors in an urban population of low socioeconomic level

To test the hypothesis that the low socioeconomic population living is shanty towns in Porto Alegre presents different levels of poverty which are reflected on its health status, a cross-sectional study was designed involving 477 families living in Vila Grande Cruzeiro, Porto Alegre, Brazil. The poverty level of the families was measured by using an instrument specifically designed for poor urban populations. Children from families living in extreme poverty (poorest quartile) were found to have higher infant mortality rate, lower birth weights, more hospitalizations, and higher malnutrition rates, in addition to belonging to more numerous families. Thus, the shanty town population of Porto Alegre is not homogeneous, and priority should be given to the more vulnerable subgroups.

Impact of academic exposure on health status of university students

OBJECTIVE: To assess the impact of academic life on health status of university students. METHODS: Longitudinal study including 154 undergraduate students from the Universidade de Aveiro, Portugal, with at least two years of follow-up observations. Sociodemographic and behavioral characteristics were collected using questionnaires. Students' weight, height, blood pressure, serum glucose, serum lipids and serum homocysteine levels were measured. Regression analysis was performed using linear mixed-effect models, allowing for random effects at the participant level. RESULTS: A higher rate of dyslipidemia (44.0% vs. 28.6%), overweight (16.3% vs. 12.5%) and smoking (19.3% vs. 0.0%) was found among students exposed to the academic life when compared to freshmen. Physical inactivity was about 80%. Total cholesterol, high density lipoprotein-cholesterol (HDL-C), triglycerides, systolic blood pressure, and physical activity levels were significantly associated with gender (p<0.001). Academic exposure was associated with increased low density lipoprotein-cholesterol (LDL-C) levels (about 1.12 times), and marginally with total cholesterol levels (p=0.041). CONCLUSIONS: High education level does not seem to have a protective effect favoring a healthier lifestyle and being enrolled in health-related areas does not seem either to positively affect students' behaviors. Increased risk factors for non-transmissible diseases in university students raise concerns about their well-being. These results should support the implementation of health promotion and prevention programs at universities.

Self-perceived health status in older adults: regional and sociodemographic inequalities in Spain

OBJECTIVE: To assess regional and sociodemographic differences in self-perceived health status among older adults. METHODS: A face-to-face quality of life survey was conducted in a representative sample of the Spanish population comprising 1,106 non-institutionalized elderly aged 60 or more in 2008. Logistic regression models were used to explain self-perceived health status according to the EuroQol Group Visual Analogue Scale (EQ-VAS). Independent variables included sociodemographic and health characteristics as well as the nomenclature of territorial units for statistics level 1 (NUTS1: group of autonomous regions) and level 2 (NUTS 2: autonomous regions). RESULTS: Younger and better off respondents were more likely to have a positive self-perceived health status. Having no chronic conditions, independence in performing daily living activities and lower level of depression were also associated with positive self-perceived health status. People living in the south of Spain showed a more negative self-perceived health status than those living in other regions. CONCLUSION: The study results point to health inequality among Spanish older adults of lower socioeconomic condition and living in the south of Spain. The analysis by geographic units allows for international cross-regional comparisons.

Deported Mexican migrants: health status and access to care

OBJECTIVE To describe the health status and access to care of forced-return Mexican migrants deported through the Mexico-United States border and to compare it with the situation of voluntary-return migrants. METHODS Secondary data analysis from the Survey on Migration in Mexico’s Northern Border from 2012. This is a continuous survey, designed to describe migration flows between Mexico and the United States, with a mobile-population sampling design. We analyzed indicators of health and access to care among deported migrants, and compare them with voluntary-return migrants. Our analysis sample included 2,680 voluntary-return migrants, and 6,862 deportees. We employ an ordinal multiple logistic regression model, to compare the adjusted odds of having worst self-reported health between the studied groups. RESULTS As compared to voluntary-return migrants, deportees were less likely to have medical insurance in the United States (OR = 0.05; 95%CI 0.04;0.06). In the regression model a poorer self-perceived health was found to be associated with having been deported (OR = 1.71, 95%CI 1.52;1.92), as well as age (OR = 1.03, 95%CI 1.02;1.03) and years of education (OR = 0.94 95%CI 0.93;0.95). CONCLUSIONS According to our results, deportees had less access to care while in the United States, as compared with voluntary-return migrants. Our results also showed an independent and statistically significant association between deportation and having poorer self-perceived health. To promote the health and access to care of deported Mexican migrants coming back from the United States, new health and social policies are required.

Stress, cognitive appraisal, and psychological health: testing instruments for health professionals

The job of health professionals, including nurses, is considered inherently stressful (Lee & Wang, 2002; Rutledge et al., 2009), and thus it is important to improve and develop specific measures that are sensitive to the demands that health professionals face. This study analysed the psychometric properties of three instruments that focus on the professional experiences of nurses in aspects related to occupational stress, cognitive appraisal, and mental health issues. The evaluation protocol included the Stress Questionnaire for Health Professionals (SQHP; Gomes, 2014), the Cognitive Appraisal Scale (CAS; Gomes, Faria, & Gonçalves, 2013), and the General Health Questionnaire-12 (GHQ-12; Goldberg, 1972). Validity and reliability issues were considered with statistical analysis (i.e. confirmatory factor analysis, convergent validity, and composite reliability) that revealed adequate values for all of the instruments, namely, a six-factor structure for the SQHP, a five-factor structure for the CAS, and a two-factor structure for the GHQ-12. In conclusion, this study proposes three consistent instruments that may be useful for analysing nurses’ adaptation to work contexts.