The role of evaluation in decision-making in the management of health services

The management of health services is a complex administrative practice due to the breadth of the field of health and the need to reconcile individual, corporate and collective interests that are not always convergent. In this context, the evaluation needs to have specific characteristics in order to fulfill its role. The scope of this study was to establish the characteristics that the evaluation for the management of health services should have to contribute to decision-making. Usefulness, opportunity, feasibility, reliability, objectivity and directionality represent the set of principles upon which the evaluation should be based. Evaluations should lead to decisions that guarantee not only their efficiency and effectiveness but also their implementation. The evaluation process should ensure that decisions involve all stakeholders in order to render the implementation of decisions feasible, and take into account the health needs of the population and the goals set for the services. The scope of this article is to elicit a debate among different stakeholders in the evaluation in the hope that it can contribute to the reflection on the real usefulness of evaluations in which the political component in management has been increasingly prevalent.

Evaluation of Long-Term Outcomes, Cytogenetic and Molecular Responses with Imatinib Mesylate in Early and Late Chronic-Phase Chronic Myeloid Leukemia: A Report from a Single Institute

Here we compare the management and survival outcomes of chronic myeloid leukemia (CML) patients who had early or late imatinib mesylate (IM) therapy. The cytogenetic and molecular responses of 189 CML patients were analyzed. Of this group, 121 patients were classified as the early chronic phase (ECP) group and started IM within 12 months of diagnosis. The other 68 patients were classified as the late chronic phase (LCP) group who had been treated with interferon (IFN)-alpha-2 and crossed over to IM more than 12 months after diagnosis. The overall rates of complete cytogenetic response (CCyR) and major molecular response (MMR) at last follow-up were 83.6 and 78.1% in the ECP and LCP groups, respectively. The CCyR rates were 89.3 (for ECP patients) versus 73.5% (for LCP patients; p < 0.0001). At last follow-up, 82.4% ECP and 64.2% LCP patients had achieved an MMR (p < 0.0001). No significant differences were noted between the two groups with regard to survival outcomes. Our experience reveals that IM is an effective rescue therapy in most CML LCP patients who are intolerant or in whom IFN-alpha therapy fails. Such therapeutic options should be considered in LCP patients, particularly in countries where IM may not be available. Copyright (C) 2012 S. Karger AG, Basel

Evaluation of quality of life in severely obese patients after bariatric surgery carried out in the public healthcare system

Objectives: To assess QoL of obese patients in the Brazilian public healthcare system, before and after bariatric surgery, and to determine the appropriateness of the Moorehead-Ardelt Questionnaire II (M-A-QoLQII) compared with the Short-Form Health Survey (SF-36). Subjects and methods: Forty-one severe obese patients in a waiting-list, and 84 patients who underwent bariatric surgery were included. Correlations were tested and reliability determined by the Cronbach's coefficient. Results: BMI differed between the pre- and post-surgery groups (52.3 +/- 8.3 kg/m(2) vs. 32.5 +/- 6.4 kg/m(2), p < 0.001). The latter showed better scores in the SF-36 domains than in the pre-surgery. SF-36 and M-A-QoLQII categories were correlated (r = 0.53, 0.49 and 0.47, for vitality, mental health, and general health domains, p < 0.001). In the logistic regression, age, previous BMI, and loss of excess weight were associated with functional capacity. Conclusions:The outcomes of bariatric surgery obtained in a Brazilian public healthcare center were successful. M-A-QoLII represents a useful tool to assess surgery outcomes, including QoL. Arq Bras Endocrinol Metab. 2012;56(1):33-8

Evaluation of Viral Load Thresholds for Predicting New World Health Organization Stage 3 and 4 Events in HIV-Infected Children Receiving Highly Active Antiretroviral Therapy

Background: This study evaluated a wide range of viral load (VL) thresholds to identify a cut-point that best predicts new clinical events in children on stable highly active antiretroviral therapy (HAART). Methods: Cox proportional hazards modeling was used to assess the adjusted risk for World Health Organization stage 3 or 4 clinical events (WHO events) as a function of time-varying CD4, VL, and hemoglobin values in a cohort study of Latin American children on HAART >= 6 months. Models were fit using different VL cut-points between 400 and 50,000 copies per milliliter, with model fit evaluated on the basis of the minimum Akaike information criterion value, a standard model fit statistic. Results: Models were based on 67 subjects with WHO events out of 550 subjects on study. The VL cut-points of >2600 and >32,000 copies per milliliter corresponded to the lowest Akaike information criterion values and were associated with the highest hazard ratios (2.0, P = 0.015; and 2.1, P = 0.0058, respectively) for WHO events. Conclusions: In HIV-infected Latin American children on stable HAART, 2 distinct VL thresholds (>2600 and >32,000 copies/mL) were identified for predicting children at significantly increased risk for HIV-related clinical illness, after accounting for CD4 level, hemoglobin level, and other significant factors.

Responsiveness to change for the Brazilian Scale of Oral Health Outcomes for 5-year-old children (SOHO-5)

Abstract Background The responsiveness of oral health-related quality of life (OHRQoL) instruments has become relevant, given the increasing tendency to use OHRQoL measures as outcomes in clinical trials and evaluations studies. The purpose of this study was to assess the responsiveness of the Brazilian Scale of Oral Health Outcomes for 5-year-old children (SOHO-5) to dental treatment. Methods One hundred and fifty-four children and their parents completed the child self- and parental’ reports of the SOHO-5 prior to treatment and 7 to 14 days after the completion of treatment. The post-treatment questionnaire also included a global transition judgment that assessed subject’s perceptions of change in their oral health following treatment. Change scores were calculated by subtracting post-treatment SOHO-5 scores from pre-treatment scores. Longitudinal construct validity was assessed by using one-way analysis of variance to examine the association between change scores and the global transition judgments. Measures of responsiveness included standardized effect sizes (ES) and standardized response mean (SRM). Results The improvement of children’s oral health after treatment are reflected in mean pre- and post-treatment SOHO-5 scores that declined from 2.67 to 0.61 (p < 0.001) for the child-self reports, and 4.04 to 0.71 (p < 0.001) for the parental reports. Mean change scores showed a gradient in the expected direction across categories of the global transition judgment, and there were significant differences in the pre- and post-treatment scores of those who reported improving a little (p < 0.05) and those who reported improving a lot (p < 0.001). For both versions, the ES and SRM based on change scores mean for total scores and for categories of global transitions judgments were moderate to large. Conclusions The Brazilian SOHO-5 is responsive to change and can be used as an outcome indicator in future clinical trials. Both the parental and the child versions presented satisfactory results.

Cross-cultural adaptation and psychometric properties of the Brazilian version of the scale of oral health outcomes for 5-year-old children (SOHO-5)

Abstract Background Most of the instruments available to measure the oral health-related quality of life (OHRQoL) in paediatric populations focus on older children, whereas parental reports are used for very young children. The scale of oral health outcomes for 5-year-old children (SOHO-5) assesses the OHRQoL of very young children through self-reports and parental proxy reports. We aimed to cross-culturally adapt the SOHO-5 to the Brazilian Portuguese language and to assess its reliability and validity. Findings We tested the quality of the cross-cultural adaptation in 2 pilot studies with 40 children aged 5–6 years and their parents. The measurement was tested for reliability and validity on 193 children that attended the paediatric dental screening program at the University of São Paulo. The children were also clinically examined for dental caries. The internal consistency was demonstrated by a Cronbach's alpha coefficient of 0.90 for the children’s self-reports and 0.77 for the parental proxy reports. The test-retest reliability results, which were based on repeated administrations on 159 children, were excellent; the intraclass correlation coefficient was 0.98 for parental and 0.92 for child reports. In general, the construct validity was satisfactory and demonstrated consistent and strong associations between the SOHO-5 and different subjective global ratings of oral health, perceived dental treatment need and overall well-being in both the parental and children’s versions (p < 0.001). The SOHO-5 was also able to clearly discriminate between children with and without a history of dental caries (mean scores: 5.8 and 1.1, respectively; p < 0.001). Conclusion The present study demonstrated that the SOHO-5 exhibits satisfactory psychometric properties and is applicable to 5- to 6-year-old children in Brazil.