Validity and reliability of a health care service evaluation instrument for tuberculosis

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis.METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis.RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest coefficient of variation. The performance of the indicators “training” and “access to recording instruments” was inferior to that of other indicators.CONCLUSIONS The instrument showed feasibility of application and potential to assess the structure of primary health care units for the treatment of tuberculosis.

Evaluation of efficacy, reliability, and tolerability of sibutramine in obese patients, with an echocardiographic study

This is a double-blind, placebo-controlled study of the efficacy, safety, and tolerability of sibutramine in the management of obese patients for a 6-month period. METHOD: Sixty-one obese patients (BMI >30, <40 kg/m2), aged 18-65 years were evaluated. In the first phase of the study (30 days), the patients were given a placebo. We monitored compliance with a low-calorie diet (1200 kcal/day) and to the placebo. In the next stage, the double-blind phase (6 months), we compared placebo and sibutramine (10 mg/day). The criteria for evaluating efficacy were weight loss, reduction in body mass index (BMI), and abdominal and hip circumferences. Tolerability was assessed based on reported side effects, variation in arterial blood pressure and heart rate, metabolic profile (fasting glucose, total cholesterol and its fractions, and triglycerides), laboratory tests (renal and hepatic functions), and flow Doppler echocardiogram. RESULTS: We observed a greater weight loss (7.3 kg, 8% vs 2.6 kg, 2.8%) and a reduction in body mass index (7.4% vs 2.1%) in the sibutramine group than in the placebo group. Classifying the patients into 4 subgroups according to weight loss (weight gain, loss <5%, loss of 5% to 9.9%, and loss >10%), we observed a weight loss of >5% in 40% of the patients on sibutramine compared with 12.9% in the placebo group. We also detected weight gain in 45.2% of the placebo group compared to 20% in the sibutramine group. The sibutramine group showed improvement in HDL- cholesterol values (increased by 17%) and triglyceride values (decreased by 12.8%). This group also showed an increase in systolic blood pressure (6.7%, 5 mmHg). There were no changes in echocardiograms comparing the beginning and end of follow-up, and side effects did not lead to discontinuation of treatment. DISCUSSION: Sibutramine proved to be effective for weight loss providing an 8% loss of the initial weight. Compliance to prolonged treatment was good, and side effects did not result in discontinuation of treatment. These data confirmed the good efficacy, tolerability, and safety profiles of sibutramine for treatment of obesity.

Serological diagnosis of Chagas disease: evaluation and characterisation of a low cost antigen with high sensitivity and specificity

In spite of evident progress in the serology of Chagas disease, the requirement for new diagnostic antigens persists. We have evaluated different antigens obtained from Trypanosoma cruzi grown in medium rich in nutrients or under nutrient stress, autoclaved or sonicated and fractionated by differential centrifugation. The resulting antigens were evaluated for diagnosis of Chagas disease using ELISA. Immunofluorescence of the parasites demonstrated that nutrient stress induced changes in the distribution and density of antigens recognised by a pool of sera from experimentally infected mice. When evaluated using ELISA, it was evident that most fractions had good sensitivity but poor specificity. Surprisingly, the best specificity and sensitivity was observed with parasites cultured under nutrient stress and autoclaved. Furthermore this antigen had low cross reactivity with sera from other parasitic diseases, Leishmaniasis in particular. Western blot analysis demonstrated that autoclaving seems to non-specifically eliminate cross-reactive antigens. In conclusion, autoclaving epimastigotes of T. cruzi, after nutrient stress, allowed us to obtain an antigen that could be used in the serological diagnosis of Chagas disease.

Translation into Brazilian Portuguese, cultural adaptation and evaluation of the reliability of the Disabilities of the Arm, Shoulder and Hand Questionnaire

The objective of the present study was to translate, adapt and validate a Brazilian Portuguese version of the Disabilities of the Arm, Shoulder and Hand (DASH) Questionnaire. The study was carried out in two steps. The first was to translate the DASH into Portuguese and to perform cultural adaptation and the second involved the determination of the reliability and validity of the DASH for the Brazilian population. For this purpose, 65 rheumatoid arthritis patients of either sex (according to the classification criteria of the American College of Rheumatology), ranging in age from 18 to 60 years and presenting no other diseases involving the upper limbs, were interviewed. The patients were selected consecutively at the rheumatology outpatient clinic of UNIFESP. The following results were obtained: in the first step (translation and cultural adaptation), all patients answered the questions. In the second step, Spearman's correlation coefficients for interobserver evaluation ranged from 0.762 to 0.995, values considered to be highly reliable. In addition, intraclass correlation coefficients ranged from 0.97 to 0.99, also highly reliable values. Spearman's correlation coefficients and the intraclass correlation coefficients obtained during intra-observer evaluation ranged from 0.731 to 0.937 and from 0.90 to 0.96, respectively, being highly reliable values. The Ritchie Index showed a weak correlation with Brazilian DASH scores, while the visual analog scale of pain showed a good correlation with DASH score. We conclude that the Portuguese version of the DASH is a reliable instrument.

Cost of diseases in Brazil: breast cancer, enteritis, cardiac valve disease and bronchopneumonia

The results from the need to develop methodologies for performing cost analysis in developing countries, principally in the region of Latin America, were studied. It, furthermore, serves to generate knowledge from an economic evaluation in order to support decision-making related to the organization of health systems, particularly in the efficient use of resources which are allocated for the provision of medical services. Two chronic diseases (breast cancer and cardiac valve disease) and two infections (enteritis and bronchopneumonia) were selected for the study. The results recommend the use of a valid methodology for economic cost analysis of any disease to be studied and the use of this information in the decision-making process.

Evaluation and additional recommendations for preparing a whole blood control material

OBJECTIVE: The assessment of an easy to prepare and low cost control material for Hematology, available for manual and automated methods. MATERIAL AND METHOD: Aliquots of stabilized whole blood were prepared by partial fixation with aldehydes; the stability at different temperatures (4. 20 and 37 °C) during periods of up to 8-9 weeks and aliquot variability with both methods were controlled. RESULTS: Aliquot variability with automated methods at day 1, expressed as CV% (coefficient of variation) was: white blood cells (WBC) 2.7, red blood cells (RBC) 0.7, hemoglobin (Hb) 0.6, hematocrit (Hct) 0.7, mean cell volume (MCV) 0.3, mean cell hemoglobin (MCH) 0.6, mean cell hemoglobin concentration (MCHC) 0.7, and platelets (PLT) 4.6. The CV (coefficient of variation) percentages obtained with manual methods in one of the batches were: WBC 23, Hct 2.8, Hb 4.5, MCHC 5.9, PLT 41. Samples stored at 4ºC and 20ºC showed good stability, only a very low initial hemolysis being observed, whereas those stored at 37ºC deteriobed a rapidly (metahemoglobin formation, aggregation of WBC and platelets, as well as alteration of erythrocyte indexes). CONCLUSIONS: It was confirmed that, as long as there is no exposure to high temperatures during distribution, this material is stable, allowing assessment, both esternal and internal, for control purposes, with acceptable reproductivity, both for manual and auttomatic methods.

Evaluation of maternal and neonatal hospital care: quality index of completeness

OBJECTIVE Develop an index to evaluate the maternal and neonatal hospital care of the Brazilian Unified Health System.METHODS This descriptive cross-sectional study of national scope was based on the structure-process-outcome framework proposed by Donabedian and on comprehensive health care. Data from the Hospital Information System and the National Registry of Health Establishments were used. The maternal and neonatal network of Brazilian Unified Health System consisted of 3,400 hospitals that performed at least 12 deliveries in 2009 or whose number of deliveries represented 10.0% or more of the total admissions in 2009. Relevance and reliability were defined as criteria for the selection of variables. Simple and composite indicators and the index of completeness were constructed and evaluated, and the distribution of maternal and neonatal hospital care was assessed in different regions of the country.RESULTS A total of 40 variables were selected, from which 27 single indicators, five composite indicators, and the index of completeness of care were built. Composite indicators were constructed by grouping simple indicators and included the following variables: hospital size, level of complexity, delivery care practice, recommended hospital practice, and epidemiological practice. The index of completeness of care grouped the five variables and classified them in ascending order, thereby yielding five levels of completeness of maternal and neonatal hospital care: very low, low, intermediate, high, and very high. The hospital network was predominantly of small size and low complexity, with inadequate child delivery care and poor development of recommended and epidemiological practices. The index showed that more than 80.0% hospitals had a low index of completeness of care and that most qualified heath care services were concentrated in the more developed regions of the country.CONCLUSIONS The index of completeness proved to be of great value for monitoring the maternal and neonatal hospital care of Brazilian Unified Health System and indicated that the quality of health care was unsatisfactory. However, its application does not replace specific evaluations.

Screening for frailty in older adults using a self-reported instrument

OBJECTIVE To validate a screening instrument using self-reported assessment of frailty syndrome in older adults.METHODS This cross-sectional study used data from the Saúde, Bem-estar e Envelhecimento study conducted in Sao Paulo, SP, Southeastern Brazil. The sample consisted of 433 older adult individuals (≥ 75 years) assessed in 2009. The self-reported instrument can be applied to older adults or their proxy respondents and consists of dichotomous questions directly related to each component of the frailty phenotype, which is considered the gold standard model: unintentional weight loss, fatigue, low physical activity, decreased physical strength, and decreased walking speed. The same classification proposed in the phenotype was utilized: not frail (no component identified); pre-frail (presence of one or two components), and frail (presence of three or more components). Because this is a screening instrument, “process of frailty” was included as a category (pre-frail and frail). Cronbach’s α was used in psychometric analysis to evaluate the reliability and validity of the criterion, the sensitivity, the specificity, as well as positive and negative predictive values. Factor analysis was used to assess the suitability of the proposed number of components.RESULTS Decreased walking speed and decreased physical strength showed good internal consistency (α = 0.77 and 0.72, respectively); however, low physical activity was less satisfactory (α = 0.63). The sensitivity and specificity for identifying pre-frail individuals were 89.7% and 24.3%, respectively, while those for identifying frail individuals were 63.2% and 71.6%, respectively. In addition, 89.7% of the individuals from both the evaluations were identified in the “process of frailty” category.CONCLUSIONS The self-reported assessment of frailty can identify the syndrome among older adults and can be used as a screening tool. Its advantages include simplicity, rapidity, low cost, and ability to be used by different professionals.

A low-cost method to test cytotoxic effects of Crotalus vegrandis (Serpentes: Viperidae) venom on kidney cell cultures

The pathogenesis of the renal lesion upon envenomation by snakebite has been related to myolysis, hemolysis, hypotension and/or direct venom nephrotoxicity caused by the venom. Both primary and continuous cell culture systems provide an in vitro alternative for quantitative evaluation of the toxicity of snake venoms. Crude Crotalus vegrandis venom was fractionated by molecular exclusion chromatography. The toxicity of C. vegrandis crude venom, hemorrhagic, and neurotoxic fractions were evaluated on mouse primary renal cells and a continuous cell line of Vero cells maintained in vitro. Cells were isolated from murine renal cortex and were grown in 96 well plates with Dulbecco's Modified Essential Medium (DMEM) and challenged with crude and venom fractions. The murine renal cortex cells exhibited epithelial morphology and the majority showed smooth muscle actin determined by immune-staining. The cytotoxicity was evaluated by the tetrazolium colorimetric method. Cell viability was less for crude venom, followed by the hemorrhagic and neurotoxic fractions with a CT50 of 4.93, 18.41 and 50.22 µg/mL, respectively. The Vero cell cultures seemed to be more sensitive with a CT50 of 2.9 and 1.4 µg/mL for crude venom and the hemorrhagic peak, respectively. The results of this study show the potential of using cell culture system to evaluate venom toxicity.

Evaluation of the reference value for the Montenegro skin test

Abstract:INTRODUCTION:The Montenegro skin test (MST) has good clinical applicability and low cost for the diagnosis of American tegumentary leishmaniasis (ATL). However, no studies have validated the reference value (5mm) typically used to discriminate positive and negative results. We investigated MST results and evaluated its performance using different cut-off points.METHODS:The results of laboratory tests for 4,256 patients with suspected ATL were analyzed, and 1,182 individuals were found to fulfill the established criteria. Two groups were formed. The positive cutaneous leishmaniasis (PCL) group included patients with skin lesions and positive direct search for parasites (DS) results. The negative cutaneous leishmaniasis (NCL) group included patients with skin lesions with evolution up to 2 months, negative DS results, and negative indirect immunofluorescence assay results who were residents of urban areas that were reported to be probable sites of infection at domiciles and peridomiciles.RESULTS:The PCL and NCL groups included 769 and 413 individuals, respectively. The mean ± standard deviation MST in the PCL group was 12.62 ± 5.91mm [95% confidence interval (CI): 12.20-13.04], and that in the NCL group was 1.43 ± 2.17mm (95% CI: 1.23-1.63). Receiver-operating characteristic curve analysis indicated 97.4% sensitivity and 93.9% specificity for a cut-off of 5mm and 95.8% sensitivity and 97.1% specificity for a cut-off of 6mm.CONCLUSIONS:Either 5mm or 6mm could be used as the cut-off value for diagnosing ATL, as both values had high sensitivity and specificity.

Cost of drugs manufactured by the University Hospital - role of the Central Pharmacy

The hospital pharmacy in large and advanced institutions has evolved from a simple storage and distribution unit into a highly specialized manipulation and dispensation center, responsible for the handling of hundreds of clinical requests, many of them unique and not obtainable from commercial companies. It was therefore quite natural that in many environments, a manufacturing service was gradually established, to cater to both conventional and extraordinary demands of the medical staff. That was the case of Hospital das Clinicas, where multiple categories of drugs are routinely produced inside the pharmacy. However, cost-containment imperatives dictate that such activities be reassessed in the light of their efficiency and essentiality. METHODS: In a prospective study, the output of the Manufacturing Service of the Central Pharmacy during a 12-month period was documented and classified into three types. Group I comprised drugs similar to commercially distributed products, Group II included exclusive formulations for routine consumption, and Group III dealt with special demands related to clinical investigations. RESULTS: Findings for the three categories indicated that these groups represented 34.4%, 45.3%, and 20.3% of total manufacture orders, respectively. Costs of production were assessed and compared with market prices for Group 1 preparations, indicating savings of 63.5%. When applied to the other groups, for which direct equivalent in market value did not exist, these results would suggest total yearly savings of over 5 100 000 US dollars. Even considering that these calculations leave out many components of cost, notably those concerning marketing and distribution, it might still be concluded that at least part of the savings achieved were real. CONCLUSIONS: The observed savings, allied with the convenience and reliability with which the Central Pharmacy performed its obligations, support the contention that internal manufacture of pharmaceutical formulations was a cost-effective alternative in the described setting.

A questionnaire to evaluate the impact of chronic diseases: validated translation and Illness Effects Questionnaire (IEQ) reliability study

INTRODUCTION: Patients' perception about their health condition, mainly involving chronic diseases, has been investigated in many studies and it has been associated to depression, compliance with the treatment, quality of life and prognosis. The Illness Effects Questionnaire (IEQ) is a tool which makes the standardized evaluation of patients' perception about their illness possible, so that it is brief and accessible to the different clinical settings. This work aims to begin the transcultural adaptation of the IEQ to Brazil through the validated translation and the reliability study. METHODS: The back-translation method and the test-retest reliability study were used in a sample of 30 adult patients under chronic hemodialysis. The reliability indexes were estimated using the Pearson, Spearman, Weighted Kappa and Cronbach's alpha coefficients. RESULTS: The semantic equivalence was reached through the validated translation. In this study, the reliability indexes obtained were respectively: 0.85 and 0.75 (p < 0.001); 0.68 and 0.92 (p < 0.0001). DISCUSSION: The reliability indexes obtained attest to the stability of responses in both evaluations. Additional procedures are necessary for the transcultural adaptation of the IEQ to be complete. CONCLUSION: The results indicate the translation validity and the reliability of the Brazilian version of the IEQ for the sample studied.

Reliability of the interpretation of coronary angiography by the simple visual method

OBJECTIVE: Evaluation of inter and intraobserver reproducibility of by the visual method interpretation of cineangiogram in a clinically based context. METHODS: Five interventional cardiologists analyzed 11 segments of 8 coronary cineangiograms at a two month apart sessions. The percent luminal reduction by the lesions were analyzed by two different classifications: in one (A) the lesions were graded in 0% = absent, 1-50% = mild, 51 - 69 = moderate, and > or = 70% = severe; the other classification (B) was a dichotomic one : <70% = nonsignificant and > or = 70%=significant lesions. The agreement were measured by the kappa (k) index. RESULTS: Interobserver agreement was moderate for classification A (1st measurement, k = 0.36 -- 0.63, k m = 0.49; 2nd measurement, k = 0.39-0.68, k m = 0.52) and good for classification B (1st measurement, k = 0.55-0.73, k m = 0.63; 2nd measurement, k = 0.37-0.82, k m = 0.61). Intraobserver levels of agreement were k = 0.57-0.95 for classification A and 0.62-1.0 for classification B. CONCLUSION: The higher level of reproducibility obtained by adopting the dichotomous criteria usually considered for ischemic limits demonstrates that in the present clinical context, the reliability of the simple visual method is adequate for the identification of patients with clinically significant lesions and candidates for myocardial revascularization procedures.

Enhancing longevity of pacemakers through reprogramming. Underutilization and cost-effectiveness

OBJECTIVE: This study was performed to observe the number of pacemakers that had never been reprogrammed after implantation, and the effect of optimised output programming on estimated longevity of pulse generators in patients with pacemaker METHODS: Sixty patients with Teletronics Reflex pacemakers were evaluated in a pacemaker clinic, from the time of the beginning of its activities, in June 1998, until March 1999. Telemetry was performed during the first clinic visit, and we observed how many pulse generators retained nominal output settings of the manufactures indicating the absence of reprogramming until that date. After evaluation of the capture threshold, reprogramming of pacemakers was performed with a safety margin of 2 to 2.5:1, and we compared the estimated longevity based on battery current at the manufacturer's settings with that based on settings achieved after reprogramming. RESULTS: In 95% of the cases, the original programmed setting was never reprogrammed before the patients attended the pacemaker clinic. Reprogramming the pacemaker prolonged estimated pulse generator life by 19.7±15.6 months (35.5%). CONCLUSION: The majority of the pacemakers evaluated had never been reprogrammed. Estimated pulse generator longevity can be prolonged significantly, using this simple, safe, efficacious, and cost-effective procedure.

Reproducibility and Reliability of the Quality of Life Questionnaire in Patients With Atrial Fibrillation

Abstract Background: Studies have shown the impact of atrial fibrillation (AF) on the patients' quality of life. Specific questionnaires enable the evaluation of relevant events. We previously developed a questionnaire to assess the quality of life of patients with AF (AFQLQ version 1), which was reviewed in this study, and new domains were added. Objective: To demonstrate the reproducibility of the AFQLQ version 2 (AFQLQ v.2), which included the domains of fatigue, illness perception and well-being. Methods: We applied 160 questionnaires (AFQLQ v.2 and SF-36) to 40 patients, at baseline and 15 days after, to measure inter- and intraobserver reproducibility. The analysis of quality of life stability was determined by test-retest, applying the Bartko intraclass correlation coefficient (ICC). Internal consistency was assessed by Cronbach's alpha test. Results: The total score of the test-retest (n = 40) had an ICC of 0.98 in the AFQLQ v.2, and of 0.94 in the SF36. In assessing the intra- and interobserver reproducibility of the AFQLQ v.2, the ICC reliability was 0.98 and 0.97, respectively. The internal consistency had a Cronbach's alpha coefficient of 0.82, compatible with good agreement of the AFQLQ v.2. Conclusion: The AFQLQ v.2 performed better than its previous version. Similarly, the domains added contributed to make it more comprehensive and robust to assess the quality of life of patients with AF.