Validity and reliability of a health care service evaluation instrument for tuberculosis

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis.METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis.RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest coefficient of variation. The performance of the indicators “training” and “access to recording instruments” was inferior to that of other indicators.CONCLUSIONS The instrument showed feasibility of application and potential to assess the structure of primary health care units for the treatment of tuberculosis.

Validity and reliability of the Questionnaire for Compliance with Standard Precaution

ABSTRACT OBJECTIVE : To evaluate the validity and reliability of the Questionnaire for Compliance with Standard Precaution for nurses. METHODS : This methodological study was conducted with 121 nurses from health care facilities in Sao Paulo's countryside, who were represented by two high-complexity and by three average-complexity health care facilities. Internal consistency was calculated using Cronbach's alpha and stability was calculated by the intraclass correlation coefficient, through test-retest. Convergent, discriminant, and known-groups construct validity techniques were conducted. RESULTS : The questionnaire was found to be reliable (Cronbach's alpha: 0.80; intraclass correlation coefficient: (0.97) In regards to the convergent and discriminant construct validity, strong correlation was found between compliance to standard precautions, the perception of a safe environment, and the smaller perception of obstacles to follow such precautions (r = 0.614 and r = 0.537, respectively). The nurses who were trained on the standard precautions and worked on the health care facilities of higher complexity were shown to comply more (p = 0.028 and p = 0.006, respectively). CONCLUSIONS : The Brazilian version of the Questionnaire for Compliance with Standard Precaution was shown to be valid and reliable. Further investigation must be conducted with nurse samples that are more representative of the Brazilian reality. The use of the questionnaire may support the creation of educational measures considering the possible gaps that can be identified, focusing on the workers' health and on the patients' safety.

Content validity and reliability of test of gross motor development in Chilean children

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

Study of the Reliability of Statistical Timing Analysis for Real-Time Systems

Presented at 23rd International Conference on Real-Time Networks and Systems (RTNS 2015). 4 to 6, Nov, 2015, Main Track. Lille, France.

Reliability of Two Methods for Identifying the Postural Phase of Gait Initiation in Healthy and Post-stroke Subjects

This study aims to compare two methods of assessing the postural phase of gait initiation as to intrasession reliability, in healthy and post-stroke subjects. As a secondary aim, this study aims to analyse anticipatory postural adjustments during gait initiation based on the centre of pressure (CoP) displacements in post-stroke participants. The CoP signal was acquired during gait initiation in fifteen post-stroke subjects and twenty-three healthy controls. Postural phase was identified through a baseline-based method and a maximal displacement based method. In both healthy and post-stroke participants higher intra-class correlation coefficient and lower coefficient of variation values were obtained with the baseline-based method when compared to the maximal displacement based method. Post-stroke participants presented decreased CoP displacement backward and toward the first swing limb compared to controls when the baseline-based method was used. With the maximal displacement based method, there were differences between groups only regarding backward CoP displacement. Postural phase duration in medial-lateral direction was also increased in post-stroke participants when using the maximal displacement based method. The findings obtained indicate that the baseline-based method is more reliable detecting the onset of gait initiation in both groups, while the maximal displacement based method presents greater sensitivity for post-stroke participants.

Predicting type of delivery by identification of obstetric risk factors through data mining

In Maternity Care, a quick decision has to be made about the most suitable delivery type for the current patient. Guidelines are followed by physicians to support that decision; however, those practice recommendations are limited and underused. In the last years, caesarean delivery has been pursued in over 28% of pregnancies, and other operative techniques regarding specific problems have also been excessively employed. This study identifies obstetric and pregnancy factors that can be used to predict the most appropriate delivery technique, through the induction of data mining models using real data gathered in the perinatal and maternal care unit of Centro Hospitalar of Oporto (CHP). Predicting the type of birth envisions high-quality services, increased safety and effectiveness of specific practices to help guide maternity care decisions and facilitate optimal outcomes in mother and child. In this work was possible to acquire good results, achieving sensitivity and specificity values of 90.11% and 80.05%, respectively, providing the CHP with a model capable of correctly identify caesarean sections and vaginal deliveries.

Eating habits and psychopathology: translation, adaptation, reliability of the Nutrition Behavior Inventory to Portuguese and relation to psychopathology

Objective: The Nutrition-Behavior Inventory (NBI) is a self-administered instrument that allows eating habits to be correlated with psychopathological symptoms. The objective was to translate and adapt the NBI to Portuguese, and test the Portuguese NBI’s reliability. The second aim was to verify its sensitivity for identification of risk factors in terms of behavior/eating habits in children and adolescents. Methods: The NBI was translated, adapted, and back-translated. The Portuguese version of the NBI was then applied (N = 96; 9-12 years). In order to verify the internal consistency, Cronbach’s alpha was used. The psychopathological indicators of the participants were accessed using the Child Behavior Checklist (CBCL). The mean CBCL scores were analyzed in relation to the NBI data (cutoff point: ≥ 30 with indicators, and < 30 without). Results: Internal consistency was high (Cronbach’s alpha = 0.89) for the NBI. The CBCL scores correlated significantly with NBI (> 30) on the following: anxiety and depression (p = 0.041), social difficulties (p = 0.028), attention problems (p = 0.001), aggressive behavior (p = 0.015); ADHD (p < 0.001), and conduct problems (p = 0.032). Conclusion: The present results indicate that the NBI is a reliable instrument. The NBI can be useful for evaluating psychopathological symptoms related to the eating habits and behaviors of children and adolescents.

Reliability of the interpretation of coronary angiography by the simple visual method

OBJECTIVE: Evaluation of inter and intraobserver reproducibility of by the visual method interpretation of cineangiogram in a clinically based context. METHODS: Five interventional cardiologists analyzed 11 segments of 8 coronary cineangiograms at a two month apart sessions. The percent luminal reduction by the lesions were analyzed by two different classifications: in one (A) the lesions were graded in 0% = absent, 1-50% = mild, 51 - 69 = moderate, and > or = 70% = severe; the other classification (B) was a dichotomic one : <70% = nonsignificant and > or = 70%=significant lesions. The agreement were measured by the kappa (k) index. RESULTS: Interobserver agreement was moderate for classification A (1st measurement, k = 0.36 -- 0.63, k m = 0.49; 2nd measurement, k = 0.39-0.68, k m = 0.52) and good for classification B (1st measurement, k = 0.55-0.73, k m = 0.63; 2nd measurement, k = 0.37-0.82, k m = 0.61). Intraobserver levels of agreement were k = 0.57-0.95 for classification A and 0.62-1.0 for classification B. CONCLUSION: The higher level of reproducibility obtained by adopting the dichotomous criteria usually considered for ischemic limits demonstrates that in the present clinical context, the reliability of the simple visual method is adequate for the identification of patients with clinically significant lesions and candidates for myocardial revascularization procedures.

Reliability of the information about the history of diagnosis and treatment of hypertension. Differences in regard to sex, age, and educational level. The pró-saúde study

OBJECTIVE: To assess the intraobserver reliability of the information about the history of diagnosis and treatment of hypertension. METHODS: A multidimensional health questionnaire, which was filled out by the interviewees, was applied twice with an interval of 2 weeks, in July '99, to 192 employees of the University of the State of Rio de Janeiro (UERJ), stratified by sex, age, and educational level. The intraobserver reliability of the answers provided was estimated by the kappa statistic and by the coefficient of intraclass correlation (CICC). RESULTS: The general kappa (k) statistic was 0.75 (95% CI=0.73-0.77). Reliability was higher among females (k=0.88, 95% CI=0.85-0.91) than among males (k=0.62, 95% CI=0.59-0.65).The reliability was higher among individuals 40 years of age or older (k=0.79; 95% CI=0.73-0.84) than those from 18 to 39 years (k=0.52; 95% CI=0.45-0.57). Finally, the kappa statistic was higher among individuals with a university educational level (k=0.86; 95% CI=0.81-0.91) than among those with high school educational level (k=0.61; 95% CI=0.53-0.70) or those with middle school educational level (k=0.68; 95% CI=0.64-0.72). The coefficient of intraclass correlation estimated by the intraobserver agreement in regard to age at the time of the diagnosis of hypertension was 0.74. A perfect agreement between the 2 answers (k=1.00) was observed for 22 interviewees who reported prior prescription of antihypertensive medication. CONCLUSION: In the population studied, estimates of the reliability of the history of medical diagnosis of hypertension and its treatment ranged from substantial to almost perfect reliability.

Reproducibility and Reliability of the Quality of Life Questionnaire in Patients With Atrial Fibrillation

Abstract Background: Studies have shown the impact of atrial fibrillation (AF) on the patients' quality of life. Specific questionnaires enable the evaluation of relevant events. We previously developed a questionnaire to assess the quality of life of patients with AF (AFQLQ version 1), which was reviewed in this study, and new domains were added. Objective: To demonstrate the reproducibility of the AFQLQ version 2 (AFQLQ v.2), which included the domains of fatigue, illness perception and well-being. Methods: We applied 160 questionnaires (AFQLQ v.2 and SF-36) to 40 patients, at baseline and 15 days after, to measure inter- and intraobserver reproducibility. The analysis of quality of life stability was determined by test-retest, applying the Bartko intraclass correlation coefficient (ICC). Internal consistency was assessed by Cronbach's alpha test. Results: The total score of the test-retest (n = 40) had an ICC of 0.98 in the AFQLQ v.2, and of 0.94 in the SF36. In assessing the intra- and interobserver reproducibility of the AFQLQ v.2, the ICC reliability was 0.98 and 0.97, respectively. The internal consistency had a Cronbach's alpha coefficient of 0.82, compatible with good agreement of the AFQLQ v.2. Conclusion: The AFQLQ v.2 performed better than its previous version. Similarly, the domains added contributed to make it more comprehensive and robust to assess the quality of life of patients with AF.

Recombinant adeno-associated virus serotype 6 (rAAV2/6)-mediated gene transfer to nociceptive neurons through different routes of delivery.

BACKGROUND: Gene transfer to nociceptive neurons of the dorsal root ganglia (DRG) is a promising approach to dissect mechanisms of pain in rodents and is a potential therapeutic strategy for the treatment of persistent pain disorders such as neuropathic pain. A number of studies have demonstrated transduction of DRG neurons using herpes simplex virus, adenovirus and more recently, adeno-associated virus (AAV). Recombinant AAV are currently the gene transfer vehicles of choice for the nervous system and have several advantages over other vectors, including stable and safe gene expression. We have explored the capacity of recombinant AAV serotype 6 (rAAV2/6) to deliver genes to DRG neurons and characterized the transduction of nociceptors through five different routes of administration in mice. RESULTS: Direct injection of rAAV2/6 expressing green fluorescent protein (eGFP) into the sciatic nerve resulted in transduction of up to 30% eGFP-positive cells of L4 DRG neurons in a dose dependent manner. More than 90% of transduced cells were small and medium sized neurons (< 700 microm 2), predominantly colocalized with markers of nociceptive neurons, and had eGFP-positive central terminal fibers in the superficial lamina of the spinal cord dorsal horn. The efficiency and profile of transduction was independent of mouse genetic background. Intrathecal administration of rAAV2/6 gave the highest level of transduction (approximately 60%) and had a similar size profile and colocalization with nociceptive neurons. Intrathecal administration also transduced DRG neurons at cervical and thoracic levels and resulted in comparable levels of transduction in a mouse model for neuropathic pain. Subcutaneous and intramuscular delivery resulted in low levels of transduction in the L4 DRG. Likewise, delivery via tail vein injection resulted in relatively few eGFP-positive cells within the DRG, however, this transduction was observed at all vertebral levels and corresponded to large non-nociceptive cell types. CONCLUSION: We have found that rAAV2/6 is an efficient vector to deliver transgenes to nociceptive neurons in mice. Furthermore, the characterization of the transduction profile may facilitate gene transfer studies to dissect mechanisms behind neuropathic pain.

Reliability of serological methods for detection of leishmaniasis in portuguese domestic and wild reservoirs

A direct agglutination test (DAT) and an immunofluorescence technique (IFAT) were compared for detection of Leishmania infantum infection in 43 dogs and five foxes from Alto-Douro and Arrábida, two known endemic areas in Portugal. In four dogs with proved canine leishmaniasis, both DAT and IFAT showed positive readings (titres >1:320 and >1:128). Of 34 samples collected from apparently healthy dogs, ten were positive by both serological tests and eight were serologically positive by one test or the other. Three foxes out of five captured in this area, scored titres indicative of leishmaniasis in both DAT and IFAT. The concordance between DAT and IFAT in all collected samples (48) was 81.25%. Considering these and previous studies in the adjacent Mediterranean areas, the seroprevalence of L. infantum infection in the canine and vulpine populations appear to be of high magnitude.

Diagnostic interview for genetic studies (DIGS): inter-rater and test-retest reliability of the French version.

The National Institute of Mental Health developed the semi-structured Diagnostic Interview for Genetic Studies (DIGS) for the assessment of major mood and psychotic disorders and their spectrum conditions. The DIGS was translated into French in a collaborative effort of investigators from sites in France and Switzerland. Inter-rater and test-retest reliability of the French version have been established in a clinical sample in Lausanne. Excellent inter-rater reliability was found for schizophrenia, bipolar disorder, major depression, and unipolar schizoaffective disorder while fair inter-rater reliability was demonstrated for bipolar schizoaffective disorder. Using a six-week test-retest interval, reliability for all diagnoses was found to be fair to good with the exception of bipolar schizoaffective disorder. The lower test-retest reliability was the result of a relatively long test-retest interval that favored incomplete symptom recall. In order to increase reliability for lifetime diagnoses in persons not currently affected, best-estimate procedures using additional sources of diagnostic information such as medical records and reports from relatives should supplement DIGS information in family-genetic studies. Within such a procedure, the DIGS appears to be a useful part of data collection for genetic studies on major mood disorders and schizophrenia in French-speaking populations.