Scientific Literature on the Reliability and Validity of the Manchester Triage System (MTS) Protocol: A Integrative Literature Review

OBJECTIVE To analyze the scientific production about the validity and reliability of the Manchester Triage System (MTS) protocol. METHOD A descriptive study of an integrative literature review. Articles on the validity and reliability of the MTS developed with children and adults published between 1999 and 2013 were included. RESULTS 14 articles were selected from a total of 8438, nine of validity and five of reliability. The reliability of the MTS ranged from moderate to almost perfect, with higher intra-evaluation. Regarding validity, the results seem to point to equivalent and satisfactory sensibility and specificity levels of the MTS. The instrument proved to be a good predictor of the need for hospitalization and of hospital mortality. CONCLUSION The reliability and validity of the MTS obtained in the studies is varied. It is recommended that new studies indicate necessary modifications to the MTS so that it is more safely used by nurses.

Reliability and validity of the interactive observation scale for psychiatric inpatients applied by nursing aides in daily ward practice

The main characteristic of the nursing Interactive Observation Scale for Psychiatric Inpatients (IOSPI) is the necessity of interaction between raters and patients during assessment. The aim of this study was to evaluate the reliability and validity of the scale in the "real" world of daily ward practice and to determine whether the IOSPI can increase the interaction time between raters and patients and influence the raters' opinion about mental illness. All inpatients of a general university hospital psychiatric ward were assessed daily over a period of two months by 9 nursing aides during the morning and afternoon shifts, with 273 pairs of daily observations. Once a week the patients were interviewed by a psychiatrist who filled in the Brief Psychiatric Rating Scale (BPRS). The IOSPI total score was found to show significant test-retest reliability (interclass correlation coefficient = 0.83) and significant correlation with the BPRS total score (r = 0.69), meeting the criteria of concurrent validity. The instrument can also discriminate between patients in need of further inpatient treatment from those about to be discharged (negative predictive value for discharge = 0.91). Using this scale, the interaction time between nursing aides and patients increased significantly (t = 2.93, P<0.05) and their opinion about the mental illness changed. The "social restrictiveness" factor of the opinion scale about mental illness showed a significant reduction (t = 4.27, P<0.01) and the "interpersonal etiology" factor tended to increase (t = 1.98, P = 0.08). The IOSPI was confirmed as a reliable and valid scale and as an efficient tool to stimulate the therapeutic attitudes of the nursing staff.

Reliability and validity of a Portuguese version of the Young Mania Rating Scale

The reliability and validity of a Portuguese version of the Young Mania Rating Scale were evaluated. The original scale was translated into and adapted to Portuguese by the authors. Definitions of clinical manifestations, a semi-structured anchored interview and more explicit rating criteria were added to the scale. Fifty-five adult subjects, aged 18 to 60 years, with a diagnosis of Current Manic Episode according to DSM-III-R criteria were assessed using the Young Mania Rating Scale as well as the Brief Psychiatric Rating Scale in two sessions held at intervals from 7 to 10 days. Good reliability ratings were obtained, with intra-class correlation coefficient of 0.97 for total scores, and levels of agreement above 0.80 (P < 0.001) for all individual items. Internal consistency analysis resulted in an alpha = 0.67 for the scale as a whole, and an alpha = 0.72 for each standardized item (P < 0.001). For the concurrent validity, a correlation of 0.78 was obtained by the Pearson coefficient between the total scores of the Young Mania Rating Scale and Brief Psychiatric Rating Scale. The results are similar to those reported for the English version, indicating that the Portuguese version of the scale constitutes a reliable and valid instrument for the assessment of manic patients.

Reliability and validity of heart rate variability threshold assessment during an incremental shuttle-walk test in middle-aged and older adults

Studies on the assessment of heart rate variability threshold (HRVT) during walking are scarce. We determined the reliability and validity of HRVT assessment during the incremental shuttle walk test (ISWT) in healthy subjects. Thirty-one participants aged 57 ± 9 years (17 females) performed 3 ISWTs. During the 1st and 2nd ISWTs, instantaneous heart rate variability was calculated every 30 s and HRVT was measured. Walking velocity at HRVT in these tests (WV-HRVT1 and WV-HRVT2) was registered. During the 3rd ISWT, physiological responses were assessed. The ventilatory equivalents were used to determine ventilatory threshold (VT) and the WV at VT (WV-VT) was recorded. The difference between WV-HRVT1 and WV-HRVT2 was not statistically significant (median and interquartile range = 4.8; 4.8 to 5.4 vs4.8; 4.2 to 5.4 km/h); the correlation between WV-HRVT1 and WV-HRVT2 was significant (r = 0.84); the intraclass correlation coefficient was high (0.92; 0.82 to 0.96), and the agreement was acceptable (-0.08 km/h; -0.92 to 0.87). The difference between WV-VT and WV-HRVT2 was not statistically significant (4.8; 4.8 to 5.4 vs 4.8; 4.2 to 5.4 km/h) and the agreement was acceptable (0.04 km/h; -1.28 to 1.36). HRVT assessment during walking is a reliable measure and permits the estimation of VT in adults. We suggest the use of the ISWT for the assessment of exercise capacity in middle-aged and older adults.

Reliability and convergent validity of the Childhood Anxiety Sensitivity Index in children and adolescents

OBJECTIVE: The purpose of this study was to examine the reliability and the convergent validity of the Children Anxiety Sensitivity Index (CASI) with DSM-IV anxiety disorder symptoms, by comparison with the Screen for Child Anxiety Related Emotional Disorders (SCARED), in a community sample of Brazilian children and adolescents. METHODS: Children and adolescents from five schools were selected from a larger study that aimed to assess different aspects of childhood anxiety disorders. All participants completed the CASI and the SCARED. RESULTS: This study supported the reliability of the CASI total score. Girls reported higher total anxiety sensitivity scores than boys and there were no differences in total anxiety sensitivity scores between children and adolescents. This study showed moderate to high correlations between the CASI scores with SCARED scores, all correlations coefficients being positive and significant. CONCLUSIONS: Our findings demonstrate an appropriate reliability and evidence of convergent validity in the CASI in a sample of Brazilian children and adolescents.

Validity and reliability of a questionnaire on knowledge of cardiovascular risk factors for use in Brazil

Using a sample of patients with coronary artery disease, this methodological study aimed to conduct a cross-cultural adaptation and validation of a questionnaire on knowledge of cardiovascular risk factors (Q-FARCS), lifestyle changes, and treatment adherence for use in Brazil. The questionnaire has three scales: general knowledge of risk factors (RFs); specific knowledge of these RFs; and lifestyle changes achieved. Cross-cultural adaptation included translation, synthesis, back-translation, expert committee review, and pretesting. Face and content validity, reliability, and construct validity were measured. Cronbach’s alpha for the total sample (n = 240) was 0.75. Assessment of psychometric properties revealed adequate face and content validity, and the construct revealed seven components. It was concluded that the Brazilian version of Q-FARCS had adequate reliability and validity for the assessment of knowledge of cardiovascular RFs.

Climacteric symptoms and quality of life: validity of women's health questionnaire

OBJECTIVE: To evaluate the reliability and validity of the Portuguese version of the Women's Health Questionnaire. METHODS: In order to evaluate the Women's Health Questionnaire (WHQ), an analytical cross-sectional study was carried out at the women's menopause outpatient clinic of a university hospital in São Paulo, Brazil. There were studied 87 women in perimenopause or menopause, defined as experiencing at least one year's absence of menstrual flow. The following variables were collected: demographic data, clinical variables (Kupperman index and correlate numeric scale) and quality of life indexes (SF-36 and utility). RESULTS: The WHQ proved to be a questionnaire easily translated into Portuguese and well-adjusted to Brazilian women. The internal consistency of the overall WHQ was excellent (Cronbach alpha =0.83; 95% CI: 0.71-0.91). Test-retest reliability was also excellent (intraclass correlation coefficient [ICC]=0.92; 95% IC: 0.86-0.96) and had good absolute agreement (0.84; 95% CI: 0.71-0.92). A satisfactory clinical validity was observed. The construct validity was corroborated by clear associations with others scales. A good index of responsiveness after the intervention was reached. CONCLUSIONS: The Portuguese version of the WHQ is of easy and fast administration and understanding. Its measuring properties were related, allowing its use in the evaluation of Brazilian climacteric women's quality of life for various purposes.

Translation into Brazilian Portuguese, cultural adaptation and evaluation of the reliability of the Disabilities of the Arm, Shoulder and Hand Questionnaire

The objective of the present study was to translate, adapt and validate a Brazilian Portuguese version of the Disabilities of the Arm, Shoulder and Hand (DASH) Questionnaire. The study was carried out in two steps. The first was to translate the DASH into Portuguese and to perform cultural adaptation and the second involved the determination of the reliability and validity of the DASH for the Brazilian population. For this purpose, 65 rheumatoid arthritis patients of either sex (according to the classification criteria of the American College of Rheumatology), ranging in age from 18 to 60 years and presenting no other diseases involving the upper limbs, were interviewed. The patients were selected consecutively at the rheumatology outpatient clinic of UNIFESP. The following results were obtained: in the first step (translation and cultural adaptation), all patients answered the questions. In the second step, Spearman's correlation coefficients for interobserver evaluation ranged from 0.762 to 0.995, values considered to be highly reliable. In addition, intraclass correlation coefficients ranged from 0.97 to 0.99, also highly reliable values. Spearman's correlation coefficients and the intraclass correlation coefficients obtained during intra-observer evaluation ranged from 0.731 to 0.937 and from 0.90 to 0.96, respectively, being highly reliable values. The Ritchie Index showed a weak correlation with Brazilian DASH scores, while the visual analog scale of pain showed a good correlation with DASH score. We conclude that the Portuguese version of the DASH is a reliable instrument.

Evaluation of efficacy, reliability, and tolerability of sibutramine in obese patients, with an echocardiographic study

This is a double-blind, placebo-controlled study of the efficacy, safety, and tolerability of sibutramine in the management of obese patients for a 6-month period. METHOD: Sixty-one obese patients (BMI >30, <40 kg/m2), aged 18-65 years were evaluated. In the first phase of the study (30 days), the patients were given a placebo. We monitored compliance with a low-calorie diet (1200 kcal/day) and to the placebo. In the next stage, the double-blind phase (6 months), we compared placebo and sibutramine (10 mg/day). The criteria for evaluating efficacy were weight loss, reduction in body mass index (BMI), and abdominal and hip circumferences. Tolerability was assessed based on reported side effects, variation in arterial blood pressure and heart rate, metabolic profile (fasting glucose, total cholesterol and its fractions, and triglycerides), laboratory tests (renal and hepatic functions), and flow Doppler echocardiogram. RESULTS: We observed a greater weight loss (7.3 kg, 8% vs 2.6 kg, 2.8%) and a reduction in body mass index (7.4% vs 2.1%) in the sibutramine group than in the placebo group. Classifying the patients into 4 subgroups according to weight loss (weight gain, loss <5%, loss of 5% to 9.9%, and loss >10%), we observed a weight loss of >5% in 40% of the patients on sibutramine compared with 12.9% in the placebo group. We also detected weight gain in 45.2% of the placebo group compared to 20% in the sibutramine group. The sibutramine group showed improvement in HDL- cholesterol values (increased by 17%) and triglyceride values (decreased by 12.8%). This group also showed an increase in systolic blood pressure (6.7%, 5 mmHg). There were no changes in echocardiograms comparing the beginning and end of follow-up, and side effects did not lead to discontinuation of treatment. DISCUSSION: Sibutramine proved to be effective for weight loss providing an 8% loss of the initial weight. Compliance to prolonged treatment was good, and side effects did not result in discontinuation of treatment. These data confirmed the good efficacy, tolerability, and safety profiles of sibutramine for treatment of obesity.

Studies in search of a suitable experimental insect model for xenodiagnosis of hosts with Chagas' disease: 2 - Attempts to upgrade the reliability and the efficacy of xenodiagnosis in chronic Chagas' disease

In order to upgrade the reliability of xenodiagnosis, attention has been directed towards population dynamics of the parasite, with particular interest for the following factors: 1. Parasite density which by itself is not a research objective, but by giving an accurate portrayal of parasite development and multiplication, has been incorporated in screening of bugs for xenodiagnosis. 2. On the assumption that food availability might increase parasite density, bugs from xenodiagnosis have been refed at biweekly intervals on chicken blood. 3. Infectivity rates and positives harbouring large parasite yields were based on gut infections, in which the parasite population comprised of all developmental forms was more abundant and easier to detect than in fecal infections, thus minimizing the probability of recording false negatives. 4. Since parasite density, low in the first 15 days of infection, increases rapidly in the following 30 days, the interval of 45 days has been adopted for routine examination of bugs from xenodiagnosis. By following the enumerated measures, all aiming to reduce false negative cases, we are getting closer to a reliable xenodiagnostic procedure. Upgrading the efficacy of xenodiagnosis is also dependent on the xenodiagnostic agent. Of 9 investigated vector species, Panstrongylus megistus deserves top priority as a xenodiagnostic agent. Its extraordinary capability to support fast development and vigorous multiplication of the few parasites, ingested from the host with chronic Chagas' disease, has been revealed by the strikingly close infectivity rates of 91.2% vs. 96.4% among bugs engorged from the same host in the chronic and acute phase of the disease respectively (Table V), the latter comporting an estimated number of 12.3 x 10[raised to the power of 3] parasites in the circulation at the time of xenodiagnosis, as reported previously by the authors (1982).

Reliability and clinical utility of a Portuguese version of the Abnormal Involuntary Movements Scale (AIMS) for tardive dyskinesia in Brazilian patients

The objective of the present study was to evaluate the reliability and clinical utility of a Portuguese version of the Abnormal Involuntary Movements Scale (AIMS). Videotaped interviews with 16 psychiatric inpatients treated with antipsychotic drugs for at least 5 years were evaluated. Reliability was assessed by the intraclass correlation coefficient (ICC) between three raters, two with and one without clinical training in psychopathology. Clinical utility was assessed by the difference between the scores of patients with (N = 11) and without (N = 5) tardive dyskinesia (TD). Patients with TD exhibited a higher severity of global evaluation by the AIMS (sum of scores: 4.2 ± 0.9 vs 0.4 ± 0.2; score on item 8: 2.3 ± 0.3 vs 0.4 ± 0.2, TD vs controls). The ICC for the global evaluation was fair between the two skilled raters (0.58-0.62) and poor between these raters and the rater without clinical experience (0.05-0.29). Thus, we concluded that the Portuguese version of the AIMS shows an acceptable inter-rater reliability, but only between clinically skilled raters, and that it is clinically useful.

Cultural adaptation and validation of the "Kidney Disease and Quality of Life - Short Form (KDQOL-SF™ 1.3)" in Brazil

The objective of the present study was to translate the Kidney Disease Quality of Life - Short Form (KDQOL-SF™1.3) questionnaire into Portuguese to adapt it culturally and validate it for the Brazilian population. The KDQOL-SF was translated into Portuguese and back-translated twice into English. Patient difficulties in understanding the questionnaire were evaluated by a panel of experts and solved. Measurement properties such as reliability and validity were determined by applying the questionnaire to 94 end-stage renal disease patients on chronic dialysis. The Nottingham Health Profile Questionnaire, the Karnofsky Performance Scale and the Kidney Disease Questionnaire were administered to test validity. Some activities included in the original instrument were considered to be incompatible with the activities usually performed by the Brazilian population and were replaced. The mean scores for the 19 components of the KDQOL-SF questionnaire in Portuguese ranged from 22 to 91. The components "Social support" and "Dialysis staff encouragement" had the highest scores (86.7 and 90.8, respectively). The test-retest reliability and the inter-observer reliability of the instrument were evaluated by the intraclass correlation coefficient. The coefficients for both reliability tests were statistically significant for all scales of the KDQOL-SF (P < 0.001), ranging from 0.492 to 0.936 for test-retest reliability and from 0.337 to 0.994 for inter-observer reliability. The Cronbach's alpha coefficient was higher than 0.80 for most of components. The Portuguese version of the KDQOL-SF questionnaire proved to be valid and reliable for the evaluation of quality of life of Brazilian patients with end-stage renal disease on chronic dialysis.

Development and applications of the SWAN rating scale for assessment of attention deficit hyperactivity disorder: a literature review

This study reviewed the use of the Strengths and Weaknesses of Attention-Deficit/Hyperactivity-symptoms and Normal-behaviors (SWAN) rating scale in diagnostic and evolutive approaches to attention deficit hyperactivity disorder (ADHD) and in correlational studies of the disorder. A review of articles published in indexed journals from electronic databases was conducted and 61 articles on the SWAN scale were analyzed. From these, 27 were selected to a) examine use of SWAN in research on attention disorders and b) verify evidence of its usefulness in the areas of genetics, neuropsychology, diagnostics, psychiatric comorbidities, neuroimaging, pharmacotherapy, and to examine its statistical reliability and validity in studies of diverse populations. This review of articles indicated a growing use of the SWAN scale for diagnostic purposes, for therapy, and in research on areas other than ADHD, especially when compared with other reliable scales. Use of the scale in ADHD diagnosis requires further statistical testing to define its psychometric properties.

RELIABILITY AND SOCIAL KNOWLEDGERELEVANT RESPONSIBILITY

Knowledge seems to need the admixture of de facto reliability and epistemic responsibility. But philosophers have had a hard time in attempting to combine them in order to achieve a satisfactory account of knowledge. In this paper I attempt to find a solution by capitalizing on the real and ubiquitous human phenomenon that is the social dispersal of epistemic labour through time. More precisely, the central objective of the paper is to deliver a novel and plausible social account of knowledge-relevant responsibility and to consider the merits of the proposed combination of reliability and responsibility with respect to certain cases of unreflective epistemic subjects.

Screening for frailty in older adults using a self-reported instrument

OBJECTIVE To validate a screening instrument using self-reported assessment of frailty syndrome in older adults.METHODS This cross-sectional study used data from the Saúde, Bem-estar e Envelhecimento study conducted in Sao Paulo, SP, Southeastern Brazil. The sample consisted of 433 older adult individuals (≥ 75 years) assessed in 2009. The self-reported instrument can be applied to older adults or their proxy respondents and consists of dichotomous questions directly related to each component of the frailty phenotype, which is considered the gold standard model: unintentional weight loss, fatigue, low physical activity, decreased physical strength, and decreased walking speed. The same classification proposed in the phenotype was utilized: not frail (no component identified); pre-frail (presence of one or two components), and frail (presence of three or more components). Because this is a screening instrument, “process of frailty” was included as a category (pre-frail and frail). Cronbach’s α was used in psychometric analysis to evaluate the reliability and validity of the criterion, the sensitivity, the specificity, as well as positive and negative predictive values. Factor analysis was used to assess the suitability of the proposed number of components.RESULTS Decreased walking speed and decreased physical strength showed good internal consistency (α = 0.77 and 0.72, respectively); however, low physical activity was less satisfactory (α = 0.63). The sensitivity and specificity for identifying pre-frail individuals were 89.7% and 24.3%, respectively, while those for identifying frail individuals were 63.2% and 71.6%, respectively. In addition, 89.7% of the individuals from both the evaluations were identified in the “process of frailty” category.CONCLUSIONS The self-reported assessment of frailty can identify the syndrome among older adults and can be used as a screening tool. Its advantages include simplicity, rapidity, low cost, and ability to be used by different professionals.