Developing a reliable audit instrument to measure the physical environment for physical activity

Background: The physical environment plays an important role in influencing participation in physical activity, although which factors of the physical environment have the greatest effect on patterns of activity remain to be determined. We describe the development of a comprehensive instrument to measure the physical environmental factors that may influence walking and cycling in local neighborhoods and report on its reliability. Methods: Following consultation with experts from a variety of fields and a literature search, we developed a Systematic Pedestrian and Cycling Environmental Scan (SPACES) instrument and used it to collect data over a total of 1987 kilometers of roads in metropolitan Perth, Western Australia. The audit instrument is available from the first author on request. Additional environmental information was collected using desktop methods and geographic information systems (GIS) technology. We assessed inter- and intra-rater reliability of the instrument among the 16 observers who collected the data. Results: The observers reported that the audit instrument was easy to use. Both inter- and intra-rater reliability of the environmental scan instrument were generally high. Conclusions: Our instrument provides a reliable, practical, and easy to-use method for collecting detailed street-level data on physical environmental factors that are potential influences on walking in local neighborhoods.

Portuguese version of the Delirium Rating Scale-Revised-98: reliability and validity

Objective To assess the validity and the reliability of the Portuguese version of the Delirium Rating Scale-Revised-98 (DRS-R-98). Methods The scale was translated into Portuguese and back-translated into English. After assessing its face validity, five diagnostic groups (n = 64; delirium, depression, dementia, schizophrenia and others) were evaluated by two independent researchers blinded to the diagnosis. Diagnosis and severity of delirium as measured by the DRS-R-98 were compared to clinical diagnosis, Mini-Mental State Exam, Confusion Assessment Method, and Clinical Global Impressions scale (CGI). Results Mean and rnedian DRS-R-98 total scores significantly distinguished delirium from the other groups (p < 0.001). Inter-rater reliability (ICC between 0.9 and 1) and internal consistency (alpha = 0.91) were very high. DRS-R-98 severity scores correlated highly with the CGI. Mean DRS-R-98 severity scores during delirium differed significantly (p < 0.01) from the post-treatment values. The area under the curve established by ROC analysis was 0.99 and using the cut-off Value of 20 the scale showed sensitivity and specificity of 92.6% and 94.6%, respectively. Conclusion The Portuguese version of the DRS-R-98 is a valid and reliable measure of delirium that distinguishes delirium from other disorders and is sensitive to change in delirium severity, which may be of great value for longitudinal studies. Copyright (c) 2007 John Wiley & Sons, Ltd.

Cross-cultural Adaptation, Reliability and Validity of the DAFS-R in a Sample of Brazilian Older Adults

The Direct Assessment of Functional Status-Revised (DAFS-R) is an instrument developed to objectively measure functional capacities required for independent living. The objective of this study was to translate and culturally adapt the DAFS-R for Brazilian Portuguese (DAFS-BR) and to evaluate its reliability and validity. The DAFS-BR was administered to 89 older patients classified previously as normal controls, mild cognitive impairment (MCI) and Alzheimer`s disease (AD). The results indicated good internal consistency (Cronbach`s alpha = 0.78) in the total sample. The DAFS-BR showed high interobserver reliability (0.996; p < .001) as well as test-retest stability over 1-week interval (0.995; p < .001). Correlation between the DAFS-BR total score and the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) was moderate and significant (r = -.65, p < .001) in the total sample, whereas it did not reach statistical significance within each diagnostic group. Receiver operating characteristic curve analyses suggested that DAFS-BR has good sensitivity and specificity to identify MCI and AD. Results suggest that DAFS-BR can document degrees of severity of functional impairment among Brazilian older adults.

A standardized measurement technique may improve the reliability of measurements of endometrial thickness and volume

Objective To investigate whether standardization of the multiplanar view (SMV) when evaluating the uterus using three-dimensional ultrasonography (3D-US) improves intra-and interobserver reliability and agreement with regard to endometrial measurement. Methods Two-dimensional (2D) and 3D-US was used to measure endometrial thickness by two observers in 30 women undergoing assisted reproduction treatment. Endometrial volume was measured with Virtual Organ Computer-aided AnaLysis (VOCAL (TM)) in the longitudinal (A) and coronal (C) planes using an unmodified multiplanar view (UMV) and a standardized multiplanar view (SMV). Measurement reliability was evaluated by intraclass correlation coefficient (ICC) and agreement was examined using Bland-Altman plots with limits of agreement (LoA). The ease of outlining the endometrial-myometrial interface was compared between the A-and C-planes using subjective assessment. Results Endometrial volume measurements using the SMV and A-plane were more reliable (intra-and interobserver ICCs, 0.979 and 0.975, respectively) than were measurements of endometrial thickness using 2D-US (intra-and interobserver ICCs, 0.742 and 0.702, respectively) or 3D-US (intra-and interobserver ICCs, 0.890 and 0.784, respectively). The LoAs were narrower for SMV than for UMV. Reliability and agreement were not much different between the A- and C-planes. However the observers agreed that delineating the endometrial-myometrial interface using the A-plane was easier (first and second observer, 50.0 and 46.7%, respectively) or `comparable` (50 and 53.3%, respectively), but never more difficult than using the C-plane. Conclusions Endometrial volume measurements are more reliable than endometrial thickness measurements and are best performed using SMV and the A-plane. Copyright (C) 2011 ISUOG. Published by John Wiley & Sons, Ltd.

Inter-rater reliability study of the modified Oxford Grading Scale and the Peritron manometer

Objective To evaluate the inter-rater reliability of the modified Oxford Grading Scale and the Peritron manometer. Design All participants were evaluated twice, first by one examiner and 30 days later by a second examiner. Measurements of vaginal squeeze pressure were compared with the results from the palpation test. Participants Nineteen women with a mean age of 23.7 years (range 21 to 28 years). Results Inter-rater reliability for vaginal palpation was fair (kappa = 0.33, 95% confidence interval 0.09 to 0.57). Using the Peritron manometer, the difference between examiners was less than 10 cmH(2)O in 11 of the 19 (58%) cases. The palpation test did not differentiate between weak, moderate, good and strong muscle contractions. This study found fair inter-rater reliability for the modified Oxford Grading Scale and moderate inter-rater reliability for the Peritron manometer. Conclusions The inter-rater reliability of vaginal squeeze pressure measurement using the Peritron manometer is acceptable and can be used in re-evaluations performed by different examiners in clinical practice. However, for research purposes, the ideal situation would be for a single examiner to assess and re-assess the subject. Vaginal palpation is important in the clinical assessment of correctness of a pelvic floor muscle contraction, but this study does not support the use of the modified Oxford Grading Scale as a reliable and valid method to measure and differentiate pelvic floor muscle strength. (C) 2010 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

How reliably do rheumatologists measure shoulder movement?

Objective: To assess the intrarater and interrater reliability among rheumatologists of a standardised protocol for measurement of shoulder movements using a gravity inclinometer. Methods: After instruction, six rheurnatologists independently assessed eight movements of the shoulder, including total and glenohumeral flexion, total and glenohumeral abduction, external rotation in neutral and in abduction, internal rotation in abduction and hand behind back, in random order in six patients with shoulder pain and stiffness according to a 6x6 Latin square design using a standardised protocol. These assessments were then repeated. Analysis of variance was used to partition total variability into components of variance in order to calculate intraclass correlation coefficients (ICCs). Results: The intrarater and interrater reliability of different shoulder movements varied widely. The movement of hand behind back and total shoulder flexion yielded the highest ICC scores for both intrarater reliability (0.91 and 0.83, respectively) and interrater reliability (0.80 and 0.72, respectively). Low ICC scores were found for the movements of glenohumeral abduction, external rotation in abduction, and internal rotation in abduction (intrarater ICCs 0.35, 0.43, and 0.32, respectively), and external rotation in neutral, external rotation in abduction, and internal rotation in abduction (interrater ICCs 0.29, 0.11, and 0.06, respectively). Conclusions: The measurement of shoulder movements using a standardised protocol by rheumatologists produced variable intrarater and interrater reliability. Reasonable reliability was obtained only for the movement of hand behind back and total shoulder flexion.

The development and psychometric properties of a measure of social and adaptive functioning for children and adolescents

Developed, piloted, and examined the psychometric properties of the Child and Adolescent Social and Adaptive Functioning Scale (CASAFS), a self-report measure designed to examine the social functioning of young people in the areas of school performance, peer relationships, family relationships, and home duties/self-care. The findings of confirmatory and exploratory factor analysis support a 4-factor solution consistent with the hypothesized domains. Fit indexes suggested that the 4-correlated factor model represented a satisfactory solution for the data, with the covariation between factors being satisfactorily explained by a single, higher order factor reflecting social and adaptive functioning in general. The internal consistency and 12-month test-retest reliability of the total scale was acceptable. A significant, negative correlation was found between the CASAFS and a measure of depressive symptoms, showing that high levels of social functioning are associated with low levels of depression. Significant differences in CASAFS total and subscale scores were found between clinically depressed adolescents and a matched sample of nonclinical controls. Adolescents who reported elevated but subclinical levels of depression also reported lower levels of social functioning in comparison to nonclinical controls.

A novel bioassay for human somatogenic activity in serum samples supports the clinical reliability of immunoassays

OBJECTIVE Because there is discordance between different immunoassay values for serum hGH, and because clinical state may not correlate with immunoreactive hGH, we have developed an assay to accurately measure serum hGH somatogenic bioactivity. The results of this assay were compared with the Elegance two-site ELISA assay across 135 patient samples in a variety of clinical states. DESIGN The somatogenic assay was based on stable expression of hGH receptor in the murine BaF line, allowing these cells to proliferate in response to hGH. To eliminate interference by other growth factors in serum, we created a specific antagonist of the hGH receptor (similar to Trovert or Pegvisomant) which allowed us to obtain a true measure of hGH somatogenic activity by subtraction of the activity in the presence of the antagonist. The assay was carried out in microtiter plates over 24 h, with oxidation of a chromogenic tetrazolium salt (MTT) as the endpoint. PATIENTS These encompassed a number of different clinical conditions related to short stature, including idiopathic short stature, neurosecretory dysfunction and renal failure, as well as obese patients on dietary restriction and normal volunteers. MEASUREMENTS In addition to the colourimetric (MTT) response to hGH, we measured free hGH by stripping out GHBP-bound hGH using beads coupled to a monoclonal antibody to the GHBP (GH binding protein). All samples were measured in both bioassay and ELISA assay. RESULTS This bioassay was sensitive (5 mU/l or 2 mug/l) and precise, and not subject to interference by the GHBP. There was a good correlation (r = 0.95) between bioactivity and immunoactivity across clinical states. There was, however, an increased bioactivity during secretory peaks (over 25 mU/l), which has been reported previously for the Nb2 bioassay. Free hGH did not correlate with clinical state. CONCLUSIONS Because the results of the Elegance ELISA and the bioassay correlate well, even though there is greater bioactivity at higher hormone concentrations, it is evident that an appropriate immunoassay is able to act as a reliable indicator for clinical assessment. In those rare cases where bio-inactive GH exists, our bioassay should provide an appropriate means to demonstrate this.

Reliability of moderate-intensity and vigorous physical activity stage of change measures for young adults

Background. The purpose of this study was to examine the reliability of stage of change (SOC) measures for moderate-intensity and vigorous physical activity in two separate samples of young adults. Staging measures have focused on vigorous exercise, but current public health guidelines emphasize moderate-intensity activity. Method. For college students in the USA (n = 105) and in Australia (n = 123), SOC was assessed separately on two occasions for moderate-intensity activity and for vigorous activity. Test-retest repeatability was determined, using Cohen's kappa coefficient. Results. In both samples, the reliability scores for the moderate-intensity physical activity staging measure were lower than the scores for the vigorous exercise staging measure. Weighted kappa values for the moderate-intensity staging measure were in the fair to good range for both studies (0.50 and 0.45); for the vigorous staging measure kappa values were excellent and fair to good (0.76 and 0.72). Conclusions. There is a need to standardize and improve methods for staging moderate-intensity activity, given that such measures are used in public health interventions targeting HEPA (health-enhancing physical activity). (C) 2003 American Health Foundation and Elsevier Science (USA). All rights reserved.

The development of a scale to measure concepts of schizophrenia: experience among Brazilian psychiatrists

INTRODUCTION: Among psychiatric disorders schizophrenia is often said to be the condition with the most disputed definition.The Bleulerian and Schneiderian approaches have given rise to diagnostic formulations that have varied with time and place. Controversies over the concept of schizophrenia were examined within European/North American settings in the early 1970s but little has since been reported on the views of psychiatrists in developing countries. In Brazil both concepts are referred to in the literature. A scale was developed to measure adherence to Bleulerian and Schneiderian concepts among psychiatrists working in S. Paulo. METHODOLOGY: A self-reported questionnaire comprising seventeen visual analogue-scale statements related to Bleulerian and Schneiderian definitions of Shizophrenia, plus sociodemographic and training characteristics, was distributed to a non-randomised sample of 150 psychiatrists. The two sub-scales were assessed by psychometric methods for internal consistency, sub-scale structure and test-retest reliability. Items selected according to internal consistency were examined by a two-factor model exploratory factor analysis. Intraclass correlation coefficients described the stability of the scale. RESULTS: Replies were received from 117 psychiatrists (mean age 36 (SD 7.9)), 74% of whom were made and 26% female. The Schneiderian scale showed better overall internal consistency than the Bleulerian scale. Intra-class correlation coefficients for test-retest comparisons were between 0.5 and 0.7 for Schneiderian items and 0.2 and 0.7 for Bleulerian items. There was no negative association between Bleulerian and Schneiderian scale scores, suggesting that respondents may hold both concepts. Place of training was significantly associated with the respondent's opinion; disagreement with a Bleulerian standpoint predominated for those trained at the University of S. Paulo. CONCLUSIONS: The less satisfactory reliability for the Bleulerian sub-scale limits confidence in the whole scale but on the other hand this questionnaire contributes to the understanding of the controversy over Bleulerian and Schneiderian models for conceptualisation of schizophrenia, the former requiring more inference and therefore being prone to unreliability.

Impact of Syncope on Quality of Life: Validation of a Measure in Patients Undergoing Tilt Testing

INTRODUCTION AND OBJECTIVES: Recurrent syncope has a significant impact on quality of life. The development of measurement scales to assess this impact that are easy to use in clinical settings is crucial. The objective of the present study is a preliminary validation of the Impact of Syncope on Quality of Life questionnaire for the Portuguese population. METHODS: The instrument underwent a process of translation, validation, analysis of cultural appropriateness and cognitive debriefing. A population of 39 patients with a history of recurrent syncope (>1 year) who underwent tilt testing, aged 52.1 ± 16.4 years (21-83), 43.5% male, most in active employment (n=18) or retired (n=13), constituted a convenience sample. The resulting Portuguese version is similar to the original, with 12 items in a single aggregate score, and underwent statistical validation, with assessment of reliability, validity and stability over time. RESULTS: With regard to reliability, the internal consistency of the scale is 0.9. Assessment of convergent and discriminant validity showed statistically significant results (p<0.01). Regarding stability over time, a test-retest of this instrument at six months after tilt testing with 22 patients of the sample who had not undergone any clinical intervention found no statistically significant changes in quality of life. CONCLUSIONS: The results indicate that this instrument is of value for assessing quality of life in patients with recurrent syncope in Portugal.

Tradução e validação para Portugal do Patient Activation Measure 13 : em pessoas com Diabetes Mellitus tipo 2

RESUMO - Introdução: A Diabetes Mellitus Tipo 2 (DM2) tem uma elevada prevalência em todo o mundo, com impacto significativo a nível de Saúde Pública, na vida dos doentes e nos custos que lhe são associados. O Patiente Activation Measure 13 (PAM13) é um questionário que possibilita a avaliação das crenças, conhecimentos, motivação e capacidades de uma pessoa em relação à sua saúde; pelo que a sua utilização na DM2 é pertinente. Objetivos: Traduzir o PAM 13, versão curta, para Português de Portugal; Estabelecer as propriedades psicométricas da versão Portuguesa do PAM 13 (PAM13-P); Validar a PAM 13-P num grupo de pessoas com DM2. Material e métodos: O processo de tradução e adaptação cultural do questionário foi composto pelas fases: 1-Tradução, 2-Reconciliação e síntese, 3-Back translation, 4-Rever e sintetizar a Back translation, 5-Harmonização, 6-Revisão do comité de peritos, 7-Cognitive debriefing e 8-Avaliação final. Para validar o PAM13-P realizou-se um estudo observacional transversal analítico com uma amostra de conveniência, de pessoas com DM2, seguidas na Associação Protectora dos Diabéticos de Portugal. O questionário foi de autopreenchimento e foi consultado o processo clínico para obtenção da HbA1c. O tratamento estatístico foi realizado através do SPSS 21® e Winsteps v3.8.1®. Resultados e discussão: O processo de tradução e adaptação cultural foi realizado de acordo com as guidelines. Foram realizados 3 painéis de e-Delphi, com 21 participantes de áreas distintas, tendo-se obtido bons níveis de concordância. As principais modificações realizadas ao questionário foram a simplificação da linguagem e dos itens, obtendo-se as equivalências necessárias. O PAM13-P foi aplicado a 201 pessoas, sendo que a taxa de resposta foi de 83%. Na amostra analisada 57.3% eram homens. Obtiveram-se as médias de idade 67.1 anos e de duração de diabetes 17.3 anos. A média do score do PAM foi 58.5±10.1(41.8-90.5) pontos e 49,7% da amostra estava no nível 3 de ativação. Relativamente aos itens verificou-se que os itens mais difíceis foram o 13(56.1) e o 8(55.4) e o com menor dificuldade foi 4(38.5). As categorias de resposta tiveram um bom ajuste ao Modelo de Rasch. O ajustamento dos itens foi infit entre 0.779-1.177 e outfit entre 0.794-1.315. A fiabilidade dos indivíduos variou entre 0.77(real) e 0.83(modelo) e dos itens foi de 0.97 (real e modelo). O Alfa de Cronbach foi bom (α=0.82). Estas estatísticas foram semelhantes aos da validação do PAM13. Existiu uma relação entre o score do PAM e os itens de validação em 51%. Das variáveis analisadas, existia um relação do nível de ativação com a idade e com a HbA1c. Conclusões: O PAM13-P foi traduzido e adaptado culturalmente para Português e foi validado em pessoas com DM2, sendo as propriedades psicométricas boas.

Development and psychometric properties of ECPICID-AVC to measure informal caregivers’ skills when caring for older stroke survivors at home

Introduction: Informal caregivers provide a significant part of the total care needed by dependent older people poststroke. Although informal care is often the preferred option of those who provide and those who receive informal care, informal caregivers often report lack of preparation to take care of older dependent people. This article outlines the development and psychometric testing of informal caregivers’ skills when providing care to older people after a stroke – ECPICID-AVC. Design: Prospective psychometric instrument validation study. Methods: Eleven experts participated in a focus group in order to delineate, develop and validate the instrument. Data were gathered among adult informal caregivers (n = 186) living in the community in Northern Portugal from August 2013 to January 2014. Results: The 32-item scale describes several aspects of informal caregiver’s skills. The scale has eight factors: skill to feed/hydrate by nasogastric feeding, skill to assist the person in personal hygiene, skill to assist the person for transferring, skill to assist the person for positioning, skill to provide technical aids, skill to assist the person to use the toilet, skill to feed/hydrate and skill to provide technical aids for dressing/undressing. Analysis demonstrated adequate internal consistency (Cronbach’s alpha = 0.83) and good temporal stability 0.988 (0.984–0.991). Conclusion: The psychometric properties of the measurement tool showed acceptable results allowing its implementation in clinical practice by the nursing community staff for evaluating practical skills in informal caregivers when providing care to older stroke survivors living at home.

Personal and Social Performance (PSP) scale for patients with schizophrenia: translation to Portuguese, cross-cultural adaptation and interrater reliability

INTRODUCTION: Schizophrenia is a chronic mental disorder associated with impairment in social functioning. The most widely used scale to measure social functioning is the GAF (Global Assessment of Functioning), but it has the disadvantage of measuring at the same time symptoms and functioning, as described in its anchors. OBJECTIVES:Translation and cultural adaptation of the PSP, proposing a final version in Portuguese for use in Brazil. METHODS: We performed five steps: 1) translation; 2) back translation; 3) formal assessment of semantic equivalence; 4) debriefing; 5) analysis by experts. Interrater reliability (Intraclass correlation, ICC) between two raters was also measured. RESULTS: The final version was applied by two independent investigators in 18 adults with schizophrenia (DSM-IV-TR). The interrater reliability (ICC) was 0.812 (p < 0.001). CONCLUSION: The translation and adaptation of the PSP had an adequate level of semantic equivalence between the Portuguese version and the original English version. There were no difficulties related to understanding the content expressed in the translated texts and terms. Its application was easy and it showed a good interrater reliability. The PSP is a valid instrument for the measurement of personal and social functioning in schizophrenia.

Reproducibility and Reliability of the Quality of Life Questionnaire in Patients With Atrial Fibrillation

Abstract Background: Studies have shown the impact of atrial fibrillation (AF) on the patients' quality of life. Specific questionnaires enable the evaluation of relevant events. We previously developed a questionnaire to assess the quality of life of patients with AF (AFQLQ version 1), which was reviewed in this study, and new domains were added. Objective: To demonstrate the reproducibility of the AFQLQ version 2 (AFQLQ v.2), which included the domains of fatigue, illness perception and well-being. Methods: We applied 160 questionnaires (AFQLQ v.2 and SF-36) to 40 patients, at baseline and 15 days after, to measure inter- and intraobserver reproducibility. The analysis of quality of life stability was determined by test-retest, applying the Bartko intraclass correlation coefficient (ICC). Internal consistency was assessed by Cronbach's alpha test. Results: The total score of the test-retest (n = 40) had an ICC of 0.98 in the AFQLQ v.2, and of 0.94 in the SF36. In assessing the intra- and interobserver reproducibility of the AFQLQ v.2, the ICC reliability was 0.98 and 0.97, respectively. The internal consistency had a Cronbach's alpha coefficient of 0.82, compatible with good agreement of the AFQLQ v.2. Conclusion: The AFQLQ v.2 performed better than its previous version. Similarly, the domains added contributed to make it more comprehensive and robust to assess the quality of life of patients with AF.