Towards criterion validity in classroom language analysis: methodological constraints of metadiscourse and inter-rater agreement

This paper reports on a process to validate a revised version of a system for coding classroom discourse in foreign language lessons, a context in which the dual role of language (as content and means of communication) and the speakers' specific pedagogical aims lead to a certain degree of ambiguity in language analysis. The language used by teachers and students has been extensively studied, and a framework of concepts concerning classroom discourse well-established. Models for coding classroom language need, however, to be revised when they are applied to specific research contexts. The application and revision of an initial framework can lead to the development of earlier models, and to the re-definition of previously established categories of analysis that have to be validated. The procedures followed to validate a coding system are related here as guidelines for conducting research under similar circumstances. The advantages of using instruments that incorporate two types of data, that is, quantitative measures and qualitative information from raters' metadiscourse, are discussed, and it is suggested that such procedure can contribute to the process of validation itself, towards attaining reliability of research results, as well as indicate some constraints of the adopted research methodology.

Prevalence and virulence properties of Vibrio cholerae non-O1, Aeromonas spp. and Plesiomonas shigelloides isolated from Cambe Stream (State of Parana, Brazil)

The incidence of Vibrio cholerae, Aeromonas spp, and Plesiomonas shigelloides was determined in Rater samples from Cambe Stream. The samples were collected from seven different sites. The serogroups, virulence markers and drug resistance profiles were also evaluated. Twelve. Aer. hydrophila, 12 Aer. caviae, eight Aer. sobria, seven Ple. shigelloides and two V. cholerae non-O1 were isolated. They belonged to different serogroups and all produced haemolysis in different assays. Five of the Aeromonas strains and one of V, cholerae non-O1 were positive for enterotoxin activity. Haemagglutination and its inhibition, using erythrocytes of different origins, was variable for Aeromonas spp and V. cholerae, while none of the Plt. shigelloides haemagglutinated in association with any type of erythrocyte. All isolates exhibited multiple drug resistance. These results indicate that the occurrence of V. cholerae non-O1, Aeromonas spp, and Ple. shigelloides, in water used for vegetable irrigation, human recreation and animal consumption, among others, represents a potential risk for humans.

Elaboração e validação de escala diagramática para quantificação da mancha alvo em folhas de acerola

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Preliminary Criteria for Global Flares in Childhood-Onset Systemic Lupus Erythematosus

Objective. To develop widely acceptable preliminary criteria of global flare for childhood-onset systemic lupus erythematosus (cSLE).Methods. Pediatric rheumatologists (n = 138) rated a total of 358 unique patient profiles with information about the cSLE flare descriptors from 2 consecutive visits: patient global assessment of well-being, physician global assessment of disease activity (MD-global), health-related quality of life, anti-double-stranded DNA antibodies, disease activity index scores, protein: creatinine (P:C) ratio, complement levels, and erythrocyte sedimentation rate (ESR). Based on 2,996 rater responses about the course of cSLE (baseline versus followup), the accuracy (sensitivity, specificity, and area under the receiver operating characteristic curve) of candidate flare criteria was assessed. An international consensus conference was held to rank these candidate flare criteria as per the American College of Rheumatology recommendations for the development and validation of criteria sets.Results. The highest-ranked candidate criteria considered absolute changes (Delta) of the Systemic Lupus Erythematosus Disease Activity Index (SLEDAI) or British Isles Lupus Assessment Group (BILAG), MD-global, P:C ratio, and ESR; flare scores can be calculated (0.5 x Delta SLEDAI + 0.45 x Delta P:C ratio + 0.5 x Delta MD-global + 0.02 x Delta ESR), where values of >= 1.04 are reflective of a flare. Similarly, BILAG-based flare scores (0.4 x Delta BILAG + Delta 0.65 x Delta P:C ratio + 0.5 + Delta MD-global + 0.02 x Delta ESR) of >= 1.15 were diagnostic of a flare. Flare scores increased with flare severity.Conclusion. Consensus has been reached on preliminary criteria for global flares in cSLE. Further validation studies are needed to confirm the usefulness of the cSLE flare criteria in research and for clinical care.

The Brazilian Research Consortium on Obsessive-Compulsive Spectrum Disorders: recruitment, assessment instruments, methods for the development of multicenter collaborative studies and preliminary results

OBJETIVO: Descrever o recrutamento de pacientes, instrumentos de avaliação, métodos para o desenvolvimento de estudos colaborativos multicêntricos e os resultados preliminares do Consórcio Brasileiro de Pesquisa em Transtornos do Espectro Obsessivo-Compulsivo, que inclui sete centros universitários. MÉTODO: Este estudo transversal incluiu entrevistas semi-estruturadas (dados sociodemográficos, histórico médico e psiquiátrico, curso da doença e diagnósticos psiquiátricos comórbidos) e instrumentos que avaliam os sintomas do transtorno obsessivo-compulsivo (Escala para Sintomas Obsessivo-Compulsivos de Yale-Brown e Escala Dimensional para Sintomas Obsessivo-Compulsivos de Yale-Brown), sintomas depressivos (Inventário de Depressão de Beck), sintomas ansiosos (Inventário de Ansiedade de Beck), fenômenos sensoriais (Escala de Fenômenos Sensoriais da Universidade de São Paulo), juízo crítico (Escala de Avaliação de Crenças de Brown), tiques (Escala de Gravidade Global de Tiques de Yale) e qualidade de vida (questionário genérico de avaliação de qualidade de vida, Medical Outcome Quality of Life Scale Short-form-36 e Escala de Avaliação Social). O treinamento dos avaliadores consistiu em assistir cinco entrevistas filmadas e entrevistar cinco pacientes junto com um pesquisador mais experiente, antes de entrevistar pacientes sozinhos. A confiabilidade entre todos os líderes de grupo para os instrumentos mais importantes (Structured Clinical Interview for DSM-IV, Dimensional Yale-Brown Obsessive-Compulsive Scale, Universidade de São Paulo Sensory Phenomena Scale ) foi medida após seis entrevistas completas. RESULTADOS: A confiabilidade entre avaliadores foi de 96%. Até março de 2008, 630 pacientes com transtorno obsessivo-compulsivo tinham sido sistematicamente avaliados. A média de idade (±SE) foi de 34,7 (±0,51), 56,3% eram do sexo feminino e 84,6% caucasianos. Os sintomas obsessivo-compulsivos mais prevalentes foram os de simetria e os de contaminação. As comorbidades psiquiátricas mais comuns foram depressão maior, ansiedade generalizada e transtorno de ansiedade social. O transtorno de controle de impulsos mais comum foi escoriação neurótica. CONCLUSÃO: Este consórcio de pesquisa, pioneiro no Brasil, permitiu delinear o perfil sociodemográfico, clínico e terapêutico do paciente com transtorno obsessivo-compulsivo em uma grande amostra clínica de pacientes. O Consórcio Brasileiro de Pesquisa em Transtornos do Espectro Obsessivo-Compulsivo estabeleceu uma importante rede de colaboração de investigação clínica padronizada sobre o transtorno obsessivo-compulsivo e pode abrir o caminho para projetos semelhantes destinados a integrar outros grupos de pesquisa no Brasil e em todo o mundo.

Mandibular cortical bone evaluation on cone beam computed tomography images of patients with bisphosphonate-related osteonecrosis of the jaw

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia

Background: Neuropsychiatric symptoms (NPS) affect almost all patients with dementia and are a major focus of study and treatment. Accurate assessment of NPS through valid, sensitive and reliable measures is crucial. Although current NPS measures have many strengths, they also have some limitations (e.g. acquisition of data is limited to informants or caregivers as respondents, limited depth of items specific to moderate dementia). Therefore, we developed a revised version of the NPI, known as the NPI-C. The NPI-C includes expanded domains and items, and a clinician-rating methodology. This study evaluated the reliability and convergent validity of the NPI-C at ten international sites (seven languages). Methods: Face validity for 78 new items was obtained through a Delphi panel. A total of 128 dyads (caregivers/patients) from three severity categories of dementia (mild = 58, moderate = 49, severe = 21) were interviewed separately by two trained raters using two rating methods: the original NPI interview and a clinician-rated method. Rater 1 also administered four additional, established measures: the Apathy Evaluation Scale, the Brief Psychiatric Rating Scale, the Cohen-Mansfield Agitation Index, and the Cornell Scale for Depression in Dementia. Intraclass correlations were used to determine inter-rater reliability. Pearson correlations between the four relevant NPI-C domains and their corresponding outside measures were used for convergent validity. Results: Inter-rater reliability was strong for most items. Convergent validity was moderate (apathy and agitation) to strong (hallucinations and delusions; agitation and aberrant vocalization; and depression) for clinician ratings in NPI-C domains. Conclusion: Overall, the NPI-C shows promise as a versatile tool which can accurately measure NPS and which uses a uniform scale system to facilitate data comparisons across studies. Copyright © 2010 International Psychogeriatric Association.

Effect of drying on the reproducibility of DIAGNOdent to detect caries-like lesions

The aim of this study was to verify the drying effect on the reproducibility of DIAGNOdent (Dd) devices to detect caries-like lesions. Three areas were created in each of the 34 bovine incisors: sound (S), demineralized (DE) and remineralized (RE). One examiner measured each area with two Dd devices (denominated X and Y), twice under humid, and twice under dry condition. Intra-rater agreement according each device and inter-device agreement were estimated by kappa statistics (κ). Intra-rater agreement for device Y was substantial under humid (κ DE=0.68 and κ RE+S=0.68) and dry condition (κ DE=0.64 and κ RE+S=0.67). For device X, it was substantial under humid condition (κ DE=0.57 and κ RE+S=0.49), and it was almost perfect after air drying (κ DE=1.0 and κRE+S=1.0). Inter-device agreement was slight (κ =0.17) under humid condition, and it was substantial under dry condition (κ =0.62). As reproducibility increased under dry condition, drying is advised to detect caries-like lesions on free smooth surfaces when different devices are used.

Influence of maxillary incisor edge asymmetries on the perception of smile esthetics among orthodontists and laypersons

Introduction: Our objective was to determine the perception of smile esthetics among orthodontists and laypeople with respect to asymmetries on the maxillary incisor edges in a frontal smile analysis. Methods: Two frontal close-up smile photos of 2 women, 1 white and 1 Afro-Brazilian, were selected for this study. Both smiles displayed healthy maxillary anterior dentitions. The images were digitally altered to create tooth wear on the maxillary left central and lateral incisors in 0.5-mm increments. The final images were randomly assembled into a photo album that was given to 120 judges, 60 orthodontists and 60 laypersons. Each rater was asked to evaluate the attractiveness of the images with visual analog scales. The data collected were statistically analyzed with 1-way analysis of variance with the Tukey post-hoc test and the unpaired Student t test. Results: The most attractive smiles in both types of smiles were those without asymmetries and the 0.5-mm wear in the lateral incisor. In general, tooth wear was considered unattractive by both groups of raters following a pattern: the more tooth wear, the more unattractive the smile; tooth wear in the central incisor was considered more unattractive than in the lateral incisor. For both group of raters, 0.5 mm of wear in the central incisor was considered unattractive, whereas the thresholds for lateral incisor discrepancies were 0.5 mm for orthodontists and 1.0 mm for laypersons. Conclusions: The result of this study corroborates the clinical assumption that symmetry between the maxillary central incisors is a paramount goal for esthetic treatments. Copyright © 2013 by the American Association of Orthodontists.

Validation of the brazilian version of the apathy inventory

Background Apathy is a frequent neuropsychiatric condition in neurodegenerative disorders, depression, and often in mild cognitive impairment. The Apathy Inventory (AI) is a reliable instrument for improving the accuracy of the apathy diagnosis. The aim was to establish the validity of the Apathy Inventory for the Brazilian community. Methods We established the concurrent validity, internal consistency, inter-rater reliability, and the sensitivity and specificity of AI for the Brazilian community in a cohort of 175 individuals with Alzheimer's disease, Parkinson's disease, depression, mild cognitive impairment, and healthy controls. The three dimensions of the AI (emotional blunting, lack of initiative, and lack of interest) were compared with the Apathy domain of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C) in an independent scheme. Results The analyses demonstrated high correlation coefficients in AI's individual dimensions and in AI-total score (F = 0.965). Concerning the NPI-C/Apathy domain, intra-class correlation coefficients were also high (F = 0.977). Concurrent validity was high according to both raters on AI dimensions × NPI-C/Apathy domain and regarding total score (rater 1: rho = 0.956 vs. rater 2: rho = 0.970). The internal consistency of the AI was also high concerning the AI's individual dimensions and total score (rater 1: 0.945 vs. rater 2: 0.958). Conclusion We observed high internal consistency, high concurrent validity, and inter-rater reliability of the Apathy Inventory. In addition, we found that its sensitivity and specificity were high. We suggest that the Brazilian version of the Apathy Inventory would be an appropriate instrument to identify the apathy syndrome in Brazilian patients. © 2012 John Wiley & Sons, Ltd.

The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity in dementia

ABSTRACT Background: Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort. Methods: Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI). Results: Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS. Conclusion: The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains. © International Psychogeriatric Association 2013.

The reliability of counting actinic keratosis

Many epidemiological studies and clinical trials have been performed concerning actinic keratoses. The most eligible endpoint in the majority of articles is counting of actinic keratoses before and after treatments, nevertheless some authors support that this is not a reliable form of evaluation. The aim of this study was to evaluate the actinic keratoses counting by various raters and suggest approaches to increase the reliability. Cross-sectional study: forty-three patients were evaluated by four raters (inter- and intra-rater assessment) on the face and forearms. The mean actinic keratoses counts on the face and forearms were 7.7 and 9.1. The overall agreement among the raters for the facial and forearm actinic keratoses was 0.74 and 0.77. The intra-rater assessment showed high rates of agreement for the face (ICC = 0.93) and forearms (ICC = 0.83). Higher agreement occurred when counting up to five lesions. Four raters led to increased measurement variability and loss of reliability. Higher rates of agreement may be achieved with small number of lesions, limitation and/or segmentation of body areas to reduce their number, in AK prevention designs, are strategies that may lead to a greater reliability of these measurements. © 2013 Springer-Verlag Berlin Heidelberg.

Avaliação da tolerância do pacu (Piaractus mesopotamicus) a carboidratos

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Influence of the Vertical Position of Maxillary Central Incisors on the Perception of Smile Esthetics Among Orthodontists and Laypersons

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Influence of spacing in the upper lateral incisor area on the perception of smile esthetics among orthodontists and laypersons

Background: The aim of this study was to determine the perception of smile esthetics among orthodontists and laypeople with respect to the presence of diastemas in the upper lateral incisor in the mesial, distal, and both surfaces using an oblique smile analysis. Methods: Two standardized oblique photos of pleasant smiles from two white women were selected. Images were digitally altered to create diastemas in the lateral incisor, in 0.5-mm increments, in the mesial, distal, or both surfaces. Final images were randomly assembled in a photo album, which was given to 120 judgesd60 orthodontists and 60 laypersons. Each rater was asked to evaluate the attractiveness of the images on a visual analog scale. The data collected were submitted to statistical analysis by the means of one-way ANOVA with the Tukey post hoc test and the unpaired Student’s t test. Results: The most attractive smile was the one without spacing, and the presence of diastemas was considered unattractive by both groups of raters, following a pattern: the greater and the more mesially located, the more unattractive was the smile. Conclusions: The results of this study suggest that diastemas in the upper lateral incisor area were considered unattractive, following a pattern: the greater and the more mesially located, the more unattractive was the smile.