Diagnostic interview for genetic studies (DIGS): inter-rater and test-retest reliability of the French version.

The National Institute of Mental Health developed the semi-structured Diagnostic Interview for Genetic Studies (DIGS) for the assessment of major mood and psychotic disorders and their spectrum conditions. The DIGS was translated into French in a collaborative effort of investigators from sites in France and Switzerland. Inter-rater and test-retest reliability of the French version have been established in a clinical sample in Lausanne. Excellent inter-rater reliability was found for schizophrenia, bipolar disorder, major depression, and unipolar schizoaffective disorder while fair inter-rater reliability was demonstrated for bipolar schizoaffective disorder. Using a six-week test-retest interval, reliability for all diagnoses was found to be fair to good with the exception of bipolar schizoaffective disorder. The lower test-retest reliability was the result of a relatively long test-retest interval that favored incomplete symptom recall. In order to increase reliability for lifetime diagnoses in persons not currently affected, best-estimate procedures using additional sources of diagnostic information such as medical records and reports from relatives should supplement DIGS information in family-genetic studies. Within such a procedure, the DIGS appears to be a useful part of data collection for genetic studies on major mood disorders and schizophrenia in French-speaking populations.

Development and validation of a psychometric scale for assessing PA chest image quality: a pilot study

Purpose - To develop and validate a psychometric scale for assessing image quality perception for chest X-ray images. Methods - Bandura's theory was used to guide scale development. A review of the literature was undertaken to identify items/factors which could be used to evaluate image quality using a perceptual approach. A draft scale was then created (22 items) and presented to a focus group (student and qualified radiographers). Within the focus group the draft scale was discussed and modified. A series of seven postero-anterior chest images were generated using a phantom with a range of image qualities. Image quality perception was confirmed for the seven images using signal-to-noise ratio (SNR 17.2–36.5). Participants (student and qualified radiographers and radiology trainees) were then invited to independently score each of the seven images using the draft image quality perception scale. Cronbach alpha was used to test interval reliability. Results - Fifty three participants used the scale to grade image quality perception on each of the seven images. Aggregated mean scale score increased with increasing SNR from 42.1 to 87.7 (r = 0.98, P < 0.001). For each of the 22 individual scale items there was clear differentiation of low, mid and high quality images. A Cronbach alpha coefficient of >0.7 was obtained across each of the seven images. Conclusion - This study represents the first development of a chest image quality perception scale based on Bandura's theory. There was excellent correlation between the image quality perception scores derived using the scale and the SNR. Further research will involve a more detailed item and factor analysis.

Statistical Inference for Some Measures of System Availability

Department of Statistics, Cochin University of Science and Technology

Avaliação histomor fométrica dos efeitos da movimentação dentária induzida sobre molares murinos submetidos à luxação extrusiva em períodos tardios

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Cross-cultural Adaptation, Reliability and Validity of the DAFS-R in a Sample of Brazilian Older Adults

The Direct Assessment of Functional Status-Revised (DAFS-R) is an instrument developed to objectively measure functional capacities required for independent living. The objective of this study was to translate and culturally adapt the DAFS-R for Brazilian Portuguese (DAFS-BR) and to evaluate its reliability and validity. The DAFS-BR was administered to 89 older patients classified previously as normal controls, mild cognitive impairment (MCI) and Alzheimer`s disease (AD). The results indicated good internal consistency (Cronbach`s alpha = 0.78) in the total sample. The DAFS-BR showed high interobserver reliability (0.996; p < .001) as well as test-retest stability over 1-week interval (0.995; p < .001). Correlation between the DAFS-BR total score and the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) was moderate and significant (r = -.65, p < .001) in the total sample, whereas it did not reach statistical significance within each diagnostic group. Receiver operating characteristic curve analyses suggested that DAFS-BR has good sensitivity and specificity to identify MCI and AD. Results suggest that DAFS-BR can document degrees of severity of functional impairment among Brazilian older adults.

Inter- and intra-tester reliability of clinical measurement to determine medio-lateral patellar position using a pachymeter or visual assessment

The aim was to investigate inter-tester and intra-tester reliability and parallel reliability between a visual assessment method and a method using a pachymeter for locating the mid-point of the patella in determining the medial/lateral patella orientation. Fifteen asymptomatic subjects were assessed and the mid-point of the patella was determined by both methods on two separate occasions two weeks apart. Inter-tester reliability was obtained by ANOVA and by intraclass correlation coefficient (ICC); intra-tester reliability was obtained by a paired t-test and ICC; and parallel reliability was obtained by Pearson`s Correlation and ICC, for the measurement on the first and second evaluations. There was acceptable inter-tester agreement (p = 0.490) and reliability for the visual inspection (ICC = 0.747) and for the pachymeter (ICC = 0.716) at the second evaluation. The inter-tester reliability in the first evaluation was unacceptable (visual ICC = 0.604; pachymeter ICC = 0.612). Although there was statistical similarity between measurements for the first and second evaluations for all testers, intra-tester reliability was not acceptable for both methods: visual (examiner 1 ICC = 0.175; examiner 2 ICC = 0.189; examiner 3 ICC = 0.155) and pachymeter (examiner 1 ICC = 0.214; examiner 2 ICC = 0.246; examiner 3 ICC = 0.069). Parallel reliability gave a perfect correlation at the first evaluation (r=0.828; p<0.001) and at the second (r=0.756; p<0.001) and reliability was between acceptable and very good (ICC = [0.748-0.813]). Both visual and pachymeter methods provide reliable and similar medial/lateral patella orientation and are reliable between different examiners, but the results between the two assessments at 2 weeks` interval demonstrated an unacceptable reliability. (C) 2009 Elsevier B.V. All rights reserved.

Preliminary Reliability and Repeatability of the Brazilian Version of the Revised Knox Preschool Play Scale

The aim of this study was to create an adaptation of the Revised Knox Preschool Play Scale (RKPPS) for the Brazilian population, as well as to apply the instrument with statistical analysis to verify the preliminary intra-rater and inter-rater reliability and repeatability of the instrument. The instructions presented by Beaton et al. regarding adaptation of instruments were followed to perform a cross-cultural adaptation of the RKPPS. A preliminary test of the Portuguese version was performed on 18 children with no motor, cognitive or sensory impairment. The video recordings of this administration were analysed on two separate occasions by two examiners within a 5-month interval, using the scores suggested by Pfeifer. The Spearman`s test was used in the statistical analysis of the obtained data. The author of the RKPPS agreed with the small necessary cultural adaptations. The Spearman test revealed a high correlation coefficient and good significance levels for both intra- and inter-raters values. This study demonstrated the reliability and repeatability of the Brazilian version of the RKPPS. This is a preliminary study and further studies are needed in order to validate the scale to be administered in the Brazilian population. Copyright (C) 2010 John Wiley & Sons, Ltd.

Inter-rater reliability study of the modified Oxford Grading Scale and the Peritron manometer

Objective To evaluate the inter-rater reliability of the modified Oxford Grading Scale and the Peritron manometer. Design All participants were evaluated twice, first by one examiner and 30 days later by a second examiner. Measurements of vaginal squeeze pressure were compared with the results from the palpation test. Participants Nineteen women with a mean age of 23.7 years (range 21 to 28 years). Results Inter-rater reliability for vaginal palpation was fair (kappa = 0.33, 95% confidence interval 0.09 to 0.57). Using the Peritron manometer, the difference between examiners was less than 10 cmH(2)O in 11 of the 19 (58%) cases. The palpation test did not differentiate between weak, moderate, good and strong muscle contractions. This study found fair inter-rater reliability for the modified Oxford Grading Scale and moderate inter-rater reliability for the Peritron manometer. Conclusions The inter-rater reliability of vaginal squeeze pressure measurement using the Peritron manometer is acceptable and can be used in re-evaluations performed by different examiners in clinical practice. However, for research purposes, the ideal situation would be for a single examiner to assess and re-assess the subject. Vaginal palpation is important in the clinical assessment of correctness of a pelvic floor muscle contraction, but this study does not support the use of the modified Oxford Grading Scale as a reliable and valid method to measure and differentiate pelvic floor muscle strength. (C) 2010 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Reliability of nasal auscultation and their relation to middle ear condition – a clinical interest to pediatrics respiratory physiotherapy

Background: Acute respiratory infections are usual in children under three years old occurring in upper respiratory tract, having an impact on child and caregiver’s quality of life predisposing to otitis media or bronchiolitis. There are few valid and reliable measures to determine the child’s respiratory condition and to guide the physiotherapy intervention. Aim: To assess the intra and inter rater reliability of nasal auscultation, to analyze the relation between sounds’ classification and middle ear’s pressure and compliance as well as with the Clinical Severity Score. Methods: A cross-sectional observational study was composed by 125 nursery children aged up to three years old. Tympanometry, pulmonary and nasal auscultation and application of Clinical Severity Score were performed to each child. Nasal auscultation sounds’ were recorded and sent to 3 blinded experts, that classified, as “obstructed” and “unobstructed”, with a 48 hours interval, in order to analyze inter and intra rater reliability. Results: Nasal auscultation revealed a substantial inter and intra rater reliability (=0,749 and evaluator A - K= 0,691; evaluator B - K= 0,605 and evaluator C - K= 0,724, respectively). Both ears’ pressure was significantly lower in children with an "unobstructed" nasal sound when compared with an “obstructed” nasal sound (t=-3,599, p<0,001 in left ear; t=-2,258, p=0,026 in right ear). Compliance in both ears was significantly lower in children with an "obstructed" nasal sound when compared with “unobstructed” nasal sound (t=-2,728, p=0,007 in left ear; t=-3,830, p<0,001 in right ear). There was a statistically significant association between sounds’ classification and tympanograms types in both ear’s (=11,437, p=0,003 in left ear; =13,535, p=0,001 in right ear). There was a trend to children with an "unobstructed" nasal sound that had a lower clinical severity score when compared with “obstructed” children. Conclusion: It was observed a good intra and substantial inter reliability for nasal auscultation. Nasal auscultation sounds’ classification was related to middle ears’ pressure and compliance.

Repeated assessment and practice effects of the written symbol digit modalities test using a short inter-test interval

The Symbol Digit Modalities Test (SDMT) is a widely used instrument to assess information processing speed, attention, visual scanning, and tracking. Considering that repeated evaluations are a common need in neuropsychological assessment routines, we explored test–retest reliability and practice effects of two alternate SDMT forms with a short inter-assessment interval. A total of 123 university students completed the written SDMT version in two different time points separated by a 150-min interval. Half of the participants accomplished the same form in both occasions, while the other half filled different forms. Overall, reasonable test–retest reliabilities were found (r = .70), and the subjects that completed the same form revealed significant practice effects (p < .001, dz = 1.61), which were almost non-existent in those filling different forms. These forms were found to be moderately reliable and to elicit a similar performance across participants, suggesting their utility in repeated cognitive assessments when brief inter-assessment intervals are required.

Reliability of the information about the history of diagnosis and treatment of hypertension. Differences in regard to sex, age, and educational level. The pró-saúde study

OBJECTIVE: To assess the intraobserver reliability of the information about the history of diagnosis and treatment of hypertension. METHODS: A multidimensional health questionnaire, which was filled out by the interviewees, was applied twice with an interval of 2 weeks, in July '99, to 192 employees of the University of the State of Rio de Janeiro (UERJ), stratified by sex, age, and educational level. The intraobserver reliability of the answers provided was estimated by the kappa statistic and by the coefficient of intraclass correlation (CICC). RESULTS: The general kappa (k) statistic was 0.75 (95% CI=0.73-0.77). Reliability was higher among females (k=0.88, 95% CI=0.85-0.91) than among males (k=0.62, 95% CI=0.59-0.65).The reliability was higher among individuals 40 years of age or older (k=0.79; 95% CI=0.73-0.84) than those from 18 to 39 years (k=0.52; 95% CI=0.45-0.57). Finally, the kappa statistic was higher among individuals with a university educational level (k=0.86; 95% CI=0.81-0.91) than among those with high school educational level (k=0.61; 95% CI=0.53-0.70) or those with middle school educational level (k=0.68; 95% CI=0.64-0.72). The coefficient of intraclass correlation estimated by the intraobserver agreement in regard to age at the time of the diagnosis of hypertension was 0.74. A perfect agreement between the 2 answers (k=1.00) was observed for 22 interviewees who reported prior prescription of antihypertensive medication. CONCLUSION: In the population studied, estimates of the reliability of the history of medical diagnosis of hypertension and its treatment ranged from substantial to almost perfect reliability.

Validity, reliability and responsiveness of the French language translation of the Western Ontario Shoulder Instability Index (WOSI).

BACKGROUND: The WOSI (Western Ontario Shoulder Instability Index) is a self-administered quality of life questionnaire designed to be used as a primary outcome measure in clinical trials on shoulder instability, as well as to measure the effect of an intervention on any particular patient. It is validated and is reliable and sensitive. As it is designed to measure subjective outcome, it is important that translation should be methodologically rigorous, as it is subject to both linguistic and cultural interpretation. OBJECTIVE: To produce a French language version of the WOSI that is culturally adapted to both European and North American French-speaking populations. MATERIALS AND METHODS: A validated protocol was used to create a French language WOSI questionnaire (WOSI-Fr) that would be culturally acceptable for both European and North American French-speaking populations. Reliability and responsiveness analyses were carried out, and the WOSI-Fr was compared to the F-QuickDASH-D/S (Disability of the Arm, Shoulder and Hand-French translation), and Walch-Duplay scores. RESULTS: A French language version of the WOSI (WOSI-Fr) was accepted by a multinational committee. The WOSI-Fr was then validated using a total of 144 native French-speaking subjects from Canada and Switzerland. Comparison of results on two WOSI-Fr questionnaires completed at a mean interval of 16 days showed that the WOSI-Fr had strong reliability, with a Pearson and interclass correlation of r=0.85 (P=0.01) and ICC=0.84 [95% CI=0.78-0.88]. Responsiveness, at a mean 378.9 days after surgical intervention, showed strong correlation with that of the F-QuickDASH-D/S, with r=0.67 (P<0.01). Moreover, a standardized response means analysis to calculate effect size for both the WOSI-Fr and the F-QuickDASH-D/S showed that the WOSI-Fr had a significantly greater ability to detect change (SRM 1.55 versus 0.87 for the WOSI-Fr and F-QuickDASH-D/S respectively, P<0.01). The WOSI-Fr showed fair correlation with the Walch-Duplay. DISCUSSION: A French-language translation of the WOSI questionnaire was created and validated for use in both Canadian and Swiss French-speaking populations. This questionnaire will facilitate outcome assessment in French-speaking settings, collaboration in multinational studies and comparison between studies performed in different countries. TYPE OF STUDY: Multicenter cohort study. LEVEL OF EVIDENCE: II.

Studies in search of a suitable experimental insect model for xenodiagnosis of hosts with Chagas' disease: 2 - Attempts to upgrade the reliability and the efficacy of xenodiagnosis in chronic Chagas' disease

In order to upgrade the reliability of xenodiagnosis, attention has been directed towards population dynamics of the parasite, with particular interest for the following factors: 1. Parasite density which by itself is not a research objective, but by giving an accurate portrayal of parasite development and multiplication, has been incorporated in screening of bugs for xenodiagnosis. 2. On the assumption that food availability might increase parasite density, bugs from xenodiagnosis have been refed at biweekly intervals on chicken blood. 3. Infectivity rates and positives harbouring large parasite yields were based on gut infections, in which the parasite population comprised of all developmental forms was more abundant and easier to detect than in fecal infections, thus minimizing the probability of recording false negatives. 4. Since parasite density, low in the first 15 days of infection, increases rapidly in the following 30 days, the interval of 45 days has been adopted for routine examination of bugs from xenodiagnosis. By following the enumerated measures, all aiming to reduce false negative cases, we are getting closer to a reliable xenodiagnostic procedure. Upgrading the efficacy of xenodiagnosis is also dependent on the xenodiagnostic agent. Of 9 investigated vector species, Panstrongylus megistus deserves top priority as a xenodiagnostic agent. Its extraordinary capability to support fast development and vigorous multiplication of the few parasites, ingested from the host with chronic Chagas' disease, has been revealed by the strikingly close infectivity rates of 91.2% vs. 96.4% among bugs engorged from the same host in the chronic and acute phase of the disease respectively (Table V), the latter comporting an estimated number of 12.3 x 10[raised to the power of 3] parasites in the circulation at the time of xenodiagnosis, as reported previously by the authors (1982).

Reliability and validity of the Alcohol Use Disorders Identification Test (AUDIT) imbedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients.

BACKGROUND: Self-administered, general health risk screening questionnaires that are administered while patients wait in the doctor's office may be a reasonable and timesaving approach to address the requirements of preventive medicine in a typical 10-min medical visit. The psychometric characteristics of the Alcohol Use Disorders Identification Test (AUDIT) incorporated within a health questionnaire (H-AUDIT) have not been examined. METHODS: The reliability and validity of the self-administered AUDIT were compared between the H-AUDIT and the AUDIT used as a single scale (S-AUDIT) in 332 primary care patients. RESULTS: No major demographic or alcohol use characteristics were found between the 166 subjects who completed the H-AUDIT and the 166 individuals who completed the S-AUDIT. The test-retest reliability of the 166 subjects who completed the H-AUDIT [estimated by Spearman correlation coefficient at a 6-week interval (0.88), internal consistency (total correlation coefficients for all items ranged from 0.38 to 0.69; Cronbach alpha index 0.85), and the sensitivity and specificity of the H-AUDIT were used to identify at-risk drinkers' areas under receiver operating characteristic (0.77) and alcohol-dependent subjects' areas under receiver operating characteristic (0.89)] was similar to the same measurements obtained with the 166 individuals who completed the S-AUDIT. CONCLUSIONS: The AUDIT incorporated in a health risk screening questionnaire is a reliable and valid self-administered instrument to identify at-risk drinkers and alcohol-dependent individuals in primary care settings.

Discriminant validity and test-retest reliability of a self-administered Internet-based questionnaire testing doctors' knowledge in evidence-based medicine.

Aims and objectives  This study aimed to determine the discriminant validity and the test-retest reliability of a questionnaire testing the impact of evidence-based medicine (EBM) training on doctors' knowledge and skills. Methods  Questionnaires were sent electronically to all doctors working as residents and chief residents in two French speaking hospital networks in Switzerland. Participants completed the questionnaire twice, within a 4-week interval. The discriminant validity was examined in comparing doctors' performance according to their reported EBM previous training. Proportion of agreement between both sessions of the questionnaire, Cohen's kappa and 'uniform kappa' determined its test-retest reliability. Results  The participation rate was 9.8%/7.1% to first/second session. Performance increased according to the level of doctors' previous training in EBM. The observed proportion of agreement between both sessions was over 70% for 14/19 questions, and the 'uniform kappa' was superior to 0.60 for 15/19 questions. Conclusion  The discriminant validity and test-retest reliability of the questionnaire were satisfying. The low participation rate did not prevent the study from achieving its aims.