Diagnostic interview for genetic studies (DIGS): inter-rater and test-retest reliability of the French version.

The National Institute of Mental Health developed the semi-structured Diagnostic Interview for Genetic Studies (DIGS) for the assessment of major mood and psychotic disorders and their spectrum conditions. The DIGS was translated into French in a collaborative effort of investigators from sites in France and Switzerland. Inter-rater and test-retest reliability of the French version have been established in a clinical sample in Lausanne. Excellent inter-rater reliability was found for schizophrenia, bipolar disorder, major depression, and unipolar schizoaffective disorder while fair inter-rater reliability was demonstrated for bipolar schizoaffective disorder. Using a six-week test-retest interval, reliability for all diagnoses was found to be fair to good with the exception of bipolar schizoaffective disorder. The lower test-retest reliability was the result of a relatively long test-retest interval that favored incomplete symptom recall. In order to increase reliability for lifetime diagnoses in persons not currently affected, best-estimate procedures using additional sources of diagnostic information such as medical records and reports from relatives should supplement DIGS information in family-genetic studies. Within such a procedure, the DIGS appears to be a useful part of data collection for genetic studies on major mood disorders and schizophrenia in French-speaking populations.

Discriminant validity and test-retest reliability of a self-administered Internet-based questionnaire testing doctors' knowledge in evidence-based medicine.

Aims and objectives  This study aimed to determine the discriminant validity and the test-retest reliability of a questionnaire testing the impact of evidence-based medicine (EBM) training on doctors' knowledge and skills. Methods  Questionnaires were sent electronically to all doctors working as residents and chief residents in two French speaking hospital networks in Switzerland. Participants completed the questionnaire twice, within a 4-week interval. The discriminant validity was examined in comparing doctors' performance according to their reported EBM previous training. Proportion of agreement between both sessions of the questionnaire, Cohen's kappa and 'uniform kappa' determined its test-retest reliability. Results  The participation rate was 9.8%/7.1% to first/second session. Performance increased according to the level of doctors' previous training in EBM. The observed proportion of agreement between both sessions was over 70% for 14/19 questions, and the 'uniform kappa' was superior to 0.60 for 15/19 questions. Conclusion  The discriminant validity and test-retest reliability of the questionnaire were satisfying. The low participation rate did not prevent the study from achieving its aims.

Test-retest reliability of thermal quantitative sensory testing on two sites within the L5 dermatome of the lumbar spine and lower extremity.

INTRODUCTION: Quantitative sensory testing (QST) is widely used in human research to investigate the integrity of the sensory function in patients with pain of neuropathic origin, or other causes such as low back pain. Reliability of QST has been evaluated on both sides of the face, hands and feet as well as on the trunk (Th3-L3). In order to apply these tests on other body-parts such as the lower lumbar spine, it is important first to establish reliability on healthy individuals. The aim of this study was to investigate intra-rater reliability of thermal QST in healthy adults, on two sites within the L5 dermatome of the lumbar spine and lower extremity. METHODS: Test-retest reliability of thermal QST was determined at the L5-level of the lumbar spine and in the same dermatome on the lower extremity in 30 healthy persons under 40 years of age. Results were analyzed using descriptive statistics and intraclass correlation coefficient (ICC). Values were compared to normative data, using Z-transformation. RESULTS: Mean intraindividual differences were small for cold and warm detection thresholds but larger for pain thresholds. ICC values showed excellent reliability for warm detection and heat pain threshold, good-to-excellent reliability for cold pain threshold and fair-to-excellent reliability for cold detection threshold. ICC had large ranges of confidence interval (95%). CONCLUSION: In healthy adults, thermal QST on the lumbar spine and lower extremity demonstrated fair-to-excellent test-retest reliability.

The QUASAR reproducibility study, Part II: Results from a multi-center Arterial Spin Labeling test-retest study.

Arterial Spin Labeling (ASL) is a method to measure perfusion using magnetically labeled blood water as an endogenous tracer. Being fully non-invasive, this technique is attractive for longitudinal studies of cerebral blood flow in healthy and diseased individuals, or as a surrogate marker of metabolism. So far, ASL has been restricted mostly to specialist centers due to a generally low SNR of the method and potential issues with user-dependent analysis needed to obtain quantitative measurement of cerebral blood flow (CBF). Here, we evaluated a particular implementation of ASL (called Quantitative STAR labeling of Arterial Regions or QUASAR), a method providing user independent quantification of CBF in a large test-retest study across sites from around the world, dubbed "The QUASAR reproducibility study". Altogether, 28 sites located in Asia, Europe and North America participated and a total of 284 healthy volunteers were scanned. Minimal operator dependence was assured by using an automatic planning tool and its accuracy and potential usefulness in multi-center trials was evaluated as well. Accurate repositioning between sessions was achieved with the automatic planning tool showing mean displacements of 1.87+/-0.95 mm and rotations of 1.56+/-0.66 degrees . Mean gray matter CBF was 47.4+/-7.5 [ml/100 g/min] with a between-subject standard variation SD(b)=5.5 [ml/100 g/min] and a within-subject standard deviation SD(w)=4.7 [ml/100 g/min]. The corresponding repeatability was 13.0 [ml/100 g/min] and was found to be within the range of previous studies.

Diagnostic interview for genetic studies (DIGS): inter-rater and test-retest reliability of alcohol and drug diagnoses

The semi-structured diagnostic interview for genetic studies (DIGS) was developed to assess major mood and psychotic disorders and their spectrum manifestations in genetic studies. Our research group developed a French version of the DIGS and tested its inter-rater and test-retest reliability in psychiatric patients. In this article, we present estimates of the reliability of substance use and antisocial personality disorders. High kappa coefficients for inter-rater reliability were found for drug and alcohol as well as antisocial personality diagnoses and slightly lower kappas for test-retest reliability. Combined with evidence of the reliability of major mood and psychotic disorders, these findings support the suitability of the DIGS for studies of familial aggregation and comorbidity of psychiatric disorders including substance use and antisocial personality disorders.

Test-retest repeatability of the pupil light response to blue and red light stimuli in normal human eyes using a novel pupillometer.

In this study, we evaluated the repeatability of pupil responses to colored light stimuli in healthy subjects using a prototype chromatic pupillometer. One eye of 10 healthy subjects was tested twice in the same day using monochromatic light exposure at two selected wavelengths (660 and 470 nm, intensity 300 cd/m(2)) presented continuously for 20 s. Pupil responses were recorded in real-time before, during, and after light exposure. Maximal contraction amplitude and sustained contraction amplitude were calculated. In addition, we quantified the summed pupil response during continuous light stimulation as the total area between a reference line representing baseline pupil size and the line representing actual pupil size over 20 s (area under the curve). There was no significant difference in the repeated measure compared to the first test for any of the pupil response parameters. In conclusion, we have developed a novel prototype of color pupillometer which demonstrates good repeatability in evoking and recording the pupillary response to a bright blue and red light stimulus.

Reliability and validity of the Alcohol Use Disorders Identification Test (AUDIT) imbedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients.

BACKGROUND: Self-administered, general health risk screening questionnaires that are administered while patients wait in the doctor's office may be a reasonable and timesaving approach to address the requirements of preventive medicine in a typical 10-min medical visit. The psychometric characteristics of the Alcohol Use Disorders Identification Test (AUDIT) incorporated within a health questionnaire (H-AUDIT) have not been examined. METHODS: The reliability and validity of the self-administered AUDIT were compared between the H-AUDIT and the AUDIT used as a single scale (S-AUDIT) in 332 primary care patients. RESULTS: No major demographic or alcohol use characteristics were found between the 166 subjects who completed the H-AUDIT and the 166 individuals who completed the S-AUDIT. The test-retest reliability of the 166 subjects who completed the H-AUDIT [estimated by Spearman correlation coefficient at a 6-week interval (0.88), internal consistency (total correlation coefficients for all items ranged from 0.38 to 0.69; Cronbach alpha index 0.85), and the sensitivity and specificity of the H-AUDIT were used to identify at-risk drinkers' areas under receiver operating characteristic (0.77) and alcohol-dependent subjects' areas under receiver operating characteristic (0.89)] was similar to the same measurements obtained with the 166 individuals who completed the S-AUDIT. CONCLUSIONS: The AUDIT incorporated in a health risk screening questionnaire is a reliable and valid self-administered instrument to identify at-risk drinkers and alcohol-dependent individuals in primary care settings.

Reliability and validity of physiological data obtained within a cycle-run transition test in age-group triathletes.

This study examined the validity and reliability of a sequential "Run-Bike-Run" test (RBR) in age-group triathletes. Eight Olympic distance (OD) specialists (age 30.0 ± 2.0 years, mass 75.6 ± 1.6 kg, run VO2max 63.8 ± 1.9 ml· kg(-1)· min(-1), cycle VO2peak 56.7 ± 5.1 ml· kg(-1)· min(-1)) performed four trials over 10 days. Trial 1 (TRVO2max) was an incremental treadmill running test. Trials 2 and 3 (RBR1 and RBR2) involved: 1) a 7-min run at 15 km· h(-1) (R1) plus a 1-min transition to 2) cycling to fatigue (2 W· kg(-1) body mass then 30 W each 3 min); 3) 10-min cycling at 3 W· kg(-1) (Bsubmax); another 1-min transition and 4) a second 7-min run at 15 km· h(-1) (R2). Trial 4 (TT) was a 30-min cycle - 20-min run time trial. No significant differences in absolute oxygen uptake (VO2), heart rate (HR), or blood lactate concentration ([BLA]) were evidenced between RBR1 and RBR2. For all measured physiological variables, the limits of agreement were similar, and the mean differences were physiologically unimportant, between trials. Low levels of test-retest error (i.e. ICC <0.8, CV<10%) were observed for most (logged) measurements. However [BLA] post R1 (ICC 0.87, CV 25.1%), [BLA] post Bsubmax (ICC 0.99, CV 16.31) and [BLA] post R2 (ICC 0.51, CV 22.9%) were least reliable. These error ranges may help coaches detect real changes in training status over time. Moreover, RBR test variables can be used to predict discipline specific and overall TT performance. Cycle VO2peak, cycle peak power output, and the change between R1 and R2 (deltaR1R2) in [BLA] were most highly related to overall TT distance (r = 0.89, p < 0. 01; r = 0.94, p < 0.02; r = 0.86, p < 0.05, respectively). The percentage of TR VO2max at 15 km· h(-1), and deltaR1R2 HR, were also related to run TT distance (r = -0.83 and 0.86, both p < 0.05).

Teaching motivational interviewing to medical students : a pre-post test pilot study

Objective: To test the efficacy of teaching motivational interviewing (MI) to medical students. Methods: Thirteen 4th year medical students volunteered to participate. Seven days before and 7 days after an 8-hour interactive training MI workshop, each student performed a videorecorded interview with two standardized patients: a 60 year old alcohol dependent woman and a 50 year old cigarette smoking man. Students' counseling skills were coded by two blinded clinicians using the Motivational Interviewing Treatment Integrity 3.0 (MITI). Inter-rater reliability was calculated for all interviews and a test-retest was completed in a sub-sample of 10 consecutive interviews three days apart. Difference between MITI scores before and after training were calculated and tested using non-parametric tests. Effect size was approximated by calculating the probability that posttest scores are greater than pretest scores (P*=P(Pre<Post)+1/2P(Pre=Post)), P*>1/2 indicating greater scores in posttest, P*=1/2 no effect, and P*<1/2 smaller scores in posttest. Results: Median differences between MITI scores before and after MI training indicated a general progression in MI skills: MI spirit global score (median difference=1.5, Inter quartile range=1.5, p<0.001, P*=0.90); Empathy global score (med diff=1, IQR=0.5, p<0.001, P*=0.85); Percentage of MI adherent skills (med diff=36.6, IQR=50.5, p<0.001, P*=0.85); Percentage of open questions (med diff=18.6, IQR=21.6, p<0.001, P*=0.96); reflections/ questions ratio (med diff=0.2, IQR=0.4, p<0.001, P*=0.81). Only Direction global score and the percentage of complex reflections were not significantly improved (med diff=0, IQR=1, p=0.53, P*=0.44, and med diff=4.3, IQR=24.8, p=0.48, P*=0.62, respectively). Inter-rater reliability indicated weighted kappa ranged between 0.14 for Direction to 0.51 for Collaboration and ICC ranged between 0.28 for Simple reflection to 0.95 for Closed question. Test-retests indicated weighted kappa ranged between 0.27 for Direction to 0.80 for Empathy and ICC ranged between 0.87 for Complex reflection to 0.98 for Closed question. Conclusion: This pilot study indicated that an 8-hour training in MI for voluntary 4th year medical students resulted in significant improvement of MI skills. Larger sample of unselected medical students should be studied to generalize the benefit of MI training to medical students. Interrater reliability and test-retests suggested that coders' training should be intensified.

Relative and absolute reliability of the clinical version of the Narrow Path Walking Test (NPWT) under single and dual task conditions.

Decline in gait stability has been associated with increased fall risk in older adults. Reliable and clinically feasible methods of gait instability assessment are needed. This study evaluated the relative and absolute reliability and concurrent validity of the testing procedure of the clinical version of the Narrow Path Walking Test (NPWT) under single task (ST) and dual task (DT) conditions. Thirty independent community-dwelling older adults (65-87 years) were tested twice. Participants were instructed to walk within the 6-m narrow path without stepping out. Trial time, number of steps, trial velocity, number of step errors, and number of cognitive task errors were determined. Intraclass correlation coefficients (ICCs) were calculated as indices of agreement, and a graphic approach called "mountain plot" was applied to help interpret the direction and magnitude of disagreements between testing procedures. Smallest detectable change and smallest real difference (SRD) were computed to determine clinically relevant improvement at group and individual levels, respectively. Concurrent validity was assessed using Performance Oriented Mobility Assessment Tool (POMA) and the Short Physical Performance Battery (SPPB). Test-retest agreement (ICC1,2) varied from 0.77 to 0.92 in ST and from 0.78 to 0.92 in DT conditions, with no apparent systematic differences between testing procedures demonstrated by the mountain plot graphs. Smallest detectable change and smallest real change were small for motor task performance and larger for cognitive errors. Significant correlations were observed for trial velocity and trial time with POMA and SPPB. The present results indicate that the NPWT testing procedure is highly reliable and reproducible.

Teaching Motivational Interviewing to Medical Students to Improve Behavior Change Counseling Skills - Results of a Pilot Test

BACKGROUND: Patient behavior accounts for half or more of the variance in health, disease, mortality and treatment outcome and costs. Counseling using motivational interviewing (MI) effectively improves the substance use and medical compliance behavior of patients. Medical training should include substantial focus on this key issue of health promotion. The objective of the study is to test the efficacy of teaching MI to medical students. METHODS: Thirteen fourth-year medical students volunteered to participate. Seven days before and after an 8-hour interactive MI training workshop, each student performed a video-recorded interview with two standardized patients: a 60 year-old alcohol dependent female consulting a primary care physician for the first time about fatigue and depression symptoms; and a 50 year-old male cigarette smoker hospitalized for myocardial infarction. All 52 videos (13 students×2 interviews before and after training) were independently coded by two blinded clinicians using the Motivational Interviewing Training Integrity (MITI, 3.0). MITI scores consist of global spirit (Evocation, Collaboration, Autonomy/Support), global Empathy and Direction, and behavior count summary scores (% Open questions, Reflection to question ratio, % Complex reflections, % MI-adherent behaviors). A "beginning proficiency" threshold (BPT) is defined for each of these 9 scores. The proportion of students reaching BPT before and after training was compared using McNemar exact tests. Inter-rater reliability was evaluated by comparing double coding, and test-retest analyses were conducted on a sub-sample of 10 consecutive interviews by each coder. Weighted Kappas were used for global rating scales and intra-class correlations (ICC) were computed for behavior count summary scores. RESULTS: The percent of counselors reaching BPT before and after MI training increased significantly for Evocation (15% to 65%, p<.001), Collaboration (27% to 77%, p=.001), Autonomy/Support (15% to 54%, p=.006), and % Open questions (4% to 38%, p=.004). Proportions increased, but were not statistically significant for Empathy (38% to 58%, p=.18), Reflection to question ratio (0% to 15%, p=.12), % Complex reflection (35% to 54%, p=.23), and % MI-adherent behaviors (8% to 15%, p=.69). There was virtually no change for the Direction scale (92% to 88%, p=1.00). The reliability analyses produced mixed results. Weighted kappas for inter-rater reliability ranged from .14 for Direction to .51 for Collaboration, and from .27 for Direction to .80 for Empathy for test-retest. ICCs ranged from .20 for Complex reflections to .89 for Open questions (inter-rater), and from .67 for Complex reflections to .99 for Reflection to question ratio (test-retest). CONCLUSION: This pilot study indicates that a single 8-hour training in motivational interviewing for voluntary fourth-year medical students results in significant improvement of some MI skills. A larger sample of randomly selected medical students observed over longer periods should be studied to test if MI training generalizes to medical students. Inter-rater reliability and test-retest findings indicate a need for caution when interpreting the present results, as well as for more intensive training to help appropriately capture more dimensions of the process in future studies.

Validation de la version française du questionnaire I7 d'impulsivité. Influence de la personnalité, du sexe et de la religion = Validation of the french version of the eysenck's impulsiveness questionnaire (I7). Influence of personality, gender, and religion

L'objectif de cette étude est de vérifier la validité interne de la version française du questionnaire d'impulsivité d'Eysenck (I7), traduite par Dupont et al., sur un échantillon d'étudiants suisses (n = 220). Dans leur questionnaire, Eysenck et Eysenck proposent trois échelles : les deux premières évaluant deux composantes distinctes de l'impulsivité (l'Impulsivité caractérisant les individus qui agissent sans penser, sans être conscients des risques associés à leurs actions, et la Recherche d'aventure caractérisant les individus qui agissent en étant conscients, et en tenant compte des risques associés à leurs actions), et la troisième servant de « distracteur » (l'Empathie caractérisant les individus qui ont la faculté de s'identifier à l'autre). La structure à trois facteurs de l'instrument a été confirmée par notre analyse factorielle en composantes principales. La solution factorielle retenue n'explique toutefois qu'une faible proportion de la variance (21.9 %). L'homogénéité interne des échelles, mesurée à l'aide d'alphas de Cronbach, est acceptable pour l'échelle d'Impulsivité (.78) et de Recherche d'aventure (.71), mais elle est, en revanche, faible pour l'échelle d'Empathie (.62). Les échelles de l'I7 d'Eysenck entretiennent des corrélations cohérentes avec les cinq grandes dimensions de la personnalité mesurées par le NEO PI-R. L'Impulsivité est associée négativement à la dimension Conscience (r = - .32), alors que la Recherche d'aventures est associée positivement à la dimension Extraversion (r = .33). Le sexe a un impact sur les échelles Recherche d'aventure et Empathie. Les qualités métrologiques de la version française du questionnaire d'impulsivité d'Eysenck (I7) sont satisfaisantes, mais l'estimation d'autres indices de validité, comme la fidélité test-retest et la validité convergente, devrait être réalisée.

Is there a common factor for vision?

In cognition, common factors play a crucial role. For example, different types of intelligence are highly correlated, pointing to a common factor, which is often called g. One might expect that a similar common factor would also exist for vision. Surprisingly, no one in the field has addressed this issue. Here, we provide the first evidence that there is no common factor for vision. We tested 40 healthy students' performance in six basic visual paradigms: visual acuity, vernier discrimination, two visual backward masking paradigms, Gabor detection, and bisection discrimination. One might expect that performance levels on these tasks would be highly correlated because some individuals generally have better vision than others due to superior optics, better retinal or cortical processing, or enriched visual experience. However, only four out of 15 correlations were significant, two of which were nontrivial. These results cannot be explained by high intraobserver variability or ceiling effects because test-retest reliability was high and the variance in our student population is commensurate with that from other studies with well-sighted populations. Using a variety of tests (e.g., principal components analysis, Bayes theorem, test-retest reliability), we show the robustness of our null results. We suggest that neuroplasticity operates during everyday experience to generate marked individual differences. Our results apply only to the normally sighted population (i.e., restricted range sampling). For the entire population, including those with degenerate vision, we expect different results.

3D gait assessment in young and elderly subjects using foot-worn inertial sensors.

This study describes the validation of a new wearable system for assessment of 3D spatial parameters of gait. The new method is based on the detection of temporal parameters, coupled to optimized fusion and de-drifted integration of inertial signals. Composed of two wirelesses inertial modules attached on feet, the system provides stride length, stride velocity, foot clearance, and turning angle parameters at each gait cycle, based on the computation of 3D foot kinematics. Accuracy and precision of the proposed system were compared to an optical motion capture system as reference. Its repeatability across measurements (test-retest reliability) was also evaluated. Measurements were performed in 10 young (mean age 26.1±2.8 years) and 10 elderly volunteers (mean age 71.6±4.6 years) who were asked to perform U-shaped and 8-shaped walking trials, and then a 6-min walking test (6MWT). A total of 974 gait cycles were used to compare gait parameters with the reference system. Mean accuracy±precision was 1.5±6.8cm for stride length, 1.4±5.6cm/s for stride velocity, 1.9±2.0cm for foot clearance, and 1.6±6.1° for turning angle. Difference in gait performance was observed between young and elderly volunteers during the 6MWT particularly in foot clearance. The proposed method allows to analyze various aspects of gait, including turns, gait initiation and termination, or inter-cycle variability. The system is lightweight, easy to wear and use, and suitable for clinical application requiring objective evaluation of gait outside of the lab environment.