Discriminant validity and test-retest reliability of a self-administered Internet-based questionnaire testing doctors' knowledge in evidence-based medicine.

Aims and objectives  This study aimed to determine the discriminant validity and the test-retest reliability of a questionnaire testing the impact of evidence-based medicine (EBM) training on doctors' knowledge and skills. Methods  Questionnaires were sent electronically to all doctors working as residents and chief residents in two French speaking hospital networks in Switzerland. Participants completed the questionnaire twice, within a 4-week interval. The discriminant validity was examined in comparing doctors' performance according to their reported EBM previous training. Proportion of agreement between both sessions of the questionnaire, Cohen's kappa and 'uniform kappa' determined its test-retest reliability. Results  The participation rate was 9.8%/7.1% to first/second session. Performance increased according to the level of doctors' previous training in EBM. The observed proportion of agreement between both sessions was over 70% for 14/19 questions, and the 'uniform kappa' was superior to 0.60 for 15/19 questions. Conclusion  The discriminant validity and test-retest reliability of the questionnaire were satisfying. The low participation rate did not prevent the study from achieving its aims.

Teaching motivational interviewing to medical students : a pre-post test pilot study

Objective: To test the efficacy of teaching motivational interviewing (MI) to medical students. Methods: Thirteen 4th year medical students volunteered to participate. Seven days before and 7 days after an 8-hour interactive training MI workshop, each student performed a videorecorded interview with two standardized patients: a 60 year old alcohol dependent woman and a 50 year old cigarette smoking man. Students' counseling skills were coded by two blinded clinicians using the Motivational Interviewing Treatment Integrity 3.0 (MITI). Inter-rater reliability was calculated for all interviews and a test-retest was completed in a sub-sample of 10 consecutive interviews three days apart. Difference between MITI scores before and after training were calculated and tested using non-parametric tests. Effect size was approximated by calculating the probability that posttest scores are greater than pretest scores (P*=P(Pre<Post)+1/2P(Pre=Post)), P*>1/2 indicating greater scores in posttest, P*=1/2 no effect, and P*<1/2 smaller scores in posttest. Results: Median differences between MITI scores before and after MI training indicated a general progression in MI skills: MI spirit global score (median difference=1.5, Inter quartile range=1.5, p<0.001, P*=0.90); Empathy global score (med diff=1, IQR=0.5, p<0.001, P*=0.85); Percentage of MI adherent skills (med diff=36.6, IQR=50.5, p<0.001, P*=0.85); Percentage of open questions (med diff=18.6, IQR=21.6, p<0.001, P*=0.96); reflections/ questions ratio (med diff=0.2, IQR=0.4, p<0.001, P*=0.81). Only Direction global score and the percentage of complex reflections were not significantly improved (med diff=0, IQR=1, p=0.53, P*=0.44, and med diff=4.3, IQR=24.8, p=0.48, P*=0.62, respectively). Inter-rater reliability indicated weighted kappa ranged between 0.14 for Direction to 0.51 for Collaboration and ICC ranged between 0.28 for Simple reflection to 0.95 for Closed question. Test-retests indicated weighted kappa ranged between 0.27 for Direction to 0.80 for Empathy and ICC ranged between 0.87 for Complex reflection to 0.98 for Closed question. Conclusion: This pilot study indicated that an 8-hour training in MI for voluntary 4th year medical students resulted in significant improvement of MI skills. Larger sample of unselected medical students should be studied to generalize the benefit of MI training to medical students. Interrater reliability and test-retests suggested that coders' training should be intensified.

Effect of Lactobacillus paracasei ST11 on a nasal provocation test with grass pollen in allergic rhinitis.

Cite this as: J. Wassenberg, S. Nutten, R. Audran, N. Barbier, V. Aubert, J. Moulin, A. Mercenier and F. Spertini, Clinical & Experimental Allergy, 2011 (41) 565-573. SUMMARY: Background Probiotics have been associated with prevention and improvement of symptoms in atopic diseases such as atopic dermatitis. However, few studies exist that document their efficacy for upper airways allergies such as allergic rhinitis. Objective To investigate the effect of short-term oral administration of Lactobacillus paracasei ST11 on a nasal provocation test (NPT) with grass pollen. Methods Thirty-one adult volunteers with allergic rhinitis were enrolled in a randomized, double-blind, placebo-controlled study, based on two 4-week cross-over periods of product consumption (ST11-fermented milk vs. placebo), separated by a wash-out period of 6-8 weeks. Objective and subjective clinical parameters of NPT as well as systemic and nasal immunological parameters were compared between the two treatment periods (registration number: NCT 011 50 253). Results Subjects that received ST11-fermented milk had lower nasal congestion than subjects under placebo (visual analogical scale; P<0.05). Nasal pruritus followed the same trend. However, no significant change in combined nasal reaction threshold was observed between the two periods. IL-5 secretion by peripheral blood mononuclear cells and serum allergen-specific IgG4 were significantly lower in ST11-fermented milk group compared to placebo group. IL-8 and IL-10 secretion followed the same trend. Conclusion and Clinical Relevance Short-term treatment with ST11-fermented milk before NPT significantly improved a clinical marker of NPT (subjective nasal congestion) and down-regulated systemic immune markers (IL-5 from peripheral blood mononuclear cells and serum IgG4). These data strongly suggest that probiotics may down modulate key parameters of allergic rhinitis and warrant future evaluation in seasonal trials.

Examining the Agreement of Structural Loss Measured With Heidelberg Retinal Tomograhy and Functional Loss With Standard Automated Perimetry (SAP; Octopus), Pulsar Perimetry (PP), and Moorfields Motion Displacement Test (MDT) Perimetry

Purpose: To examine the relationship of functional measurements with structural measures. Methods: 146 eyes of 83 test subjects underwent Heidelberg Retinal Tomography (HRTIII) (disc area<2.43, mphsd<40), and perimetry testing with Octopus (SAP; Dynamic), Pulsar (PP; TOP) and Moorfields MDT (ESTA). Glaucoma was defined as progressive structural or functional loss (20 eyes). Perimetry test points were grouped into 6 sectors based on the estimated optic nerve head angle into which the associated nerve fiber bundle enters (Garway-Heath map). Perimetry summary measures (PSM) (MD SAP/ MD PP/ PTD MDT) were calculated from the average total deviation of each measured threshold from the normal for each sector. We calculated the 95% significance level of the sectorial PSM from the respective normative data. We calculated the percentage agreement with group1 (G1), healthy on HRT and within normal perimetric limits, and group 2 (G2), abnormal on HRT and outside normal perimetric limits. We also examined the relationship of PSM and rim area (RA) in those sectors classified as abnormal by MRA (Moorfields Regression Analysis) of HRT. Results: The mean age was 65 (range= [37, 89]). The global sensitivity versus specificity of each instrument in detecting glaucomatous eyes was: MDT 80% vs. 88%, SAP 80% vs. 80%, PP 70% vs. 89% and HRT 80% vs. 79%. Highest percentage agreement of HRT (respectively G1, G2, sector) with PSM were MDT (89%, 57%, nasal superior), SAP (83%, 74%, temporal superior), PP (74%, 63%, nasal superior). Globally percentage agreement (respectively G1, G2) was MDT (92%, 28%), SAP (87%, 40%) and PP (77%, 49%). Linear regression showed there was no significant trend globally associating RA and PSM. However, sectorally the supero-nasal sector had a statistically significant (p<0.001) trend with each instrument, the associated r2 coefficients are (MDT 0.38 SAP 0.56 and PP 0.39). Conclusions: There were no significant differences in global sensitivity or specificity between instruments. Structure-function relationships varied significantly between instruments and were consistently strongest supero-nasally. Further studies are required to investigate these relationships in detail.

Revising the Cannabis Use Disorders Identification Test (CUDIT) by means of Item Response Theory.

Cannabis use among adolescents and young adults has become a major public health challenge. Several European countries are currently developing short screening instruments to identify 'problematic' forms of cannabis use in general population surveys. One such instrument is the Cannabis Use Disorders Identification Test (CUDIT), a 10-item questionnaire based on the Alcohol Use Disorders Identification Test. Previous research found that some CUDIT items did not perform well psychometrically. In the interests of improving the psychometric properties of the CUDIT, this study replaces the poorly performing items with new items that specifically address cannabis use. Analyses are based on a sub-sample of 558 recent cannabis users from a representative population sample of 5722 individuals (aged 13-32) who were surveyed in the 2007 Swiss Cannabis Monitoring Study. Four new items were added to the original CUDIT. Psychometric properties of all 14 items, as well as the dimensionality of the supplemented CUDIT were then examined using Item Response Theory. Results indicate the unidimensionality of CUDIT and an improvement in its psychometric performance when three original items (usual hours being stoned; injuries; guilt) are replaced by new ones (motives for using cannabis; missing out leisure time activities; difficulties at work/school). However, improvements were limited to cannabis users with a high problem score. For epidemiological purposes, any further revision of CUDIT should therefore include a greater number of 'easier' items.

Relative and absolute reliability of the clinical version of the Narrow Path Walking Test (NPWT) under single and dual task conditions.

Decline in gait stability has been associated with increased fall risk in older adults. Reliable and clinically feasible methods of gait instability assessment are needed. This study evaluated the relative and absolute reliability and concurrent validity of the testing procedure of the clinical version of the Narrow Path Walking Test (NPWT) under single task (ST) and dual task (DT) conditions. Thirty independent community-dwelling older adults (65-87 years) were tested twice. Participants were instructed to walk within the 6-m narrow path without stepping out. Trial time, number of steps, trial velocity, number of step errors, and number of cognitive task errors were determined. Intraclass correlation coefficients (ICCs) were calculated as indices of agreement, and a graphic approach called "mountain plot" was applied to help interpret the direction and magnitude of disagreements between testing procedures. Smallest detectable change and smallest real difference (SRD) were computed to determine clinically relevant improvement at group and individual levels, respectively. Concurrent validity was assessed using Performance Oriented Mobility Assessment Tool (POMA) and the Short Physical Performance Battery (SPPB). Test-retest agreement (ICC1,2) varied from 0.77 to 0.92 in ST and from 0.78 to 0.92 in DT conditions, with no apparent systematic differences between testing procedures demonstrated by the mountain plot graphs. Smallest detectable change and smallest real change were small for motor task performance and larger for cognitive errors. Significant correlations were observed for trial velocity and trial time with POMA and SPPB. The present results indicate that the NPWT testing procedure is highly reliable and reproducible.

Geophysical Investigations for Hydrogeological Characterization at the Kappelen Test Site (Switzerland)

Vertical electric soundings, 2D resistivity imaging and several logging measurements were performed at Kappelen test site to identify the various geolelectric facies that allowed determining the tabular and horizontal structure of the aquifer. The surface-based geoelectric methods allowed for a reliable characterization of the overall structure and the geometry of the aquifer, while geophysical logging methods allowed for inferring detailed hydrogeophysical characteristics, such as the electrical resistivity, total porosity, global and matrix density and hydraulic conductivity. The synoptic interpretation and integration of this broad and diverse database allows for constraining the key hydrological characteristics and hence forms the basis for the detailed hydraulic modelling of flow and transport process.

Test of four colon cancer risk-scores in formalin fixed paraffin embedded microarray gene expression data.

BACKGROUND: Prognosis prediction for resected primary colon cancer is based on the T-stage Node Metastasis (TNM) staging system. We investigated if four well-documented gene expression risk scores can improve patient stratification. METHODS: Microarray-based versions of risk-scores were applied to a large independent cohort of 688 stage II/III tumors from the PETACC-3 trial. Prognostic value for relapse-free survival (RFS), survival after relapse (SAR), and overall survival (OS) was assessed by regression analysis. To assess improvement over a reference, prognostic model was assessed with the area under curve (AUC) of receiver operating characteristic (ROC) curves. All statistical tests were two-sided, except the AUC increase. RESULTS: All four risk scores (RSs) showed a statistically significant association (single-test, P < .0167) with OS or RFS in univariate models, but with HRs below 1.38 per interquartile range. Three scores were predictors of shorter RFS, one of shorter SAR. Each RS could only marginally improve an RFS or OS model with the known factors T-stage, N-stage, and microsatellite instability (MSI) status (AUC gains < 0.025 units). The pairwise interscore discordance was never high (maximal Spearman correlation = 0.563) A combined score showed a trend to higher prognostic value and higher AUC increase for OS (HR = 1.74, 95% confidence interval [CI] = 1.44 to 2.10, P < .001, AUC from 0.6918 to 0.7321) and RFS (HR = 1.56, 95% CI = 1.33 to 1.84, P < .001, AUC from 0.6723 to 0.6945) than any single score. CONCLUSIONS: The four tested gene expression-based risk scores provide prognostic information but contribute only marginally to improving models based on established risk factors. A combination of the risk scores might provide more robust information. Predictors of RFS and SAR might need to be different.

A new blood-based screening test for colorectal cancer: a pilot study

Background: Colorectal cancer (CRC) can be cured when diagnosed in its early or precancerous (adenoma) stages. Mostly due to poor compliance towards invasive screening procedures, detection rates for adenoma and early CRCs are still low. Available non-invasive screening tests have unfortunately low sensitivity and specificity performances. Therefore, there is a large unmet need calling for a cost-effective, reliable and non-invasive test to screen for early neoplastic and pre-neoplastic lesions. Objective: To develop a routine screening test based on a nucleic acids multi-gene assay performed on peripheral blood mononuclear cells (PBMCs) that can detect early CRCs and adenomas. Methods: 116 patients (mean age: 55 years; range: 18 to 74 years; female/male ration 0.98) were included in this pilot, nonblinded, colonoscopy-controlled study. Colonoscopy revealed 21 patients with CRC, 30 patients with adenoma bigger than 1 cm, 24 patients with inflammatory bowel disease (IBD) and 41 patients had no neoplastic or inflammatory lesions. Blood samples were taken from each patient the day of the colonoscopy and PBMCs were purified. Total RNA was extracted following standard procedures. Multiplex RT-qPCR was applied on 92 different candidate biomarkers. Different univariate and multivariate statistical methods were applied on these candidates, and among them, 57 biomarkers with significant p values (<0.01, Wilcoxon test) were selected, including ADAMTS1, MMP9, CXCL10, CXCR4, VEGFA and CDH1. Two distinct biomarker signatures are used to separate patients without neoplastic lesion from those with cancer (named COLOX 1 test), respectively from those with adenoma (named COLOX 2 test). Result: COLOX 1 and 2 tests have successfully separated patients without neoplastic lesion from those with CRC (sensitivity 70%, specificity 90%, AUC 0.88), respectively from those with adenoma bigger than 1cm (sensitivity 61%, specificity 80%, AUC 0.80). 6/24 patients in the IBD group have a positive COLOX 1 test. Conclusion: These two COLOX tests demonstrated an acceptable sensitivity and a high specificity to detect the presence of CRCs and adenomas bigger than 1 cm. The false positives COLOX 1 test in IBD patients could possibly be due to the chronic inflammatory state. A prospective, multicenter, pivotal study is underway in order to confirm these promising results in a larger cohort.

The trail making test as a screening instrument for driving performance in older drivers; a translational research.

BACKGROUND: In many countries, primary care physicians determine whether or not older drivers are fit to drive. Little, however, is known regarding the effects of cognitive decline on driving performance and the means to detect it. This study explores to what extent the trail making test (TMT) can provide indications to clinicians about their older patients' on-road driving performance in the context of cognitive decline. METHODS: This translational study was nested within a cohort study and an exploratory psychophysics study. The target population of interest was constituted of older drivers in the absence of important cognitive or physical disorders. We therefore recruited and tested 404 home-dwelling drivers, aged 70 years or more and in possession of valid drivers' licenses, who volunteered to participate in a driving refresher course. Forty-five drivers also agreed to undergo further testing at our lab. On-road driving performance was evaluated by instructors during a 45 minute validated open-road circuit. Drivers were classified as either being excellent, good, moderate, or poor depending on their score on a standardized evaluation of on-road driving performance. RESULTS: The area under the receiver operator curve for detecting poorly performing drivers was 0.668 (CI95% 0.558 to 0.778) for the TMT-A, and 0.662 (CI95% 0.542 to 0.783) for the TMT-B. TMT was related to contrast sensitivity, motion direction, orientation discrimination, working memory, verbal fluency, and literacy. Older patients with a TMT-A ≥ 54 seconds or a TMT-B ≥ 150 seconds have a threefold (CI95% 1.3 to 7.0) increased risk of performing poorly during the on-road evaluation. TMT had a sensitivity of 63.6%, a specificity of 64.9%, a positive predictive value of 9.5%, and a negative predictive value of 96.9%. CONCLUSION: In screening settings, the TMT would have clinicians uselessly consider driving cessation in nine drivers out of ten. Given the important negative impact this could have on older drivers, this study confirms the TMT not to be specific enough for clinicians to justify driving cessation without complementary investigations on driving behaviors.

Comparison of the interobserver variability of 2 different methods of dietary assessment in a geriatric ward: a pilot study.

BACKGROUND: Protein-energy malnutrition is highly prevalent in aged populations. Associated clinical, economic, and social burden is important. A valid screening method that would be robust and precise, but also easy, simple, and rapid to apply, is essential for adequate therapeutic management. OBJECTIVES: To compare the interobserver variability of 2 methods measuring food intake: semiquantitative visual estimations made by nurses versus calorie measurements performed by dieticians on the basis of standardized color digital photographs of servings before and after consumption. DESIGN: Observational monocentric pilot study. SETTING/PARTICIPANTS: A geriatric ward. The meals were randomly chosen from the meal tray. The choice was anonymous with respect to the patients who consumed them. MEASUREMENTS: The test method consisted of the estimation of calorie consumption by dieticians on the basis of standardized color digital photographs of servings before and after consumption. The reference method was based on direct visual estimations of the meals by nurses. Food intake was expressed in the form of a percentage of the serving consumed and calorie intake was then calculated by a dietician based on these percentages. The methods were applied with no previous training of the observers. Analysis of variance was performed to compare their interobserver variability. RESULTS: Of 15 meals consumed and initially examined, 6 were assessed with each method. Servings not consumed at all (0% consumption) or entirely consumed by the patient (100% consumption) were not included in the analysis so as to avoid systematic error. The digital photography method showed higher interobserver variability in calorie intake estimations. The difference between the compared methods was statistically significant (P < .03). CONCLUSIONS: Calorie intake measures for geriatric patients are more concordant when estimated in a semiquantitative way. Digital photography for food intake estimation without previous specific training of dieticians should not be considered as a reference method in geriatric settings, as it shows no advantages in terms of interobserver variability.

Passive knee-extension test to measure hamstring tightness: influence of gravity correction

CONTEXT: A passive knee-extension test has been shown to be a reliable method of assessing hamstring tightness, but this method does not take into account the potential effect of gravity on the tested leg. OBJECTIVE: To compare an original passive knee-extension test with 2 adapted methods including gravity's effect on the lower leg. DESIGN: Repeated measures. SETTING: Laboratory. PARTICIPANTS: 20 young track and field athletes (16.6 ± 1.6 y, 177.6 ± 9.2 cm, 75.9 ± 24.8 kg). INTERVENTION: Each subject was tested in a randomized order with 3 different methods: In the original one (M1), passive knee angle was measured with a standard force of 68.7 N (7 kg) applied proximal to the lateral malleolus. The second (M2) and third (M3) methods took into account the relative lower-leg weight (measured respectively by handheld dynamometer and anthropometrical table) to individualize the force applied to assess passive knee angle. MAIN OUTCOME MEASURES: Passive knee angles measured with video-analysis software. RESULTS: No difference in mean individualized applied force was found between M2 and M3, so the authors assessed passive knee angle only with M2. The mean knee angle was different between M1 and M2 (68.8 ± 12.4 vs 73.1 ± 10.6, P < .001). Knee angles in M1 and M2 were correlated (r = .93, P < .001). CONCLUSIONS: Differences in knee angle were found between the original passive knee-extension test and a method with gravity correction. M2 is an improved version of the original method (M1) since it minimizes the effect of gravity. Therefore, we recommend using it rather than M1.

How to screen for problematic cannabis use in population surveys: an evaluation of the Cannabis Use Disorders Identification Test (CUDIT) in a Swiss sample of adolescents and young adults.

BACKGROUND/AIMS: Cannabis use is a growing challenge for public health, calling for adequate instruments to identify problematic consumption patterns. The Cannabis Use Disorders Identification Test (CUDIT) is a 10-item questionnaire used for screening cannabis abuse and dependency. The present study evaluated that screening instrument. METHODS: In a representative population sample of 5,025 Swiss adolescents and young adults, 593 current cannabis users replied to the CUDIT. Internal consistency was examined by means of Cronbach's alpha and confirmatory factor analysis. In addition, the CUDIT was compared to accepted concepts of problematic cannabis use (e.g. using cannabis and driving). ROC analyses were used to test the CUDIT's discriminative ability and to determine an appropriate cut-off. RESULTS: Two items ('injuries' and 'hours being stoned') had loadings below 0.5 on the unidimensional construct and correlated lower than 0.4 with the total CUDIT score. All concepts of problematic cannabis use were related to CUDIT scores. An ideal cut-off between six and eight points was found. CONCLUSIONS: Although the CUDIT seems to be a promising instrument to identify problematic cannabis use, there is a need to revise some of its items.

A test of Jessor's problem behavior theory in a Eurasian and a Western European developmental context.

PURPOSE: The current study tested the applicability of Jessor's problem behavior theory (PBT) in national probability samples from Georgia and Switzerland. Comparisons focused on (1) the applicability of the problem behavior syndrome (PBS) in both developmental contexts, and (2) on the applicability of employing a set of theory-driven risk and protective factors in the prediction of problem behaviors. METHODS: School-based questionnaire data were collected from n = 18,239 adolescents in Georgia (n = 9499) and Switzerland (n = 8740) following the same protocol. Participants rated five measures of problem behaviors (alcohol and drug use, problems because of alcohol and drug use, and deviance), three risk factors (future uncertainty, depression, and stress), and three protective factors (family, peer, and school attachment). Final study samples included n = 9043 Georgian youth (mean age = 15.57; 58.8% females) and n = 8348 Swiss youth (mean age = 17.95; 48.5% females). Data analyses were completed using structural equation modeling, path analyses, and post hoc z-tests for comparisons of regression coefficients. RESULTS: Findings indicated that the PBS replicated in both samples, and that theory-driven risk and protective factors accounted for 13% and 10% in Georgian and Swiss samples, respectively in the PBS, net the effects by demographic variables. Follow-up z-tests provided evidence of some differences in the magnitude, but not direction, in five of six individual paths by country. CONCLUSION: PBT and the PBS find empirical support in these Eurasian and Western European samples; thus, Jessor's theory holds value and promise in understanding the etiology of adolescent problem behaviors outside of the United States.