Validity and reliability of the German version of the short understanding of substance abuse scale

This paper presents the German version of the Short Understanding of Substance Abuse Scale (SUSS) [Humphreys et al.: Psychol Addict Behav 1996;10:38-44], the Verstandnis von Storungen durch Substanzkonsum (VSS), and evaluates its psychometric properties. The VSS assesses clinicians' beliefs about the nature and treatment of substance use disorders, particularly their endorsement of psychosocial and disease orientation. The VSS was administered to 160 treatment staff members at 12 substance use disorder treatment programs in the German-speaking part of Switzerland. Because the confirmatory factor analysis of the VSS did not completely replicate the factorial structure of the SUSS, an exploratory factor analysis was undertaken. This analysis identified two factors: the Psychosocial model factor and a slightly different Disease model factor. The VSS Disease and Psychosocial subscales showed convergent and discriminant validity, as well as sufficient reliability.

Reliability of radiologic assessment of the fracture anatomy at the posterior tibial plafond in malleolar fractures

The aim of this study was to assess the ability to extract surgically relevant information from plain radiographs in trimalleolar fractures and to compare this with the information gathered from computed tomography (CT).

Reliability of intraoperative high-resolution 2D ultrasound as an alternative to high-field strength MR imaging for tumor resection control: a prospective comparative study

OBJECT: Ultrasound may be a reliable but simpler alternative to intraoperative MR imaging (iMR imaging) for tumor resection control. However, its reliability in the detection of tumor remnants has not been definitely proven. The aim of the study was to compare high-field iMR imaging (1.5 T) and high-resolution 2D ultrasound in terms of tumor resection control. METHODS: A prospective comparative study of 26 consecutive patients was performed. The following parameters were compared: the existence of tumor remnants after presumed radical removal and the quality of the images. Tumor remnants were categorized as: detectable with both imaging modalities or visible only with 1 modality. RESULTS: Tumor remnants were detected in 21 cases (80.8%) with iMR imaging. All large remnants were demonstrated with both modalities, and their image quality was good. Two-dimensional ultrasound was not as effective in detecting remnants<1 cm. Two remnants detected with iMR imaging were missed by ultrasound. In 2 cases suspicious signals visible only on ultrasound images were misinterpreted as remnants but turned out to be a blood clot and peritumoral parenchyma. The average time for acquisition of an ultrasound image was 2 minutes, whereas that for an iMR image was approximately 10 minutes. Neither modality resulted in any procedure-related complications or morbidity. CONCLUSIONS: Intraoperative MR imaging is more precise in detecting small tumor remnants than 2D ultrasound. Nevertheless, the latter may be used as a less expensive and less time-consuming alternative that provides almost real-time feedback information. Its accuracy is highest in case of more confined, deeply located remnants. In cases of more superficially located remnants, its role is more limited.

Reliability of evaluations for the choice of system solutions at the example of automated order-picking systems for bagged goods

There is a steadily increasing pressure on cost-savings and productivity growth in sectors of order-picking such that the wish for rationalization by automation is rising. Special problems are faced trying to automatize handling operations of order-picking articles packed in bags. The mechanical properties of the objects and their hard-to-predict shape and position represent obstacles and are complicating handling operations. A systematic approach in system design is required. This article deals with the properties of such products under aspects of difficulties arising in automated handling and points out a useful system development methodology.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: The design of Virtual Patients (VPs) is essential. So far there are no validated evaluation instruments for VP design published. Summary of work: We examined three sources of validity evidence of an instrument to be filled out by students aimed at measuring the quality of VPs with a special emphasis on fostering clinical reasoning: (1) Content was examined based on theory of clinical reasoning and an international VP expert team. (2) Response process was explored in think aloud pilot studies with students and content analysis of free text questions accompanying each item of the instrument. (3) Internal structure was assessed by confirmatory factor analysis (CFA) using 2547 student evaluations and reliability was examined utilizing generalizability analysis. Summary of results: Content analysis was supported by theory underlying Gruppen and Frohna’s clinical reasoning model on which the instrument is based and an international VP expert team. The pilot study and analysis of free text comments supported the validity of the instrument. The CFA indicated that a three factor model comprising 6 items showed a good fit with the data. Alpha coefficients per factor were 0,74 - 0,82. The findings of the generalizability studies indicated that 40-200 student responses are needed in order to obtain reliable data on one VP. Conclusions: The described instrument has the potential to provide faculty with reliable and valid information about VP design. Take-home messages: We present a short instrument which can be of help in evaluating the design of VPs.

Reliability of lithium dilution cardiac output in anaesthetized sheep

BACKGROUND: Cardiac output (CO) measurement with lithium dilution (COLD) has not been fully validated in sheep using precise ultrasonic flow probe technology (COUFP). Sheep generate important cardiovascular research models and the use of COLD has become more popular in experimental settings. METHODS: Ultrasonic transit-time perivascular flow probes were surgically implanted on the pulmonary artery of 13 sheep. Paired COLD readings were taken at six time points, before and after implantation of a left ventricular assist device (LVAD) and compared with COUFP recorded just after lithium injection. RESULTS: The mean COLD was 5.7 litre min(-1) (range 3.8-9.6 litre min(-1)) and mean COUFP 5.9 litre min(-1) (range 4.0-9.2 litre min(-1)). The bias (standard deviation) was 0.3 (1.0) litre min(-1) [5.1 (16.9)%] and limits of agreement (LOA) were -1.7 to 2.3 litre min(-1) (-28.8 to 39.0%) with a percentage error (PE) of 34.4%. Data to assess trending [rate (95% confidence intervals)] included a 78 (62-93)% concordance rate in the four-quadrant plot (n=27). In the half moon polar plot (n=19), the mean polar angle was +5°, the radial LOA were -49 to +35° and 68 (47-89)% of data points fell within 22.5° of the mean polar angle. Both tests indicated moderate to poor trending ability. CONCLUSION: COLD is not precise when evaluated against COUFP in sheep based on the statistical criteria set, but the results are comparable with previously published animal studies. KEYWORDS:

Low reliability of perceptual priming: consequences for the interpretation of functional dissociations between explicit and implicit memory

In this study, three experiments are presented that investigate the reliability of memory measures. In Experiment 1, the well-known dissociation between explicit (recall, recognition) and implicit memory (picture clarification) as a function of age in a sample of 335 persons aged between 65 and 95 was replicated. Test-retest reliability was significantly lower in implicit than in explicit measures. In Experiment 2, parallel-test reliabilities in a student sample confirmed the finding of Experiment 1. In Experiment 3, the reliability of cued recall and word stem completion was investigated. There were significant priming effects and a dissociation between explicit and implicit memory as a function of levels of processing. However, the reliability of implicit memory measures was again substantially lower than in explicit tests in all test conditions. As a consequence, differential reliabilities of direct and indirect memory tests should be considered as a possible determinant of dissociations between explicit and implicit memory as a function of experimental or quasi-experimental manipulations.

Intra-session test-retest reliability of pelvic floor muscle electromyography during running

INTRODUCTION AND HYPOTHESIS The prevalence of female stress urinary incontinence is high, and young adults are also affected, including athletes, especially those involved in "high-impact" sports. To date there have been almost no studies testing pelvic floor muscle (PFM) activity during dynamic functional whole body movements. The aim of this study was the description and reliability test of PFM activity and time variables during running. METHODS A prospective cross-sectional study including ten healthy female subjects was designed with the focus on the intra-session test-retest reliability of PFM activity and time variables during running derived from electromyography (EMG) and accelerometry. RESULTS Thirteen variables were identified based on ten steps of each subject: Six EMG variables showed good reliability (ICC 0.906-0.942) and seven time variables did not show good reliability (ICC 0.113-0.731). Time variables (e.g. time difference between heel strike and maximal acceleration of vaginal accelerator) showed low reliability. However, relevant PFM EMG variables during running (e.g., pre-activation, minimal and maximal activity) could be identified and showed good reliability. CONCLUSION Further adaptations regarding measurement methods should be tested to gain better control of the kinetics and kinematics of the EMG probe and accelerometers. To our knowledge this is the first study to test the reliability of PFM activity and time variables during dynamic functional whole body movements. More knowledge of PFM activity and time variables may help to provide a deeper insight into physical strain with high force impacts and important functional reflexive contraction patterns of PFM to maintain or to restore continence.

Functional connectivity in BOLD and CBF data: similarity and reliability of resting brain networks

Resting-state functional connectivity (FC) fMRI (rs-fcMRI) offers an appealing approach to mapping the brain's intrinsic functional organization. Blood oxygen level dependent (BOLD) and arterial spin labeling (ASL) are the two main rs-fcMRI approaches to assess alterations in brain networks associated with individual differences, behavior and psychopathology. While the BOLD signal is stronger with a higher temporal resolution, ASL provides quantitative, direct measures of the physiology and metabolism of specific networks. This study systematically investigated the similarity and reliability of resting brain networks (RBNs) in BOLD and ASL. A 2×2×2 factorial design was employed where each subject underwent repeated BOLD and ASL rs-fcMRI scans on two occasions on two MRI scanners respectively. Both independent and joint FC analyses revealed common RBNs in ASL and BOLD rs-fcMRI with a moderate to high level of spatial overlap, verified by Dice Similarity Coefficients. Test-retest analyses indicated more reliable spatial network patterns in BOLD (average modal Intraclass Correlation Coefficients: 0.905±0.033 between-sessions; 0.885±0.052 between-scanners) than ASL (0.545±0.048; 0.575±0.059). Nevertheless, ASL provided highly reproducible (0.955±0.021; 0.970±0.011) network-specific CBF measurements. Moreover, we observed positive correlations between regional CBF and FC in core areas of all RBNs indicating a relationship between network connectivity and its baseline metabolism. Taken together, the combination of ASL and BOLD rs-fcMRI provides a powerful tool for characterizing the spatiotemporal and quantitative properties of RBNs. These findings pave the way for future BOLD and ASL rs-fcMRI studies in clinical populations that are carried out across time and scanners.

Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a study protocol

BACKGROUND The Cochrane risk of bias (RoB) tool has been widely embraced by the systematic review community, but several studies have reported that its reliability is low. We aim to investigate whether training of raters, including objective and standardized instructions on how to assess risk of bias, can improve the reliability of this tool. We describe the methods that will be used in this investigation and present an intensive standardized training package for risk of bias assessment that could be used by contributors to the Cochrane Collaboration and other reviewers. METHODS/DESIGN This is a pilot study. We will first perform a systematic literature review to identify randomized clinical trials (RCTs) that will be used for risk of bias assessment. Using the identified RCTs, we will then do a randomized experiment, where raters will be allocated to two different training schemes: minimal training and intensive standardized training. We will calculate the chance-corrected weighted Kappa with 95% confidence intervals to quantify within- and between-group Kappa agreement for each of the domains of the risk of bias tool. To calculate between-group Kappa agreement, we will use risk of bias assessments from pairs of raters after resolution of disagreements. Between-group Kappa agreement will quantify the agreement between the risk of bias assessment of raters in the training groups and the risk of bias assessment of experienced raters. To compare agreement of raters under different training conditions, we will calculate differences between Kappa values with 95% confidence intervals. DISCUSSION This study will investigate whether the reliability of the risk of bias tool can be improved by training raters using standardized instructions for risk of bias assessment. One group of inexperienced raters will receive intensive training on risk of bias assessment and the other will receive minimal training. By including a control group with minimal training, we will attempt to mimic what many review authors commonly have to do, that is-conduct risk of bias assessment in RCTs without much formal training or standardized instructions. If our results indicate that an intense standardized training does improve the reliability of the RoB tool, our study is likely to help improve the quality of risk of bias assessments, which is a central component of evidence synthesis.