Can prospective usability evaluation predict data errors?

Increasing amounts of clinical research data are collected by manual data entry into electronic source systems and directly from research subjects. For this manual entered source data, common methods of data cleaning such as post-entry identification and resolution of discrepancies and double data entry are not feasible. However data accuracy rates achieved without these mechanisms may be higher than desired for a particular research use. We evaluated a heuristic usability method for utility as a tool to independently and prospectively identify data collection form questions associated with data errors. The method evaluated had a promising sensitivity of 64% and a specificity of 67%. The method was used as described in the literature for usability with no further adaptations or specialization for predicting data errors. We conclude that usability evaluation methodology should be further investigated for use in data quality assurance.

Assessment of patient setup errors in IGRT in combination with a six degrees of freedom couch

PURPOSE The range of patient setup errors in six dimensions detected in clinical routine for cranial as well as for extracranial treatments, were analyzed while performing linear accelerator based stereotactic treatments with frameless patient setup systems. Additionally, the need for re-verification of the patient setup for situations where couch rotations are involved was analyzed for patients treated in the cranial region. METHODS AND MATERIALS A total of 2185 initial (i.e. after pre-positioning the patient with the infrared system but before image guidance) patient setup errors (1705 in the cranial and 480 in the extracranial region) obtained by using ExacTrac (BrainLAB AG, Feldkirchen, Germany) were analyzed. Additionally, the patient setup errors as a function of the couch rotation angle were obtained by analyzing 242 setup errors in the cranial region. Before the couch was rotated, the patient setup error was corrected at couch rotation angle 0° with the aid of image guidance and the six degrees of freedom (6DoF) couch. For both situations attainment rates for two different tolerances (tolerance A: ± 0.5mm, ± 0.5°; tolerance B: ± 1.0 mm, ± 1.0°) were calculated. RESULTS The mean (± one standard deviation) initial patient setup errors for the cranial cases were -0.24 ± 1.21°, -0.23 ± 0.91° and -0.03 ± 1.07° for the pitch, roll and couch rotation axes and 0.10 ± 1.17 mm, 0.10 ± 1.62 mm and 0.11 ± 1.29 mm for the lateral, longitudinal and vertical axes, respectively. Attainment rate (all six axes simultaneously) for tolerance A was 0.6% and 13.1% for tolerance B, respectively. For the extracranial cases the corresponding values were -0.21 ± 0.95°, -0.05 ± 1.08° and -0.14 ± 1.02° for the pitch, roll and couch rotation axes and 0.15 ± 1.77 mm, 0.62 ± 1.94 mm and -0.40 ± 2.15 mm for the lateral, longitudinal and vertical axes. Attainment rate (all six axes simultaneously) for tolerance A was 0.0% and 3.1% for tolerance B, respectively. After initial setup correction and rotation of the couch to treatment position a re-correction has to be performed in 77.4% of all cases to fulfill tolerance A and in 15.6% of all cases to fulfill tolerance B. CONCLUSION The analysis of the data shows that all six axes of a 6DoF couch are used extensively for patient setup in clinical routine. In order to fulfill high patient setup accuracies (e.g. for stereotactic treatments), a 6DoF couch is recommended. Moreover, re-verification of the patient setup after rotating the couch is required in clinical routine.

Risk factors for patient-reported medical errors in eleven countries

OBJECTIVES The aim of this study was to identify common risk factors for patient-reported medical errors across countries. In country-level analyses, differences in risks associated with error between health care systems were investigated. The joint effects of risks on error-reporting probability were modelled for hypothetical patients with different health care utilization patterns. DESIGN Data from the Commonwealth Fund's 2010 lnternational Survey of the General Public's Views of their Health Care System's Performance in 11 Countries. SETTING Representative population samples of 11 countries were surveyed (total sample = 19,738 adults). Utilization of health care, coordination of care problems and reported errors were assessed. Regression analyses were conducted to identify risk factors for patients' reports of medical, medication and laboratory errors across countries and in country-specific models. RESULTS Error was reported by 11.2% of patients but with marked differences between countries (range: 5.4-17.0%). Poor coordination of care was reported by 27.3%. The risk of patient-reported error was determined mainly by health care utilization: Emergency care (OR = 1.7, P < 0.001), hospitalization (OR = 1.6, P < 0.001) and the number of providers involved (OR three doctors = 2.0, P < 0.001) are important predictors. Poor care coordination is the single most important risk factor for reporting error (OR = 3.9, P < 0.001). Country-specific models yielded common and country-specific predictors for self-reported error. For high utilizers of care, the probability that errors are reported rises up to P = 0.68. CONCLUSIONS Safety remains a global challenge affecting many patients throughout the world. Large variability exists in the frequency of patient-reported error across countries. To learn from others' errors is not only essential within countries but may also prove a promising strategy internationally.

Systematic diagonal and vertical errors in antisaccades and memory-guided saccades

Studies of memory-guided saccades in monkeys show an upward bias, while studies of antisaccades in humans show a diagonal effect, a deviation of endpoints toward the 45° diagonal. To determine if these two different spatial biases are specific to different types of saccades, we studied prosaccades, antisaccades and memory-guided saccades in humans. The diagonal effect occurred not with prosaccades but with antisaccades and memory-guided saccades with long intervals, consistent with hypotheses that it originates in computations of goal location under conditions of uncertainty. There was a small upward bias for memory-guided saccades but not prosaccades or antisaccades. Thus this bias is not a general effect of target uncertainty but a property specific to memory-guided saccades.

The impact of medical errors on Swiss anaesthesiologists: a cross-sectional survey.

BACKGROUND Clinicians involved in medical errors can experience significant distress. This study aims to examine (1) how medical errors impact anaesthesiologists in key work and life domains; (2) anaesthesiologists' attitudes regarding support after errors; (3) and which anaesthesiologists are most affected by errors. METHODS This study is a mailed cross-sectional survey completed by 281 of the 542 clinically active anaesthesiologists (52% response rate) working at Switzerland's five university hospitals between July 2012 and April 2013. RESULTS Respondents reported that errors had negatively affected anxiety about future errors (51%), confidence in their ability as a doctor (45%), ability to sleep (36%), job satisfaction (32%), and professional reputation (9%). Respondents' lives were more likely to be affected as error severity increased. Ninety per cent of respondents disagreed that hospitals adequately support them in coping with the stress associated with medical errors. Nearly all of the respondents (92%) reported being interested in psychological counselling after a serious error, but many identified barriers to seeking counselling. However, there were significant differences between departments regarding error-related stress levels and attitudes about error-related support. Respondents were more likely to experience certain distress if they were female, older, had previously been involved in a serious error, and were dissatisfied with their last error disclosure. CONCLUSION Medical errors, even minor errors and near misses, can have a serious effect on clinicians. Health-care organisations need to do more to support clinicians in coping with the stress associated with medical errors.

Disclosing and reporting medical errors: Cross-sectional survey of Swiss anaesthesiologists.

BACKGROUND There is limited research on anaesthesiologists' attitudes and experiences regarding medical error communication, particularly concerning disclosing errors to patients. OBJECTIVE To characterise anaesthesiologists' attitudes and experiences regarding disclosing errors to patients and reporting errors within the hospital, and to examine factors influencing their willingness to disclose or report errors. DESIGN Cross-sectional survey. SETTING Switzerland's five university hospitals' departments of anaesthesia in 2012/2013. PARTICIPANTS Two hundred and eighty-one clinically active anaesthesiologists. MAIN OUTCOME MEASURES Anaesthesiologists' attitudes and experiences regarding medical error communication. RESULTS The overall response rate of the survey was 52% (281/542). Respondents broadly endorsed disclosing harmful errors to patients (100% serious, 77% minor errors, 19% near misses), but also reported factors that might make them less likely to actually disclose such errors. Only 12% of respondents had previously received training on how to disclose errors to patients, although 93% were interested in receiving training. Overall, 97% of respondents agreed that serious errors should be reported, but willingness to report minor errors (74%) and near misses (59%) was lower. Respondents were more likely to strongly agree that serious errors should be reported if they also thought that their hospital would implement systematic changes after errors were reported [(odds ratio, 2.097 (95% confidence interval, 1.16 to 3.81)]. Significant differences in attitudes between departments regarding error disclosure and reporting were noted. CONCLUSION Willingness to disclose or report errors varied widely between hospitals. Thus, heads of department and hospital chiefs need to be aware of the importance of local culture when it comes to error communication. Error disclosure training and improving feedback on how error reports are being used to improve patient safety may also be important steps in increasing anaesthesiologists' communication of errors.

Sensitivity of the WRF model to PBL parametrisations and nesting techniques: evaluation of wind storms over complex terrain

Simulating surface wind over complex terrain is a challenge in regional climate modelling. Therefore, this study aims at identifying a set-up of the Weather Research and Forecasting Model (WRF) model that minimises system- atic errors of surface winds in hindcast simulations. Major factors of the model configuration are tested to find a suitable set-up: the horizontal resolution, the planetary boundary layer (PBL) parameterisation scheme and the way the WRF is nested to the driving data set. Hence, a number of sensitivity simulations at a spatial resolution of 2 km are carried out and compared to observations. Given the importance of wind storms, the analysis is based on case studies of 24 historical wind storms that caused great economic damage in Switzerland. Each of these events is downscaled using eight different model set-ups, but sharing the same driving data set. The results show that the lack of representation of the unresolved topography leads to a general overestimation of wind speed in WRF. However, this bias can be substantially reduced by using a PBL scheme that explicitly considers the effects of non-resolved topography, which also improves the spatial structure of wind speed over Switzerland. The wind direction, although generally well reproduced, is not very sensitive to the PBL scheme. Further sensitivity tests include four types of nesting methods: nesting only at the boundaries of the outermost domain, analysis nudging, spectral nudging, and the so-called re-forecast method, where the simulation is frequently restarted. These simulations show that restricting the freedom of the model to develop large-scale disturbances slightly increases the temporal agreement with the observations, at the same time that it further reduces the overestimation of wind speed, especially for maximum wind peaks. The model performance is also evaluated in the outermost domains, where the resolution is coarser. The results demonstrate the important role of horizontal resolution, where the step from 6 to 2 km significantly improves model performance. In summary, the combination of a grid size of 2 km, the non-local PBL scheme modified to explicitly account for non-resolved orography, as well as analysis or spectral nudging, is a superior combination when dynamical downscaling is aimed at reproducing real wind fields.

Minimum count sums for charcoalconcentration estimates in pollen slides: accuracy and potential errors

Charcoal particles in pollen slides are often abundant, and thus analysts are faced with the problem of setting the minimum counting sum as small as possible in order to save time. We analysed the reliability of charcoal-concentration estimates based on different counting sums, using simulated low-to high-count samples. Bootstrap simulations indicate that the variability of inferred charcoal concentrations increases progressively with decreasing sums. Below 200 items (i.e., the sum of charcoal particles and exotic marker grains), reconstructed fire incidence is either too high or too low. Statistical comparisons show that the means of bootstrap simulations stabilize after 200 counts. Moreover, a count of 200-300 items is sufficient to produce a charcoal-concentration estimate with less than+5% error if compared with high-count samples of 1000 items for charcoal/marker grain ratios 0.1-0.91. If, however, this ratio is extremely high or low (> 0.91 or < 0.1) and if such samples are frequent, we suggest that marker grains are reduced or added prior to new sample processing.

Time-order errors and standard-position effects in duration discrimination: An experimental study and an analysis by the sensation-weighting model

Studies have shown that the discriminability of successive time intervals depends on the presentation order of the standard (St) and the comparison (Co) stimuli. Also, this order affects the point of subjective equality. The first effect is here called the standard-position effect (SPE); the latter is known as the time-order error. In the present study, we investigated how these two effects vary across interval types and standard durations, using Hellström’s sensation-weighting model to describe the results and relate them to stimulus comparison mechanisms. In Experiment 1, four modes of interval presentation were used, factorially combining interval type (filled, empty) and sensory modality (auditory, visual). For each mode, two presentation orders (St–Co, Co–St) and two standard durations (100 ms, 1,000 ms) were used; half of the participants received correctness feedback, and half of them did not. The interstimulus interval was 900 ms. The SPEs were negative (i.e., a smaller difference limen for St–Co than for Co–St), except for the filled-auditory and empty-visual 100-ms standards, for which a positive effect was obtained. In Experiment 2, duration discrimination was investigated for filled auditory intervals with four standards between 100 and 1,000 ms, an interstimulus interval of 900 ms, and no feedback. Standard duration interacted with presentation order, here yielding SPEs that were negative for standards of 100 and 1,000 ms, but positive for 215 and 464 ms. Our findings indicate that the SPE can be positive as well as negative, depending on the interval type and standard duration, reflecting the relative weighting of the stimulus information, as is described by the sensation-weighting model.

Mapping spectroscopic uncertainties into prospective methane retrieval errors from Sentinel-5 and its precursor

Sentinel-5 (S5) and its precursor (S5P) are future European satellite missions aiming at global monitoring of methane (CH4) column-average dry air mole fractions (XCH4). The spectrometers to be deployed onboard the satellites record spectra of sunlight backscattered from the Earth's surface and atmosphere. In particular, they exploit CH4 absorption in the shortwave infrared spectral range around 1.65 mu m (S5 only) and 2.35 mu m (both S5 and S5P) wavelength. Given an accuracy goal of better than 2% for XCH4 to be delivered on regional scales, assessment and reduction of potential sources of systematic error such as spectroscopic uncertainties is crucial. Here, we investigate how spectroscopic errors propagate into retrieval errors on the global scale. To this end, absorption spectra of a ground-based Fourier transform spectrometer (FTS) operating at very high spectral resolution serve as estimate for the quality of the spectroscopic parameters. Feeding the FTS fitting residuals as a perturbation into a global ensemble of simulated S5- and S5P-like spectra at relatively low spectral resolution, XCH4 retrieval errors exceed 0.6% in large parts of the world and show systematic correlations on regional scales, calling for improved spectroscopic parameters.

Position Errors Caused by GPS Height of Instrument Blunders

Height of instrument (HI) blunders in GPS measurements cause position errors. These errors can be pure vertical, pure horizontal, or a mixture of both. There are different error regimes depending on whether both the base and the rover both have HI blunders, if just the base has an HI blunder, or just the rover has an HI blunder. The resulting errors are on the order of 30 cm for receiver separations of 1000 km for an HI blunder of 2 m. Given the complicated nature of the errors, we believe it would be difficult, if not impossible, to detect such errors by visual inspection. This serves to underline the necessity to enter GPS HI's correctly.

Position Errors Caused by GPS HI Blunders

Height of instrument (HI) blunders in GPS measurements cause position errors. These errors can be pure vertical, pure horizontal, or a mixture of both. There are different error regimes depending on whether both the base and the rover both have HI blunders, if just the base has an HI blunder, or just the rover has an HI blunder. The resulting errors are on the order of 30 cm for receiver separations of 1000 km for an HI blunder of 2 m. Given the complicated nature of the errors, we believe it would be difficult, if not impossible, to detect such errors by visual inspection. This serves to underline the necessity to enter GPS HIs correctly.

Dynamic Effects of Currency Depreciation on Stock Market Returns during the Asian Financial Crisis

The current international integration of financial markets provides a channel for currency depreciation to affect stock prices. Moreover, the recent financial crisis in Asia with its accompanying exchange rate volatility affords a case study to examine that channel. This paper applies a bivariate GARCH-M model of the reduced form of stock market returns to investigate empirically the effects of daily currency depreciation on stock market returns for five newly emerging East Asian stock markets during the Asian financial crisis. The evidence shows that the conditional variances of stock market returns and depreciation rates exhibit time-varying characteristics for all countries. Domestic currency depreciation and its uncertainty adversely affects stock market returns across countries. The significant effects of foreign exchange market events on stock market returns suggest that international fund managers who invest in the newly emerging East Asian stock markets must evaluate the value and stability of the domestic currency as a part of their stock market investment decisions.