818 resultados para Reliability assessments
Resumo:
INTRODUCTION Even though arthroplasty of the ankle joint is considered to be an established procedure, only about 1,300 endoprostheses are implanted in Germany annually. Arthrodeses of the ankle joint are performed almost three times more often. This may be due to the availability of the procedure - more than twice as many providers perform arthrodesis - as well as the postulated high frequency of revision procedures of arthroplasties in the literature. In those publications, however, there is often no clear differentiation between revision surgery with exchange of components, subsequent interventions due to complications and subsequent surgery not associated with complications. The German Orthopaedic Foot and Ankle Association's (D. A. F.) registry for total ankle replacement collects data pertaining to perioperative complications as well as cause, nature and extent of the subsequent interventions, and postoperative patient satisfaction. MATERIAL AND METHODS The D. A. F.'s total ankle replacement register is a nation-wide, voluntary registry. After giving written informed consent, the patients can be added to the database by participating providers. Data are collected during hospital stay for surgical treatment, during routine follow-up inspections and in the context of revision surgery. The information can be submitted in paper-based or online formats. The survey instruments are available as minimum data sets or scientific questionnaires which include patient-reported outcome measures (PROMs). The pseudonymous clinical data are collected and evaluated at the Institute for Evaluative Research in Medicine, University of Bern/Switzerland (IEFM). The patient-related data remain on the register's module server in North Rhine-Westphalia, Germany. The registry's methodology as well as the results of the revisions and patient satisfaction for 115 patients with a two year follow-up period are presented. Statistical analyses are performed with SAS™ (Version 9.4, SAS Institute, Inc., Cary, NC, USA). RESULTS About 2½ years after the register was launched there are 621 datasets on primary implantations, 1,427 on follow-ups and 121 records on re-operation available. 49 % of the patients received their implants due to post-traumatic osteoarthritis, 27 % because of a primary osteoarthritis and 15 % of patients suffered from a rheumatic disease. More than 90 % of the primary interventions proceeded without complications. Subsequent interventions were recorded for 84 patients, which corresponds to a rate of 13.5 % with respect to the primary implantations. It should be noted that these secondary procedures also include two-stage procedures not due to a complication. "True revisions" are interventions with exchange of components due to mechanical complications and/or infection and were present in 7.6 % of patients. 415 of the patients commented on their satisfaction with the operative result during the last follow-up: 89.9 % of patients evaluate their outcome as excellent or good, 9.4 % as moderate and only 0.7 % (3 patients) as poor. In these three cases a component loosening or symptomatic USG osteoarthritis was present. Two-year follow-up data using the American Orthopedic Foot and Ankle Society Ankle and Hindfoot Scale (AOFAS-AHS) are already available for 115 patients. The median AOFAS-AHS score increased from 33 points preoperatively to more than 80 points three to six months postoperatively. This increase remained nearly constant over the entire two-year follow-up period. CONCLUSION Covering less than 10 % of the approximately 240 providers in Germany and approximately 12 % of the annually implanted total ankle-replacements, the D. A. F.-register is still far from being seen as a national registry. Nevertheless, geographical coverage and inclusion of "high-" (more than 100 total ankle replacements a year) and "low-volume surgeons" (less than 5 total ankle replacements a year) make the register representative for Germany. The registry data show that the number of subsequent interventions and in particular the "true revision" procedures are markedly lower than the 20 % often postulated in the literature. In addition, a high level of patient satisfaction over the short and medium term is recorded. From the perspective of the authors, these results indicate that total ankle arthroplasty - given a correct indication and appropriate selection of patients - is not inferior to an ankle arthrodesis concerning patients' satisfaction and function. First valid survival rates can be expected about 10 years after the register's start.
Resumo:
Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.
Resumo:
BACKGROUND The abstraction of data from medical records is a widespread practice in epidemiological research. However, studies using this means of data collection rarely report reliability. Within the Transition after Childhood Cancer Study (TaCC) which is based on a medical record abstraction, we conducted a second independent abstraction of data with the aim to assess a) intra-rater reliability of one rater at two time points; b) the possible learning effects between these two time points compared to a gold-standard; and c) inter-rater reliability. METHOD Within the TaCC study we conducted a systematic medical record abstraction in the 9 Swiss clinics with pediatric oncology wards. In a second phase we selected a subsample of medical records in 3 clinics to conduct a second independent abstraction. We then assessed intra-rater reliability at two time points, the learning effect over time (comparing each rater at two time-points with a gold-standard) and the inter-rater reliability of a selected number of variables. We calculated percentage agreement and Cohen's kappa. FINDINGS For the assessment of the intra-rater reliability we included 154 records (80 for rater 1; 74 for rater 2). For the inter-rater reliability we could include 70 records. Intra-rater reliability was substantial to excellent (Cohen's kappa 0-6-0.8) with an observed percentage agreement of 75%-95%. In all variables learning effects were observed. Inter-rater reliability was substantial to excellent (Cohen's kappa 0.70-0.83) with high agreement ranging from 86% to 100%. CONCLUSIONS Our study showed that data abstracted from medical records are reliable. Investigating intra-rater and inter-rater reliability can give confidence to draw conclusions from the abstracted data and increase data quality by minimizing systematic errors.
Resumo:
BACKGROUND AND OBJECTIVES Reliability is an essential condition for using quantitative sensory tests (QSTs) in research and clinical practice, but information on reliability in patients with chronic pain is sparse. The aim of this study was to evaluate the reliability of different QST in patients with chronic low back pain. METHODS Eighty-nine patients with chronic low back pain participated in 2 identical experimental sessions, separated by at least 7 days. The following parameters were recorded: pressure pain detection and tolerance thresholds at the toe, electrical pain thresholds to single and repeated stimulation, heat pain detection and tolerance thresholds at the arm and leg, cold pain detection threshold at the arm and leg, and conditioned pain modulation using the cold pressor test.Reliability was analyzed using the coefficient of variation, the coefficient of repeatability, and the intraclass correlation coefficient. It was judged as acceptable or not based primarily on the analysis of the coefficient of repeatability. RESULTS The reliability of most tests was acceptable. Exceptions were cold pain detection thresholds at the leg and arm. CONCLUSIONS Most QST measurements have acceptable reliability in patients with chronic low back pain.
Resumo:
Twenty-five public supply wells throughout the hydrogeologically diverse region of Scania, southern Sweden are subjected to environmental tracer analysis (³H–³He,⁴He, CFCs, SF₆ and for one well only also ⁸⁵Kr and ³⁹Ar) to study well and aquifer vulnerability and evaluate possibilities of groundwater age distribution assessment. We find CFC and SF₆ concentrations well above solubility equilibrium with modern atmosphere, indicating local contamination, as well as indications of CFC degradation. The tracer-specific complications considerably constrain possibilities for sound quantitative regional ground- water age distribution assessment and demonstrate the importance of initial qualitative assessment of tracer-specific reliability, as well a need for additional, complementary tracers (e.g. ⁸⁵Kr,³⁹Ar and potentially also ¹⁴C). Lumped parameter modelling yields credible age distribution assessments for representative wells in four type aquifers. Pollution vulnerability of the aquifer types was based on the selected LPM models and qualitative age characterisation. Most vulnerable are unconfined dual porosity and fractured bedrock aquifers, due to a large component of very young groundwater. Unconfined sedimentary aquifers are vulnerable due to young groundwater and a small pre-modern component. Less vulnerable are semi-confined sedimentary or dual-porosity aquifers, due to older age of the modern component and a larger pre-modern component. Confined aquifers appear least vulnerable, due an entirely pre-modern groundwater age distribution (recharged before 1963). Tracer complications aside, environmental tracer analyses and lumped parameter modelling aid in vulnerability assessment and protection of regional groundwater resources.
Resumo:
OBJECTIVE To assess the reliability of the cervical vertebrae maturation method (CVM). BACKGROUND Skeletal maturity estimation can influence the manner and time of orthodontic treatment. The CVM method evaluates skeletal growth on the basis of the changes in the morphology of cervical vertebrae C2, C3, C4 during growth. These vertebrae are visible on a lateral cephalogram, so the method does not require an additional radiograph. METHODS In this website based study, 10 orthodontists with a long clinical practice (3 routinely using the method - "Routine user - RU" and 7 with less experience in the CVM method - "Non-Routine user - nonRU") rated twice cervical vertebrae maturation with the CVM method on 50 cropped scans of lateral cephalograms of children in circumpubertal age (for boys: 11.5 to 15.5 years; for girls: 10 to 14 years). Kappa statistics (with lower limits of 95% confidence intervals (CI)) and proportion of complete agreement on staging was used to evaluate intra- and inter-assessor agreement. RESULTS The mean weighted kappa for intra-assessor agreement was 0.44 (range: 0.30-0.64; range of lower limits of 95% CI: 0.12-0.48) and for inter-assessor agreement was 0.28 (range: -0.01-0.58; range of lower limits of 95% CI: -0.14-0.42). The mean proportion of identical scores assigned by the same assessor was 55.2 %(range: 44-74 %) and for different pairs of assessors was 42 % (range: 16-68 %). CONCLUSIONS The reliability of the CVM method is questionable and if orthodontic treatment should be initiated relative to the maximum growth, the use of additional biologic indicators should be considered (Tab. 4, Fig. 1, Ref. 24).
Resumo:
OBJECTIVES The aim of this in vitro study was to examine the effect of different levels of magnification on the accuracy and reliability of visual caries detection using ICDAS criteria. METHODS Occlusal surfaces of 100 extracted molars were assessed by 14 examiners (3rd and the 4th year dental students and dentists) using no magnification aids, a 2.5× Galilean loupe, a 4.5× Keplerian loupe, or a surgical microscope with 10× magnification. The assessments were repeated on a different day. Sensitivity, specificity, AUC and reliabilities were calculated according to the gold standard of histology. RESULTS We found that with increasing magnification, the number of surfaces rated as "sound" (ICDAS code 0) decreased, while the number of surfaces with a localized enamel breakdown (ICDAS code 3) increased. While the sensitivities increased, the values of the specificities decreased to an unacceptably low level irrespective of the clinical experience of the examiners. CONCLUSIONS ICDAS seems to be optimized for natural vision up to 2.0× magnification and not for high magnifications. The use of powerful magnification in visual caries detection involves the risk of unnecessary and premature invasive treatment. CLINICAL SIGNIFICANCE This paper discusses when it does and does not make sense to use magnification devices for visual caries detection using ICDAS criteria. Strong magnifications should be refrained from for this purpose.
Resumo:
OBJECTIVE To evaluate changes over time in owner-perceived, weighted quality-of-life assessments in dogs with spinal cord injuries and determine whether scores were associated with underlying etiology or with veterinarian-assigned scores for severity of neurologic dysfunction. DESIGN Cohort study. ANIMALS 100 dogs with spinal cord injury. PROCEDURES Duration of dysfunction, modified Frankel neurologic injury score, and etiology were recorded. At initial and recheck (4- to 6-week) evaluations, owners were asked to identify 5 areas or activities they believed had the most influence on their dogs' quality of life, assess their dogs' current status in each area, and provide a weighting for the importance of each area; results were used to construct a weighted quality-of-life score. Owners were also asked to provide a quality-of-life score with a visual analog scale (VAS). RESULTS At initial and recheck evaluations, weighted quality-of-life scores were higher for ambulatory than for nonambulatory dogs. However, scores did not differ among groups when dogs were grouped on the basis of underlying etiology or duration of injury. Dogs with an increase in Frankel score between the initial and recheck evaluations had a significant increase in weighted quality-of-life score, whereas for dogs that did not have any change in Frankel score, initial and recheck weighted quality-of-life scores were not significantly different. CONCLUSIONS AND CLINICAL RELEVANCE Results suggested that owner-assigned, weighted quality-of-life scores for dogs with spinal cord injuries did not vary significantly on the basis of underlying etiology or duration of injury but were higher for ambulatory than for nonambulatory dogs.
Resumo:
OBJECTIVE To evaluate a questionnaire for obtaining owner-perceived, weighted quality-oflife assessments for dogs with spinal cord injuries. DESIGN Evaluation study. Animals-100 dogs with spinal cord injuries and 48 healthy control dogs. PROCEDURES The questionnaire was adapted from a questionnaire (the schedule for the evaluation of individual quality of life-direct weighting) used for human patients. Specifically, owners were asked to identify 5 areas or activities they believed had the most influence on their dogs' quality of life, assess their dogs' current status in each of those areas, and provide a weighting for the importance of each area. Results were used to construct a weighted quality-of-life score ranging from 0 to 100 for each dog. Owners were also asked to provide a quality-of-life score with a visual analog scale (VAS). RESULTS A good correlation was found between weighted and VAS quality-of-life scores. Dogs with spinal cord injuries had weighted quality-of-life scores that were significantly lower than scores for control dogs. Quality-of-life areas and activities provided by owners of dogs with spinal cord injuries were similar to areas and activities provided by owners of healthy control dogs and could mostly be encompassed by 5 broader domains: mobility, play or mental stimulation, health, companionship, and other. CONCLUSIONS AND CLINICAL RELEVANCE Results suggested that the questionnaire could be used to obtain owner-perceived, weighted quality-of-life assessments for dogs with spinal cord injuries. Obtaining owner-perceived quality-of-life assessments for individual dogs should allow veterinarians to better address quality-of-life concerns and expectations of owners.
Resumo:
PURPOSE Stress urinary incontinence (SUI) affects women of all ages including young athletes, especially those involved in high-impact sports. To date, hardly any studies are available testing pelvic floor muscles (PFM) during sports activities. The aim of this study was the description and reliability test of six PFM electromyography (EMG) variables during three different running speeds. The secondary objective was to evaluate whether there was a speed-dependent difference between the PFM activity variables. METHODS This trial was designed as an exploratory and reliability study including ten young healthy female subjects to characterize PFM pre-activity and reflex activity during running at 7, 9 and 11 km/h. Six variables for each running speed, averaged over ten steps per subject, were presented descriptively, tested regarding their reliability (Friedman, ICC, SEM, MD) and speed difference (Friedman). RESULTS PFM EMG variables varied between 67.6 and 106.1 %EMG, showed no systematic error and were low for SEM and MD using the single value model. Applying the average model over ten steps, ICC (3,k) were >0.75 and SEM and MD about 50 % lower than for the single value model. Activity was found to be highest in 11 km/h. CONCLUSION EMG variables showed excellent ICC and very low SEM and MD. Further studies should investigate inter-session reliability and PFM reactivity patterns of SUI patients using the average over ten steps for each variable as it showed very high ICC and very low SEM and MD. Subsequently, longer running distances and other high-impact sports disciplines could be studied.
Resumo:
Glycogen is a major substrate in energy metabolism and particularly important to prevent hypoglycemia in pathologies of glucose homeostasis such as type 1 diabetes mellitus (T1DM). (13) C-MRS is increasingly used to determine glycogen in skeletal muscle and liver non-invasively; however, the low signal-to-noise ratio leads to long acquisition times, particularly when glycogen levels are determined before and after interventions. In order to ease the requirements for the subjects and to avoid systematic effects of the lengthy examination, we evaluated if a standardized preparation period would allow us to shift the baseline (pre-intervention) experiments to a preceding day. Based on natural abundance (13) C-MRS on a clinical 3 T MR system the present study investigated the test-retest reliability of glycogen measurements in patients with T1DM and matched controls (n = 10 each group) in quadriceps muscle and liver. Prior to the MR examination, participants followed a standardized diet and avoided strenuous exercise for two days. The average coefficient of variation (CV) of myocellular glycogen levels was 9.7% in patients with T1DM compared with 6.6% in controls after a 2 week period, while hepatic glycogen variability was 13.3% in patients with T1DM and 14.6% in controls. For comparison, a single-session test-retest variability in four healthy volunteers resulted in 9.5% for skeletal muscle and 14.3% for liver. Glycogen levels in muscle and liver were not statistically different between test and retest, except for hepatic glycogen, which decreased in T1DM patients in the retest examination, but without an increase of the group distribution. Since the CVs of glycogen levels determined in a "single session" versus "within weeks" are comparable, we conclude that the major source of uncertainty is the methodological error and that physiological variations can be minimized by a pre-study standardization. For hepatic glycogen examinations, familiarization sessions (MR and potentially strenuous interventions) are recommended. Copyright © 2016 John Wiley & Sons, Ltd.
Resumo:
Keel bone damage (KBD) is a critical issue facing the laying hen industry today as a result of the likely pain leading to compromised welfare and the potential for reduced productivity. Recent reports suggest that damage, while highly variable and likely dependent on a host of factors, extends to all systems (including battery cages, furnished cages, and non-cage systems), genetic lines, and management styles. Despite the extent of the problem, the research community remains uncertain as to the causes and influencing factors of KBD. Although progress has been made investigating these factors, the overall effort is hindered by several issues related to the assessment of KBD, including quality and variation in the methods used between research groups. These issues prevent effective comparison of studies, as well as difficulties in identifying the presence of damage leading to poor accuracy and reliability. The current manuscript seeks to resolve these issues by offering precise definitions for types of KBD, reviewing methods for assessment, and providing recommendations that can improve the accuracy and reliability of those assessments.