Intra-Rater and Inter-Rater Reliability of a Medical Record Abstraction Study on Transition of Care after Childhood Cancer.

BACKGROUND The abstraction of data from medical records is a widespread practice in epidemiological research. However, studies using this means of data collection rarely report reliability. Within the Transition after Childhood Cancer Study (TaCC) which is based on a medical record abstraction, we conducted a second independent abstraction of data with the aim to assess a) intra-rater reliability of one rater at two time points; b) the possible learning effects between these two time points compared to a gold-standard; and c) inter-rater reliability. METHOD Within the TaCC study we conducted a systematic medical record abstraction in the 9 Swiss clinics with pediatric oncology wards. In a second phase we selected a subsample of medical records in 3 clinics to conduct a second independent abstraction. We then assessed intra-rater reliability at two time points, the learning effect over time (comparing each rater at two time-points with a gold-standard) and the inter-rater reliability of a selected number of variables. We calculated percentage agreement and Cohen's kappa. FINDINGS For the assessment of the intra-rater reliability we included 154 records (80 for rater 1; 74 for rater 2). For the inter-rater reliability we could include 70 records. Intra-rater reliability was substantial to excellent (Cohen's kappa 0-6-0.8) with an observed percentage agreement of 75%-95%. In all variables learning effects were observed. Inter-rater reliability was substantial to excellent (Cohen's kappa 0.70-0.83) with high agreement ranging from 86% to 100%. CONCLUSIONS Our study showed that data abstracted from medical records are reliable. Investigating intra-rater and inter-rater reliability can give confidence to draw conclusions from the abstracted data and increase data quality by minimizing systematic errors.

Comprehensive assessment of gesture production: a new test of upper limb apraxia (TULIA)

BACKGROUND: Only few standardized apraxia scales are available and they do not cover all domains and semantic features of gesture production. Therefore, the objective of the present study was to evaluate the reliability and validity of a newly developed test of upper limb apraxia (TULIA), which is comprehensive and still short to administer. METHODS: The TULIA consists of 48 items including imitation and pantomime domain of non-symbolic (meaningless), intransitive (communicative) and transitive (tool related) gestures corresponding to 6 subtests. A 6-point scoring method (0-5) was used (score range 0-240). Performance was assessed by blinded raters based on videos in 133 stroke patients, 84 with left hemisphere damage (LHD) and 49 with right hemisphere damage (RHD), as well as 50 healthy subjects (HS). RESULTS: The clinimetric findings demonstrated mostly good to excellent internal consistency, inter- and intra-rater (test-retest) reliability, both at the level of the six subtests and at individual item level. Criterion validity was evaluated by confirming hypotheses based on the literature. Construct validity was demonstrated by a high correlation (r = 0.82) with the De Renzi-test. CONCLUSION: These results show that the TULIA is both a reliable and valid test to systematically assess gesture production. The test can be easily applied and is therefore useful for both research purposes and clinical practice.

Correlation between broiler lameness and anatomical measurements of bone using radiographical projections with assessments of consistency across and within radiographs.

Lameness represents a major welfare and production issue in the poultry industry with a recent survey estimating 27% of birds lame and 3% unable to walk by 40 d of age. A variety of factors may induce lameness and are typically grouped into 2 broad classes on the basis of being infectious or skeletal in nature with the latter accounting for the majority of cases. The current work sought to build upon a large body of literature assessing the anatomical properties of bone in lame birds. Our specific objectives sought to identify relationships between relevant anatomical properties of the tibia and metatarsus using digital quantification from radiographs of legs and a measure of walking difficulty. Resulting output was statistically analyzed to assess 1) observer reliability for consistency in placing the leg during the radiograph procedure and quantification of the various measures within a radiograph, 2) the relationship between the various measurements of anatomical bone properties and sex, bird mass, and gait score, and 3) the relationship between each measurement and leg symmetry. Our anatomical bone measures were found to be reliable (intra-rater and test-retest reliabilities < 0.75) within radiograph for all measures and 8 of the 10 measures across radiographs. Several measures of bone properties in the tibia correlated to difficulty walking as measured by gait score (P < 0.05), indicating greater angulations with increasing lameness. Of the measures that manifested a gait score × bird mass interaction, heavier birds appeared to exhibit less angulation with increasing difficulty walking with lighter birds the opposite. These interactions suggest possibilities for influencing effects of activity or feed intake on bone mineralization with the bone angulation observed. Our efforts agree with that of others and indicate that angulation of the tibia may be related to lameness, though subsequent efforts involving comprehensive measures of bird activity, growth rates, and internal bone structure will be needed if the validity of the measures are to be accepted.

Automatic quality control in clinical (1) H MRSI of brain cancer.

MRSI grids frequently show spectra with poor quality, mainly because of the high sensitivity of MRS to field inhomogeneities. These poor quality spectra are prone to quantification and/or interpretation errors that can have a significant impact on the clinical use of spectroscopic data. Therefore, quality control of the spectra should always precede their clinical use. When performed manually, quality assessment of MRSI spectra is not only a tedious and time-consuming task, but is also affected by human subjectivity. Consequently, automatic, fast and reliable methods for spectral quality assessment are of utmost interest. In this article, we present a new random forest-based method for automatic quality assessment of (1) H MRSI brain spectra, which uses a new set of MRS signal features. The random forest classifier was trained on spectra from 40 MRSI grids that were classified as acceptable or non-acceptable by two expert spectroscopists. To account for the effects of intra-rater reliability, each spectrum was rated for quality three times by each rater. The automatic method classified these spectra with an area under the curve (AUC) of 0.976. Furthermore, in the subset of spectra containing only the cases that were classified every time in the same way by the spectroscopists, an AUC of 0.998 was obtained. Feature importance for the classification was also evaluated. Frequency domain skewness and kurtosis, as well as time domain signal-to-noise ratios (SNRs) in the ranges 50-75 ms and 75-100 ms, were the most important features. Given that the method is able to assess a whole MRSI grid faster than a spectroscopist (approximately 3 s versus approximately 3 min), and without loss of accuracy (agreement between classifier trained with just one session and any of the other labelling sessions, 89.88%; agreement between any two labelling sessions, 89.03%), the authors suggest its implementation in the clinical routine. The method presented in this article was implemented in jMRUI's SpectrIm plugin. Copyright © 2016 John Wiley & Sons, Ltd.

A novel colourimetric technique to assess chewing function using two-coloured specimens: Validation and application

OBJECTIVES Chewing efficiency may be evaluated using cohesive specimen, especially in elderly or dysphagic patients. The aim of this study was to evaluate three two-coloured chewing gums for a colour-mixing ability test and to validate a new purpose built software (ViewGum©). METHODS Dentate participants (dentate-group) and edentulous patients with mandibular two-implant overdentures (IOD-group) were recruited. First, the dentate-group chewed three different types of two-coloured gum (gum1-gum3) for 5, 10, 20, 30 and 50 chewing cycles. Subsequently the number of chewing cycles with the highest intra- and inter-rater agreement was determined visually by applying a scale (SA) and opto-electronically (ViewGum©, Bland-Altman analysis). The ViewGum© software determines semi-automatically the variance of hue (VOH); inadequate mixing presents with larger VOH than complete mixing. Secondly, the dentate-group and the IOD-group were compared. RESULTS The dentate-group comprised 20 participants (10 female, 30.3±6.7 years); the IOD-group 15 participants (10 female, 74.6±8.3 years). Intra-rater and inter-rater agreement (SA) was very high at 20 chewing cycles (95.00-98.75%). Gums 1-3 showed different colour-mixing characteristics as a function of chewing cycles, gum1 showed a logarithmic association; gum2 and gum3 demonstrated more linear behaviours. However, the number of chewing cycles could be predicted in all specimens from VOH (all p<0.0001, mixed linear regression models). Both analyses proved discriminative to the dental state. CONCLUSION ViewGum© proved to be a reliable and discriminative tool to opto-electronically assess chewing efficiency, given an elastic specimen is chewed for 20 cycles and could be recommended for the evaluation of chewing efficiency in a clinical and research setting. CLINICAL SIGNIFICANCE Chewing is a complex function of the oro-facial structures and the central nervous system. The application of the proposed assessments of the chewing function in geriatrics or special care dentistry could help visualising oro-functional or dental comorbidities in dysphagic patients or those suffering from protein-energy malnutrition.

The inter-rater reliability of the Pulmonary Embolism Severity Index

The Pulmonary Embolism Severity Index (PESI) is a validated clinical prognostic model for patients with acute pulmonary embolism (PE). Our goal was to assess the PESI's inter-rater reliability in patients diagnosed with PE. We prospectively identified consecutive patients diagnosed with PE in the emergency department of a Swiss teaching hospital. For all patients, resident and attending physician raters independently collected the 11 PESI variables. The raters then calculated the PESI total point score and classified patients into one of five PESI risk classes (I-V) and as low (risk classes I/II) versus higher-risk (risk classes III-V). We examined the inter-rater reliability for each of the 11 PESI variables, the PESI total point score, assignment to each of the five PESI risk classes, and classification of patients as low versus higher-risk using kappa ( ) and intra-class correlation coefficients (ICC). Among 48 consecutive patients with an objective diagnosis of PE, reliability coefficients between resident and attending physician raters were > 0.60 for 10 of the 11 variables comprising the PESI. The inter-rater reliability for the PESI total point score (ICC: 0.89, 95% CI: 0.81-0.94), PESI risk class assignment ( : 0.81, 95% CI: 0.66-0.94), and the classification of patients as low versus higher-risk ( : 0.92, 95% CI: 0.72-0.98) was near perfect. Our results demonstrate the high reproducibility of the PESI, supporting the use of the PESI for risk stratification of patients with PE.

Decompressive craniectomy after intra-arterial thrombolysis: safety and outcome

Data on decompressive craniectomy (DC) after intra-arterial thrombolysis (IAT) for treatment of malignant middle cerebral artery (MCA) stroke are lacking.

Dental arch relationship in children with complete unilateral cleft lip and palate following one-stage and three-stage surgical protocols

The objective of this study is to compare dental arch relationship following one-stage and three-stage surgical protocols of unilateral cleft lip and palate. Dental casts of 61 children (mean age, 11.2 years; SD, 1.7), consecutively treated in one center with one-stage closure of the complete cleft at 9.2 months (SD, 2.0), were compared with a sample of 97 patients (mean age, 8.7 years; SD, 0.9), consecutively treated with a three-stage protocol including delayed hard palate closure in another center. The dental casts were assigned random numbers to blind their origin. Four raters graded dental arch relationship and palatal morphology using the EUROCRAN index. The strength of agreement of rating was assessed with kappa statistics. Independent t tests were run to compare the EUROCRAN scores between one-stage and three-stage samples, and Fisher's exact tests were performed to evaluate differences of distribution of the EUROCRAN grades. The intra- and inter-rater agreement was moderate to very good. Dental arch relationship in the one-stage sample was less favorable than in three-stage group (mean scores, 2.58 and 1.97 for one-stage and three-stage samples, respectively; p?

T1 assessment of hip joint cartilage following intra-articular gadolinium injection: a pilot study

This pilot study defines the feasibility of cartilage assessment in symptomatic femoroacetabular impingement patients using intra-articular delayed gadolinium-enhanced MRI of cartilage (ia-dGEMRIC). Nine patients were scanned preliminary to study the contrast infiltration process into hip joint cartilage. Twenty-seven patients with symptomatic femoroacetabular impingement were subsequently scanned with intra-articular delayed gadolinium-enhanced MRI of cartilage. These T(1) findings were correlated to morphological findings. Zonal variations were studied. This pilot study demonstrates a significant difference between the pre- and postcontrast T(1) values (P < 0.001) remaining constant for 45 min. We noted higher mean T(1) values in morphologically normal-appearing cartilage than in damaged cartilage, which was statistically significant for all zones except the anterior-superior zone. Intraobserver (0.972) and interobserver correlation coefficients (0.933) were statistically significant. This study outlines the feasibility of intra-articular delayed gadolinium-enhanced MRI of cartilage for assessment of cartilage changes in patients with femoroacetabular impingement. It can also define the topographic extent and differing severities of cartilage damage.

Intravenous versus intra-articular delayed gadolinium-enhanced magnetic resonance imaging in the hip joint: a comparative analysis

The purpose of this study was to investigate whether T1-mapping of hip joint with intra-articular delayed gadolinium-enhanced magnetic resonance imaging (MRI) of cartilage (ia-dGEMRIC) is comparable to the already established intravenous (iv)-technique for assessing different grades of cartilage degeneration.

Compartment pressure of the rectus sheath accurately reflects intra-abdominal pressure in a porcine model

To investigate whether the compartment pressure of the rectus sheath (CPRS) reflects the intra-abdominal pressure (IAP) under various conditions of intra-abdominal hypertension (IAH) in a pig model.

Increasing abdominal pressure with and without PEEP: effects on intra-peritoneal, intra-organ and intra-vascular pressures

Intra-organ and intra-vascular pressures can be used to estimate intra-abdominal pressure. The aim of this prospective, interventional study was to assess the effect of PEEP on the accuracy of pressure estimation at different measurement sites in a model of increased abdominal pressure.

Three-Month and Long-Term Outcomes and Their Predictors in Acute Basilar Artery Occlusion Treated With Intra-Arterial Thrombolysis

Intra-arterial thrombolysis can be used for treatment of basilar artery occlusion. Predictors of outcome before initiation of treatment are of special interest.

Intra-arterial injection of neural stem cells using a microneedle technique does not cause microembolic strokes

Intra-arterial (IA) injection represents an experimental avenue for minimally invasive delivery of stem cells to the injured brain. It has however been reported that IA injection of stem cells carries the risk of reduction in cerebral blood flow (CBF) and microstrokes. Here we evaluate the safety of IA neural progenitor cell (NPC) delivery to the brain. Cerebral blood flow of rats was monitored during IA injection of single cell suspensions of NPCs after stroke. Animals received 1 × 10(6) NPCs either injected via a microneedle (microneedle group) into the patent common carotid artery (CCA) or via a catheter into the proximally ligated CCA (catheter group). Controls included saline-only injections and cell injections into non-stroked sham animals. Cerebral blood flow in the microneedle group remained at baseline, whereas in the catheter group a persistent (15 minutes) decrease to 78% of baseline occurred (P<0.001). In non-stroked controls, NPCs injected via the catheter method resulted in higher levels of Iba-1-positive inflammatory cells (P=0.003), higher numbers of degenerating neurons as seen in Fluoro-Jade C staining (P<0.0001) and ischemic changes on diffusion weighted imaging. With an appropriate technique, reduction in CBF and microstrokes do not occur with IA transplantation of NPCs.