Disagreements in meta-analyses using outcomes measured on continuous or rating scales: observer agreement study

OBJECTIVE: To study the inter-observer variation related to extraction of continuous and numerical rating scale data from trial reports for use in meta-analyses. DESIGN: Observer agreement study. DATA SOURCES: A random sample of 10 Cochrane reviews that presented a result as a standardised mean difference (SMD), the protocols for the reviews and the trial reports (n=45) were retrieved. DATA EXTRACTION: Five experienced methodologists and five PhD students independently extracted data from the trial reports for calculation of the first SMD result in each review. The observers did not have access to the reviews but to the protocols, where the relevant outcome was highlighted. The agreement was analysed at both trial and meta-analysis level, pairing the observers in all possible ways (45 pairs, yielding 2025 pairs of trials and 450 pairs of meta-analyses). Agreement was defined as SMDs that differed less than 0.1 in their point estimates or confidence intervals. RESULTS: The agreement was 53% at trial level and 31% at meta-analysis level. Including all pairs, the median disagreement was SMD=0.22 (interquartile range 0.07-0.61). The experts agreed somewhat more than the PhD students at trial level (61% v 46%), but not at meta-analysis level. Important reasons for disagreement were differences in selection of time points, scales, control groups, and type of calculations; whether to include a trial in the meta-analysis; and data extraction errors made by the observers. In 14 out of the 100 SMDs calculated at the meta-analysis level, individual observers reached different conclusions than the originally published review. CONCLUSIONS: Disagreements were common and often larger than the effect of commonly used treatments. Meta-analyses using SMDs are prone to observer variation and should be interpreted with caution. The reliability of meta-analyses might be improved by having more detailed review protocols, more than one observer, and statistical expertise.

T1(Gd) gives comparable information as Delta T1 relaxation rate in dGEMRIC evaluation of cartilage repair tissue

OBJECTIVES: To evaluate the relationship between T1 after intravenous contrast administration (T1Gd) and Delta relaxation rate (DeltaR1) = (1/T1(Gd) - 1/T1o) in the delayed Gadolinium-Enhanced MRI of cartilage (dGEMRIC) evaluation of cartilage repair tissue. MATERIALS AND METHODS: Thirty single MR examinations from 30 patients after matrix-associated autologous chondrocyte transplantations of the knee joint with different postoperative intervals were examined using an 8-channel knee-coil at 3T. T1 mapping using a 3D GRE sequence with a 35/10 degrees flip angle excitation pulse combination was performed before and after contrast administration (dGEMRIC technique). T1 postcontrast (T1(Gd)) and the DeltaR1 (relative index of pre- and postcontrast R1 value) were calculated for repair tissue and the weight-bearing normal appearing control cartilage. For evaluation of the different postoperative intervals, MR exams were subdivided into 3 groups (up to 12 months, 12-24 months, more than 24 months). For statistical analysis Spearman correlation coefficients were calculated. RESULTS: The mean value for T1 postcontrast was 427 +/- 159 ms, for DeltaR1 1.85 +/- 1.0; in reference cartilage 636 +/- 181 ms for T1 postcontrast and 0.83 +/- 0.5 for DeltaR1.The correlation coefficients were highly significant between T1 (Gd) and DeltaR1 for repair tissue (0.969) as well as normal reference cartilage (0.928) in total, and for the reparative cartilage in the early, middle postoperative, and late postoperative interval after surgery (R values: -0.986, -0.970, and -0.978, respectively). Using either T1(Gd) or DeltaR1, the 2 metrics resulted in similar conclusions regarding the time course of change of repair tissue and control tissue, namely that highly significant (P > 0.01) differences between cartilage repair tissue and reference cartilage were found for all follow-up groups. Additionally, for both metrics highly significant differences (P < 0.01) between early follow up and the 2 later postoperative groups for cartilage repair tissue were found. No statistical differences were found between the 2 later follow-up groups of reparative cartilage either for T1 (Gd) or DeltaR1. CONCLUSION: The high correlation between T1 (Gd) and DeltaR1 and the comparable conclusions reached utilizing metric implies that T1 mapping before intravenous administration of MR contrast agent is not necessary for the evaluation of repair tissue. This will help to reduce costs, inconvenience for the patients, simplifies the examination procedure, and makes dGEMRIC more attractive for follow-up of patients after cartilage repair surgeries.

Neer Award 2007: Reversion of structural muscle changes caused by chronic rotator cuff tears using continuous musculotendinous traction. An experimental study in sheep

HYPOTHESIS: Chronic rotator cuff tears are associated with irreversible architectural muscle changes and a high rate of repair failure. The changes observed in man and their irreversibility with a single stage repair can be reproduced in sheep. It was the purpose of this experiment to test the hypothesis that slow, continuous elongation of a retracted musculotendinous unit allows reversal of the currently irreversible structural muscle changes. MATERIALS AND METHODS: The infraspinatus tendon of 12 sheep was released using a greater tuberosity osteotomy and allowed to retract for 4 months. Then, a new device was mounted on the scapular spine and used to extend the infraspinatus muscuculotendinous unit transcutaneously by 1 mm per day. Thereafter, the tendon was repaired back to the greater tuberosity. We assessed the muscular architecture using magnetic resonance imaging, macroscopic dissection, histology, and electron microscopy. Fatty infiltration (in Hounsfield units 1/4 HU) and muscular cross-sectional area (in % of the control side) were monitored with computed tomography at tendon release, initiation of elongation, repair, and at sacrifice. RESULTS: Sixteen weeks after tendon release, the mean tendon retraction was 29 +/- 6 mm (14% of original length, P = .008). In 8 sheep, elongation was achieved as planned (group I), but in 4, the elongation failed technically (group II). The mean traction time was 24 +/- 6 days with a mean traction distance of 19 +/- 4 mm. At sacrifice, the mean pennation angle in the infraspinatus of group I was not different from the control side (29.8 degrees +/-7.5 degrees vs. 30 degrees +/-6 degrees , P = .575). In group II, the pennation angle had increased from 30 degrees +/-6 degrees to 55 degrees +/-14 degrees (P = .035). There was no fatty infiltration at the time of tendon release. After retraction, there was a significant increase in fatty infiltration of the infraspinatus muscle and a decrease of its cross-sectional area to 57% of the contralateral side (P = .0001). During traction, the degree of fatty infiltration remained unchanged (36 HU to 38 HU, P = .381), and atrophy improved to a muscle square area of 78% of the contralateral side (P = .0001) in group I. In group II, an increase of fatty infiltration was measured from 36 HU to 28 HU; however, this increase was not significant (P = .144). Atrophy did not change in group II (57-55%, P = .946). At sacrifice, the remaining muscle mass was 64% in group I and 46% in group II (P = .019). DISCUSSION: Our preliminary results document, that continuous elongation of a retracted, fatty infiltrated and atrophied musculotendinous unit is technically feasible. CONCLUSION: In the sheep, continuous elongation can lead to restoration of normal muscle architecture, to partial reversal of muscle atrophy, and to arrest of the progression of fatty infiltration. LEVEL OF EVIDENCE: Basic science level 2; Prospective comparative therapeutic study.

Reliable gene expression measurements from degraded RNA by quantitative real-time PCR depend on short amplicons and a proper normalization

Quantitative reverse transcriptase real-time PCR (QRT-PCR) is a robust method to quantitate RNA abundance. The procedure is highly sensitive and reproducible as long as the initial RNA is intact. However, breaks in the RNA due to chemical or enzymatic cleavage may reduce the number of RNA molecules that contain intact amplicons. As a consequence, the number of molecules available for amplification decreases. We determined the relation between RNA fragmentation and threshold values (Ct values) in subsequent QRT-PCR for four genes in an experimental model of intact and partially hydrolyzed RNA derived from a cell line and we describe the relation between RNA integrity, amplicon size and Ct values in this biologically homogenous system. We demonstrate that degradation-related shifts of Ct values can be compensated by calculating delta Ct values between test genes and the mean values of several control genes. These delta Ct values are less sensitive to fragmentation of the RNA and are unaffected by varying amounts of input RNA. The feasibility of the procedure was demonstrated by comparing Ct values from a larger panel of genes in intact and in partially degraded RNA. We compared Ct values from intact RNA derived from well-preserved tumor material and from fragmented RNA derived from formalin-fixed, paraffin-embedded (FFPE) samples of the same tumors. We demonstrate that the relative abundance of gene expression can be based on FFPE material even when the amount of RNA in the sample and the extent of fragmentation are not known.

Development and pharmacokinetic characterization of pulmonal and intravenous delta-9-tetrahydrocannabinol (THC) in humans

The aim of the present study was to develop a physiologically compatible inhalation solution of delta-9-tetrahydrocannabinol (THC), and to compare the pharmacokinetic and analgesic properties of pulmonal THC versus pulmonal placebo and intravenous (iv) THC, respectively. Eight healthy volunteers were included in this randomized, double-blind, crossover study. The aqueous THC formulations were prepared by using a solubilization technique. iv THC (0.053 mg/kg body weight), pulmonal THC (0.053 mg/kg), or a placebo inhalation solution was administered as single dose. At defined time points, blood samples were collected, and somatic and psychotropic side effects as well as vital functions monitored. An ice water immersion test was performed to measure analgesia. Using a pressure-driven nebulizer, the pulmonal administration of the THC liquid aerosol resulted in high THC peak plasma levels within minutes. The bioavailability of the pulmonal THC was 28.7 +/- 8.2% (mean +/- SEM). The side effects observed after pulmonal THC were coughing and slight irritation of the upper respiratory tract, very mild psychotropic symptoms, and headache. The side effects after iv THC were much more prominent. Neither pulmonal nor iv THC significantly reduced experimentally induced pain.

Treatment of acute renal failure in the intensive care unit: lower costs by intermittent dialysis than continuous venovenous hemodiafiltration

Intermittent and continuous renal replacement therapies (RRTs) are available for the treatment of acute renal failure (ARF) in the intensive care unit (ICU). Although at present there are no adequately powered survival studies, available data suggest that both methods are equal with respect to patient outcome. Therefore, cost comparison between techniques is important for selecting the modality. Expenditures were prospectively assessed as a secondary end point during a controlled, randomized trial comparing intermittent hemodialysis (IHD) with continuous venovenous hemodiafiltration (CVVHDF). The outcome of the primary end points of this trial, that is, ICU and in-hospital mortality, has been previously published. One hundred twenty-five patients from a Swiss university hospital ICU were randomized either to CVVHDF or IHD. Out of these, 42 (CVVHDF) and 34 (IHD) were available for cost analysis. Patients' characteristics, delivered dialysis dose, duration of stay in the ICU or hospital, mortality rates, and recovery of renal function were not different between the two groups. Detailed 24-h time and material consumption protocols were available for 369 (CVVHDF) and 195 (IHD) treatment days. The mean daily duration of CVVHDF was 19.5 +/- 3.2 h/day, resulting in total expenditures of Euro 436 +/- 21 (21% for human resources and 79% for technical devices). For IHD (mean 3.0 +/- 0.4 h/treatment), the costs were lower (Euro 268 +/- 26), with a larger proportion for human resources (45%). Nursing time spent for CVVHDF was 113 +/- 50 min, and 198 +/- 63 min per IHD treatment. Total costs for RRT in ICU patients with ARF were lower when treated with IHD than with CVVHDF, and have to be taken into account for the selection of the method of RRT in ARF on the ICU.

Triangle-programmed coulometric nanotitrations completed by continuous flow with potentiometric detection

Coulometric nanotitrations were realized in a microchannel system using a continuous-flow titration technique with a triangle current-time profile. Redox and acid-base titrations were carried out on Fe(II) and nitric acid samples, respectively, with the same nanotitrator device. A linear relation between the concentration and the coulometric current transferred to the solution was found. The advantages of this universally applicable nanotitrator are fast response, low sample volume, high sensitivity, and high reproducibility as well as the convenience of handling an automated analyzer of the flow-through type.

Continuous monitoring of bovine spongiform encephalopathy rapid test performance by weak positive tissue controls and quality control charts

Bovine spongiform encephalopathy (BSE) rapid tests and routine BSE-testing laboratories underlie strict regulations for approval. Due to the lack of BSE-positive control samples, however, full assay validation at the level of individual test runs and continuous monitoring of test performance on-site is difficult. Most rapid tests use synthetic prion protein peptides, but it is not known to which extend they reflect the assay performance on field samples, and whether they are sufficient to indicate on-site assay quality problems. To address this question we compared the test scores of the provided kit peptide controls to those of standardized weak BSE-positive tissue samples in individual test runs as well as continuously over time by quality control charts in two widely used BSE rapid tests. Our results reveal only a weak correlation between the weak positive tissue control and the peptide control scores. We identified kit-lot related shifts in the assay performances that were not reflected by the peptide control scores. Vice versa, not all shifts indicated by the peptide control scores indeed reflected a shift in the assay performance. In conclusion these data highlight that the use of the kit peptide controls for continuous quality control purposes may result in unjustified rejection or acceptance of test runs. However, standardized weak positive tissue controls in combination with Shewhart-CUSUM control charts appear to be reliable in continuously monitoring assay performance on-site to identify undesired deviations.

Modulation of nociceptive withdrawal reflexes evoked by single and repeated nociceptive stimuli in conscious dogs by low-dose acepromazine

OBJECTIVES: To investigate the modulation of the nociceptive withdrawal reflex (NWR) and temporal summation (TS) by low-dose acepromazine (ACP) in conscious dogs. To assess the short- and long-term stability of the reflex thresholds. STUDY DESIGN: Randomized, blinded, placebo-controlled cross-over experimental study. ANIMALS: Eight adult male Beagles. METHODS: The NWR was elicited using single transcutaneous electrical stimulation of the ulnar nerve. Repeated stimuli (10 pulses, 5 Hz) were applied to evoke TS. The responses of the deltoideus muscle were recorded and quantified by surface electromyography and the behavioural reactions were scored. Each dog received 0.01 mg kg(-1) ACP or an equal volume saline intravenously (IV) at 1 week intervals. Measurements were performed before (baseline) and 20, 60 and 100 minutes after drug administration. Sedation was scored before drug administration and then at 10 minutes intervals. Data were analyzed with Friedman repeated measures analysis of variance on ranks and Wilcoxon signed rank tests. RESULTS: Acepromazine resulted in a mild tranquilization becoming obvious at 20 minutes and peaking 30 minutes after injection. Single (I(t)) and repeated stimuli (TS(t)) threshold intensities, NWR and TS characteristics and behavioural responses were not affected by the ACP at any time point. Both I(t) and TS(t) were stable over time. CONCLUSIONS AND CLINICAL RELEVANCE: In dogs, 0.01 mg kg(-1) ACP IV had no modulatory action on the NWR evoked by single or repeated stimuli, suggesting no antinociceptive activity on phasic nociceptive stimuli. The evidence of the stability of the NWR thresholds supports the use of the model as an objective tool to investigate nociception in conscious dogs. A low dose of ACP administered as the sole drug, can be used to facilitate the recordings in anxious subjects without altering the validity of this model.