Meta-analysis in medical research: potentials and limitations

Meta-analysis, the statistical combination of results from several studies to produce a single estimate of a treatment effect or size of an association, continues to attract controversy. We illustrate and discuss the promises and limitations of meta-analysis. Meta-analysis of clinical trials can prevent delays in the introduction of effective treatments or lead to the timely identification of adverse effects. However, meta-analyses are liable to numerous biases, both at the level of the individual study and the selection of studies for inclusion in meta-analysis. The biases and confounding factors that threaten the validity of individual studies will also affect meta-analyses of observational studies. We argue that meta-analyses should only be performed within the framework of systematic reviews that have been prepared using methods that minimize bias and address the combinability of studies.

Significance of coil orientation for motor evoked potentials from nasalis muscle elicited by transcranial magnetic stimulation

OBJECTIVE: In transcranial magnetic stimulation (TMS) of the motor cortex, the optimal orientation of the coil on the scalp is dependent on the muscle under investigation, but not yet known for facial muscles. METHODS: Using a figure-of-eight coil, we compared TMS induced motor evoked potentials (MEPs) from eight different coil orientations when recording from ipsi- and contralateral nasalis muscle. RESULTS: The MEPs from nasalis muscle revealed three components: The major ipsi- and contra-lateral middle latency responses of approximately 10 ms onset latency proved entirely dependent on voluntary pre-innervation. They were most easily obtained from a coil orientation with posterior inducing current direction, and in this respect resembled the intrinsic hand rather than the masseter muscles. Early short duration responses of around 6 ms onset latency were best elicited with an antero-lateral current direction and not pre-innervation dependent, and therefore most probably due to stimulation of the nerve roots. Late responses (>18 ms) could inconsistently be elicited with posterior coil orientations in pre-innervated condition. CONCLUSIONS: By using the appropriate coil orientation and both conditions relaxed and pre-innervated, cortically evoked MEP responses from nasalis muscle can reliably be separated from peripheral and reflex components and also from cross talk of masseter muscle activation.

Effect of discharge desynchronization on the size of motor evoked potentials: an analysis

OBJECTIVE: Motor evoked potentials (MEPs) after transcranial magnetic brain stimulation (TMS) are smaller than CMAPs after peripheral nerve stimulation, because desynchronization of the TMS-induced motor neurone discharges occurs (i.e. MEP desynchronization). This desynchronization effect can be eliminated by use of the triple stimulation technique (TST; Brain 121 (1998) 437). The objective of this paper is to study the effect of discharge desynchronization on MEPs by comparing the size of MEP and TST responses. METHODS: MEP and TST responses were obtained in 10 healthy subjects during isometric contractions of the abductor digiti minimi, during voluntary background contractions between 0% and 20% of maximal force, and using 3 different stimulus intensities. Additional data from other normals and from multiple sclerosis (MS) patients were obtained from previous studies. RESULTS: MEPs were smaller than TST responses in all subjects and under all stimulating conditions, confirming the marked influence of desynchronization on MEPs. There was a linear relation between the amplitudes of MEPs vs. TST responses, independent of the degree of voluntary contraction and stimulus intensity. The slope of the regression equation was 0.66 on average, indicating that desynchronization reduced the MEP amplitude on average by one third, with marked inter-individual variations. A similar average proportion was found in MS patients. CONCLUSIONS: The MEP size reduction induced by desynchronization is not influenced by the intensity of TMS and by the level of facilitatory voluntary background contractions. It is similar in healthy subjects and in MS patients, in whom increased desynchronization of central conduction was previously suggested to occur. Thus, the MEP size reduction observed may not parallel the actual amount of desynchronization.

Trial-to-trial size variability of motor-evoked potentials. A study using the triple stimulation technique

Motor-evoked potentials (MEPs) vary in size from one stimulus to the next. The objective of this study was to determine the cause and source of trial-to-trial MEP size variability. In two experiments involving 10 and 14 subjects, the variability of MEPs to cortical stimulation (cortical-MEPs) in abductor digiti minimi (ADM) and abductor hallucis (AH) was compared to those responses obtained using the triple stimulation technique (cortical-TST). The TST eliminates the effects of motor neuron (MN) response desynchronization and of repetitive MN discharges. Submaximal stimuli were used in both techniques. In six subjects, cortical-MEP variability was compared to that of brainstem-MEP and brainstem-TST. Variability was greater for MEPs than that for TST responses, by approximately one-third. The variability was the same for cortical- and brainstem-MEPs and was similar in ADM and AH. Variability concerned at least 10-15% of the MN pool innervating the target muscle. With the stimulation parameters used, repetitive MN discharges did not influence variability. For submaximal stimuli, approximately two-third of the observed MEP size variability is caused by the variable number of recruited alpha-MNs and approximately one-third by changing synchronization of MN discharges. The source of variability is most likely localized at the spinal segmental level.

Velocity recovery cycles of human muscle action potentials and their sensitivity to ischemia

This study was undertaken to test whether recovery cycle measurements can provide useful information about the membrane potential of human muscle fibers. Multifiber responses to direct muscle stimulation through needle electrodes were recorded from the brachioradialis of healthy volunteers, and the latency changes measured as conditioning stimuli were applied at interstimulus intervals of 2-1000 ms. In all subjects, the relative refractory period (RRP), which lasted 3.27 +/- 0.45 ms (mean +/- SD, n = 12), was followed by a phase of supernormality, in which the velocity increased by 9.3 +/- 3.4% at 6.1 +/- 1.3 ms, and recovered over 1 s. A broad hump of additional supernormality was seen at around 100 ms. Extra conditioning stimuli had little effect on the early supernormality but increased the later component. The two phases of supernormality resembled early and late afterpotentials, attributable respectively to the passive decay of membrane charge and potassium accumulation in the t-tubules. Five minutes of ischemia progressively prolonged the RRP and reduced supernormality, confirming that these parameters are sensitive to membrane depolarization. Velocity recovery cycles may provide useful information about altered muscle membrane potential and t-tubule function in muscle disease. Muscle Nerve, 2008.

Benchmarking with Spine Tango: potentials and pitfalls

The newly released online statistics function of Spine Tango allows comparison of own data against the aggregated results of the data pool that all other participants generate. This comparison can be considered a very simple way of benchmarking, which means that the quality of what one organization does is compared with other similar organizations. The goal is to make changes towards better practice if benchmarking shows inferior results compared with the pool. There are, however, pitfalls in this simplified way of comparing data that can result in confounding. This means that important influential factors can make results appear better or worse than they are in reality and these factors can only be identified and neutralized in a multiple regression analysis performed by a statistical expert. Comparing input variables, confounding is less of a problem than comparing outcome variables. Therefore, the potentials and limitations of automated online comparisons need to be considered when interpreting the results of the benchmarking procedure.

Auditory event-related potentials, bispectral index, and entropy for the discrimination of different levels of sedation in intensive care unit patients

BACKGROUND: Sedation protocols, including the use of sedation scales and regular sedation stops, help to reduce the length of mechanical ventilation and intensive care unit stay. Because clinical assessment of depth of sedation is labor-intensive, performed only intermittently, and interferes with sedation and sleep, processed electrophysiological signals from the brain have gained interest as surrogates. We hypothesized that auditory event-related potentials (ERPs), Bispectral Index (BIS), and Entropy can discriminate among clinically relevant sedation levels. METHODS: We studied 10 patients after elective thoracic or abdominal surgery with general anesthesia. Electroencephalogram, BIS, state entropy (SE), response entropy (RE), and ERPs were recorded immediately after surgery in the intensive care unit at Richmond Agitation-Sedation Scale (RASS) scores of -5 (very deep sedation), -4 (deep sedation), -3 to -1 (moderate sedation), and 0 (awake) during decreasing target-controlled sedation with propofol and remifentanil. Reference measurements for baseline levels were performed before or several days after the operation. RESULTS: At baseline, RASS -5, RASS -4, RASS -3 to -1, and RASS 0, BIS was 94 [4] (median, IQR), 47 [15], 68 [9], 75 [10], and 88 [6]; SE was 87 [3], 46 [10], 60 [22], 74 [21], and 87 [5]; and RE was 97 [4], 48 [9], 71 [25], 81 [18], and 96 [3], respectively (all P < 0.05, Friedman Test). Both BIS and Entropy had high variabilities. When ERP N100 amplitudes were considered alone, ERPs did not differ significantly among sedation levels. Nevertheless, discriminant ERP analysis including two parameters of principal component analysis revealed a prediction probability PK value of 0.89 for differentiating deep sedation, moderate sedation, and awake state. The corresponding PK for RE, SE, and BIS was 0.88, 0.89, and 0.85, respectively. CONCLUSIONS: Neither ERPs nor BIS or Entropy can replace clinical sedation assessment with standard scoring systems. Discrimination among very deep, deep to moderate, and no sedation after general anesthesia can be provided by ERPs and processed electroencephalograms, with similar P(K)s. The high inter- and intraindividual variability of Entropy and BIS precludes defining a target range of values to predict the sedation level in critically ill patients using these parameters. The variability of ERPs is unknown.

Managing a World Heritage Site – Potentials and Limitations of Transdisciplinary Approaches

Management of the World Heritage Site Swiss Alps Jungfrau-Aletsch is challenged by the interplay of conservation and economic development. This is a situation where a knowledge-based solution is sought for a complex societal problem. This sets the frame for transdisciplinary research where the problem is defined and solved cooperatively by actors from science and the life-world. In this paper we re-examine studies carried out in the region of the WHS Jungfrau-Aletsch and reveal the issue of integration into participation, the issue of perceptions and positions as well as the issue of negotiability and implementation as key issues prevalent in transdisciplinary settings. The transdisciplinary setting in the case of the WHS Jungfrau-Aletsch constructs a situation of mutual learning among stakeholders from different levels and backgrounds. However, the positive effects of mutual learning are continuously challenged by the power play inherent in participatory approaches.