Disagreements in meta-analyses using outcomes measured on continuous or rating scales: observer agreement study

OBJECTIVE: To study the inter-observer variation related to extraction of continuous and numerical rating scale data from trial reports for use in meta-analyses. DESIGN: Observer agreement study. DATA SOURCES: A random sample of 10 Cochrane reviews that presented a result as a standardised mean difference (SMD), the protocols for the reviews and the trial reports (n=45) were retrieved. DATA EXTRACTION: Five experienced methodologists and five PhD students independently extracted data from the trial reports for calculation of the first SMD result in each review. The observers did not have access to the reviews but to the protocols, where the relevant outcome was highlighted. The agreement was analysed at both trial and meta-analysis level, pairing the observers in all possible ways (45 pairs, yielding 2025 pairs of trials and 450 pairs of meta-analyses). Agreement was defined as SMDs that differed less than 0.1 in their point estimates or confidence intervals. RESULTS: The agreement was 53% at trial level and 31% at meta-analysis level. Including all pairs, the median disagreement was SMD=0.22 (interquartile range 0.07-0.61). The experts agreed somewhat more than the PhD students at trial level (61% v 46%), but not at meta-analysis level. Important reasons for disagreement were differences in selection of time points, scales, control groups, and type of calculations; whether to include a trial in the meta-analysis; and data extraction errors made by the observers. In 14 out of the 100 SMDs calculated at the meta-analysis level, individual observers reached different conclusions than the originally published review. CONCLUSIONS: Disagreements were common and often larger than the effect of commonly used treatments. Meta-analyses using SMDs are prone to observer variation and should be interpreted with caution. The reliability of meta-analyses might be improved by having more detailed review protocols, more than one observer, and statistical expertise.

Critical appraisal of meta-analyses: an introductory guide for the practicing surgeon

ABSTRACT: Meta-analyses are an essential tool of clinical research. Meta-analyses of individual randomized controlled trials frequently constitute the highest possible level of scientific evidence for a given research question and allow surgeons to rapidly gain a comprehensive understanding of an important clinical issue. Moreover, meta-analyses often serve as cornerstones for evidence-based surgery, treatment guidelines, and knowledge transfer. Given the importance of meta-analyses to the medical (and surgical) knowledge base, it is of cardinal importance that surgeons have a basic grasp of the principles that guide a high-quality meta-analysis, and be able to weigh objectively the advantages and potential pitfalls of this clinical research tool. Unfortunately, surgeons are often ill-prepared to successfully conduct, critically appraise, and correctly interpret meta-analyses. The objective of this educational review is to provide surgeons with a brief introductory overview of the knowledge and skills required for understanding and critically appraising surgical meta-analyses as well as assessing their implications for their own surgical practice.

Plant ion channels: gene families, physiology, and functional genomics analyses

Distinct potassium, anion, and calcium channels in the plasma membrane and vacuolar membrane of plant cells have been identified and characterized by patch clamping. Primarily owing to advances in Arabidopsis genetics and genomics, and yeast functional complementation, many of the corresponding genes have been identified. Recent advances in our understanding of ion channel genes that mediate signal transduction and ion transport are discussed here. Some plant ion channels, for example, ALMT and SLAC anion channel subunits, are unique. The majority of plant ion channel families exhibit homology to animal genes; such families include both hyperpolarization- and depolarization-activated Shaker-type potassium channels, CLC chloride transporters/channels, cyclic nucleotide-gated channels, and ionotropic glutamate receptor homologs. These plant ion channels offer unique opportunities to analyze the structural mechanisms and functions of ion channels. Here we review gene families of selected plant ion channel classes and discuss unique structure-function aspects and their physiological roles in plant cell signaling and transport.

Comparative Analyses of Child and Youth Services in Europe

This paper contains a comparative evaluation of the reactions of welfare states to the isomorphic pressures emanating from the European Union based on two case studies taken from the Child and Youth Welfare System. In the European Community different concepts of welfare policy exist. In the unification process every member state has to find answers to the pressure of assimilation invoked by the legislation. The objective of this explorative study is to show that countries can learn from each other in order to improve their own system of social services.

Clinical, histologic, and immunohistochemical analyses of feline squamous cell carcinoma in situ

Actinic keratosis (AK) and Bowenoid in situ carcinoma (BISC) are two distinct forms of in situ squamous cell carcinoma in felines. They usually occur on different locations and present with specific clinical and histologic features. However, in some cases, these diseases cannot be distinguished either clinically or histopathologically. The aim of the present study was to determine the accuracy of diagnosis based on clinical or histologic criteria alone, and whether immunohistochemistry for papillomavirus or p53 can improve the accuracy of diagnosis. A series of in situ squamous cell carcinoma cases (n = 45) were selected according to their location and initial histologic classification and subsequently classified as AK (n = 22) or BISC (n = 23) according to the clinical criteria and were reevaluated histologically by 2 dermatopathologists. All BISC cases and most of the AK cases (n = 15) were confirmed histologically. In 7 cases clinically classified as AK, this diagnosis was not unanimously confirmed histologically because of the presence of overlapping features. P53 immunoreactivity was observed in 11/14 (79%) confirmed AK cases and in 4/22 (18%) BISC cases, while papillomavirus antigen was not detected in any confirmed AK case but was detected in 11/23 (48%) BISC cases. It was concluded that BISC can usually be reliably diagnosed histologically. The histologic diagnosis of lesions clinically suggestive of AK might sometimes be difficult. Results of immunohistochemistry for p53 and papillomavirus antigen were supportive for a role of sun exposure and papillomavirus in the pathogenesis of AK and BISC, respectively.

The Nestlé crash

On November 17, 1988, the board of directors of Nestlé AG decided to allow foreign investors to hold Nestlé registered stock, reversing a longstanding practice. This decision had a tremendous impact on the prices of the firm's three classes of common stock, as well as on the prices of several other corporations traded on the Zürich stock exchange. These price changes can be explained by the hypothesis that demand curves slope down.

Brain electric correlates of strong belief in paranormal phenomena: intracerebral EEG source and regional Omega complexity analyses

The neurocognitive processes underlying the formation and maintenance of paranormal beliefs are important for understanding schizotypal ideation. Behavioral studies indicated that both schizotypal and paranormal ideation are based on an overreliance on the right hemisphere, whose coarse rather than focussed semantic processing may favor the emergence of 'loose' and 'uncommon' associations. To elucidate the electrophysiological basis of these behavioral observations, 35-channel resting EEG was recorded in pre-screened female strong believers and disbelievers during resting baseline. EEG data were subjected to FFT-Dipole-Approximation analysis, a reference-free frequency-domain dipole source modeling, and Regional (hemispheric) Omega Complexity analysis, a linear approach estimating the complexity of the trajectories of momentary EEG map series in state space. Compared to disbelievers, believers showed: more right-located sources of the beta2 band (18.5-21 Hz, excitatory activity); reduced interhemispheric differences in Omega complexity values; higher scores on the Magical Ideation scale; more general negative affect; and more hypnagogic-like reveries after a 4-min eyes-closed resting period. Thus, subjects differing in their declared paranormal belief displayed different active, cerebral neural populations during resting, task-free conditions. As hypothesized, believers showed relatively higher right hemispheric activation and reduced hemispheric asymmetry of functional complexity. These markers may constitute the neurophysiological basis for paranormal and schizotypal ideation.

Face-elicited ERPs and affective attitude: brain electric microstate and tomography analyses

Objectives: Although behavioral studies have demonstrated that normative affective traits modulate the processing of facial and emotionally charged stimuli, direct electrophysiological evidence for this modulation is still lacking. Methods: Event-related potential (ERP) data associated with personal, traitlike approach- or withdrawal-related attitude (assessed post-recording and 14 months later) were investigated in 18 subjects during task-free (i.e. unrequested, spontaneous) emotional evaluation of faces. Temporal and spatial aspects of 27 channel ERP were analyzed with microstate analysis and low resolution electromagnetic tomography (LORETA), a new method to compute 3 dimensional cortical current density implemented in the Talairach brain atlas. Results: Microstate analysis showed group differences 132-196 and 196-272 ms poststimulus, with right-shifted electric gravity centers for subjects with negative affective attitude. During these (over subjects reliably identifiable) personality-modulated, face-elicited microstates, LORETA revealed activation of bilateral occipito-temporal regions, reportedly associated with facial configuration extraction processes. Negative compared to positive affective attitude showed higher activity right temporal; positive compared to negative attitude showed higher activity left temporo-parieto-occipital. Conclusions: These temporal and spatial aspects suggest that the subject groups differed in brain activity at early, automatic, stimulus-related face processing steps when structural face encoding (configuration extraction) occurs. In sum, the brain functional microstates associated with affect-related personality features modulate brain mechanisms during face processing already at early information processing stages.