The inter-rater reliability of the Pulmonary Embolism Severity Index

The Pulmonary Embolism Severity Index (PESI) is a validated clinical prognostic model for patients with acute pulmonary embolism (PE). Our goal was to assess the PESI's inter-rater reliability in patients diagnosed with PE. We prospectively identified consecutive patients diagnosed with PE in the emergency department of a Swiss teaching hospital. For all patients, resident and attending physician raters independently collected the 11 PESI variables. The raters then calculated the PESI total point score and classified patients into one of five PESI risk classes (I-V) and as low (risk classes I/II) versus higher-risk (risk classes III-V). We examined the inter-rater reliability for each of the 11 PESI variables, the PESI total point score, assignment to each of the five PESI risk classes, and classification of patients as low versus higher-risk using kappa ( ) and intra-class correlation coefficients (ICC). Among 48 consecutive patients with an objective diagnosis of PE, reliability coefficients between resident and attending physician raters were > 0.60 for 10 of the 11 variables comprising the PESI. The inter-rater reliability for the PESI total point score (ICC: 0.89, 95% CI: 0.81-0.94), PESI risk class assignment ( : 0.81, 95% CI: 0.66-0.94), and the classification of patients as low versus higher-risk ( : 0.92, 95% CI: 0.72-0.98) was near perfect. Our results demonstrate the high reproducibility of the PESI, supporting the use of the PESI for risk stratification of patients with PE.

Clinical application and reliability of a post abdominal surgery pain assessment scale (PASPAS) in horses

The aim of this study was to refine a multi-dimensional scale based on physiological and behavioural parameters, known as the post abdominal surgery pain assessment scale (PASPAS), to quantify pain after laparotomy in horses. After a short introduction, eight observers used the scale to assess eight horses at multiple time points after laparotomy. In addition, a single observer was used to test the correlation of each parameter with the total pain index in 34 patients, and the effect of general anaesthesia on PASPAS was investigated in a control group of eight horses. Inter-observer variability was low (coefficient of variation 0.3), which indicated good reliability of PASPAS. The correlation of individual parameters with the total pain index differed between parameters. PASPAS, which was not influenced by general anaesthesia, was a useful tool to evaluate pain in horses after abdominal surgery and may also be useful to investigate analgesic protocols or for teaching purposes.

Cold-season temperatures in the European Alps during the past millennium: variability, seasonality and recent trends

This study presents a proxy-based, quantitative reconstruction of cold-season (mean October to May, TOct–May) air temperatures covering nearly the entire last millennium (AD 1060–2003, some hiatuses). The reconstruction was based on subfossil chrysophyte stomatocyst remains in the varved sediments of high-Alpine Lake Silvaplana, eastern Swiss Alps (46°27’N, 9°48′W, 1791 m a.s.l.). Previous studies have demonstrated the reliability of this proxy by comparison to meteorological data. Cold-season air temperatures could therefore be reconstructed quantitatively, at a high resolution (5-yr) and with high chronological accuracy. Spatial correlation analysis suggests that the reconstruction reflects cold season climate variability over the high- Alpine region and substantial parts of central and western Europe. Cold-season temperatures were characterized by a relatively stable first part of the millennium until AD 1440 (2σ of 5-yr mean values = 0.7 °C) and highly variable TOct–May after that (AD 1440–1900, 2σ of 5-yr mean values = 1.3 °C). Recent decades (AD, 1991-present) were unusually warm in the context of the last millennium (exceeding the 2σ-range of the mean decadal TOct–May) but this warmth was not unprecedented. The coolest decades occurred from AD 1510–1520 and AD 1880–1890. The timing of extremely warm and cold decades is generally in good agreement with documentary data representing Switzerland and central European lowlands. The transition from relatively stable to highly variable TOct–May coincided with large changes in atmospheric circulation patterns in the North Atlantic region. Comparison of reconstructed cold season temperatures to the North Atlantic Oscillation index (NAO) during the past 1000 years showed that the relatively stable and warm conditions at the study site until AD 1440 coincided with a persistent positive mode of the NAO. We propose that the transition to large TOct–May variability around AD 1440 was linked to the subsequent absence of this persistent zonal flow pattern, which would allow other climatic drivers to gain importance in the study area. From AD 1440–1900, the similarity of reconstructed TOct–May to reconstructed air pressure in the Siberian High suggests a relatively strong influence of continental anticyclonic systems on Alpine cold season climate parameters during periods when westerly airflow was subdued. A more continental type of atmospheric circulation thus seems to be characteristic for the Little Ice Age in Europe. Comparison of Toct–May to summer temperature reconstructions from the same study site shows that, as expected, summer and cold season temperature trends and variability differed completely throughout nearly the entire last 1000 years. Since AD 1980, however, summer and cold season temperatures show a simultaneous, strong increase, which is unprecedented in the context of the last millennium. We suggest that the most likely explanation for this recent trend is anthropogenic greenhouse gas (GHG) forcing.

Interlaboratory variability of MIB1 staining in well-differentiated pancreatic neuroendocrine tumors

Neuroendocrine tumors (NET) are routinely graded and staged to judge prognosis. Proliferation index using MIB1 staining has been introduced to assess grading. There are vivid discussions on cutoff definitions, automated counting, and interobserver variability. However, no data exist regarding interlaboratory reproducibility for low proliferation indices which are of importance to discriminate between G1 and G2 NET. We performed MIB1 staining in three different university hospital-based pathology laboratories on a tissue micro array (TMA) of a well-characterized patient cohort, containing pancreatic NET of 61 patients. To calculate the proliferation index, number of positive tumor nuclei was divided by the total number of tumor nuclei. Labeling index was compared to mitotic counts in whole tissue sections and to clinical outcome. Linear regression analysis, intraclass comparison, and log-rank analysis were performed. Intraclass correlation showed moderate-to-fair agreement. Especially low proliferating tumors were affected by interlaboratory differences. Log-rank analysis was performed for each lab and resulted in three different cutoffs (5.0, 3.0, and 0.5 %). Every calculated cutoff stratified the patient cohort to a significant extent for the underlying stain (p < 0.001, <0.001, and <0.001) but showed no or lesser significance when applied to the other stains. Significant and relevant interlab differences for MIB1 exist. Since the MIB1 proliferation index influences grading, local cutoffs or external standardization should urgently be introduced to achieve reliability and reproducibility.

The Lower Limb Functional Index: development and clinimetric properties

Background Existing lower-limb, region-specific, patient-reported outcome measures have clinimetric limitations, including limitations in psychometric characteristics (eg, lack of internal consistency, lack of responsiveness, measurement error) and the lack of reported practical and general characteristics. A new patient-reported outcome measure, the Lower Limb Functional Index (LLFI), was developed to address these limitations. Objective The purpose of this study was to overcome recognized deficiencies in existing lower-limb, region-specific, patient-reported outcome measures through: (1) development of a new lower-extremity outcome scale (ie, the LLFI) and (2) evaluation of the clinimetric properties of the LLFI using the Lower Extremity Functional Scale (LEFS) as a criterion measure. Design This was a prospective observational study. Methods The LLFI was developed in a 3-stage process of: (1) item generation, (2) item reduction with an expert panel, and (3) pilot field testing (n=18) for reliability, responsiveness, and sample size requirements for a larger study. The main study used a convenience sample (n=127) from 10 physical therapy clinics. Participants completed the LLFI and LEFS every 2 weeks for 6 weeks and then every 4 weeks until discharge. Data were used to assess the psychometric, practical, and general characteristics of the LLFI and the LEFS. The characteristics also were evaluated for overall performance using the Measurement of Outcome Measures and Bot clinimetric assessment scales. Results The LLFI and LEFS demonstrated a single-factor structure, comparable reliability (intraclass correlation coefficient [2,1]=.97), scale width, and high criterion validity (Pearson r=.88, with 95% confidence interval [CI]). Clinimetric performance was higher for the LLFI compared with the LEFS on the Measurement of Outcome Measures scale (96% and 95%, respectively) and the Bot scale (100% and 83%, respectively). The LLFI, compared with the LEFS, had improved responsiveness (standardized response mean=1.75 and 1.64, respectively), minimal detectable change with 90% CI (6.6% and 8.1%, respectively), and internal consistency (α=.91 and .95, respectively), as well as readability with reduced user error and completion and scoring times. Limitations Limitations of the study were that only participants recruited from outpatient physical therapy clinics were included and that no specific conditions or diagnostic subgroups were investigated. Conclusion The LLFI demonstrated sound clinimetric properties. There was lower response error, efficient completion and scoring, and improved responsiveness and overall performance compared with the LEFS. The LLFI is suitable for assessment of lower-limb function.

Indigenous knowledge related to climate variability and change: insights from droughts in semi-arid areas of former Makueni District, Kenya

This article describes the indigenous knowledge (IK) that agro-pastoralists in larger Makueni District, Kenya hold and how they use it to monitor, mitigate and adapt to drought. It examines ways of integrating IK into formal monitoring, how to enhance its value and acceptability. Data was collected through target interviews, group discussions and questionnaires covering 127 households in eight villages. Daily rainfall data from 1961–2003 were analysed. Results show that agro-pastoralists hold IK on indicators of rainfall variability; they believe in IK efficacy and they rely on them. Because agro-pastoralists consult additional sources, the authors interpret that IK forms a basic knowledge frame within which agro-pastoralists position and interpret meteorological forecasts. Only a few agro-pastoralists adapt their practices in anticipation of IK-based forecasts partly due to the conditioning of the actors to the high rainfall variability characteristic of the area and partly due to lack of resources. Non-drought factors such as poverty, inadequate resources and lack of preparedness expose agro-pastoralists to drought impacts and limit their adaptive capacity. These factors need to be understood and effectively addressed to increase agro-pastoralists’ decision options and the influence of IK-based forecasts on their decision-making patterns. The limited intergenerational transfer of IK currently threatens its existence in the longer term. One way to ensure its continued existence and use is to integrate IK into the education curriculum and to link IK with formal climate change research through the participation of the local people. However, further studies are necessary to address the reliability and validity of the identified IK indicators of climate variability and change.

Multiplicity of data in trial reports and the reliability of meta-analyses: empirical study

Objectives To examine the extent of multiplicity of data in trial reports and to assess the impact of multiplicity on meta-analysis results. Design Empirical study on a cohort of Cochrane systematic reviews. Data sources All Cochrane systematic reviews published from issue 3 in 2006 to issue 2 in 2007 that presented a result as a standardised mean difference (SMD). We retrieved trial reports contributing to the first SMD result in each review, and downloaded review protocols. We used these SMDs to identify a specific outcome for each meta-analysis from its protocol. Review methods Reviews were eligible if SMD results were based on two to ten randomised trials and if protocols described the outcome. We excluded reviews if they only presented results of subgroup analyses. Based on review protocols and index outcomes, two observers independently extracted the data necessary to calculate SMDs from the original trial reports for any intervention group, time point, or outcome measure compatible with the protocol. From the extracted data, we used Monte Carlo simulations to calculate all possible SMDs for every meta-analysis. Results We identified 19 eligible meta-analyses (including 83 trials). Published review protocols often lacked information about which data to choose. Twenty-four (29%) trials reported data for multiple intervention groups, 30 (36%) reported data for multiple time points, and 29 (35%) reported the index outcome measured on multiple scales. In 18 meta-analyses, we found multiplicity of data in at least one trial report; the median difference between the smallest and largest SMD results within a meta-analysis was 0.40 standard deviation units (range 0.04 to 0.91). Conclusions Multiplicity of data can affect the findings of systematic reviews and meta-analyses. To reduce the risk of bias, reviews and meta-analyses should comply with prespecified protocols that clearly identify time points, intervention groups, and scales of interest.

Monitoring Butterfly Abundance: Beyond Pollard Walks

Most butterfly monitoring protocols rely on counts along transects (Pollard walks) to generate species abundance indices and track population trends. It is still too often ignored that a population count results from two processes: the biological process (true abundance) and the statistical process (our ability to properly quantify abundance). Because individual detectability tends to vary in space (e.g., among sites) and time (e.g., among years), it remains unclear whether index counts truly reflect population sizes and trends. This study compares capture-mark-recapture (absolute abundance) and count-index (relative abundance) monitoring methods in three species (Maculinea nausithous and Iolana iolas: Lycaenidae; Minois dryas: Satyridae) in contrasted habitat types. We demonstrate that intraspecific variability in individual detectability under standard monitoring conditions is probably the rule rather than the exception, which questions the reliability of count-based indices to estimate and compare specific population abundance. Our results suggest that the accuracy of count-based methods depends heavily on the ecology and behavior of the target species, as well as on the type of habitat in which surveys take place. Monitoring programs designed to assess the abundance and trends in butterfly populations should incorporate a measure of detectability. We discuss the relative advantages and inconveniences of current monitoring methods and analytical approaches with respect to the characteristics of the species under scrutiny and resources availability.

Stimulation induced variability of pulse plethysmography does not discriminate responsiveness to intubation

BACKGROUND: Hypnotic depth but not haemodynamic response to painful stimulation can be measured with various EEG-based anaesthesia monitors. We evaluated the variation of pulse plethysmography amplitude induced by an electrical tetanic stimulus (PPG variation) as a potential measure for analgesia and predictor of haemodynamic responsiveness during general anaesthesia. METHODS: Ninety-five patients, ASA I or II, were randomly assigned to five groups [Group 1: bispectral index (BIS) (range) 40-50, effect site remifentanil concentration 1 ng ml(-1);Group 2: BIS 40-50, remifentanil 2 ng ml(-1); Group 3: BIS 40-50, remifentanil 4 ng ml(-1); Group 4: BIS 25-35, remifentanil 2 ng ml(-1); Group 5: BIS 55-65, remifentanil 2 ng ml(-1)]. A 60 mA tetanic stimulus was applied for 5 s on the ulnar nerve. From the digitized pulse oximeter wave recorded on a laptop computer, linear and non-linear parameters of PPG variation during the 60 s period after stimulation were computed. The haemodynamic response to subsequent orotracheal intubation was recorded. The PPG variation was compared between groups and between responders and non-responders to intubation (anova). Variables independently predicting the response were determined by logistic regression. RESULTS: The probability of a response to tracheal intubation was 0.77, 0.47, 0.05, 0.18 and 0.52 in Groups 1-5, respectively (P<0.03). The PPG variability was significantly higher in responders than in non-responders but it did not improve the prediction of the response to tracheal intubation based on BIS level and effect site remifentanil concentration. CONCLUSION: Tetanic stimulation induced PPG variation does not reflect the analgesic state in a wide clinical range of surgical anaesthesia.

Intraobserver and interobserver variability of 64-row computed tomography abdominal aortic aneurysm neck measurements

BACKGROUND: Integrity of the abdominal aortic aneurysm (AAA) neck is crucial for the long-term success of endovascular AAA repair (EVAR). However, suitable tools for reliable assessment of changes in small aortic volumes are lacking. The purpose of this study was to assess the intraobserver and interobserver variability of software-enhanced 64-row computed tomographic angiography (CTA) AAA neck volume measurements in patients after EVAR. METHODS: A total of 25 consecutive patients successfully treated by EVAR underwent 64-row follow-up CTA in 1.5-mm collimation. Manual CTA measurements were performed twice by three blinded and independent readers in random order with at least a 4-week interval between readings. Maximum and minimum transverse aortic neck diameters were measured twice on two different levels within the proximal neck. Volumetry of the proximal aortic neck was performed by using dedicated software. Variability was calculated as 1.96 SD of the mean arithmetic difference according to Bland and Altman. Two-sided and paired t tests were used to compare measurements. P values <.05 were considered to indicate statistical significance. RESULTS: Intraobserver agreement was excellent for dedicated aneurysmal neck volumetry, with mean differences of less than 1 mL (P > .05), whereas it was poor for transverse aortic neck diameter measurements (P < .05). However, interobserver variability was statistically significant for both neck volumetry (P < .005) and neck diameter measurements (P < .015). CONCLUSIONS: The reliability of dedicated AAA neck volumetry by using 64-row CTA is excellent for serial measurements by individual readers, but not between different readers. Therefore, studies should be performed with aortic neck volumetry by a single experienced reader.

Early autonomic dysfunction in patients with diabetes mellitus assessed by spectral analysis of heart rate and blood pressure variability

Patients with diabetes mellitus (DM) often have alterations of the autonomic nervous system (ANS), even early in their disease course. Previous research has not evaluated whether these changes may have consequences on adaptation mechanisms in DM, e.g. to mental stress. We therefore evaluated whether patients with DM who already had early alterations of the ANS reacted with an abnormal regulatory pattern to mental stress. We used the spectral analysis technique, known to be valuable and reliable in the investigation of disturbances of the ANS. We investigated 34 patients with DM without clinical evidence of ANS dysfunction (e.g. orthostatic hypotension) and 44 normal control subjects (NC group). No patients on medication known to alter ANS responses were accepted. The investigation consisted of a resting state evaluation and a mental stress task (BonnDet). In basal values, only the 21 patients with type 2 DM were different in respect to body mass index and systolic blood pressure. In the study parameters we found significantly lower values in resting and mental stress spectral power of mid-frequency band (known to represent predominantly sympathetic influences) and of high-frequency and respiration bands (known to represent parasympathetic influences) in patients with DM (types 1 and 2) compared with NC group (5.3 +/- 1.2 ms2 vs. 6.1 +/- 1.3 ms2, and 5.5 +/- 1.6 ms2 vs. 6.2 +/- 1.5 ms2, and 4.6 +/- 1.7 ms2 vs. 6.2 +/- 1.5 ms2, for resting values respectively; 4.7 +/- 1.4 ms2 vs. 5.9 +/- 1.2 ms2, and 4.6 +/- 1.9 ms2 vs. 5.6 +/- 1.7 ms2, and 3.7 +/- 2.1 ms2 vs. 5.6 +/- 1.7 ms2, for stress values respectively; M/F ratio 6/26 vs. 30/14). These differences remained significant even when controlled for age, sex, and body weight. However, patients with DM type 2 (and significantly higher body weight) showed only significant values in mental stress modulus values. There were no specific group effects in the patients with DM in adaptation mechanisms to mental stress compared with the NC group. These findings demonstrate that power spectral examinations at rest are sufficiently reliable to diagnose early alterations in ANS in patients with DM. The spectral analysis technique is sensitive and reliable in investigation of ANS in patients with DM without clinically symptomatic autonomic dysfunction.

Relationship between heart rate variability, interleukin-6, and soluble tissue factor in healthy subjects

Decreased heart rate variability (HRV) has been associated with an increased risk of atherosclerosis. We hypothesized that a decrease in frequency domains of resting HRV would be associated with elevated plasma levels of interleukin (IL)-6 and soluble tissue factor (sTF) both previously shown to prospectively predict atherothrombotic events in healthy subjects. Subjects were 102 healthy and unmedicated black and white middle-aged men and women. We determined IL-6 and sTF antigen in plasma and HRV measures from surface electrocardiogram data using spectral analysis. All statistical analyses controlled for age, gender, ethnicity, smoking status, blood pressure, and body mass index. Low amounts of low frequency (LF) power (beta=-0.31, p=0.007) and high frequency (HF) power (beta=-0.36, p=0.002) were associated with increased amounts of IL-6, explaining 7% and 9% of the variance, respectively. Interactions between LF power and IL-6 (p=0.002) and between HF power and IL-6 (p=0.012) explained 8% and 5%, respectively, of the variance in sTF. Post hoc analyses showed associations between IL-6 and sTF when LF power (beta=0.51, p<0.001) and HF power (beta=0.48, p<0.001) were low but not when LF power and high HF power were high. The findings suggest that systemic low-grade inflammatory activity is associated with a decrease in HRV. Furthermore, there was a positive relationship between plasma levels of IL-6 and sTF antigen when HRV was low. Inflammation and related hypercoagulability might particularly contribute to atherothrombotic events in a setting of decreased HRV.

Index of Complexity, Outcome and Need scored on plaster and digital models

The aim of this study was to compare standard plaster models with their digital counterparts for the applicability of the Index of Complexity, Outcome, and Need (ICON). Generated study models of 30 randomly selected patients: 30 pre- (T(0)) and 30 post- (T(1)) treatment. Two examiners, calibrated in the ICON, scored the digital and plaster models. The overall ICON scores were evaluated for reliability and reproducibility using kappa statistics and reliability coefficients. The values for reliability of the total and weighted ICON scores were generally high for the T(0) sample (range 0.83-0.95) but less high for the T(1) sample (range 0.55-0.85). Differences in total ICON score between plaster and digital models resulted in mostly statistically insignificant values (P values ranging from 0.07 to 0.19), except for observer 1 in the T(1) sample. No statistically different values were found for the total ICON score on either plaster or digital models. ICON scores performed on computer-based models appear to be as accurate and reliable as ICON scores on plaster models.

Oscillometric measurement of ankle-brachial index in patients with suspected peripheral disease: comparison with Doppler method

QUESTION UNDER STUDY: Purpose was to validate accuracy and reliability of automated oscillometric ankle-brachial (ABI) measurement prospectively against the current gold standard of Doppler-assisted ABI determination. METHODS: Oscillometric ABI was measured in 50 consecutive patients with peripheral arterial disease (n = 100 limbs, mean age 65 +/- 6 years, 31 men, 19 diabetics) after both high and low ABI had been determined conventionally by Doppler under standardised conditions. Correlation was assessed by linear regression and Pearson product moment correlation. Degree of inter-modality agreement was quantified by use of Bland and Altman method. RESULTS: Oscillometry was performed significantly faster than Doppler-assisted ABI (3.9 +/- 1.3 vs 11.4 +/- 3.8 minutes, P <0.001). Mean readings were 0.62 +/- 0.25, 0.70 +/- 0.22 and 0.63 +/- 0.39 for low, high and oscillometric ABI, respectively. Correlation between oscillometry and Doppler ABI was good overall (r = 0.76 for both low and high ABI) and excellent in oligo-symptomatic, non-diabetic patients (r = 0.81; 0.07 +/- 0.23); it was, however, limited in diabetic patients and in patients with critical limb ischaemia. In general, oscillometric ABI readings were slightly higher (+0.06), but linear regression analysis showed that correlation was sustained over the whole range of measurements. CONCLUSIONS: Results of automated oscillometric ABI determination correlated well with Doppler-assisted measurements and could be obtained in shorter time. Agreement was particularly high in oligo-symptomatic non-diabetic patients.

Auditory event-related potentials, bispectral index, and entropy for the discrimination of different levels of sedation in intensive care unit patients

BACKGROUND: Sedation protocols, including the use of sedation scales and regular sedation stops, help to reduce the length of mechanical ventilation and intensive care unit stay. Because clinical assessment of depth of sedation is labor-intensive, performed only intermittently, and interferes with sedation and sleep, processed electrophysiological signals from the brain have gained interest as surrogates. We hypothesized that auditory event-related potentials (ERPs), Bispectral Index (BIS), and Entropy can discriminate among clinically relevant sedation levels. METHODS: We studied 10 patients after elective thoracic or abdominal surgery with general anesthesia. Electroencephalogram, BIS, state entropy (SE), response entropy (RE), and ERPs were recorded immediately after surgery in the intensive care unit at Richmond Agitation-Sedation Scale (RASS) scores of -5 (very deep sedation), -4 (deep sedation), -3 to -1 (moderate sedation), and 0 (awake) during decreasing target-controlled sedation with propofol and remifentanil. Reference measurements for baseline levels were performed before or several days after the operation. RESULTS: At baseline, RASS -5, RASS -4, RASS -3 to -1, and RASS 0, BIS was 94 [4] (median, IQR), 47 [15], 68 [9], 75 [10], and 88 [6]; SE was 87 [3], 46 [10], 60 [22], 74 [21], and 87 [5]; and RE was 97 [4], 48 [9], 71 [25], 81 [18], and 96 [3], respectively (all P < 0.05, Friedman Test). Both BIS and Entropy had high variabilities. When ERP N100 amplitudes were considered alone, ERPs did not differ significantly among sedation levels. Nevertheless, discriminant ERP analysis including two parameters of principal component analysis revealed a prediction probability PK value of 0.89 for differentiating deep sedation, moderate sedation, and awake state. The corresponding PK for RE, SE, and BIS was 0.88, 0.89, and 0.85, respectively. CONCLUSIONS: Neither ERPs nor BIS or Entropy can replace clinical sedation assessment with standard scoring systems. Discrimination among very deep, deep to moderate, and no sedation after general anesthesia can be provided by ERPs and processed electroencephalograms, with similar P(K)s. The high inter- and intraindividual variability of Entropy and BIS precludes defining a target range of values to predict the sedation level in critically ill patients using these parameters. The variability of ERPs is unknown.