Distance measures for image segmentation evaluation

The task considered in this paper is performance evaluation of region segmentation algorithms in the ground-truth-based paradigm. Given a machine segmentation and a ground-truth segmentation, performance measures are needed. We propose to consider the image segmentation problem as one of data clustering and, as a consequence, to use measures for comparing clusterings developed in statistics and machine learning. By doing so, we obtain a variety of performance measures which have not been used before in image processing. In particular, some of these measures have the highly desired property of being a metric. Experimental results are reported on both synthetic and real data to validate the measures and compare them with others.

How do indirect measures of evaluation work? Evaluating the inference of prejudice in the Implicit Association Test

There has been significant interest in indirect measures of attitudes like the Implicit Association Test (IAT), presumably because of the possibility of uncovering implicit prejudices. The authors derived a set of qualitative predictions for people's performance in the IAT on the basis of random walk models. These were supported in 3 experiments comparing clearly positive or negative categories to nonwords. They also provided evidence that participants shift their response criterion when doing the IAT. Because of these criterion shifts, a response pattern in the IAT can have multiple causes. Thus, it is not possible to infer a single cause (such as prejudice) from IAT results. A surprising additional result was that nonwords were treated as though they were evaluated more negatively than obviously negative items like insects, suggesting that low familiarity items may generate the pattern of data previously interpreted as evidence for implicit prejudice.

Evaluation of renal allograft function early after transplantation with diffusion-weighted MR imaging

To determine the inter-patient variability of apparent diffusion coefficients (ADC) and concurrent micro-circulation contributions from diffusion-weighted MR imaging (DW-MRI) in renal allografts early after transplantation, and to obtain initial information on whether these measures are altered in histologically proven acute allograft rejection (AR).

Comparison of two scoring systems for evaluation of treatment outcome in patients with complete bilateral cleft lip and palate

Objective : To compare two scoring systems: the Huddart/Bodenham system (HB system) and the Bauru-BCLP yardstick (BCLP yardstick), which classify treatment outcome in terms of dental arch relationships in patients with complete bilateral cleft lip and palate (CBCLP). The predictive value of these scoring systems for treatment outcome was also evaluated. Design : Retrospective longitudinal study. Patients : Dental arch relationships of 43 CBCLP patients were evaluated at 6, 9, and 12 years. Setting : Treatment outcome in BCLP patients using two scoring systems. Main Outcome Measures : For each age group, the HB scores were correlated with the BCLP yardstick scores using Spearman's correlation coefficient. The predictive value of the two scoring systems was evaluated by backward regression analysis. Results : Intraobserver Kappa values for the BCLP yardstick scoring for the two observers were .506 and .627, respectively, and the interobserver reliability ranged from .427 and .581. The intraobserver reliability for the HB system ranged from .92 to .97 and the interobserver reliability from .88 to .96. The BCLP yardstick scores of 6 and 9 years together were predictors for the outcome at 12 years (explained variance 41.3%). Adding the incisor and lateral HB scores in the regression model increased the explained variance to 67%. Conclusions : The BCLP yardstick and the HB system are reliable scoring systems for evaluation of dental arch relationships of CBCLP patients. The HB system categorizes treatment outcome into similar categories as the BCLP yardstick. In case a more sensitive measure of treatment outcome is needed, selectively both scoring systems should be used.

Electroencephalographic topography measures of experienced utility

Economic theory distinguishes two concepts of utility: decision utility, objectively quantifiable by choices, and experienced utility, referring to the satisfaction by an obtainment. To date, experienced utility is typically measured with subjective ratings. This study intended to quantify experienced utility by global levels of neuronal activity. Neuronal activity was measured by means of electroencephalographic (EEG) responses to gain and omission of graded monetary rewards at the level of the EEG topography in human subjects. A novel analysis approach allowed approximating psychophysiological value functions for the experienced utility of monetary rewards. In addition, we identified the time windows of the event-related potentials (ERP) and the respective intracortical sources, in which variations in neuronal activity were significantly related to the value or valence of outcomes. Results indicate that value functions of experienced utility and regret disproportionally increase with monetary value, and thus contradict the compressing value functions of decision utility. The temporal pattern of outcome evaluation suggests an initial (∼250 ms) coarse evaluation regarding the valence, concurrent with a finer-grained evaluation of the value of gained rewards, whereas the evaluation of the value of omitted rewards emerges later. We hypothesize that this temporal double dissociation is explained by reward prediction errors. Finally, a late, yet unreported, reward-sensitive ERP topography (∼500 ms) was identified. The sources of these topographical covariations are estimated in the ventromedial prefrontal cortex, the medial frontal gyrus, the anterior and posterior cingulate cortex and the hippocampus/amygdala. The results provide important new evidence regarding “how,” “when,” and “where” the brain evaluates outcomes with different hedonic impact.

Evaluation of high-definition and conventional oscillometric blood pressure measurement in anaesthetised dogs using ACVIM guidelines

OBJECTIVES: To evaluate high-definition and conventional oscillometry in comparison with direct blood pressure measurements in anaesthetised dogs. METHODS: Eight simultaneous readings for systolic, diastolic and mean pressure were obtained directly and with each of two devices in nine anaesthetised dogs. Measurement procedure and validation were based on the 2007 ACVIM guidelines. RESULTS: Sixty-three simultaneous readings were evaluated for each device and direct measurements. The mean differences (bias) to direct values were within 10 mmHg for both devices although bias for systolic and diastolic blood pressures was higher for Memodiagnostic. The standard deviations of differences (precision) were within 15 mmHg for Dinamap but exceeded for Memodiagnostic. Correlation coefficients were higher for Dinamap than Memodiagnostic but both failed to reach a correlation of 0.9. Over 50% of values lay within 10 mmHg of direct measures for both devices, but this percentage was greater for Dinamap than Memodiagnostic. Over 80% of values lay within 20 mmHg of direct measures for Dinamap but not for Memodiagnostic. CLINICAL SIGNIFICANCE: Both devices failed to meet ACVIM guideline validation. However, Dinamap only failed with regards to correlation. Memodiagnostic failed on several requirements, and based on poor correlation, accuracy and precision, this device cannot be currently recommended for dogs under anaesthesia.

Definitions and outcome measures for bullous pemphigoid: recommendations by an international panel of experts

Our scientific knowledge of bullous pemphigoid (BP) has dramatically progressed in recent years. However, despite the availability of various therapeutic options for the treatment of inflammatory diseases, only a few multicenter controlled trials have helped to define effective therapies in BP. A major obstacle in sharing multicenter-based evidences for therapeutic efforts is the lack of generally accepted definitions for the clinical evaluation of patients with BP. Common terms and end points of BP are needed so that experts in the field can accurately measure and assess disease extent, activity, severity, and therapeutic response, and thus facilitate and advance clinical trials. These recommendations from the International Pemphigoid Committee represent 2 years of collaborative efforts to attain mutually acceptable common definitions for BP and proposes a disease extent score, the BP Disease Area Index. These items should assist in the development of consistent reporting of outcomes in future BP reports and studies.

Endoscopic sinus surgery training courses: benefit and problems - a multicentre evaluation to systematically improve surgical training

The aim of this multicentre study was to systematically analyse the strengths and weaknesses in the surgical training for endoscopic sinus surgery (ESS) and identify measures that may improve training.

Nanoparticle-based test measures overall propensity for calcification in serum

Vascular and soft tissue calcification contributes to cardiovascular morbidity and mortality in both the general population and CKD. Because calcium and phosphate serum concentrations are near supersaturation, the balance of inhibitors and promoters critically influences the development of calcification. An assay that measures the overall propensity for calcification to occur in serum may have clinical use. Here, we describe a nanoparticle-based assay that detects, in the presence of artificially elevated calcium and phosphate concentrations, the spontaneous transformation of spherical colloidal primary calciprotein particles (CPPs) to elongate crystalline secondary CPPs. We used characteristics of this transition to describe the intrinsic capacity of serum to inhibit the precipitation of calcium and phosphate. Using this assay, we found that both the sera of mice deficient in fetuin-A, a serum protein that inhibits calcification, and the sera of patients on hemodialysis have reduced intrinsic properties to inhibit calcification. In summary, we developed a nanoparticle-based test that measures the overall propensity for calcification in serum. The clinical use of the test requires evaluation in a prospective study.

Ligament balancing in TKA: Evaluation of a force-sensing device and the influence of patellar eversion and ligament release

Ligament balancing in total knee arthroplasty may have an important influence on joint stability and prosthesis lifetime. In order to provide quantitative information and assistance during ligament balancing, a device that intraoperatively measures knee joint forces and moments was developed. Its performance and surgical advantages were evaluated on six cadaver specimens mounted on a knee joint loading apparatus allowing unconstrained knee motion as well as compression and varus-valgus loading. Four different experiments were performed on each specimen. (1) Knee joints were axially loaded. Comparison between applied and measured compressive forces demonstrated the accuracy and reliability of in situ measurements (1.8N). (2) Assessment of knee stability based on condyle contact forces or varus-valgus moments were compared to the current surgical method (difference of varus-valgus loads causing condyle lift-off). The force-based approach was equivalent to the surgical method while the moment-based, which is considered optimal, showed a tendency of lateral imbalance. (3) To estimate the importance of keeping the patella in its anatomical position during imbalance assessment, the effect of patellar eversion on the mediolateral distribution of tibiofemoral contact forces was measured. One fourth of the contact force induced by the patellar load was shifted to the lateral compartment. (4) The effect of minor and major medial collateral ligament releases was biomechanically quantified. On average, the medial contact force was reduced by 20% and 46%, respectively. Large variation among specimens reflected the difficulty of ligament release and the need for intraoperative force monitoring. This series of experiments thus demonstrated the device's potential to improve ligament balancing and survivorship of total knee arthroplasty.

Cost effectiveness of home based population screening for Chlamydia trachomatis in the UK: economic evaluation of chlamydia screening studies (ClaSS) project

OBJECTIVE: To investigate the cost effectiveness of screening for Chlamydia trachomatis compared with a policy of no organised screening in the United Kingdom. DESIGN: Economic evaluation using a transmission dynamic mathematical model. SETTING: Central and southwest England. PARTICIPANTS: Hypothetical population of 50,000 men and women, in which all those aged 16-24 years were invited to be screened each year. MAIN OUTCOME MEASURES: Cost effectiveness based on major outcomes averted, defined as pelvic inflammatory disease, ectopic pregnancy, infertility, or neonatal complications. RESULTS: The incremental cost per major outcome averted for a programme of screening women only (assuming eight years of screening) was 22,300 pounds (33,000 euros; $45,000) compared with no organised screening. For a programme screening both men and women, the incremental cost effectiveness ratio was approximately 28,900 pounds. Pelvic inflammatory disease leading to hospital admission was the most frequently averted major outcome. The model was highly sensitive to the incidence of major outcomes and to uptake of screening. When both were increased the cost effectiveness ratio fell to 6200 pound per major outcome averted for screening women only. CONCLUSIONS: Proactive register based screening for chlamydia is not cost effective if the uptake of screening and incidence of complications are based on contemporary empirical studies, which show lower rates than commonly assumed. These data are relevant to discussions about the cost effectiveness of the opportunistic model of chlamydia screening being introduced in England.

Endoscopic scoring of the tracheal septum in horses and its clinical relevance for the evaluation of lower airway health in horses

REASONS FOR PERFORMING STUDY: Although endoscopic scoring of the tracheal septum thickness is used as a diagnostic tool for evaluation of lower airway disease, its clinical relevance and reliability have never been critically assessed in the horse. OBJECTIVES: To investigate if septum thickness scores (STS) are reliable and serve as a clinically useful indicator of lower airway disease status and/or inflammation. METHODS: The variance of STS attributable to the horse, observer and changes over time was determined. The distribution of STS in a population of clinically normal horses and correlations of STS with age, gender, as well as mucus accumulation and cell differentials of tracheobronchial secretions and bronchoalveolar lavage fluid were investigated. Effects of altered pulmonary ventilation, induced by different drugs, on STS were assessed. Finally, STS of horses affected with recurrent airway obstruction (RAO) were compared to those of clinically normal horses. RESULTS: Recorded STS showed excellent intra- and satisfactory interobserver agreement Established clinical, endoscopic and cytological measures of lower airway inflammation, i.e. mucus accumulation scores and airway neutrophilia, did not correlate with STS. In horses age > or = 10 years, septum scores were significantly higher (P = 0.022) than in younger horses. Septum thickness scores did not differ significantly between clinically normal and RAO-affected horses both in exacerbation and in remission. Horses with markedly increased breathing effort (i.e. with metacholine- or lobeline hydrochloride-challenge), often differed markedly (up to 1.9 scores), but the average of end-inspiratory and end-expiratory STS did not differ from baseline STS. CONCLUSIONS AND CLINICAL RELEVANCE: Endoscopic STS are a reproducible measure, but STS did not correlate with clinical, endoscopic and cytological findings indicative of RAO or inflammatory airway disease.

Scleral buckling versus primary vitrectomy in rhegmatogenous retinal detachment study (SPR Study): recruitment list evaluation. Study report no. 2

BACKGROUND: Accompanying the patient recruitment within the "Scleral buckling versus primary vitrectomy in rhegmatogenous retinal detachment multicentre trial (SPR)", all patients with primary rhegmatogenous retinal detachment (RRD) had to be documented in a detailed recruitment list. The main goal of this analysis was to estimate the prevalence of "medium-severe" RRD (SPR Study eligible) as defined by the SPR Study inclusion criteria. In addition, the detailed anatomical situation of medium-severe RRD is investigated. METHODS: SPR Study recruitment was evaluated via a standardised questionnaire, which contained a coloured fundus drawing and information regarding possible reasons for exclusion from the SPR Study in each case. A team of three experienced vitreoretinal surgeons evaluated all fundus drawings from a 1-year period. The review led to a decision on SPR Study eligibility on the pure basis of anatomical assessment. The main outcome measures were assessment of feasible inclusion into the SPR Study by the evaluation team based on the fundus drawing and anatomical details. RESULTS: A total of 1,115 patients with RRD from 13 European centres were prospectively enrolled in the year 2000. The quality of the drawings sufficed for assessment in 1,107 cases (99.3%). Three hundred and twelve fundus drawings (28.2%) met the anatomic inclusion criteria of the SPR Study. RRD of medium severity is characterised by an average number of 2.6 (SD 2.4) retinal breaks, 5.8 (SD 2.8) clock hours of detached retina, unclear hole situation in 15.1% of cases (n=47), attached macula in 42.9% (n=134), bullous detachment in 15.1% (n=47) and vitreous haemorrhage/opacity in 7.7% (n=24). CONCLUSIONS: In the recruitment lists of the SPR Study of the year 2000, RRD of medium severity was present in nearly one third of the patients with primary RRD. These findings emphasise the clinical relevance of the SPR Study.

Evaluation of 41calcium as a new approach to assess changes in bone metabolism: effect of a bisphosphonate intervention in postmenopausal women with low bone mass

A new technique was evaluated to identify changes in bone metabolism directly at high sensitivity through isotopic labeling of bone Ca. Six women with low BMD were labeled with 41Ca up to 700 days and treated for 6 mo with risedronate. Effect of treatment on bone could be identified using 41Ca after 4-8 wk in each individual. INTRODUCTION: Isotopic labeling of bone using 41Ca, a long-living radiotracer, has been proposed as an alternative approach for measuring changes in bone metabolism to overcome current limitations of available techniques. After isotopic labeling of bone, changes in urinary 41Ca excretion reflect changes in bone Ca balance. The aim of this study was to validate this new technique against established measures. Changes in bone Ca balance were induced by giving a bisphosphonate. MATERIALS AND METHODS: Six postmenopausal women with diagnosed osteopenia/osteoporosis received a single oral dose of 100 nCi 41Ca for skeleton labeling. Urinary 41Ca/40Ca isotope ratios were monitored by accelerator mass spectrometry up to 700 days after the labeling process. Subjects received 35 mg risedronate per week for 6 mo. Effect of treatment was monitored using the 41Ca signal in urine and parallel measurements of BMD by DXA and biochemical markers of bone metabolism in urine and blood. RESULTS: Positive response to treatment was confirmed by BMD measurements, which increased for spine by +3.0% (p = 0.01) but not for hip. Bone formation markers decreased by -36% for bone alkaline phosphatase (BALP; p = 0.002) and -59% for procollagen type I propeptides (PINP; p = 0.001). Urinary deoxypyridinoline (DPD) and pyridinoline (PYD) were reduced by -21% (p = 0.019) and -23% (p = 0.009), respectively, whereas serum and urinary carboxy-terminal teleopeptides (CTXs) were reduced by -60% (p = 0.001) and -57.0% (p = 0.001), respectively. Changes in urinary 41Ca excretion paralleled findings for conventional techniques. The urinary 41Ca/40Ca isotope ratio was shifted by -47 +/- 10% by the intervention. Population pharmacokinetic analysis (NONMEM) of the 41Ca data using a linear three-compartment model showed that bisphosphonate treatment reduced Ca transfer rates between the slowly exchanging compartment (bone) and the intermediate fast exchanging compartment by 56% (95% CI: 45-58%). CONCLUSIONS: Isotopic labeling of bone using 41Ca can facilitate human trials in bone research by shortening of intervention periods, lowering subject numbers, and having easier conduct of cross-over studies compared with conventional techniques.

Graft coronary vasculopathy in cardiac transplantation--evaluation of risk factors by multivariate analysis

The development of coronary vasculopathy is the main determinant of long-term survival in cardiac transplantation. The identification of risk factors, therefore, seems necessary in order to identify possible treatment strategies. Ninety-five out of 397 patients, undergoing orthotopic cardiac transplantation from 10/1985 to 10/1992 were evaluated retrospectively on the basis of perioperative and postoperative variables including age, sex, diagnosis, previous operations, renal function, cholesterol levels, dosage of immunosuppressive drugs (cyclosporin A, azathioprine, steroids), incidence of rejection, treatment with calcium channel blockers at 3, 6, 12, and 18 months postoperatively. Coronary vasculopathy was assessed by annual angiography at 1 and 2 years postoperatively. After univariate analysis, data were evaluated by stepwise multiple logistic regression analysis. Coronary vasculopathy was assessed in 15 patients at 1 (16%), and in 23 patients (24%) at 2, years. On multivariate analysis, previous operations and the incidence of rejections were identified as significant risk factors (P < 0.05), whereas the underlying diagnosis had borderline significance (P = 0.058) for the development of graft coronary vasculopathy. In contrast, all other variables were not significant in our subset of patients investigated. We therefore conclude that the development of coronary vasculopathy in cardiac transplant patients mainly depends on the rejection process itself, aside from patient-dependent factors. Therapeutic measures, such as the administration of calcium channel blockers and regulation of lipid disorders, may therefore only reduce the progress of native atherosclerotic disease in the posttransplant setting.