A technique for evaluation of interactive evolutionary systems

Very large scale scheduling and planning tasks cannot be effectively addressed by fully automated schedule optimisation systems, since many key factors which govern 'fitness' in such cases are unformalisable. This raises the question of an interactive (or collaborative) approach, where fitness is assigned by the expert user. Though well-researched in the domains of interactively evolved art and music, this method is as yet rarely used in logistics. This paper concerns a difficulty shared by all interactive evolutionary systems (IESs), but especially those used for logistics or design problems. The difficulty is that objective evaluation of IESs is severely hampered by the need for expert humans in the loop. This makes it effectively impossible to, for example, determine with statistical confidence any ranking among a decent number of configurations for the parameters and strategy choices. We make headway into this difficulty with an Automated Tester (AT) for such systems. The AT replaces the human in experiments, and has parameters controlling its decision-making accuracy (modelling human error) and a built-in notion of a target solution which may typically be at odds with the solution which is optimal in terms of formalisable fitness. Using the AT, plausible evaluations of alternative designs for the IES can be done, allowing for (and examining the effects of) different levels of user error. We describe such an AT for evaluating an IES for very large scale planning.

The effect of selective decontamination of the digestive tract on mortality in multiple trauma patients: a multicenter randomized controlled trial

Objective: Evaluation of selective decontamination of the digestive tract (SDD) on late mortality in ventilated trauma patients in an intensive care unit (ICU). Methods: A multicenter, randomized controlled trial was undertaken in 401 trauma patients with Hospital Trauma Index-Injury Severity Score of 16 or higher. Patients were randomized to control (n = 200) or SDD (n = 201), using polymyxin E, tobramycin, and amphotericin B in throat and gut throughout ICU treatment combined with cefotaxime for 4 days. Primary endpoint was late mortality excluding early death from hemorrhage or craniocerebral injury. Secondary endpoints were infection and organ dysfunction. Results: Mortality was 20.9% with SDD and 22.0% in controls. Overall late mortality was 15.3% (57/372) as 29 patients died from cerebral injury, 16 SDD and 13 control. The odds ratio (95% confidence intervals) of late mortality for SDD relative to control was 0.75 (0.40-1.37), corresponding to estimates of 13.4% SDD and 17.2% control. The overall infection rate was reduced in the test group (48.8% vs. 61.0%). SDD reduced lower airway infections (30.9% vs. 50.0%) and bloodstream infections due to aerobic Gram-negative bacilli (2.5% vs. 7.5%). No difference in organ dysfunction was found. Concluson: This study demonstrates that SDD significantly reduces infection in multiple trauma, although this RCT in 401 patients was underpowered to detect a mortality benefit.

An annotation-free method for evaluating privacy protection techniques in videos

While several privacy protection techniques are pre- sented in the literature, they are not complemented with an established objective evaluation method for their assess- ment and comparison. This paper proposes an annotation- free evaluation method that assesses the two key aspects of privacy protection that are privacy and utility. Unlike some existing methods, the proposed method does not rely on the use of subjective judgements and does not assume a spe- cific target type in the image data. The privacy aspect is quantified as an appearance similarity and the utility aspect is measured as a structural similarity between the original raw image data and the privacy-protected image data. We performed an extensive experimentation using six challeng- ing datasets (including two new ones) to demonstrate the effectiveness of the evaluation method by providing a per- formance comparison of four state-of-the-art privacy pro- tection techniques.

The TIGGE project and its achievements

TIGGE was a major component of the THORPEX (The Observing System Research and Predictability Experiment) research program, whose aim is to accelerate improvements in forecasting high-impact weather. By providing ensemble prediction data from leading operational forecast centers, TIGGE has enhanced collaboration between the research and operational meteorological communities and enabled research studies on a wide range of topics. The paper covers the objective evaluation of the TIGGE data. For a range of forecast parameters, it is shown to be beneficial to combine ensembles from several data providers in a Multi-model Grand Ensemble. Alternative methods to correct systematic errors, including the use of reforecast data, are also discussed. TIGGE data have been used for a range of research studies on predictability and dynamical processes. Tropical cyclones are the most destructive weather systems in the world, and are a focus of multi-model ensemble research. Their extra-tropical transition also has a major impact on skill of mid-latitude forecasts. We also review how TIGGE has added to our understanding of the dynamics of extra-tropical cyclones and storm tracks. Although TIGGE is a research project, it has proved invaluable for the development of products for future operational forecasting. Examples include the forecasting of tropical cyclone tracks, heavy rainfall, strong winds, and flood prediction through coupling hydrological models to ensembles. Finally the paper considers the legacy of TIGGE. We discuss the priorities and key issues in predictability and ensemble forecasting, including the new opportunities of convective-scale ensembles, links with ensemble data assimilation methods, and extension of the range of useful forecast skill.

Autopoiesis vs. social autopoiesis: critical evaluation and implications for understanding firms as autopoietic social systems

The main objective of this study is to revisit the fundamental postulations of autopoietic self-production wrapped within the autopoietic six-point key and to investigate whether or not firms as specific social systems can be treated as autopoietic unities. In order to do so firms have to be defined as simple and composite unities whereupon their boundaries have to be clearly identifiable. The test of social autopoiesis reveals that firms can be viewed as autopoietic social systems that exist in the communicative space with employees' firm-specific communicative sub-domains as their components. Furthermore, it is argued that the social reification of autopoiesis (autokoinopoiesis) in firms is quintessentially interconnected with physical autopoiesis of their employees (autophysiopoiesis). Discontiguous focus on productivity as firms' obvious physical implication may thus be upgraded by a very social nature of ideactivity, firms' only real survival force.

Comparison of energy evaluation systems and a mechanistic model for milk production by dairy cattle offered fresh grass-based diets

Grass-based diets are of increasing social-economic importance in dairy cattle farming, but their low supply of glucogenic nutrients may limit the production of milk. Current evaluation systems that assess the energy supply and requirements are based on metabolisable energy (ME) or net energy (NE). These systems do not consider the characteristics of the energy delivering nutrients. In contrast, mechanistic models take into account the site of digestion, the type of nutrient absorbed and the type of nutrient required for production of milk constituents, and may therefore give a better prediction of supply and requirement of nutrients. The objective of the present study is to compare the ability of three energy evaluation systems, viz. the Dutch NE system, the agricultural and food research council (AFRC) ME system, and the feed into milk (FIM) ME system, and of a mechanistic model based on Dijkstra et al. [Simulation of digestion in cattle fed sugar cane: prediction of nutrient supply for milk production with locally available supplements. J. Agric. Sci., Cambridge 127, 247-60] and Mills et al. [A mechanistic model of whole-tract digestion and methanogenesis in the lactating dairy cow: model development, evaluation and application. J. Anim. Sci. 79, 1584-97] to predict the feed value of grass-based diets for milk production. The dataset for evaluation consists of 41 treatments of grass-based diets (at least 0.75 g ryegrass/g diet on DM basis). For each model, the predicted energy or nutrient supply, based on observed intake, was compared with predicted requirement based on observed performance. Assessment of the error of energy or nutrient supply relative to requirement is made by calculation of mean square prediction error (MSPE) and by concordance correlation coefficient (CCC). All energy evaluation systems predicted energy requirement to be lower (6-11%) than energy supply. The root MSPE (expressed as a proportion of the supply) was lowest for the mechanistic model (0.061), followed by the Dutch NE system (0.082), FIM ME system (0.097) and AFRCME system(0.118). For the energy evaluation systems, the error due to overall bias of prediction dominated the MSPE, whereas for the mechanistic model, proportionally 0.76 of MSPE was due to random variation. CCC analysis confirmed the higher accuracy and precision of the mechanistic model compared with energy evaluation systems. The error of prediction was positively related to grass protein content for the Dutch NE system, and was also positively related to grass DMI level for all models. In conclusion, current energy evaluation systems overestimate energy supply relative to energy requirement on grass-based diets for dairy cattle. The mechanistic model predicted glucogenic nutrients to limit performance of dairy cattle on grass-based diets, and proved to be more accurate and precise than the energy systems. The mechanistic model could be improved by allowing glucose maintenance and utilization requirements parameters to be variable. (C) 2007 Elsevier B.V. All rights reserved.

Evaluation of a sequential global test of improved recovery following stroke as applied to the ICTUS trial of citicoline

The International Citicoline Trial in acUte Stroke is a sequential phase III study of the use of the drug citicoline in the treatment of acute ischaemic stroke, which was initiated in 2006 in 56 treatment centres. The primary objective of the trial is to demonstrate improved recovery of patients randomized to citicoline relative to those randomized to placebo after 12 weeks of follow-up. The primary analysis will take the form of a global test combining the dichotomized results of assessments on three well-established scales: the Barthel Index, the modified Rankin scale and the National Institutes of Health Stroke Scale. This approach was previously used in the analysis of the influential National Institute of Neurological Disorders and Stroke trial of recombinant tissue plasminogen activator in stroke. The purpose of this paper is to describe how this trial was designed, and in particular how the simultaneous objectives of taking into account three assessment scales, performing a series of interim analyses and conducting treatment allocation and adjusting the analyses to account for prognostic factors, including more than 50 treatment centres, were addressed. Copyright (C) 2008 John Wiley & Sons, Ltd.

The automation and evaluation of nested clade phylogeographic analysis

Nested clade phylogeographic analysis (NCPA) is a popular method for reconstructing the demographic history of spatially distributed populations from genetic data. Although some parts of the analysis are automated, there is no unique and widely followed algorithm for doing this in its entirety, beginning with the data, and ending with the inferences drawn from the data. This article describes a method that automates NCPA, thereby providing a framework for replicating analyses in an objective way. To do so, a number of decisions need to be made so that the automated implementation is representative of previous analyses. We review how the NCPA procedure has evolved since its inception and conclude that there is scope for some variability in the manual application of NCPA. We apply the automated software to three published datasets previously analyzed manually and replicate many details of the manual analyses, suggesting that the current algorithm is representative of how a typical user will perform NCPA. We simulate a large number of replicate datasets for geographically distributed, but entirely random-mating, populations. These are then analyzed using the automated NCPA algorithm. Results indicate that NCPA tends to give a high frequency of false positives. In our simulations we observe that 14% of the clades give a conclusive inference that a demographic event has occurred, and that 75% of the datasets have at least one clade that gives such an inference. This is mainly due to the generation of multiple statistics per clade, of which only one is required to be significant to apply the inference key. We survey the inferences that have been made in recent publications and show that the most commonly inferred processes (restricted gene flow with isolation by distance and contiguous range expansion) are those that are commonly inferred in our simulations. However, published datasets typically yield a richer set of inferences with NCPA than obtained in our random-mating simulations, and further testing of NCPA with models of structured populations is necessary to examine its accuracy.

Prebiotic evaluation of a novel galactooligosaccharide mixture produced by the enzymatic activity of Bifidobacterium bifidum NCIMB 41171, in healthy humans: a randomized, double-blind, crossover, placebo-controlled intervention study

Background: Galactooligosaccharides are selectively fermented by the beneficial member of the colonic microflora contributing to the health of the host. Objective: We assessed the prebiotic potential of a novel galactooligosaccharide produced through the action of beta-galactosidases, originating from a probiotic Bifidobacterium bifidum strain, against a galactooligosaccharide produced through the action of an industrial P-galactosidase and a placebo. Design: Fifty-nine healthy human volunteers participated in this study. Initially, the effect of the matrix on the prebiotic properties of a commercially available galactooligosaccharide (7 g/d) was assessed during 7-d treatment periods with a 7-d washout period in between. During the second phase, 30 volunteers were assigned to a sequence of treatments (7 d) differing in the amount of the novel galactooligosaccharide (0, 3.6, or 7 g/d). Stools were recovered before and after each intervention, and bacteria numbers were determined by fluorescent in situ hybridization. Results: Addition of the novel galactooligosaccharide mixture significantly increased the bifidobacterial population ratio compared with the placebo (P < 0.05), whereas 7 g/d of the novel galactooligosaccharide significantly increased the bifidobacterial ratio compared with the commercial galactooligosaccharide (P < 0.05). Moreover, a significant relation (P < 0.001) between the bifidobacteria proportion and the novel galactooligosaccharide dose (0, 3.6, and 7 g/d) was observed. This relation was similar to the effect of the novel galactooligosaccharide on the prebiotic index of each dose. Conclusions: This study showed that galactooligosaccharide mixtures produced with different beta-galactosidases show different prebiotic properties and that, by using enzymes originating from bifidobacterial species, an increase in the bifidogenic properties of the prebiotic product is achievable.

A preliminary evaluation of cognitive-behaviour therapy for clinical perfectionism: a case series

Objective: The construct of 'clinical perfectionism' has been developed in response to criticisms that other approaches have failed to yield advances in the treatment of the type of self-oriented perfectionism that poses a clinical problem. The primary aim of this study was to conduct a preliminary investigation into the efficacy of a theory-driven, cognitive-behavioural intervention for 'clinical perfectionism'. Design. A multiple baseline single case series design was used. Method: A specific, 10-session cognitive-behavioural intervention to address clinical perfectionism in eating disorders was adapted to allow its use in nine patients referred with a range of axis I disorders and clinical perfectionism. Results: The intervention led to clinically significant improvements in self-referential perfectionism from pretreatment to follow-up for six of the nine participants on two perfectionism measures and for three of the nine participants on the measure of clinical perfectionism. Statistically significant improvements from pre- to post-intervention for the group as a whole were found on all three measures. The improvements were maintained at follow-up. Conclusions: The finding that clinical perfectionism is improved in the majority of participants is particularly encouraging given that perfectionism has traditionally been viewed as a personality characteristic resistant to change. These preliminary findings warrant replication in a larger study.

Prebiotic evaluation of cocoa-derived flavanols in healthy humans by using a randomized, controlled, double-blind, crossover intervention study

BACKGROUND: The absorption of cocoa flavanols in the small intestine is limited, and the majority of the flavanols reach the large intestine where they may be metabolized by resident microbiota. OBJECTIVE: We assessed the prebiotic potential of cocoa flavanols in a randomized, double-blind, crossover, controlled intervention study. DESIGN: Twenty-two healthy human volunteers were randomly assigned to either a high-cocoa flavanol (HCF) group (494 mg cocoa flavanols/d) or a low-cocoa flavanol (LCF) group (23 mg cocoa flavanols/d) for 4 wk. This was followed by a 4-wk washout period before volunteers crossed to the alternant arm. Fecal samples were recovered before and after each intervention, and bacterial numbers were measured by fluorescence in situ hybridization. A number of other biochemical and physiologic markers were measured. RESULTS: Compared with the consumption of the LCF drink, the daily consumption of the HCF drink for 4 wk significantly increased the bifidobacterial (P < 0.01) and lactobacilli (P < 0.001) populations but significantly decreased clostridia counts (P < 0.001). These microbial changes were paralleled by significant reductions in plasma triacylglycerol (P < 0.05) and C-reactive protein (P < 0.05) concentrations. Furthermore, changes in C-reactive protein concentrations were linked to changes in lactobacilli counts (P < 0.05, R(2) = -0.33 for the model). These in vivo changes were closely paralleled by cocoa flavanol-induced bacterial changes in mixed-batch culture experiments. CONCLUSION: This study shows, for the first time to our knowledge, that consumption of cocoa flavanols can significantly affect the growth of select gut microflora in humans, which suggests the potential prebiotic benefits associated with the dietary inclusion of flavanol-rich foods. This trial was registered at clinicaltrials.gov as NCT01091922.

Evaluation of an improved tracer method to monitor cheese curd syneresis at varying milk fat levels in a cheese vat

Previous studies have reported that cheese curd syneresis kinetics can be monitored by dilution of chemical tracers, such as Blue Dextran, in whey. The objective of this study was to evaluate an improved tracer method to monitor whey volumes expelled over time during syneresis. Two experiments with different ranges of milk fat (0-5% and 2.3-3.5%) were carried out in an 11 L double-O laboratory scale cheese vat. Tracer was added to the curd-whey mixture during the cutting phase of cheese making and samples were taken at 10 min intervals up to 75 min after cutting. The volume of whey expelled was measured gravimetrically and the dilution of tracer in the whey was measured by absorbance at 620 nm. The volumes of whey expelled were significantly reduced at higher milk fat levels. Whey yield was predicted with a SEP ranging from 3.2 to 6.3 g whey/100 mL of milk and a CV ranging from 2.03 to 2.7% at different milk fat levels.

Towards a method for the economic evaluation of environmental indicators in UK Integrated Arable Farming Systems

Integrated Arable Farming Systems (IAFS), which involve a reduction in the use of off-farm inputs, are attracting considerable research interest in the UK. The objectives of these systems experiments are to compare their financial performance with that from conventional or current farming practices. To date, this comparison has taken little account of any environmental benefits (or disbenefits) of the two systems. The objective of this paper is to review the assessment methodologies available for the analysis of environmental impacts. To illustrate the results of this exercise, the methodology and environmental indicators chosen are then applied to data from one of the LINK - Integrated Farming Systems experimental sites. Data from the Pathhead site in Southern Scotland are used to evaluate the use of invertebrates and nitrate loss as environmental indicators within IAFS. The results suggest that between 1992 and 1995 the biomass of earthworms fell by 28 kg per hectare on the integrated rotation and rose by 31 kg per hectare on the conventional system. This led to environmental costs ranging between £2.24 and £13.44 per hectare for the integrated system and gains of between £2.48 and £14.88 for the conventional system. In terms of nitrate, the integrated system had an estimated loss of £72.21 per hectare in comparison to £149.40 per hectare on the conventional system. Conclusions are drawn about the advantages and disadvantages of this type of analytical framework. Keywords: Farming systems; IAFS; Environmental valuation; Economics; Earthworms; Nitrates; Soil fauna

Description and process evaluation of pharmacists’ interventions in a pharmacist-led information technology-enabled multicentre cluster randomised controlled trial for reducing medication errors in general practice (PINCER trial)

Objective To undertake a process evaluation of pharmacists' recommendations arising in the context of a complex IT-enabled pharmacist-delivered randomised controlled trial (PINCER trial) to reduce the risk of hazardous medicines management in general practices. Methods PINCER pharmacists manually recorded patients’ demographics, details of interventions recommended, actions undertaken by practice staff and time taken to manage individual cases of hazardous medicines management. Data were coded and double entered into SPSS v15, and then summarised using percentages for categorical data (with 95% CI) and, as appropriate, means (SD) or medians (IQR) for continuous data. Key findings Pharmacists spent a median of 20 minutes (IQR 10, 30) reviewing medical records, recommending interventions and completing actions in each case of hazardous medicines management. Pharmacists judged 72% (95%CI 70, 74) (1463/2026) of cases of hazardous medicines management to be clinically relevant. Pharmacists recommended 2105 interventions in 74% (95%CI 73, 76) (1516/2038) of cases and 1685 actions were taken in 61% (95%CI 59, 63) (1246/2038) of cases; 66% (95%CI 64, 68) (1383/2105) of interventions recommended by pharmacists were completed and 5% (95%CI 4, 6) (104/2105) of recommendations were accepted by general practitioners (GPs), but not completed at the end of the pharmacists’ placement; the remaining recommendations were rejected or considered not relevant by GPs. Conclusions The outcome measures were used to target pharmacist activity in general practice towards patients at risk from hazardous medicines management. Recommendations from trained PINCER pharmacists were found to be broadly acceptable to GPs and led to ameliorative action in the majority of cases. It seems likely that the approach used by the PINCER pharmacists could be employed by other practice pharmacists following appropriate training.

Trade-offs and responsiveness of the single-layer urban canopy parametrization in WRF: an offline evaluation using the MOSCEM optimization algorithm and field observations

For an increasing number of applications, mesoscale modelling systems now aim to better represent urban areas. The complexity of processes resolved by urban parametrization schemes varies with the application. The concept of fitness-for-purpose is therefore critical for both the choice of parametrizations and the way in which the scheme should be evaluated. A systematic and objective model response analysis procedure (Multiobjective Shuffled Complex Evolution Metropolis (MOSCEM) algorithm) is used to assess the fitness of the single-layer urban canopy parametrization implemented in the Weather Research and Forecasting (WRF) model. The scheme is evaluated regarding its ability to simulate observed surface energy fluxes and the sensitivity to input parameters. Recent amendments are described, focussing on features which improve its applicability to numerical weather prediction, such as a reduced and physically more meaningful list of input parameters. The study shows a high sensitivity of the scheme to parameters characterizing roof properties in contrast to a low response to road-related ones. Problems in partitioning of energy between turbulent sensible and latent heat fluxes are also emphasized. Some initial guidelines to prioritize efforts to obtain urban land-cover class characteristics in WRF are provided. Copyright © 2010 Royal Meteorological Society and Crown Copyright.