Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Risk-based decision making method for maintenance policy selection of thermal power plant equipment

This study presents a decision-making method for maintenance policy selection of power plants equipment. The method is based on risk analysis concepts. The method first step consists in identifying critical equipment both for power plant operational performance and availability based on risk concepts. The second step involves the proposal of a potential maintenance policy that could be applied to critical equipment in order to increase its availability. The costs associated with each potential maintenance policy must be estimated, including the maintenance costs and the cost of failure that measures the critical equipment failure consequences for the power plant operation. Once the failure probabilities and the costs of failures are estimated, a decision-making procedure is applied to select the best maintenance policy. The decision criterion is to minimize the equipment cost of failure, considering the costs and likelihood of occurrence of failure scenarios. The method is applied to the analysis of a lubrication oil system used in gas turbines journal bearings. The turbine has more than 150 MW nominal output, installed in an open cycle thermoelectric power plant. A design modification with the installation of a redundant oil pump is proposed for lubricating oil system availability improvement. (C) 2009 Elsevier Ltd. All rights reserved.

Miniaturized structures for removal or selection of particles from liquid flow

The aim of this work was the development of miniaturized structures useful for retention and/or selection of particles and viscous substances from a liquid flow. The proposed low costs structures are similar to macroscopic wastewater treatment systems, named baffles, and allow disassemble. They were simulated using FEMLAB 3.2b package and manufactured in acrylic with conventional tools. Tests for retention or selection of particles in water or air and viscous fluids in water were carried out. Either in air or water particles with 50 mu m diameter will be retained but not with 13 mu m diameter. In aqueous flow, it is also possible the retention of viscous samples, such as silicone 350 cSt. The simulated results showed good agreement with experimental measurements. These miniaturized structures can be useful in sample pretreatment for chemical analysis and microorganism manipulation. (C) 2007 Elsevier B.V. All rights reserved.

AUTOMATIC CORONARY WALL SEGMENTATION IN INTRAVASCULAR ULTRASOUND IMAGES USING BINARY MORPHOLOGICAL RECONSTRUCTION

Intravascular ultrasound (IVUS) image segmentation can provide more detailed vessel and plaque information, resulting in better diagnostics, evaluation and therapy planning. A novel automatic segmentation proposal is described herein; the method relies on a binary morphological object reconstruction to segment the coronary wall in IVUS images. First, a preprocessing followed by a feature extraction block are performed, allowing for the desired information to be extracted. Afterward, binary versions of the desired objects are reconstructed, and their contours are extracted to segment the image. The effectiveness is demonstrated by segmenting 1300 images, in which the outcomes had a strong correlation to their corresponding gold standard. Moreover, the results were also corroborated statistically by having as high as 92.72% and 91.9% of true positive area fraction for the lumen and media adventitia border, respectively. In addition, this approach can be adapted easily and applied to other related modalities, such as intravascular optical coherence tomography and intravascular magnetic resonance imaging. (E-mail: matheuscardosomg@hotmail.com) (C) 2011 World Federation for Ultrasound in Medicine & Biology.

Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems

In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semi-definite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution fir the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.

Obtaining and selection of hexokinases-less strains of Saccharomyces cerevisiae for production of ethanol and fructose from sucrose

Saccharomyces cerevisiae hexokinase-less strains were produced to study the production of ethanol and fructose from sucrose. These strains do not have the hexokinases A and B. Twenty-three double-mutant strains were produced, and then, three were selected for presenting a smaller growth in yeast extract-peptone-fructose. In fermentations with a medium containing sucrose (180.3 g L-1) and with cell recycles, simulating industrial conditions, the capacity of these mutant yeasts in inverting sucrose and fermenting only glucose was well characterized. Besides that, we could also see their great tolerance to the stresses of fermentative recycles, where fructose production (until 90 g L-1) and ethanol production (until 42.3 g L-1) occurred in cycles of 12 h, in which hexokinase-less yeasts performed high growth (51.2% of wet biomass) and viability rates (77% of viable cells) after nine consecutive cycles.

Extension of a Recent Method for Obtaining Exact Solutions of the Bruce and Klute Equation

A method based on a specific power-law relationship between the hydraulic head and the Boltzmann variable was recently presented. We generalized this relationship to a range of powers and extended the solution to include the saturated zone. As a result, the new solution satisfies the Bruce and Klute equation exactly.

A positive growth response to NaCl applications in Eucalyptus plantations established on K-deficient soils

Contrasting responses of Eucalyptus trees to K fertilizer applications have been reported on soils with low K contents. A complete randomized block experiment was set up in Brazil to test the hypothesis that large atmospheric deposits of NaCl in coastal regions might lead to a partial substitution of K by Na in Eucalyptus physiology and enhance tree growth. Treatments with application of 1.5, 3.0, 4.5 kmol K ha(-1) (K(1.5), K(3.0), 1(4.5, respectively) as KCl, 3.0 kmol K ha(-1) applied as K(2)SO(4), 3.0 kmol Na ha(-1) (Na(3.0)) as NaCl commercialized for cattle feeding, and a mixture of 1.5 kmol K + 1.5 kmol Na ha(-1) (K(1.5) + Na(1.5)) were compared to a control treatment (C) with no K and Na applications. All the plots were fertilized with large amounts of the other nutrients. A positive effect of NaCl applications on the growth of E. grandis trees was observed. NaCl and KCl additions in treatments Na(3.0) and K(3.0) increased above-ground biomass by 56% and 130% three years after planting, respectively, in comparison with the C treatment. By contrast, accumulated litterfall up to age 3 years was not significantly modified. NaCl applications in the Na(3.0) treatment significantly increased Na accumulation in above-ground tree components but did not modify K accumulation, whatever the sampling age. A partial substitution of K by Na in tree physiology, as observed for various agricultural crops, might explain this behaviour. Our results suggest the possibility of applying inexpensive K fertilizers, which are less purified in Na, and explain why high yields are achieved without K fertilizer applications in areas with large dry depositions of marine aerosols. Further investigations are necessary to identify the processes involving Na in Eucalyptus tree physiology. (C) 2009 Elsevier B.V. All rights reserved.

Sugar and ethanol production as a rural development strategy in Brazil: Evidence from the state of Sao Paulo

Sugar and ethanol production are key components of Brazil`s rural development and energy strategies, yet in recent years sugar production has been widely criticized for its environmental and labor practices. This study examines the relationship between rural development and sugarcane, ethanol, and cattle production in the state of Sao Paulo. Our results suggest that the value added components of sugarcane production, which include sugar refining and ethanol production, may have a strong positive affect on local human development in comparison to primary agricultural production activities and other land uses. These results imply that sugar production, when accompanied by a local processing industry can stimulate rural development. However, this paper also highlights the significant environmental and social harms generated by the sugar industry at large, which may undermine its development benefits if not addressed. (C) 2011 Elsevier Ltd. All rights reserved.

Identification of microsatellites markers associated with yield components and quality parameters in sugarcane

Marker assisted selection depends on the identification of tightly linked association between marker and the trait of interest. In the present work, functional (EST-SSRs) and genomic (gSSRs) microsatellite markers were used to detect putative QTLs for sugarcane yield components (stalk number, diameter and height) and as well as for quality parameters (Brix, Pol and fibre) in plant cane. The mapping population (200 individuals) was derived from a bi-parental cross (IACSP95-3018 x IACSP93-3046) from the IAC Sugarcane Breeding Program. As the map is under construction, single marker trait association analysis based on the likelihood ratio test was undertaken to detect the QTLs. Of the 215 single dose markers evaluated (1:1 and 3:1), 90 (42%) were associated with putative QTLs involving 43 microsatellite primers (18 gSSRs and 25 EST-SSRs). For the yield components, 41 marker/trait associations were found: 20 for height, 6 for diameter and 15 for stalk number. An EST-SSRs marker with homology to non-phototropic hypocotyls 4 (NPH4) protein was associated with a putative QTL with positive effect for diameter as also with a negative effect for stalk number. In relation to the quality parameters, 18 marker trait associations were found for Brix, 19 for Pol, and 12 for fibre. For fibre, 58% of the QTLs detected showed a negative effect on this trait. Some makers associated with QTLs with a negative effect for fibre showed a positive effect for Pol, reflecting the negative correlation generally observed between these traits.

Genetic potential of a maize population from Southern Brazil for the modified convergent-divergent selection scheme

Maize (Zea mays L.) is a very important cereal to world-wide economy which is also true for Brazil, particularly in the South region. Grain yield and plant height have been chosen as important criteria by breeders and farmers from Santa Catarina State (SC), Brazil. The objective of this work was to estimate genetic-statistic parameters associated with genetic gain for grain yield and plant height, in the first cycle of convergent-divergent half-sib selection in a maize population (MPA1) cultivated by farmers within the municipality of Anchieta (SC). Three experiments were carried out in different small farms at Anchieta using low external agronomic inputs; each experiment represented independent samples of half-sib families, which were evaluated in randomized complete blocks with three replications per location. Significant differences among half-sib families were observed for both variables in all experiments. The expected responses to truncated selection of the 25% better families in each experiment were 5.1, 5.8 and 5.2% for reducing plant height and 3.9, 5.7 and 5.0% for increasing grain yield, respectively. The magnitudes of genetic-statistic parameters estimated evidenced that the composite population MPA1 exhibits enough genetic variability to be used in cyclical process of recurrent selection. There were evidences that the genetic structure of the base population MPA1, as indicated by its genetic variability, may lead to expressive changes in the traits under selection, even under low selection pressure.

Does using stepwise variable selection to build sequential path analysis models make sense?

Causal inference methods - mainly path analysis and structural equation modeling - offer plant physiologists information about cause-and-effect relationships among plant traits. Recently, an unusual approach to causal inference through stepwise variable selection has been proposed and used in various works on plant physiology. The approach should not be considered correct from a biological point of view. Here, it is explained why stepwise variable selection should not be used for causal inference, and shown what strange conclusions can be drawn based upon the former analysis when one aims to interpret cause-and-effect relationships among plant traits.

Vegetative and fruit characteristics of papaya trees obtained by mass selection

The present work had as purpose to evaluate some characteristics of papaya trees (Carica papaya L.), Golden cultivar, obtained trough plant mass selection, regarding plant and fruit quality in the first months of production. The samples were evaluated in a commercial crop at: 0, 20, 40, 70, 130, 180, 230, 260, 280, 310 and 340 days after the planting (DAP) and the first fruits were harvested at 230 DAP. The results showed the low height (199cm in 340 DAP) and low first flowering`s heigth (71cm), which is important to facilitate the harvest process. The plants presented good yield with high number of leafs (allowing a great area of fruit cover) and about 60 fruits per plant. The fruits kept similar features to cv. Golden. The fruit`s fresh weight ranged from 302.4 to 467.5g, which is in the range of the Brazilian market. The pulp thickness was 2.35cm, which is a feature of great economic interest. The pulp thickness showed close relation with climatic factors, and great variations of temperature and precipitation accelerated the pulp loss of thickness.

Dissociation of deprotonated microcystin variants by collision-induced dissociation following electrospray ionization

Microcystins (MC) are a family of hepatotoxic cyclic heptapeptides produced by a number of different cyanobacterial species. Considering the recent advances in the characterization of deprotonated peptides by mass spectrometry, the fragmentation behavior of four structurally related microcystin compounds was investigated using collision-induced dissociation (CID) experiments on an orbitrap mass spectrometer. It is demonstrated in this study that significant structural information can be obtained from the CID spectra of deprotonated microcystins. A predominant ring-opening reaction at the isoMeAsp residue, as well as two major complementary fragmentation pathways, was observed, reducing the complexity of the product ion spectra in comparison with spectra observed from protonated species. This proposed fragmentation behavior was applied to characterize [Leu(1)]MC-LR from a cyanobacterial cell extract. In conclusion, CID spectra of microcystins in the negative ion mode provide rich structurally informative mass spectra which greatly enhance confidence in structural assignments, in particular when combined with complementary positive ion CID spectra. Copyright (C) 2011 John Wiley & Sons, Ltd.

The influence of positive or negative charges in the passive and iontophoretic skin penetration of porphyrins used in photodynamic therapy

Meso-tetra-(N-methylpiridinium-4-yl)-porphyrin (TMPyP) and meso-tetra-(4-sulfonatophenyl)-porphyrin (TPPS(4)) are photosensitizing drugs (PS) used in photodynamic therapy (PDT). Based on the fact that these compounds present similar chemical structures but opposite charges at pH levels near physiological conditions, this work aims to evaluate the in vitro and in vivo influence of these electrical charges on the iontophoretic delivery of TMPyP and TPPS4, attempting to achieve maximum accumulation of PS in skin tissue. The iontophoretic transport of these drugs from a hydrophilic gel was investigated in vitro using porcine ear skin and vertical, flow-through diffusion cells. In vivo experiments using rats were also carried out, and the penetration of the PSs was analyzed by fluorescence microscopy to visualize the manner of how these compounds were distributed in the skin after a short period of iontophoresis application. In vitro, both passive and iontophoretic delivery of the positively charged TMPyP were much greater (20-fold and 67-fold, respectively) than those of the negatively charged TPPS(4). TPPS(4) iontophoresis in vivo increased the fluorescence of the skin only in the very superficial layers. On the other hand, iontophoresis of the positively charged drug expressively increased the rat epidermis and dermis fluorescence, indicating high amounts of this drug throughout the skin layers. Moreover, TMPyP was homogeneously distributed around and into the nuclei of the skin cells, suggesting its potential use in topical PDT. (C) 2010 Elsevier B.V. All rights reserved.