Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Evaluation of therapeutic ultrasound equipments performance

The therapeutic ultrasound (US) is one of the resources mostly used by physiotherapists; however the use of uncalibrated equipments results in inefficient or even harmful therapies to the patient. In this direction, the objective of this study was to evaluate the performance and the procedures of utilization and maintenance of US in use in clinics and Physical-therapy offices. A questionnaire with questions related to the procedures applied in service during the use of therapeutic ultrasound was applied to physiotherapists. The performance of 31 equipments of 6 different brands and 13 different models was evaluated according to the IEC 61689 norm. The parameters measured were: acoustic power; effective radiating area (AER); non-uniformity ratio of the beam (RBN); maximum effective intensity; acoustic frequency of operation, modulation factor and wave form on pulsate mode. As for the questionnaires, it was evident that the professionals are not concerned about the calibration of the equipment. The results demonstrated that only 32.3% of the equipments were in accordance with the norms for the variables power and effective radiation area. The frequency analysis indicated that 20% of the 3 MHz transducers and 12.5% of the 1 MHz contemplated the norms. In the pulsate mode, 12.7% presented relation rest/duration inside allowed limits. A great variation of the ultrasonic field was observed on the obtained images, which presented beams not centered, sometimes with bifurcation of its apex. The results allow concluding that, although used in therapeutic sessions with the population, none of the equipments presents all the analyzed variables inside technical norms. (C) 2010 Elsevier B. V. All rights reserved.

Risk-based decision making method for maintenance policy selection of thermal power plant equipment

This study presents a decision-making method for maintenance policy selection of power plants equipment. The method is based on risk analysis concepts. The method first step consists in identifying critical equipment both for power plant operational performance and availability based on risk concepts. The second step involves the proposal of a potential maintenance policy that could be applied to critical equipment in order to increase its availability. The costs associated with each potential maintenance policy must be estimated, including the maintenance costs and the cost of failure that measures the critical equipment failure consequences for the power plant operation. Once the failure probabilities and the costs of failures are estimated, a decision-making procedure is applied to select the best maintenance policy. The decision criterion is to minimize the equipment cost of failure, considering the costs and likelihood of occurrence of failure scenarios. The method is applied to the analysis of a lubrication oil system used in gas turbines journal bearings. The turbine has more than 150 MW nominal output, installed in an open cycle thermoelectric power plant. A design modification with the installation of a redundant oil pump is proposed for lubricating oil system availability improvement. (C) 2009 Elsevier Ltd. All rights reserved.

Approximate algorithms for credal networks with binary variables

This paper presents a family of algorithms for approximate inference in credal networks (that is, models based on directed acyclic graphs and set-valued probabilities) that contain only binary variables. Such networks can represent incomplete or vague beliefs, lack of data, and disagreements among experts; they can also encode models based on belief functions and possibilistic measures. All algorithms for approximate inference in this paper rely on exact inferences in credal networks based on polytrees with binary variables, as these inferences have polynomial complexity. We are inspired by approximate algorithms for Bayesian networks; thus the Loopy 2U algorithm resembles Loopy Belief Propagation, while the Iterated Partial Evaluation and Structured Variational 2U algorithms are, respectively, based on Localized Partial Evaluation and variational techniques. (C) 2007 Elsevier Inc. All rights reserved.

Fretting fatigue in overhead conductors: Rig design and failure analysis of a Grosbeak aluminium cable steel reinforced conductor

The performance optimisation of overhead conductors depends on the systematic investigation of the fretting fatigue mechanisms in the conductor/clamping system. As a consequence, a fretting fatigue rig was designed and a limited range of fatigue tests was carried out at the middle high cycle fatigue regime in order to access an exploratory S-N curve for a Grosbeak conductor, which was mounted on a mono-articulated aluminium clamping system. Subsequent to these preliminary fatigue tests, the components of the conductor/clamping system, such as ACSR conductor, upper and lower clamps, bolt and nuts, were subjected to a failure analysis procedure in order to investigate the metallurgical free variables interfering on the fatigue test results, aiming at the optimisation of the testing reproducibility. The results indicated that the rupture of the planar fracture surfaces observed in the external At strands of the conductor tested under lower bending amplitude (0.9 mm) occurred by fatigue cracking (I mm deep), followed by shear overload. The V-type fracture surfaces observed in some At strands of the conductor tested under higher bending amplitude (1.3 mm) were also produced by fatigue cracking (approximately 400 mu m deep), followed by shear overload. Shear overload fracture (45 degrees fracture surface) was also observed on the remaining At wires of the conductor tested under higher bending amplitude (1.3 mm). Additionally, the upper and lower Al-cast clamps presented microstructure-sensitive cracking, which was folowed by particle detachment and formation of abrasive debris on the clamp/conductor tribo-interface, promoting even further the fretting mechanism. The detrimental formation of abrasive debris might be inhibited by the selection of a more suitable class of as-cast At alloy for the production of clamps. Finally, the bolt/nut system showed intense degradation of the carbon steel nut (fabricated in ferritic-pearlitic carbon steel, featuring machined threads with 190 HV), with intense plastic deformation and loss of material. Proper selection of both the bolt and nut materials and the finishing processing might prevent the loss in the clamping pressure during the fretting testing. It is important to control the specification of these components (clamps, bolt and nuts) prior to the start of large scale fretting fatigue testing of the overhead conductors in order to increase the reproducibility of this assessment. (c) 2008 Elsevier Ltd. All rights reserved.

Collaboration intensity in the Brazilian supermarket retail chain

Purpose - This paper seeks to identify collaboration elements and evaluate their intensity in the Brazilian supermarket retail chain, especially the manufacturer-retailer channel. Design/methodology/approach - A structured questionnaire was elaborated and applied to 125 representatives from suppliers of large supermarket chains. Statistical methods including multivariate analysis were employed. Variables were grouped and composed into five indicators (joint actions, information sharing, interpersonal integration, gains and cost sharing, and strategic integration) to assess the degree of collaboration. Findings - The analyses showed that the interviewees considered interpersonal integration to be of greater importance to collaboration intensity than the other integration factors, such as gain or cost sharing or even strategic integration. Research limitations/implications - The research was conducted solely from the point of view of the industries that supply the large retail networks. The interviews were not conducted in pairs; that is, there was no application of one questionnaire to the retail network and another to the partner industry. Practical implications - Companies should invest in conducting periodic meetings with their partners to increase collaboration intensity, and should carry out technical visits to learn about their partners` logistic reality and thus make better operational decisions. Originality/value - The paper reveals which indicators produce greater collaboration intensity, and thus those that are more relevant to more efficient logistics management.

Miniaturized structures for removal or selection of particles from liquid flow

The aim of this work was the development of miniaturized structures useful for retention and/or selection of particles and viscous substances from a liquid flow. The proposed low costs structures are similar to macroscopic wastewater treatment systems, named baffles, and allow disassemble. They were simulated using FEMLAB 3.2b package and manufactured in acrylic with conventional tools. Tests for retention or selection of particles in water or air and viscous fluids in water were carried out. Either in air or water particles with 50 mu m diameter will be retained but not with 13 mu m diameter. In aqueous flow, it is also possible the retention of viscous samples, such as silicone 350 cSt. The simulated results showed good agreement with experimental measurements. These miniaturized structures can be useful in sample pretreatment for chemical analysis and microorganism manipulation. (C) 2007 Elsevier B.V. All rights reserved.

Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems

In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semi-definite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution fir the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.

A calibration approach based on Takagi-Sugeno fuzzy inference system for digital electronic compasses

Recently, the development of industrial processes brought on the outbreak of technologically complex systems. This development generated the necessity of research relative to the mathematical techniques that have the capacity to deal with project complexities and validation. Fuzzy models have been receiving particular attention in the area of nonlinear systems identification and analysis due to it is capacity to approximate nonlinear behavior and deal with uncertainty. A fuzzy rule-based model suitable for the approximation of many systems and functions is the Takagi-Sugeno (TS) fuzzy model. IS fuzzy models are nonlinear systems described by a set of if then rules which gives local linear representations of an underlying system. Such models can approximate a wide class of nonlinear systems. In this paper a performance analysis of a system based on IS fuzzy inference system for the calibration of electronic compass devices is considered. The contribution of the evaluated IS fuzzy inference system is to reduce the error obtained in data acquisition from a digital electronic compass. For the reliable operation of the TS fuzzy inference system, adequate error measurements must be taken. The error noise must be filtered before the application of the IS fuzzy inference system. The proposed method demonstrated an effectiveness of 57% at reducing the total error based on considered tests. (C) 2011 Elsevier Ltd. All rights reserved.

Variability on red blood cell transfusion practices among Brazilian neonatal intensive care units

BACKGROUND: Guidelines for red blood cell (RBC) transfusions exist; however, transfusion practices vary among centers. This study aimed to analyze transfusion practices and the impact of patients and institutional characteristics on the indications of RBC transfusions in preterm infants. STUDY DESIGN AND METHODS: RBC transfusion practices were investigated in a multicenter prospective cohort of preterm infants with a birth weight of less than 1500 g born at eight public university neonatal intensive care units of the Brazilian Network on Neonatal Research. Variables associated with any RBC transfusions were analyzed by logistic regression analysis. RESULTS: Of 952 very-low-birth-weight infants, 532 (55.9%) received at least one RBC transfusion. The percentages of transfused neonates were 48.9, 54.5, 56.0, 61.2, 56.3, 47.8, 75.4, and 44.7%, respectively, for Centers 1 through 8. The number of transfusions during the first 28 days of life was higher in Center 4 and 7 than in other centers. After 28 days, the number of transfusions decreased, except for Center 7. Multivariate logistic regression analysis showed higher likelihood of transfusion in infants with late onset sepsis (odds ratio [OR], 2.8; 95% confidence interval [CI], 1.8-4.4), intraventricular hemorrhage (OR, 9.4; 95% CI, 3.3-26.8), intubation at birth (OR, 1.7; 95% CI, 1.0-2.8), need for umbilical catheter (OR, 2.4; 95% CI, 1.3-4.4), days on mechanical ventilation (OR, 1.1; 95% CI, 1.0-1.2), oxygen therapy (OR, 1.1; 95% CI, 1.0-1.1), parenteral nutrition (OR, 1.1; 95% CI, 1.0-1.1), and birth center (p < 0.001). CONCLUSIONS: The need of RBC transfusions in very-low-birth-weight preterm infants was associated with clinical conditions and birth center. The distribution of the number of transfusions during hospital stay may be used as a measure of neonatal care quality.

Obtaining and selection of hexokinases-less strains of Saccharomyces cerevisiae for production of ethanol and fructose from sucrose

Saccharomyces cerevisiae hexokinase-less strains were produced to study the production of ethanol and fructose from sucrose. These strains do not have the hexokinases A and B. Twenty-three double-mutant strains were produced, and then, three were selected for presenting a smaller growth in yeast extract-peptone-fructose. In fermentations with a medium containing sucrose (180.3 g L-1) and with cell recycles, simulating industrial conditions, the capacity of these mutant yeasts in inverting sucrose and fermenting only glucose was well characterized. Besides that, we could also see their great tolerance to the stresses of fermentative recycles, where fructose production (until 90 g L-1) and ethanol production (until 42.3 g L-1) occurred in cycles of 12 h, in which hexokinase-less yeasts performed high growth (51.2% of wet biomass) and viability rates (77% of viable cells) after nine consecutive cycles.

Spatial-temporal variation in coiled and straight morphotypes of Cylindrospermopsis raciborskii (Wolsz) Seenayya et Subba Raju (Cyanobacteria)

(Spatial-temporal variation in coiled and straight morphotypes of Cylindrospermopsis raciborskii (Wolsz) Seenayya et Subba Raju (Cyanobacteria)). This study reports the spatial and temporal behavior of straight and coiled morphotypes of C. raciborskii in a reservoir in Brazil`s semiarid region as well as the main factors responsible for the variability. Two set of samples were collected from the subsurface and bottom in the central region of a reservoir in two seasonal periods (dry January 2005; rainy June 2005) over 20-hour sampling periods during daylight (8 am, 12 pm and 4 pm) and dark (8 pm, 12 am and 4 am) hours. Measurements of abiotic parameters were determined concurrently to the sampling of biotic variables. Two C. raciborskii morphotypes were found in the reservoir: straight and coiled. There was no difference in density of the straight and coiled C. raciborskii morphotypes between the different sampling times for either season. Vertical differences were found in the distribution of both morphotypes in both seasons, with greater densities recorded at the subsurface. Densities of the two C. raciborskii morphotypes were greater in the dry season, with the density of the coiled morphotype at the surface two-fold greater than that of the straight morphotype and that found in the rainy season. The ecological success of the coiled morphotype was due to thermal stratification, whereas a mixed condition was determinant in the success of the straight morphotype.

Multivariate analysis of sensory characteristics of coffee grains (Coffea arabica L.) in the region of upper Paranaiba

This study aimed to examine the sensory characteristics of the grains of 21 cultivars of Coffea arabica L. and Coffea canephora Pierre from the essays of genetic improvement of EPAMIG, located in Patrocinio Municipality, Minas Gerais State, where they were collected through cloths stripping method and washed. Subsequently to dry (11 to 12% moisture b.u.), we obtained the coffee designated as natural. The evaluated varieties were: Acaia Cerrado MG 1474; Bourbon Vermelho DATERRA; Catigua MG 1; Catigua MG 2; Catual Amarelo IAC 62; Catuai Vermelho IAC 15; H 419-3-1-4-2; H 419-6-2 -5-2; H 419-6-2-5-3; H 419-6-2-7-3 Vermelho; H 493-1-2-10; H 514-7-10-1 Vermelho; H 514-7-10-6; H 515-4-2-2; H 518-3-6-1; Icatu Amarelo IAC 3282; Mundo Novo 379-19; Mundo Novo TAO 376-4; Rubi MG 1192; Sacramento MG 1 and Topazio MG 1190, from 2005/2006 and 2006/2007 seasons. The cultivars according to the first principal component with notes above 80 points, regarded as superior drink according to attributes with the highest scores (flavor, sweetness, balance, acidity, clean drink, and aspect) were: Catigua MG2, Rubi MG 1192, 514-7-10-6 H, H 419-3-1-4-2, H 419-6-2-5-2, 493-1-2-10 H, H 514-7-10-1 Vermelho, Catigua MG1, Sacramento MG1, 419-6-2-5-3 H, H 515-9-2-2 and Catuai Amarelo IAC 62.

Time stability of soil water storage measured by neutron probe and the effects of calibration procedures in a small watershed

The knowledge of soil water storage (SWS) of soil profiles is crucial for the adoption of vegetation restoration practices. With the aim of identifying representative sites to obtain the mean SWS of a watershed, a time stability analysis of neutron probe evaluations of SWS was performed by the means of relative differences and Spearman rank correlation coefficients. At the same time, the effects of different neutron probe calibration procedures were explored on time stability analysis. mean SWS estimation. and preservation of the spatial variability of SWS. The selected watershed, with deep gullies and undulating slopes which cover an area of 20 ha, is characterized by an Ust-Sandiic Entisol and an Aeolian sandy soil. The dominant vegetation species are bunge needlegrass (Stipa bungeana Trim) and korshinsk peashrub (Carugano Korshinskii kom.). From June 11, 2007 to July 23,2008, SWS of the top1 m soil layer was evaluated for 20 dates, based on neutron probe data of 12 sampling sites. Three calibration procedures were employed: type 1, most complete, with each site having its own linear calibration equation (TrE); type II. with TrE equations extended over the whole field: and type III, with one single linear calibration curve for the whole field (UnE) and also correcting its intercept based on site specific relative difference analysis (RdE) and on linear fitting of data (RcE), both maintaining the same slope. A strong time stability of SWS estimated by TrE equations was identified. Soil particle size and soil organic matter content were recognized as the influencing factors for spatial variability of SWS. Land use influenced neither the spatial variability nor the time stability of SWS. Time stability analysis identified one site to represent the mean SWS of the whole watershed with mean absolute percentage errors of less than 10%, therefore. this site can be used as a predictor for the mean SWS of the watershed. Some equations of type II were found to be unsatisfactory to yield reliable mean SWS values or in preserving the associated soil spatial variability. Hence, it is recommended to be cautious in extending calibration equations to other sites since they might not consider the field variability. For the equations with corrected intercept (type III), which consider the spatial variability of calibration in a different way in relation to TrE, it was found that they can yield satisfactory means and standard deviation of SWS, except for the RdE equations, which largely leveled off the SWS values in the watershed. Correlation analysis showed that the neutron probe calibration was linked to soil bulk density and to organic matter content. Therefore, spatial variability of soil properties should be taken into account during the process of neutron probe calibration. This study provides useful information on the mean SWS observation with a time stable site and on distinct neutron probe calibration procedures, and it should be extended to soil water management studies with neutron probes, e.g., the process of vegetation restoration in wider area and soil types of the Loess Plateau in China. (C) 2009 Elsevier B.V. All rights reserved.

On the use of correlated beta random variables with animal population modelling

We give reasons why demographic parameters such as survival and reproduction rates are often modelled well in stochastic population simulation using beta distributions. In practice, it is frequently expected that these parameters will be correlated, for example with survival rates for all age classes tending to be high or low in the same year. We therefore discuss a method for producing correlated beta random variables by transforming correlated normal random variables, and show how it can be applied in practice by means of a simple example. We also note how the same approach can be used to produce correlated uniform triangular, and exponential random variables. (C) 2008 Elsevier B.V. All rights reserved.