Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

A reference business process for ecological niche modelling

Ecological niche modelling combines species occurrence points with environmental raster layers in order to obtain models for describing the probabilistic distribution of species. The process to generate an ecological niche model is complex. It requires dealing with a large amount of data, use of different software packages for data conversion, for model generation and for different types of processing and analyses, among other functionalities. A software platform that integrates all requirements under a single and seamless interface would be very helpful for users. Furthermore, since biodiversity modelling is constantly evolving, new requirements are constantly being added in terms of functions, algorithms and data formats. This evolution must be accompanied by any software intended to be used in this area. In this scenario, a Service-Oriented Architecture (SOA) is an appropriate choice for designing such systems. According to SOA best practices and methodologies, the design of a reference business process must be performed prior to the architecture definition. The purpose is to understand the complexities of the process (business process in this context refers to the ecological niche modelling problem) and to design an architecture able to offer a comprehensive solution, called a reference architecture, that can be further detailed when implementing specific systems. This paper presents a reference business process for ecological niche modelling, as part of a major work focused on the definition of a reference architecture based on SOA concepts that will be used to evolve the openModeller software package for species modelling. The basic steps that are performed while developing a model are described, highlighting important aspects, based on the knowledge of modelling experts. In order to illustrate the steps defined for the process, an experiment was developed, modelling the distribution of Ouratea spectabilis (Mart.) Engl. (Ochnaceae) using openModeller. As a consequence of the knowledge gained with this work, many desirable improvements on the modelling software packages have been identified and are presented. Also, a discussion on the potential for large-scale experimentation in ecological niche modelling is provided, highlighting opportunities for research. The results obtained are very important for those involved in the development of modelling tools and systems, for requirement analysis and to provide insight on new features and trends for this category of systems. They can also be very helpful for beginners in modelling research, who can use the process and the experiment example as a guide to this complex activity. (c) 2008 Elsevier B.V. All rights reserved.

Experimental Measurement of Water Diffusion through Fine Aggregate Mixtures

The water diffusion attributable to concentration gradients is among the main mechanisms of water transport into the asphalt mixture. The transport of small molecules through polymeric materials is a very complex process, and no single model provides a complete explanation because of the small molecule`s complex internal structure. The objective of this study was to experimentally determine the diffusion of water in different fine aggregate mixtures (FAM) using simple gravimetric sorption measurements. For the purposes of measuring the diffusivity of water, FAMs were regarded as a representative homogenous volume of the hot-mix asphalt (HMA). Fick`s second law is generally used to model diffusion driven by concentration gradients in different materials. The concept of the dual mode diffusion was investigated for FAM cylindrical samples. Although FAM samples have three components (asphalt binder, aggregates, and air voids), the dual mode was an attempt to represent the diffusion process by only two stages that occur simultaneously: (1) the water molecules are completely mobile, and (2) the water molecules are partially mobile. The combination of three asphalt binders and two aggregates selected from the Strategic Highway Research Program`s (SHRP) Materials Reference Library (MRL) were evaluated at room temperature [23.9 degrees C (75 degrees F)] and at 37.8 degrees C (100 degrees F). The results show that moisture uptake and diffusivity of water through FAM is dependent on the type of aggregate and asphalt binder. At room temperature, the rank order of diffusivity and moisture uptake for the three binders was the same regardless of the type of aggregate. However, this rank order changed at higher temperatures, suggesting that at elevated temperatures different binders may be undergoing a different level of change in the free volume. DOI: 10.1061/(ASCE)MT.1943-5533.0000190. (C) 2011 American Society of Civil Engineers.

Evaluation of FAO Penman-Monteith and alternative methods for estimating reference evapotranspiration with missing data in Southern Ontario, Canada

Grass reference evapotranspiration (ETo) is an important agrometeorological parameter for climatological and hydrological studies, as well as for irrigation planning and management. There are several methods to estimate ETo, but their performance in different environments is diverse, since all of them have some empirical background. The FAO Penman-Monteith (FAD PM) method has been considered as a universal standard to estimate ETo for more than a decade. This method considers many parameters related to the evapotranspiration process: net radiation (Rn), air temperature (7), vapor pressure deficit (Delta e), and wind speed (U); and has presented very good results when compared to data from lysimeters Populated with short grass or alfalfa. In some conditions, the use of the FAO PM method is restricted by the lack of input variables. In these cases, when data are missing, the option is to calculate ETo by the FAD PM method using estimated input variables, as recommended by FAD Irrigation and Drainage Paper 56. Based on that, the objective of this study was to evaluate the performance of the FAO PM method to estimate ETo when Rn, Delta e, and U data are missing, in Southern Ontario, Canada. Other alternative methods were also tested for the region: Priestley-Taylor, Hargreaves, and Thornthwaite. Data from 12 locations across Southern Ontario, Canada, were used to compare ETo estimated by the FAD PM method with a complete data set and with missing data. The alternative ETo equations were also tested and calibrated for each location. When relative humidity (RH) and U data were missing, the FAD PM method was still a very good option for estimating ETo for Southern Ontario, with RMSE smaller than 0.53 mm day(-1). For these cases, U data were replaced by the normal values for the region and Delta e was estimated from temperature data. The Priestley-Taylor method was also a good option for estimating ETo when U and Delta e data were missing, mainly when calibrated locally (RMSE = 0.40 mm day(-1)). When Rn was missing, the FAD PM method was not good enough for estimating ETo, with RMSE increasing to 0.79 mm day(-1). When only T data were available, adjusted Hargreaves and modified Thornthwaite methods were better options to estimate ETo than the FAO) PM method, since RMSEs from these methods, respectively 0.79 and 0.83 mm day(-1), were significantly smaller than that obtained by FAO PM (RMSE = 1.12 mm day(-1). (C) 2009 Elsevier B.V. All rights reserved.

Banana fiber craftwork in the perspective of multifunctionality in quilombola communities

This study pursued an analysis of a modality of craftwork activity developed as an alternative for occupation and income using banana crop wastes. It is the banana fiber craftwork. The experience was developed in quilombola communities in the region of Vale do Ribeira, S (a) over tildeo Paulo State, Brazil. The correlation between the craftwork and other activities used as a source of income, like organic banana and other land crops, and rural tourism, was established. Using multifunctionality as a reference, it was intended to focus on the craftwork. activity within the dynamics of rural families in their territories, considering the economic, social, cultural and environmental issues involved in the quilombola`s activities. This permitted the evaluation of their contributions to the maintainance of the life conditions of these communities.

Evapotranspiration and crop coefficients of seedless watermelon

The research was developed in Fortaleza, CE (latitude 3 degrees 43`S, longitude of 38 degrees 32`W and altitude of 19.5 m). It aimed to determine the Evapotranspiration and the crop coefficients for the different stadiums of seedless watermelon (Citrullus lanatus, Schrad), using the water balance method in drainage lysimeter. The experimental unit consisted of four located drainage lysimeter in an area of 600 m(2). The culture Evapotranspiration (ETc) was determined by the method of the water balance, in a volume of soil control with depth of 0.45 m, whose humidity was monitored by tensiometers. The reference Evapotranspiration (ETo) was estimated by the method of the class A pan. The crop coefficients were obtained from the rate between ETc and ETo in the different stages. The ETc presented growing values from the vegetative stage to the fruiting stage, dropping straight away in the mature stage. The maximum value of kc was observed in the fruiting stage.

Evaluation of two semi-selective media to detect Curtobacterium flaccumfaciens pv. flaccumfaciens in bean seeds

Evaluation of two semi-selective media to detect Curtobacterium flaccumfaciens pv. flaccumfaciens in bean seeds This study aimed to compare the effectiveness of the semi-selective MSCFF and modified CNS culture media in detecting Curtobacterium flaccumfaciens pv. flaccumfaciens (Cff) in bean seeds, using the streak and spread plate techniques. Four 500 g subsamples, obtained from two samples of bean seeds, were immersed in 600 mL of sterile distilled water for 18 h at 5 degrees C. Suspensions were picked and transferred to plates with both culture media. Plates were then incubated at 28 degrees C, and bacterial growth on both media was evaluated 72 and 144 hours later, compared to the growth of a Cff reference strain. Both media revealed the presence of Cff colonies. Typical colonies were isolated for PCR analyses and pathogenicity tests on tobacco leaves. A characteristic Cff growth on MSCFF medium was observed for the seed samples, for the two plate techniques used, in both evaluations. On the modified CNS culture medium, the bacterial growth was only detected in seed samples after 144 hours of incubation, regardless of the plate technique used. The results showed Cff grew faster on the MSCFF semi-selective culture medium. Bacterial isolates tested were identified as Cff by both PCR analyses and a positive tobacco hypersensitivity reaction.

Bioequivalence Evaluation of Two Different Tablet Formulations of Tinidazole in Healthy Volunteers

The bioequivalence of two different tablet formulations of tirtidazole (CAS 19387-91-8) was determined in healthy volunteers after a single dose in a randomized crossover study, with a 1-week washout period between the doses. Reference and test products were administered to 24 volunteers with 240 mL water after overnight fasting. Plasma concentrations of tinidazole were monitored by a high-performance liquid chromatographic method (HPLC) over a period of 72 h after the administration. The pharmacokinetic parameters AUC(0-t), AUC(0-infinity), C(max), T(max), T((1/2)el) and beta were determined from plasma concentration time profile of both formulations and found to be in good agreement with previously reported values. The calculated pharmacokinetic parameters were compared statistically to evaluate bioequivalence between the two brands. The analysis of variance (ANOVA) did not show any significant difference between the two formulations and 90% confidence intervals for the ratio of C(max) (93.9 - 102.6%), AUC(0-t), (94.9-101.1%) and AUC(0-infinity) (94.6-100.8%) values for the test and reference products were within the 80 - 125% interval, satisfying bioequivalence criteria of the European Committee for Proprietary Medicinal Products and the US Food and Drug Administration Guidelines. These results indicate that the test and the reference products of tinidazole are bioequivalent and, thus, may be prescribed interchangeably.

Bioequivalence study of two oral formulations of cefadroxil in healthy volunteers

Two different cefadroxil (CAS 50370-12-2) formulations were evaluated for their relative bioavailability in 24 healthy volunteers who received a single 500 mg oral dose of each preparation. An open, randomized clinical trial designed as a two-period crossover study with a 7-day washout period between doses was employed. Plasma samples for assessments of their cefadroxil concentration by HPLC-UV were obtained over 8 h after administration. Values of 48.94 +/- 10.18 mu g . h/ml for test, and 48.51 +/- 9.02 mu g . h/ml for the reference preparation AUC(0-t) demonstrate a nearly identical extend of drug absorption. Maximum plasma concentration C-max of 16.04 +/- 4.94 mu g/ml and 16.01 +/- 4.02 mu g/ml achieved for the test and reference preparations did not differ significantly. The parametric 90% confidence intervals (CI) of the mean of the difference (test-reference) between log-transformed values of the two formulations were 96.80% to 104.51% and 92.01% to 107.00% for AUC(0-t) and C-max, respectively. Since for both AUC(0-t) or C-max the 90% CI values are within the interval proposed by the Food and Drug Administration, the test product is bioequivalent to the reference product for both the rate and extent of absorption after single dose administration.

Further sesquiterpene lactones from viguiera robusta and the potential anti-inflammatory activity of a heliangolide: Inhibition of human neutrophil elastase release

In addition to known heliangolides, a new eudesmanolide was isolated from the leaf rinse extract of Viguiera robusta (Asteraceae). Structural elucidation was based oil spectral analysis. It is the first report on eudesmanolides in members of the subgenus Calanticaria of Viguiera. In this work, the main isolated compound, the furanoheliangolide budlein A, besides its previously, reported in vitro and in vivo anti-inflammatory activities, inhibited human neutrophil elastase release. The inhibition was at the concentration of (16.83 +/- 1.96) mu M for formylated bacterial tripeptide (fMLP) stimulation and (11.84 +/- 1.62) mu M for platelet aggregation factor (PAF) stimulation, being slightly less active than the reference drug parthenolide. The results are important to demonstrate the potential anti-inflammatory activities of sesquiterpene lactones and corroborate the previous studies using other targets.

Association Among Microalbuminuria and Oxidative Stress Biomarkers in Patients With Type 2 Diabetes

Aim: Hyperglycemia in diabetes mellitus (DM) may be one of the most important factors responsible for the development of oxidative stress, which promotes the main complications in DM patients. Therefore, this study evaluated if the hyperglycemia could be related to oxidative stress biomarkers, lipid profile, and renal function in type 2 diabetes patients without clinic complications. Methods: Plasmatic malondialdehyde (MDA), serum protein carbonyl (PCO), serum creatinine levels, microalbuminuria, glycated hemoglobin, and lipid profile were analyzed in 37 type 2 diabetic patients and 25 subjects with no diabetes. Results: Serum creatinine levels were within the reference values, but microalbuminuria presented increased levels in all the patients compared with controls (P G 0.05) and above of the reference values. The MDA, PCO, low- density lipoprotein, and triglyceride levels showed positive correlation with microalbuminuria levels. Moreover, glycated hemoglobin presented positive correlation with MDA, PCO, and microalbuminuria levels. Conclusions: The hyperglycemia could be responsible for the increase of the microalbuminuria levels and for the oxidation process in lipids and proteins in DM patients. Therefore, we suggested that the microvascular lesion is a direct consequence from hyperglycemia and an indirect one from the increased oxidative stress. Malondialdehyde and protein carbonyl levels could be suggested as additional biochemical evaluation to verify tissue damage in type 2 DM patients.

Retinal and lenticular ultrastructure in the aestivating salamanderfish, Lepidogalaxias salamandroides (Galaxiidae, Teleostei) with special reference to a new type of photoreceptor mosaic

The salamanderfish, Lepidogalaxias salamandroides (Galaxiidae, Teleostei) is endemic to southwestern Australia and inhabits shallow, freshwater pools which evaporate during the hot summer months. Burrowing into the substrate in response to falling water levels allows these fish to aestivate for extended periods of time while encapsulated in a mucous cocoon even when the pools contain no water. Only a few minutes after a major rainfall, these fish emerge into relatively clear water which subsequently becomes laden with tannin, turning the water black and reducing the pH to approximately 4.3. As part of a large study of the visual adaptations of this unique species, the retinal and lenticular morphology of the aestivating salamanderfish is examined at the level of the light and electron microscopes. The inner retina is highly vascularised by a complex system of vitreal blood vessels, while the outer retina receives a blood supply by diffusion from a choriocapillaris. This increased retinal blood supply may be an adaptation for reducing the oxygen tension during critical periods of aestivation. Large numbers of Muller cells traverse the thickness of the retina from the inner to the outer limiting membranes. The ganglion cells are arranged in two ill-defined layers, separated from a thick inner nuclear layer containing two layers of horizontal cells by a soma-free inner plexiform layer. The photoreceptors can be divided into three types typical of many early actinopterygian representatives; equal double cones, small single cones and large rods (2:1:1). These photoreceptors are arranged into a unique regular square mosaic comprising a large rod bordered by four equal double cones with a small single cone located at the corner of each repeating unit. The double cones may optimise perception of mobile prey which it tracks by flexion of its head and neck and the large rods may increase sensitivity in the dark tannin-rich waters in which it lives. Each single cone also possesses a dense collection of polysomes and glycogen (a paraboloid) beneath its ellipsoid, the first such finding in teleosts. The retinal pigment epithelium possesses melanosomes, pha,oocytes and a large number of mitochondria. The anatomy of the retina and the photoreceptor mosaic is discussed in relation to the primitive phylogeny of this species and its unique life history.

Assessment of transient gene expression in plant tissues using the green fluorescent protein as a reference

Four different promoters (35S and enhanced 35S of the cauliflower mosaic virus, polyubiquitin of maize and actin1 of rice) were compared in a transient assay using maize leaves and particle bombardment. A gene encoding the jellyfish green fluorescent protein (GFP) driven by the 358 promoter was used as an internal standard to monitor the effectiveness of each bombardment. Normalisation of the transient expression assay using the GFP reference significantly reduced the variability between separate bombardments and allowed for a rapid and accurate evaluation of different promoters in microprojectile-bombarded leaves.

Predicting composition of leg sections with anthropometry and bioelectrical impedance analysis using magnetic resonance imaging as reference

Magnetic resonance imaging (MRI) was used to evaluate and compare with anthropometry a fundamental bioelectrical impedance analysis (BIA) method for predicting muscle and adipose tissue composition in the lower limb. Healthy volunteers (eight men and eight women), aged 41 to 62 years, with mean (S.D.) body mass indices of 28.6 (5.4) kg/m(2) and 25.1 (5.4) kg/m(2) respectively, were subjected to MRI leg scans, from which 20-cm sections of thigh and IO-cm sections of lower leg (calf) were analysed for muscle and adipose tissue content, using specifically developed software. Muscle and adipose tissue were also predicted from anthropometric measurements of circumferences and skinfold thicknesses, and by use of fundamental BIA equations involving section impedance at 50 kHz and tissue-specific resistivities. Anthropometric assessments of circumferences, cross-sectional areas and volumes for total constituent tissues matched closely MRI estimates. Muscle volume was substantially overestimated (bias: thigh, -40%; calf, -18%) and adipose tissue underestimated (bias: thigh, 43%; calf, 8%) by anthropometry, in contrast to generally better predictions by the fundamental BIA approach for muscle (bias:thigh, -12%; calf, 5%) and adipose tissue (bias:thigh, 17%; calf, -28%). However, both methods demonstrated considerable individual variability (95% limits of agreement 20-77%). In general, there was similar reproducibility for anthropometric and fundamental BIA methods in the thigh (inter-observer residual coefficient of variation for muscle 3.5% versus 3.8%), but the latter was better in the calf (inter-observer residual coefficient of variation for muscle 8.2% versus 4.5%). This study suggests that the fundamental BIA method has advantages over anthropometry for measuring lower limb tissue composition in healthy individuals.