Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Transmission lines distance protection using artificial neural networks

This work presents the development and implementation of an artificial neural network based algorithm for transmission lines distance protection. This algorithm was developed to be used in any transmission line regardless of its configuration or voltage level. The described ANN-based algorithm does not need any topology adaptation or ANN parameters adjustment when applied to different electrical systems. This feature makes this solution unique since all ANN-based solutions presented until now were developed for particular transmission lines, which means that those solutions cannot be implemented in commercial relays. (c) 2011 Elsevier Ltd. All rights reserved.

Learning about knowledge management for improving environmental impact assessment in a government agency: The Western Australian experience

How does knowledge management (KM) by a government agency responsible for environmental impact assessment (EIA) potentially contribute to better environmental assessment and management practice? Staff members at government agencies in charge of the EIA process are knowledge workers who perform judgement-oriented tasks highly reliant on individual expertise, but also grounded on the agency`s knowledge accumulated over the years. Part of an agency`s knowledge can be codified and stored in an organizational memory, but is subject to decay or loss if not properly managed. The EIA agency operating in Western Australia was used as a case study. Its KM initiatives were reviewed, knowledge repositories were identified and staff surveyed to gauge the utilisation and effectiveness of such repositories in enabling them to perform EIA tasks. Key elements of KM are the preparation of substantive guidance and spatial information management. It was found that treatment of cumulative impacts on the environment is very limited and information derived from project follow-up is not properly captured and stored, thus not used to create new knowledge and to improve practice and effectiveness. Other opportunities for improving organizational learning include the use of after-action reviews. The learning about knowledge management in EIA practice gained from Western Australian experience should be of value to agencies worldwide seeking to understand where best to direct their resources for their own knowledge repositories and environmental management practice. (C) 2011 Elsevier Ltd. All rights reserved.

Magnetic losses evolution of a semi-processed steel during forced aging treatments

An ultra-low carbon steel (30 ppm after decarburization) containing Al and Si was aged for distinct soaking times at 210 degrees C. The core loss increased continuously until around 24 h. After that, only slight changes were verified. It was found that only the hysteresis loss component changed during the aging treatment. By internal friction test and transmission electron microscopy it was seen that carbon precipitation caused the magnetic aging. By scanning electron microscopy it could be concluded that the increase of aging index was attributed to the high number of carbides larger than 0.1 mu m. (C) 2008 Elsevier B. V. All rights reserved.

On Building a Memory Evolutive System for Application to Learning and Cognition Modeling

We address here aspects of the implementation of a memory evolutive system (MES), based on the model proposed by A. Ehresmann and J. Vanbremeersch (2007), by means of a simulated network of spiking neurons with time dependent plasticity. We point out the advantages and challenges of applying category theory for the representation of cognition, by using the MES architecture. Then we discuss the issues concerning the minimum requirements that an artificial neural network (ANN) should fulfill in order that it would be capable of expressing the categories and mappings between them, underlying the MES. We conclude that a pulsed ANN based on Izhikevich`s formal neuron with STDP (spike time-dependent plasticity) has sufficient dynamical properties to achieve these requirements, provided it can cope with the topological requirements. Finally, we present some perspectives of future research concerning the proposed ANN topology.

Ultra-thin films of alternating semi-interpenetrating layers of a conducting polymer with thermosetting phenolic resins for sensor application

In this work a new method for crosslinking ultra-thin films with potential applications in sensor systems is proposed. The films were produced by layer-by-layer (LbL) assembly using a conducting polymer, poly(o-ethoxyaniline) (POEA), alternated with a thermosetting resin, novolac-type phenolformaldehyde (PF), crosslinked by a simple thermal treatment. The PF resin served as both alternating and crosslinking agents. The films were characterized by Fourier transform infrared (FTIR) and ultraviolet-visible (UV-Vis) spectroscopy, thermogravimetry (TG), desorption, doping/dedoping cycling and electrical measurements. The results showed that film architecture and crosslinking degree can be controlled by the conditions used for film deposition (number of bilayers, polymer concentration, pH, and deposition time), and crosslinking time. Moreover, this approach offers several advantages such as fast curing time and low cost, indicating that these films can be used to produce sensors with improved stability.

Repeated disturbances and canopy disturbance regime in a tropical semi-deciduous forest

The canopy disturbance regime and the influence of gap methods on the interpretation of forest structure and dynamics were evaluated in a tropical semi-deciduous forest in south-eastern Brazil. We encountered a gap density of 11.2 gaps ha(-1) and an average size which varied from 121 to 333 m(2) depending on the gap delimitation method considered (minimum gap size was 10 m(2)). Although average size was slightly higher, the median value obtained (78 m(2)) was comparable to other tropical forest sites and the gap size-class distribution found supported the pattern described for such forest sites. Among 297 gap makers, snapping and uprooting were the most common modes of disturbance. The number and basal area of gap makers were good predictors of gap size. Almost 25% of all gaps suffered from repeated disturbance events that brought about larger gap sizes. Such processes, along with delimitation methods, strongly influenced the estimation of turnover rate and therefore the interpretation of forest dynamics. These results demonstrated the importance of further studies on repeated disturbances, which is often neglected in forest studies.

Toward sustainable soil and water resources use in China`s highly erodible semi-arid loess plateau

The water-wind crisscross region of the Loess Plateau in China is comprised of 17.8 million hectares of highly erodible soil under limited annual rainfall. This requires a sustainable water balance for the restoration of dryland ecosystems to reduce and manage soil erosion. In this region, alfalfa has been one of the main legumes grown to minimize soil erosion. However, alfalfa yields were significantly lower in years of reduced rainfall suggesting that high water use and deep rooting alfalfa make it an unsustainable crop due to the long-term decline in soil water storage and productivity. Our objectives in this Study were to evaluate the soil water balance of Loess Plateau soils during vegetative restoration and to evaluate practices that prevent soil desiccation and promote ecosystem restoration and sustainability. Field observations of soil moisture recovery and soil erosion were carried out for five years after alfalfa was replaced with different crops and with bare soil. Soil water content changes in cropland, rangeland, and bare soil were tracked over several years, using a water balance approach. Results indicate that growing forages significantly reduced runoff and sediment transport. A forage-food-crop rotation is a better choice than other cropping systems for achieving sustainable productivity and preventing soil erosion and desiccation. However, economic considerations have prevented its widespread adoption by local farmers. Alternatively, this study recommends consideration of grassland crops or forest ecosystems to provide a sustainable water balance in the Loess Plateau of China. (C) 2009 Elsevier B.V. All rights reserved.

Evaluation of two semi-selective media to detect Curtobacterium flaccumfaciens pv. flaccumfaciens in bean seeds

Evaluation of two semi-selective media to detect Curtobacterium flaccumfaciens pv. flaccumfaciens in bean seeds This study aimed to compare the effectiveness of the semi-selective MSCFF and modified CNS culture media in detecting Curtobacterium flaccumfaciens pv. flaccumfaciens (Cff) in bean seeds, using the streak and spread plate techniques. Four 500 g subsamples, obtained from two samples of bean seeds, were immersed in 600 mL of sterile distilled water for 18 h at 5 degrees C. Suspensions were picked and transferred to plates with both culture media. Plates were then incubated at 28 degrees C, and bacterial growth on both media was evaluated 72 and 144 hours later, compared to the growth of a Cff reference strain. Both media revealed the presence of Cff colonies. Typical colonies were isolated for PCR analyses and pathogenicity tests on tobacco leaves. A characteristic Cff growth on MSCFF medium was observed for the seed samples, for the two plate techniques used, in both evaluations. On the modified CNS culture medium, the bacterial growth was only detected in seed samples after 144 hours of incubation, regardless of the plate technique used. The results showed Cff grew faster on the MSCFF semi-selective culture medium. Bacterial isolates tested were identified as Cff by both PCR analyses and a positive tobacco hypersensitivity reaction.

Tree-ring formation, radial increment periodicity, and phenology of tree species from a seasonal semi-deciduous forest in southeast Brazil

Many tropical tree species produce growth rings in response to seasonal environmental factors that influence the activity of the vascular cambium. We applied the following methods to analyze the annual nature of treering formation of 24 tree species from a seasonal semi-deciduous forest of southeast Brazil: describing wood anatomy and phenology, counting tree rings after cambium markings, and using permanent dendrometer bands. After 7 years of systematic observations and measurements, we found the following: the trees lost their leaves during the dry season and grew new leaves at the end of the same season; trunk increment dynamics corresponded to seasonal changes in precipitation, with higher increment (active period) during the rainy season (October-April) and lower increment (dormant period) during the dry season (May-September); the number of tree rings formed after injuries to the cambium coincided with the number of years since the extraction of the wood samples. As a result of these observations, it was concluded that most study trees formed one growth ring per year. This suggests that tree species from the seasonal semi-deciduous forests of Brazil have an annual cycle of wood formation. Therefore, these trees have potential for use in future studies of tree age and radial growth rates, as well as to infer ecological and regional climatic conditions. These future studies can provide important information for the management and conservation of these endangered forests.

Evaluation of the role of environmental factors in the human gastrointestinal tract on the behaviour of probiotic cultures of Lactobacillus casei Shirota and Lactobacillus casei LC01 by the use of a semi-dynamic in vitro model

This study evaluated the influence of gastrointestinal environmental factors (pH, digestive enzymes, food components, medicaments) on the survival of Lactobacillus casei Shirota and Lactobacillus casei LC01, using a semi-dynamic in vitro model that simulates the transit of microorganisms through the human GIT. The strains were first exposed to different simulated gastric juices for different periods of time (0, 30, 60 and 120 min), and then to simulated intestinal fluids for zero, 120, 180 and 240 min, in a step-wise format. The number of viable cells was determined after each step. The influence of food residues (skim milk) in the fluids and resistance to medicaments commonly used for varied therapeutic purposes (analgesics, antiarrhythmics, antibiotics, antihistaminics, proton pump inhibitors, etc.) were also evaluated. Results indicated that survival of both cultures was pH and time dependent, and digestive enzymes had little influence. Milk components presented a protective effect, and medicaments, especially anti-inflammatory drugs, influenced markedly the viability of the probiotic cultures, indicating that the beneficial effects of the two probiotic cultures to health are dependent of environmental factors encountered in the human gastrointestinal tract.

Molecular Modeling Suggests Cruzain Specificity for Peptide Primaquine Prodrugs

Chagas` disease, infection caused by the protozoan Trypanosoma cruzi, is an important, social and medical ailment in the Latin America. This disease is endemic in 21 countries, mostly Latin America countries, with more than 300,000 new cases every year and about 16-18 million infected people. Current therapy is not effective in the chronic phase of the disease. Thus, new and better drugs are urgently needed. In this sense, the in vitro activity of primaquine (PQ) was reported. Based on this, peptide prodrugs of primaquine containing dipeptides - lysine-arginine (LysArg), phenylalanine-alanine (PheAla) and phenylalanine-arginine (PheArg) -- as carriers, were designed to be selectively cleaved by cruzain, a specific cysteine protease of T. cruzi. The prodrugs have shown to be active against tripomastigote forms according to this order: LysArg-PQ> PheAla-PQ> PheArg-PQ. The molecular mechanism of action considered a probable nucleophilic attack of the catalytic residue of cruzain (Cys25) on the respective prodrug amide carbonyl carbon, releasing PQ. In order to test this hypothesis, molecular modeling studies were performed, physicochemical parameters and stereoelectronic features calculated by using the AM1 semi-empirical method suggest that the amide carbonyl carbon is favorable for cleavage, where the LysArg showed the most electronic reactive and sterically disposable, leading to the prodrug release and action. In addition, the docking study indicates the occurrence of specific interactions between prodrugs and the pockets S1 and S2 of cruzain through the dipeptides carriers, being the distance between cruzain Cys25 and the amide carbonyl group related to the biological activity of the prodrugs.

The semi-synthetic kaurane ent-16 alpha-methoxykauran-19-oic acid induces vascular relaxation and hypotension in rats

The present work investigates the mechanisms involved in the vasorelaxant effect of ent-16 alpha-methoxykauran-19-oic acid (KA-OCH(3)), a semi-synthetic derivative obtained from the kaurane-type diterpene ent-kaur-16-en-19-oic acid (kaurenoic acid). Vascular reactivity experiments were performed in aortic rings isolated from male Wistar rats using standard muscle bath procedures. The cytosolic calcium concentration ([Ca(2+)]c) was measured by confocal microscopy using the fluorescent probe Fluo-3 AM. Blood pressure measurements were performed in conscious rats. KA-OCH(3) (10,50 and 100 mu mol/l) inhibited phenylephrine-induced contraction in either endothelium-intact or endothelium-denuded rat aortic rings. KA-OCH(3) also reduced CaCl(2)-induced contraction in a Ca(2+)-free solution containing KCl (30 mmol/l) or phenylephrine (0.1 mu mol/l). KA-OCH(3) (0.1-300 mu mol/l) concentration-dependently relaxed endothelium-intact and endothelium-denuded aortas pre-contracted with either phenylephrine or KCl, to a greater extent than kaurenoic acid. Moreover, a Ca(2+) mobilisation study showed that KA-OCH(3) (100 mu mol/l) inhibited the increase in Ca(2+) concentration in smooth muscle and endothelial cells induced by phenylephrine or KCl. Pre-incubation of intact or denuded aortic rings with N(G)-nitro-L-arginine methyl ester (L-NAME, 100 mu mol/l), 7-nitroindazole (100 mu mol/l), wortmannin (0.5 mu mol/l) and 1H-[1,2,4]Oxadiazolo[4,3-a]quinoxalin-1-one (ODQ 1 mu mol/l) produced a rightward displacement of the KA-OCH(3) concentration-response curve. Intravenous administration of KA-OCH(3) (1-10 mg/kg) reduced mean arterial blood pressure in normotensive rats. Collectively, our results show that KA-OCH(3) induces vascular relaxation and hypotension. The mechanisms underlying the cardiovascular actions of KA-OCH(3) involve blockade of Ca(2+) influx and activation of the NO-cGMP pathway. (C) 2011 Elsevier B.V. All rights reserved.

Evaluation of flow regimes in a semi-cylindrical spouted bed through statistical, mutual information, spectral and Hurst`s analysis

Hydrodynamic studies were conducted in a semi-cylindrical spouted bed column of diameter 150 mm, height 1000 mm, conical base included angle of 60 degrees and inlet orifice diameter 25 mm. Pressure transducers at several axial positions were used to obtain pressure fluctuation time series with 1.2 and 2.4 mm glass beads at U/U-ms from 0.3 to 1.6, and static bed depths from 150 to 600 mm. The conditions covered several flow regimes (fixed bed, incipient spouting, stable spouting, pulsating spouting, slugging, bubble spouting and fluidization). Images of the system dynamics were also acquired through the transparent walls with a digital camera. The data were analyzed via statistical, mutual information theory, spectral and Hurst`s Rescaled Range methods to assess the potential of these methods to characterize the spouting quality. The results indicate that these methods have potential for monitoring spouted bed operation.

Information Society, Teaching, and Learning: Education Reforms in Brazil

This article examines the subject matter of learning within the context of information society, through an inquiry concerning both the reforms in education adopted in Brazil in the last thirty years and their results. It provides a revision on the explanations of school failure based on assumptions of learning problems due to cognitive and linguistic deficits. From the guidelines related with written school forms as well as the constant cultural oppression accomplished inside the school, the article claims the necessity of changing the psychological and pedagogic views that, under the label of democratic practices, determine school institutions and its daily life, by means of instrumental relations with knowledge that disregard the reading practices which are congenial to popular culture.