Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Seasonal and diurnal changes in photosynthetic limitation of young sweet orange trees

This study tests the hypothesis that potted sweet orange plants show a significant variation in photosynthesis over seasonal and diurnal cycles. even in well-hydrated conditions. This hypothesis was tested by measuring diurnal variations in leaf gas exchange, chlorophyll fluorescence, leaf water potential, and the responses of CO(2) assimilation to increasing air CO(2) concentrations in 1-year-old `Valencia` sweet orange scions grafted onto `Cleopatra` mandarin rootstocks during the winter and summer seasons in a subtropical climate. In addition, diurnal leaf gas exchange was evaluated under controlled conditions, with constant environmental conditions during both winter and summer. In relation to our hypothesis, a greater rate of photosynthesis is found during the summer compared to the winter. Reduced photosynthesis during winter was induced by cool night conditions, as the diurnal fluctuation of environmental conditions was not limiting. Low air and soil temperatures caused decreases in the stomatal conductance and in the rates of the biochemical reactions underlying photosynthesis (ribulose-1,5-bisphosphate (RuBP) carboxylation and RuBP regeneration) during the winter compared to the values obtained for those markers in the Summer. Citrus photosynthesis during the summer was riot impaired by biochemical or photochemical reactions. as CO(2) assimilation was only limited by stomatal conductance due to high leaf-to-air vapor pressure difference (VPD) during the afternoon. During the winter, the reduction in photosynthesis during the afternoon Was Caused by decreases in RuBP regeneration and stomatal conductance, which are both precipitated by low night temperature. (c) 2009 Elsevier B.V. All rights reserved.

Evaluation on the effectiveness of actions for controlling infestation by rodents in Campo Limpo region, Sao Paulo Municipality, Brazil

Rodents are responsible for the transmission of more than 60 diseases both to human beings and to domestic animals. The increase in rodent infestation in a given area brings several health problems to the nearby population. Thus, when infestation increases, it is time to take intervention measures. Although many countries have implemented programs aimed at controlling rodent infestation, literature on studies evaluating the effectiveness of intervention measures in urban areas is scarce. Aimed at contributing to the understanding of rodents` population dynamics in urban areas, the objective of this study was to evaluate the effectiveness of the control methods proposed by ""Programa de Vigilancia e Controle de Roedores do Municipio de Sao Paulo`` (Program for Rodents Surveillance and Control in Sao Paulo Municipality), conducted on Jardim Comercial District. As a first step, a survey to assess infestation rates was conducted in 1529 dwellings located in the area studied. After that, a chemical control upon rodents was accomplished in every dwelling infested. One week and six months after completion of control measures, a new evaluation on infestation rates was carried out, in order to verify the effectiveness of the procedures taken and to estimate the re-infestation capacity. Initial infestation rate was 40.0%, and the final infestation rate, 14.4%. Therefore, the effectiveness of the control methods utilized was 63.8%. It can thus be concluded that the control methods applied were quite effective.

Limitation of double folding potentials to simulate the polarization in reactions involving halo nuclei

In this work, we investigate the limitation of the use of strength coefficients on double folding potentials to study the presence of the threshold anomaly in the elastic scattering of halo nuclei at near barrier energies. For this purpose, elastic angular distributions and reaction cross sections for the He-6 on Bi-209 are studied. (c) 2008 Elsevier B.V. All rights reserved.

Insufficient uracil supply in fully aerobic chemostat cultures of Saccharomyces cerevisiae leads to respiro-fermentative metabolism and double nutrient-limitation

A combination of chemostat cultivation and a defined medium was used to demonstrate that uracil limitation leads to a drastic alteration in the physiology of auxotrophic cells of Saccharomyces cerevisiae. Under this condition, the carbon source is dissimilated mainly to ethanol and acetate, even in fully aerobic cultures grown at 0.1 h(-1), which is far below the critical dilution rate. Differently from nitrogen-, sulphur-, or phosphate-limited cultures, uracil limitation leads to residual sugar (either glucose or sucrose) concentrations below 2 mM, which characterizes a situation of double-limitation: by the carbon source and by uracil. Furthermore, the specific rates of CO(2) production and O(2) consumption are increased when compared to the corresponding prototrophic strain. We conclude that when auxotrophic strains are to be used for quantitative physiological studies, special attention must be paid to the cultivation conditions, mainly regarding medium formulation, in order to avoid limitation of growth by the auxotrophic nutrient.

Chemopreventive effects of beta-ionone and geraniol during rat hepatocarcinogenesis promotion: distinct actions on cell proliferation, apoptosis, HMGCoA reductase, and RhoA

Chemopreventive activities of the dietary isoprenoids beta-ionone (beta I) and geraniol (GOH) were evaluated during the promotion phase of hepatocarcinogenesis. Over 5 consecutive weeks, rats received daily 16 mg/100 g body weight (b.w.) of beta I (beta I group), 25 mg/100 g b.w. of GOH (GOH group), or only corn oil (CO group, controls). Compared to the CO group, the following was observed: only the beta I group showed a decrease in the mean number of visible hepatocyte nodules (P<.05); beta I and GOH groups had reduced mean number of persistent preneoplastic lesions (pPNLs) (P<.05), but no differences regarding number of remodeling PNL (rPNLs) were observed; only the beta I group exhibited smaller rPNL size and percentage of liver sections occupied by pPNLs (P<.05), whereas the GOH group displayed a smaller percentage of liver sections occupied by rPNLs (P<.05); a trend was observed in the beta I group, which showed reduced cell proliferation of pPNLs (P<.10), and the GOH group had increased apoptosis in pPNLs and rPNLs (P<.05); only the beta I group displayed reduced total plasma cholesterol concentrations (P<.05) and increased hepatic 3-hydroxy-3-methylglutaryl coenzyme A (HMGCoA) reductase mRNA levels (P<.05): only the GOH group had lower hepatic membrane RhoA protein levels (P<.05); both the beta I- and GOH-treated groups had higher hepatic concentrations of beta I and GOH, respectively (P<.05). Given these data, beta I and GOH show promising chemopreventive effects during promotion of hepatocarcinogenesis by acting through distinct mechanism of actions: beta I may inhibit cell proliferation and modulate HMGCoA reductase, and GOH can induce apoptosis and inhibit RhoA activation. (C) 2011 Elsevier Inc. All rights reserved.

Condutas terapêuticas de atenção às famílias da população infantojuvenil atendida nos centros de atenção psicossocial infantojuvenis (CAPSI) do estado de São Paulo

Os Centros de Atenção Psicossociais Infantojuvenis (CAPSi) são elementos estratégicos da atenção pública em saúde mental ofertado para população infantojuvenil com sofrimento psíquico intenso e persistente. São articulados numa rede de atenção que extrapola o campo da saúde e interage com os recursos do território de determinada comunidade para promover inclusão social de crianças e adolescentes e conta para tanto também com a co-responsabilização das famílias, escolas e outros setores sociais. No rol de suas condutas terapêuticas há espaço reservado para o atendimento de familiares quando essa medida for necessária para aquela dirigida à clientela em foco. OBJETIVO: identificar condutas terapêuticas oferecidas às famílias de crianças e adolescentes atendidos nos CAPSi. MÉTODO: estudo transversal em crianças e adolescentes provenientes dos prontuários ativos, selecionados aleatoriamente, de 19 CAPSi do Estado de São Paulo no período de setembro de 2008 a fevereiro de 2009. A análisedescritiva foi apresentada por meio de tabelas de número e porcentagem. RESULTADOS: a mãe se revelou a principal cuidadora dessa população fora dos serviços. Contudo, há de se destacar a importante ausência de registros de atendimento ou propostas realizadas às famílias. CONSIDERAÇÕES FINAIS: a principal conduta indicada para as famílias são os atendimentos grupais, as famílias têm sido pouco privilegiadas nas condutas terapêuticas dentro dos projetos terapêuticos da população atendida. As falhas de registro nos prontuários pesquisados podem ser uma limitação do estudo. As ações são preponderantemente institucionais e as ofertas extramuros são raríssimas

Treatment of Obese Adolescents: The Influence of Periodization Models and ACE Genotype

The aims of the present study were to compare the effects of two periodization models on metabolic syndrome risk factors in obese adolescents and verify whether the angiotensin-converting enzyme (ACE) genotype is important in establishing these effects. A total of 32 postpuberty obese adolescents were submitted to aerobic training (AT) and resistance training (RT) for 14 weeks. The subjects were divided into linear periodization (LP, n = 16) or daily undulating periodization (DUP, n = 16). Body composition, visceral and subcutaneous fat, glycemia, insulinemia, homeostasis model assessment of insulin resistance (HOMA-IR), lipid profiles, blood pressure, maximal oxygen consumption (VO(2max)), resting metabolic rate (RMR), muscular endurance were analyzed at baseline and after intervention. Both groups demonstrated a significant reduction in body mass, BMI, body fat, visceral and subcutaneous fat, total and low-density lipoprotein cholesterol, blood pressure and an increase in fat-free mass, VO(2max), and muscular endurance. However, only DUP promoted a reduction in insulin concentrations and HOMA-IR. It is important to emphasize that there was no statics difference between LP and DUP groups; however, it appears that there may be bigger changes in the DUP than LP group in some of the metabolic syndrome risk factors in obese adolescents with regard to the effect size (ES). Both periodization models presented a large effect on muscular endurance. Despite the limitation of sample size, our results suggested that the ACE genotype may influence the functional and metabolic characteristics of obese adolescents and may be considered in the future strategies for massive obesity control.

A review of time-motion analysis and combat development in mixed martial arts matches at regional level tournaments

Mixed martial arts (MMA) have become a fast-growing worldwide expansion of martial arts competition, requiring high level of skill, physical conditioning, and strategy, and involving a synthesis of combat while standing or on the ground. This study quantified the effort-pause ratio (EP), and classified effort segments of stand-up or groundwork development to identify the number of actions performed per round in MMA matches. 52 MMA athletes participated in the study (M age = 24 yr., SD = 5; average experience in MMA = 5 yr., SD = 3). A one-way analysis of variance with repeated measurements was conducted to compare the type of action across the rounds. A chi-squared test was applied across the percentages to compare proportions of different events. Only one significant difference (p < .05) was observed among rounds: time in groundwork of low intensity was longer in the second compared to the third round. When the interval between rounds was not considered, the EP ratio (between high-intensity effort to low-intensity effort plus pauses) WE S 1:2 to 1:4. This ratio is between ratios typical for judo, wrestling, karate, and taekwondo and reflects the combination of ground and standup techniques. Most of the matches ended in the third round, involving high-intensity actions, predominantly executed during groundwork combat.

Effects of recovery type after a judo match on blood lactate and performance in specific and non-specific judo tasks

The objective of the present study was to verify if active recovery (AR) applied after a judo match resulted in a better performance when compared to passive recovery (PR) in three tasks varying in specificity to the judo and in measurement of work performed: four upper-body Wingate tests (WT); special judo fitness test (SJFT); another match. For this purpose, three studies were conducted. Sixteen highly trained judo athletes took part in study 1, 9 in study 2, and 12 in study 3. During AR judokas ran (15 min) at the velocity corresponding to 70% of 4 mmol l(-1) blood lactate intensity (similar to 50% (V) over dotO(2) peak), while during PR they stayed seated at the competition area. The results indicated that the minimal recovery time reported in judo competitions (15 min) is long enough for sufficient recovery of WT performance and in a specific high-intensity test (SJFT). However, the odds ratio of winning a match increased ten times when a judoka performed AR and his opponent performed PR, but the cause of this phenomenon cannot be explained by changes in number of actions performed or by changes in match`s time structure.

A survey on the sanitary condition of commercial foods of plant origin sold in Brazil

The objective of the study was to evaluate the hygienic conditions and practices of commercial foods of plant origin in establishments and street marketed by street vendors in cities in the State of Rio de Janeiro, Brazil. Forty different sales points were evaluated (establishments that prepared and sold fruit juices and street vendors that commercialized fresh coconut water, sugarcane juice and orange juice) using a questionnaire with 12 items, divided into three blocks (salesmen/handlers, operations, installations). The results indicated that the activities related to the commerce of fruit beverages in the cities of Sao Goncalo and Rio de Janeiro required the elaboration of a set of actions by the Sanitary Vigilance Agency in order to improve the hygienic and sanitary level and minimize health risk to consumers. Important requirements in the legislation relevant to this type of food are still not followed; adequate packaging and storage of the raw material, obtaining the raw material from registered suppliers, hygiene of the handlers and adequate management of wastes produced during the activities in question are amongst the main items deserving attention. (C) 2009 Elsevier Ltd. All rights reserved.

Tityus serrulatus venom and toxins Ts1, Ts2 and Ts6 induce macrophage activation and production of immune mediators

Scorpion envenomation induces a systemic immune response, and neurotoxins of venom act on specific ion channels, modulating neurotransmitter release or activity. However, little is known about the immunomodulatory effects of crude venom from scorpion Tityus serrulatus (TsV) or its toxins (Ts1, Ts2 and Ts6) in combination with lipopolysaccharide (LPS). To investigate the immunomodulatory effects of TsV and its toxins (Ts1, Ts2 and Ts6), J774.1 cells were stimulated with different concentrations (25, 50 and 100 mu g/mL) of venom or toxins pre-stimulated or not with LPS (0.5 mu g/mL). Macrophage cytotoxicity was assessed, and nitric oxide (NO) and cytokine production were analyzed utilizing the culture supernatants. TsV and its toxins did not produce cytotoxic effects. Depending on the concentrations used, TsV, Ts1 and Ts6 stimulated the production of NO, interleukin (IL)-6 and tumor necrosis factor (TNF)-alpha in J774.1 cells, which were enhanced under LPS co-stimulation. However, LPS + Ts2 inhibited NO, IL-6 and TNF-alpha production, and Ts2 alone stimulated the production of IL-10, suggesting an anti-inflammatory activity for this toxin. Our findings are important for the basic understanding of the mechanisms involved in macrophage activation following envenomation: additionally, these findings may contribute to the discovery of new therapeutic compounds to treat immune-mediated diseases. (C) 2011 Elsevier Ltd. All rights reserved.

Usefulness of liver biopsy in chronic hepatitis C

Major requirements for performance of liver biopsy (LB) are the benefits for the patient and the impossibility of having the same information by less invasive procedures. In the last two decades physicians have faced the difficult task of convincing a patient positive for hepatitis C, with minimal clinical or laboratory alterations to be submitted to LB in order to evaluate the status of the disease for therapeutic management. The characteristics of the needle used for percutaneous LB interferes with the accuracy of diagnosis. In chronic hepatitis C (CHC), validity is achieved with liver fragments about 25mm in length containing more than 10 portal tracts. Morbidity due to LB is mainly related to bleeding but death is very rare. Severe complications are also uncommon, increasing with number of passes and decreasing with experience of operator and ultrasound guidance. Although CHC is a diffuse disease, the various areas of the liver may not be equally affected and sampling errors are possible. Another potential limitation of LB is the discordance between pathologists in its interpretation. To replace LB, many panels of surrogate markers have been described, aiming to identify extent of fibrosis and inflammation. All of them have used LB as their ""gold standard"". Liver biopsy continues to be the most reliable method to evaluate the possibility of therapy for CHC. Universal treatment of all patients with diagnosis of CHC would be ideal. But, there are mainly three drawbacks. Overall efficacy is as low as 50%, side effects are common and may be severe and treatment is prolonged and expensive. The acceptability of the biopsy by the patient is highly dependent on the physician`s conviction of its usefulness.

Effect of paricalcitol and calcitriol on aortic wall remodeling in uninephrectomized ApoE knockout mice

Becker LE, Koleganova N, Piecha G, Noronha IL, Zeier M, Geldyyev A, Kokeny G, Ritz E, Gross ML. Effect of paricalcitol and calcitriol on aortic wall remodeling in uninephrectomized ApoE knockout mice. Am J Physiol Renal Physiol 300: F772-F782, 2011. First published December 15, 2010; doi:10.1152/ajprenal.00042.2010.-Despitean only minor reduction in the glomerular filtration rate, uninephrectomy (UNX) markedly accelerates the rate of growth of atherosclerotic plaques in ApoE-/- mice. It has been suggested that vitamin D receptor (VDR) activation exerts an antiproliferative effect on vascular smooth muscle cells, but the side effects may limit its use. To assess a potentially different spectrum of actions, we compared the effects of paricalcitol and calcitriol on remodeling and calcification of the aortic wall in sham-operated and UNX ApoE-/- mice on a diet with normal cholesterol content. Sham-operated and UNX mice were randomly allotted to treatment with solvent, calcitriol (0.03 mu g/kg) or paricalcitol (0.1 mu g/kg) 5 times/wk intraperitoneally for 10 wk. Semithin (0.6 mu m) sections of the aorta were analyzed by 1) morphometry, 2) immunohistochemistry, and 3) Western blotting of key proteins involved in vascular calcification and growth. Compared with sham-operated animals (5.6 +/- 0.24), the wall-to-lumen ratio (x100) of the aorta was significantly higher in solvent-and calcitriol-treated UNX animals (6.64 +/- 0.27 and 7.17 +/- 0.81, respectively, P < 0.05), but not in paricalcitol-treated UNX (6.1 5 +/- 0.32). Similar differences were seen with respect to maximal plaque height. Expression of transforming growth factor (TGF)-beta 1 in aortic intima/plaque was also significantly higher in UNX solvent and UNX calcitriol compared with sham-operated and UNX paricalcitol animals. Treatment with both paricalcitol and calcitriol caused significant elevation of VDR expression in the aorta. While at the dose employed paricalcitol significantly reduced TGF-beta expression in plaques, calcitriol in contrast caused significant vascular calcification and elevated expression of related proteins (BMP2, RANKL, and Runx2).

Abnormal expression of telomerase/apoptosis limits type II alveolar epithelial cell replication in the early remodeling of usual interstitial pneumonia/idiopathic pulmonary fibrosis

Idiopathic pulmonary fibrosis is a distinctive, usually fatal, type of chronic fibrosing interstitial pneumonia of unknown cause that increases in prevalence with advanced age, characterized by failure of alveolar re-epithelization and progressive scar formation. Recently, limitation of the replicative capacity of tissues determined by telomerase/apoptosis balance has been implicated in pathogenesis of age-related diseases. In this study, we validated the importance of the expression of type 2 alveolar epithelial cells telomerase protein and studied the relationships between telomerase and apoptosis in early remodeling of usual interstitial pneumonia. We determined type 2 alveolar epithelial cells density, telomerase expression, and apoptosis in surgical lung biopsies from 24 patients with usual interstitial pneumonia, and in normal lung tissues from 18 subjects. We used immunohistochemistry, deoxynucleotidyl transferase method of end labeling, electron microscopy, and histomorphometry to evaluate the amount of type 2 alveolar epithelial cells staining for surfactant-A, telomerase, and in situ detection of apoptotic cells. Unaffected areas of usual interstitial pneumonia and normal lung tissue had similar densities of type 2 alveolar epithelial cells, but a significant minor subpopulation of type 2 alveolar epithelial cells was telomerase positive and a large population was telomerase negative. A significant inverse association was found between low type 2, alveolar. epithelial cell telomerase expression and high apoptosis in unaffected areas of usual interstitial pneumonia. Although type 2 alveolar epithelial cell telomerase expression was higher than apoptosis in NLT group, no significant association was found between them. Electron microscopy confirmed epithelial apoptosis, alveolar collapse, and initial fibroplasia. We conclude that abnormal type 2 alveolar epithelial cells telomerase/apoptosis balance may reduce alveolar epithelial regenerative capacity, thus contributing to the early remodeling response in usual interstitial pneumonia. (C) 2010 Elsevier Inc. All rights reserved.