Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

History of hypertension and eplerenone in patients with acute myocardial infarction complicated by heart failure

In the Eplerenone Post-Acute Myocardial Infarction Heart Failure Efficacy and Survival Study ( n = 6632), eplerenone- associated reduction in all- cause mortality was significantly greater in those with a history of hypertension ( Hx- HTN). There were 4007 patients with Hx- HTN ( eplerenone: n = 1983) and 2625 patients without Hx- HTN ( eplerenone: n = 1336). Propensity scores for eplerenone use, separately calculated for patients with and without Hx- HTN, were used to assemble matched cohorts of 1838 and 1176 pairs of patients. In patients with Hx- HTN, all- cause mortality occurred in 18% of patients treated with placebo ( rate, 1430/ 10 000 person- years) and 14% of patients treated with eplerenone ( rate, 1058/ 10 000 person- years) during 2350 and 2457 years of follow- up, respectively ( hazard ratio [ HR]: 0.71; 95% CI: 0.59 to 0.85; P < 0.0001). Composite end point of cardiovascular hospitalization or cardiovascular mortality occurred in 33% of placebo-treated patients ( 3029/ 10 000 person- years) and 28% of eplerenone- treated patients (2438/10 000 person- years) with Hx- HTN ( HR: 0.82; 95% CI: 0.72 to 0.94; P = 0.003). In patients without Hx- HTN, eplerenone reduced heart failure hospitalization ( HR: 73; 95% CI: 0.55 to 0.97; P = 0.028) but had no effect on mortality ( HR: 0.91; 95% CI: 0.72 to 1.15; P = 0.435) or on the composite end point ( HR: 0.91; 95% CI: 0.76 to 1.10; P = 0.331). Eplerenone should, therefore, be prescribed to all of the post - acute myocardial infarction patients with reduced left ventricular ejection fraction and heart failure regardless of Hx- HTN.

PDIA3, HSPA5 and viementin, proteins identified by 2-DE in the valvular tissue, are the target antigens of peripheral and heart infiltrating T cells from chronic rheumatic heart disease patients

Rheumatic fever (RF) is a post-infectious autoimmune disease due to sequel of group A streptococcus (GAS) pharyngitis. Rheumatic heart disease (RHD), the major manifestation of RF, is characterized by inflammation of heart valves and myocardium. Molecular mimicry between GAS antigens and host proteins has been shown at B and T cell level. However the identification of the autoantigens recognized by B and T cells within the inflammatory microenvironment of heart tissue in patients with RHD is still incompletely elucidated. In the present study, we used two-dimensional gel electrophoresis (2-DE) and mass spectrometry to identify valvular tissue proteins target of T cells from chronic RHD patients. We could identify three proteins recognized by heart infiltrating and peripheral T cells as protein disulfide isomerase ER-60 precursor (PDIA3), 78 kD glucose-regulated protein precursor (HSPA5) and vimentin, with coverage of 45%, 43 and 34%, respectively. These proteins were recognized in a proliferation assay by peripheral and heart infiltrating T cells from RHD patients suggesting that they may be involved in the autoimmune reactions that leads to valve damage. We also observed that several other proteins isolated by 2-DE but not identified by mass spectrometry were also recognized by T cells. The identified cardiac proteins are likely relevant antigens involved in T cell-mediated autoimmune responses in RF/RHD that may contribute to the development of RHD

Evaluation of left ventricular diastolic echocardiographic parameters in healthy dogs by pulsed-wave Doppler

Left ventricular diastolic dysfunction plays an important role on heart failure progression. In order to obtain additional reference values of left ventricular diastolic parameters and investigate influence of common variables, peak E wave (peak E), peak A wave (peak A), E/A ratio (E/A), E wave deceleration time (EDT) and isovolumic relaxation time (IRVT) were studied in 40 clinically healthy dogs, by pulsed wave Doppler. The following values were obtained: peak E = 0.747 ± 0.117 m/s, peak A = 0.487 ± 0.062 m/s, E/A = 1.533 ± 0.198, EDT = 88.7 ± 9.2 ms and IRVT = 0.080 ± 0.009 s. Some parameters were influenced by heart rate (peak E, peak A and IRVT), by age (peak A and E/A) and by body weight (TRIV). Gender influence was absent. Values obtained can be used as reference for canine specimens but its interpretation should consider on the influence of related variables.

Influence of Parasympathetic Modulation in Doppler Mitral Inflow Velocity in Individuals without Heart Disease

Background: The relation between left ventricular filing velocities determined by Doppler echocardiography and autonomic nervous system function assessed by heart rate variability (HRV) is unclear. The aim of this study was to evaluate the influence of the autonomic nervous system assessed by the time and frequency domain indices of HRV in the Doppler indices of left ventricular diastolic filling velocities in patients without heart disease. Methods: We studied 451 healthy individuals (255 female [56.4%]) with normal blood pressure, electrocardiogram, chest x-ray, and treadmill electrocardiographic exercise stress test results, with a mean age of 43 +/- 12 (range 15-82) years, who underwent transthoracic Doppler echocardiography and 24-hour electrocardiographic ambulatory monitoring. We studied indices of HRV on time (standard deviation [SD] of all normal sinus RR intervals during 24 hours, SD of averaged normal sinus RR intervals for all 5-minute segments, mean of the SD of all normal sinus RR intervals for all 5-minute segments, root-mean-square of the successive normal sinus RR interval difference, and percentage of successive normal sinus RR intervals > 50 ms) and frequency (low frequency, high frequency, very low frequency, low frequency/high frequency ratio) domains relative to peak flow velocity during rapid passive filling phase (E), atrial contraction (A), E/A ratio, E-wave deceleration time, and isovolumic relaxation time. Statistical analysis was performed with Pearson correlation and logistic regression. Results: Peak flow velocity during rapid passive filling phase (E) and atrial contraction (A), E/A ratio, and deceleration time of early mitral inflow did not demonstrate a significant correlation with indices of HRV in time and frequency domain. We found that the E/A ratio was < 1 in 45 individuals (10%). Individuals with an E/A ratio < 1 had lower indices of HRV in frequency domain (except low frequency/high frequency) and lower indices of the mean of the SD of all normal sinus RR intervals for all 5-minute segments, root-mean-square of the successive normal sinus RR interval difference, and percentage of successive normal sinus RR intervals > 50 ms in time domain. Logistic regression demonstrated that an E/A ratio < 1 was associated with lower HF. Conclusion: Individuals with no evidence of heart disease and an E/A ratio < 1 demonstrated a significant decrease in indexes of HRV associated with parasympathetic modulation. (J Am Soc Echocardiogr 2010;23: 762-5.)

Cardiac response and anxiety levels in psychopathic murderers

OBJECTIVE: To compare the emotional response and level of anxiety of psychopathic murderers, non-psychopathic murderers, and nonpsychopathic non-criminals. METHOD: 110 male individuals aged over 18 years were divided into three groups: psychopathic murderers (n = 38); non-psychopathic murderers (n = 37) serving sentences for murder convictions in Maximum Security Prisons in the State of Sao Paulo; and non-criminal, non-psychopathic individuals (n = 35) according to the Psychopathy Checklist-Revised. The emotional response of subjects was assessed by heart rate variation and anxiety level (State-Trait Anxiety Inventory) after viewing standardized pictures depicting pleasant, unpleasant and neutral content from the International Affective Picture System. RESULTS: Psychopathic murderers presented lower anxiety levels and smaller heart rate variations when exposed to pleasant and unpleasant stimuli than nonpsychopathic murderers or non-psychopathic non-criminals. The results also demonstrated that the higher the score for factor 1 on the Psychopathy Checklist-Revised, the lower the heart rate variation and anxiety level. CONCLUSION: The results suggest that psychopathic murderers do not present variation in emotional response to different visual stimuli. Although the non-psychopathic murderers had committed the same type of crime as the psychopathic murderers, the former tended to respond with a higher level of anxiety and heart rate variation.

In vivo bioavailability of selenium in enriched Pleurotus ostreatus mushrooms

The in vivo bioavailability of Se was investigated in enriched Pleurotus ostreatus mushrooms. A bioavailability study was performed using 64 Wistar male rats separated in 8 groups and fed with different diets: without Se, with mushrooms without Se, with enriched mushrooms containing 0.15, 0.30 or 0.45 mg kg(-1) Se and a normal diet containing 0.15 mg kg(-1) of Se using sodium selenate. The experiment was performed in two periods: depletion (14 days) and repletion (21 days), according to the Association of Official Analytical Chemists. After five weeks, the rats were sacrificed under carbon dioxide, and blood was drawn by heart puncture. Blood plasma was separated by centrifugation. The total Se concentration in the plasma of rats fed with enriched mushrooms was higher than in rats fed with a normal diet containing sodium selenate. The plasma protein profiles were obtained using size exclusion chromatography (SEC) and UV detectors. Aliquots of effluents (0.5 mL per minute) were collected throughout in the end of the chomatographic column. However, Se was determined by graphite furnace atomic absorption spectrometry (GF AAS) only in the aliquots where proteins were detected by SEC-UV. The plasma protein pro. le of rats fed with different diets was similar. The highest Se concentration was observed in a peptide presenting 8 kDa. Furthermore, the higher Se concentration in this peptide was obtained for rats fed with a diet using enriched mushrooms (7 mu g L(-1) Se) compared to other diets (2-5 mu g L(-1) Se). These results showed that Se-enriched mushrooms can be considered as an alternative Se food source for humans, due to their high bioavailability.

Exercise training associated with estrogen therapy induced cardiovascular benefits after ovarian hormones deprivation

Menopause is recognized as a period of increased risk for coronary heart disease. Although the benefits of exercise training in lowering cardiovascular risk factors are well established, the risks and benefits of hormone therapy have been questioned. The purpose of the present study was to investigate the effects of estrogen therapy (HT) associated or not with exercise training (ET) in autonomic cardiovascular control in ovariectomized (OVX) rats. Female rats were divided into: control, OVX, OVX+HT, OVX+ET and OVX+HT+ET. HT was performed using a 0.25 mg 8-weeks sustained release pellet. Trained groups were submitted to an 8-week exercise training protocol on treadmill. Baroreflex sensitivity (BRS) was evaluated by heart rate responses to arterial pressure (AP) changes, and vagal and sympathetic tonus by pharmacological blockade. Ovariectomy induced an AP increase (123 +/- 2 mmHg vs. 108 +/- 2 mmHg), BRS impairment (similar to 69%), sympathetic activation (similar to 100%) and vagal tonus reduction (similar to 77%) compared to controls. HT or ET normalized the changes in parasympathetic tonus. However, only the association HT + ET was able to promote normalization of AP, BRS and sympathetic tonus, as compared to controls. These results indicate that ET induces cardiovascular and autonomic benefits in OVX rats under HT, suggesting a positive role of this association in the management of cardiovascular risk factor in postmenopausal women. (C) 2009 Elsevier Ireland Ltd. All rights reserved.

Effects of exercise training on autonomic dysfunction management in an experimental model of menopause and myocardial infarction

Objective: The aim of this study was to investigate the effects of exercise training on cardiovascular autonomic dysfunction in ovariectomized rats submitted to myocardial infarction. Methods: Female Wistar rats were divided into the following ovariectomized groups: sedentary ovariectomized (SO), trained ovariectomized (TO), sedentary ovariectomized infarcted (SOI), and trained ovariectomized infarcted (TOI). Trained groups were submitted to an exercise training protocol on a treadmill (8 wk). Arterial baroreflex sensitivity was evaluated by heart rate responses to arterial pressure changes, and cardiopulmonary baroreflex sensitivity was tested by bradycardic and hypotension responses to serotonin injection. Vagal and sympathetic effects were calculated by pharmacological blockade. Results: Arterial pressure was reduced in the TO in comparison with the SO group and increased in the TOI in relation to the SOI group. Exercise training improved the baroreflex sensitivity in both the TO and TOI groups. The TOI group displayed improvement in cardiopulmonary reflex sensitivity compared with the SOI group at the 16 mu g/kg serotonin dose. Exercise training enhanced the vagal effect in both the TO (45%) and TOI (46%) animals compared with the SO and SOI animals and reduced the sympathetic effect in the TOI (38%) in comparison with the SOI animals. Significant correlations were obtained between bradycardic baroreflex responses and vagal (r = -0.7, P < 0.005) and sympathetic (r = 0.7, P < 0.001) effects. Conclusions: These results indicate that exercise training in ovariectomized rats submitted to myocardial infarction improves resting hemodynamic status and reflex control of the circulation, which may be due to an increase in the vagal component. This suggests a homeostatic role for exercise training in reducing the autonomic impairment of myocardial infarction in postmenopausal women.

The Process of Simulation Authoring/Creation by Chemistry Teachers: A Service Learning Experience

Two case studies are presented to describe the process of public school teachers authoring and creating chemistry simulations. They are part of the Virtual Didactic Laboratory for Chemistry, a project developed by the School of the Future of the University of Sao Paulo. the documental analysis of the material produced by two groups of teachers reflects different selection process for both themes and problem-situations when creating simulations. The study demonstrates the potential for chemistry learning with an approach that takes students' everyday lives into account and is based on collaborative work among teachers and researches. Also, from the teachers' perspectives, the possibilities of interaction that a simulation offers for classroom activities are considered.

The case of thyroid hormones: how to learn physiology by solving a detective case

Lellis-Santos C, Giannocco G, Nunes MT. The case of thyroid hormones: how to learn physiology by solving a detective case. Adv Physiol Educ 35: 219-226, 2011; doi:10.1152/advan.00135.2010.Thyroid diseases are prevalent among endocrine disorders, and careful evaluation of patients' symptoms is a very important part in their diagnosis. Developing new pedagogical strategies, such as problem-based learning (PBL), is extremely important to stimulate and encourage medical and biomedical students to learn thyroid physiology and identify the signs and symptoms of thyroid dysfunction. The present study aimed to create a new pedagogical approach to build deep knowledge about hypo-/hyperthyroidism by proposing a hands-on activity based on a detective case, using alternative materials in place of laboratory animals. After receiving a description of a criminal story involving changes in thyroid hormone economy, students collected data from clues, such as body weight, mesenteric vascularization, visceral fat, heart and thyroid size, heart rate, and thyroid-stimulating hormone serum concentration to solve the case. Nevertheless, there was one missing clue for each panel of data. Four different materials were proposed to perform the same practical lesson. Animals, pictures, small stuffed toy rats, and illustrations were all effective to promote learning, and the detective case context was considered by students as inviting and stimulating. The activity can be easily performed independently of the institution's purchasing power. The practical lesson stimulated the scientific method of data collection and organization, discussion, and review of thyroid hormone actions to solve the case. Hence, this activity provides a new strategy and alternative materials to teach without animal euthanization.

Effects of maternal glycemia on fetal heart rate in pregnancies complicated by pregestational diabetes mellitus

Objective: To investigate the influence of maternal glycemia on fetal heart rate (FHR) parameters analyzed by computerized cardiotocography in fetuses of diabetic mothers in the third trimester. Study design: Thirty-nine pregnant women with pregestational diabetes mellitus were studied prospectively. The inclusion criteria were a diagnosis of pregestational diabetes, singleton pregnancy between 36 and 40 weeks, and absence of fetal abnormalities. Computerized cardiotocography (System 8002) was performed over a period of 60 min and capillary glycemia was measured immediately before and 30 and 60 min after the beginning of the exam. The evaluations were done 2 h after lunch. Results: Nineteen patients (48.7%) presented mean glycemia >= 120 mg/dL The mean basal FHR was 136.7 +/- 10.0 bpm in the group with glycemia <120 mg/dL and 144.8 +/- 9.4 bpm in the group with glycemia >= 120 mg/dL (p = 0.013, Student`s t test). There was a significant positive correlation (Pearson`s test, p = 0.0001, r = 0.57) between basal FHR and mean glycemia. A significant negative correlation was observed between short-term variation and mean glycemia (Pearson`s test, p = 0.003, r = -0.47). No significant differences were observed between the other indices evaluated by computerized cardiotocography and glycemia. Conclusions: Maternal hyperglycemia at the time of cardiotocography is associated with elevated FHR. It seems to be important to understand how FHR parameters are influenced by maternal glycemic status at the time of fetal assessment in pregnancies complicated by diabetes. (C) 2009 Published by Elsevier Ireland Ltd.

Long-Term Pulmonary Vascular Reactivity After Orthotopic Heart Transplantation by the Biatrial Versus the Bicaval Technique

Introduction. Advantages of the bicaval versus the biatrial technique have been reported, emphasizing atrial electrical stability and less tricuspid regurgitation. Objective. To analyze the impact of the surgical technique on long-term pulmonary pressures, contractility, and graft valvular behavior after heart transplantation. Methods. Among 400 orthotopic heart transplantation recipients from 1985 to 2010, we selected 30 consecutive patients who had survived beyond 3 years. The biatrial versus bicaval surgical technique groups included 15 patients each. Their preoperative clinical characteristics were similar. None of the patients displayed a pulmonary vascular resistance or pulmonary artery pressure over 6U Wood or 60 mm Hg, respectively. We evaluated invasive hemodynamic parameters during routine endomyocardial biopsies. Two-dimensional echocardiographic parameters were obtained from routine examinations. Results. There were no significant differences regarding right atrial pressure, systolic pulmonary artery pressure, pulmonary capillary wedge pressure, pulmonary vascular resistance, cardiac index, systolic blood pressure, left ventricular ejection fraction, and mitral regurgitation (P > .05). Tricuspid regurgitation increased significantly over the 3 years of observation only among the biatrial group (P = .0212). In both groups, the right atrial pressure, pulmonary wedge capillary pressure, transpulmonary gradient, and pulmonary vascular resistance decreased significantly (P < .05) from the pre- to the postoperative examination. In both groups cardiac index and systemic blood pressure increased significantly after transplantation (P < .05). Comparative analysis of the groups only showed significant differences regarding right atrial pressure and degree of tricuspid regurgitation; the bicaval group showing the best performance. Conclusions. Both surgical techniques ensure adequate left ventricular function in the long term; however, the bicaval technique provided better trends in hemodynamic performance, as well as a lower incidence and severity of tricuspid valve dysfunction.

Investigating 22q11.2 Deletion and Other Chromosomal Aberrations in Fetuses With Heart Defects Detected by Prenatal Echocardiography

Congenital heart disease (CHD) is the most common birth defect and the leading cause of mortality in the first year of life. In fetuses with a heart defect, chromosomal abnormalities are very frequent. Besides aneuploidy, 22q11.2 deletion is one of the most recognizable chromosomal abnormalities causing CHD. The frequency of this abnormality varies in nonselected populations. This study aimed to investigate the incidence of the 22q11.2 deletion and other chromosomal alterations in a Brazilian sample of fetuses with structural cardiac anomalies detected by fetal echocardiography. In a prospective study, 68 fetuses with a heart defect were evaluated. Prenatal detection of cardiac abnormalities led to identification of aneuploidy or structural chromosomal anomaly in 35.3% of these cases. None of the fetuses with apparently normal karyotypes had a 22q11.2 deletion. The heart defects most frequently associated with chromosomal abnormalities were atrioventricular septal defect (AVSD), ventricular septal defect (VSD), and tetralogy of Fallot. Autosomal trisomies 18 and 21 were the most common chromosomal abnormalities. The study results support the strong association of chromosome alterations and cardiac malformation, especially in AVSD and VSD, for which a chromosome investigation is indicated. In fetuses with an isolated conotruncal cardiopathy, fluorescence in situ hybridization (FISH) to investigate a 22q11.2 deletion is not indicated.

Evaluation of Adult Chronic Chagas` Heart Disease Diagnosis by Molecular and Serological Methods

Chagas` disease caused by Trypanosoma cruzi is endemic in Latin America. T. cruzi presents heterogeneous populations and comprises two main genetic lineages, named T. cruzi I and T. cruzi II. Diagnosis in the chronic phase is based on conventional serological tests, including indirect immunofluorescence (IIF) and enzyme-linked immunosorbent assay (ELISA), and diagnosis in the acute phase based on parasitological methods, including hemoculture. The objective of this study was to evaluate the diagnostic procedures of Chagas` disease in adult patients in the chronic phase by using a PCR assay and conventional serological tests, including TESA-blot as the gold standard. Samples were obtained from 240 clinical chronic chagasic patients. The sensitivities, compared to that of TESA-blot, were 70% for PCR using the kinetoplast region, 75% for PCR using the nuclear repetitive region, 99% for IIF, and 95% for ELISA. According to the serological tests results, we recommend that researchers assess the reliability and sensitivity of the commercial kit Chagatest ELISA recombinant, version 3.0 (Chagatest Rec v3.0; Wiener Lab, Rosario, Argentina), due to the lack of sensitivity. Based on our analysis, we concluded that PCR cannot be validated as a conventional diagnostic technique for Chagas` disease. These data have been corroborated by low levels of concordance with serology test results. It is recommended that PCR be used only for alternative diagnostic support. Using the nuclear repetitive region of T. cruzi, PCR could also be applicable for monitoring patients receiving etiologic treatment.