Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

INFLUENCE OF ALTITUDE, AGE AND DIAMETER ON YIELD AND ALPHA-BISABOLOL CONTENT OF CANDEIA TREES (Eremanthus erythropappus)

The heartwood of candeia tree is a source of essential oil rich in alpha-bisabolol, a substance widely used in the cosmetic and pharmaceutical industry. Bearing in mind the economic importance of alpha-bisabolol, this work aimed to evaluate the influence of tree age on the yield and content of alpha-bisabolol present in essential oil from candeia, considering two distinct reliefs and three diameter classes, in Aiuruoca region, south Minas Gerais state. The two distinct reliefs correspond respectively to one section of the stand growing at 1,000m of altitude (Area 1) and another section growing at 1,100m of altitude (Area 2). In each section, 15 trees were felled from among 3 different diameter classes. Discs were removed from the base of each tree to estimate their age by doing growth ring count. Soil samples were taken and Subjected to physical and chemical analysis. The logs were reduced into chips and random samples were taken for distillation to extract essential oil. The method used was steam distillation at a pressure of 2 kgf/cm(2)/2.5 h. The chemical analysis was performed in a gas chromatograph (GC) based on the alpha-bisabolol standard reference. The yield of essential oil from trees in Area I was higher than that from trees in Area 2, with the same pattern of influence for older trees. In Area 2, the alpha-bisabolol content was higher in younger trees. No differences were found between the relevant parameters in relation to diameter classes.

Early motor and electrophysiological changes in transgenic mouse model of amyotrophic lateral sclerosis and gender differences on clinical outcome

Amyotrophic lateral sclerosis (ALS) is a progressive degenerative disorder affecting motoneurons and the SOD1(G93A) transgenic mice are widely employed to study disease physiopathology and therapeutic strategies. Despite the cellular and biochemical evidences of an early motor system dysfunction, the conventional behavioral tests do not detect early motor impairments in SOD1 mouse model. We evaluated early changes in motor behavior of ALS mice by doing the analyses of tail elevation, footprint, automatic recording of motor activities by means of an infrared motion sensor activity system and electrophysiological measurements in male and female wild-type (WT) and SOD1(G93A) mice from postnatal day (P) 20 up to endpoint. The classical evaluations of mortality, weight loss, tremor, rotometer, hanging wire and inclined plane were also employed. There was a late onset (after P90) of the impairments of classical parameters and the outcome varied between genders of ALS mice, being tremor, cumulative survival, weight loss and neurological score about 10 days earlier in male than female ALS mice and also about 20 days earlier in ALS males regarding rotarod and hanging wire performances. While diminution of hindpaw base was 10 days earlier in ALS males (P110) compared to females, the steep length decreased 40 days earlier in ALS females (P60) than ALS males. The automatic analysis of motor impairments showed substantial late changes (after P90) of motility and locomotion in the ALS females, but not in the ALS males. It was surprising that the scores of tail elevation were already decreased in ALS males and females by P40, reaching the minimal values at the endpoint. The electrophysiological analyses showed early changes of measures in the ALS mouse sciatic nerve, i.e., decreased values of amplitude (P40) and nerve conduction velocity (P20), and also an increased latency (P20) reaching maximal level of impairments at the late disease phase. The early changes were not accompanied by reductions of neuronal protein markers of neurofilament 200 and ChAT in the ventral part of the lumbar spinal cord of P20 and P60 ALS mice by means of Western blot technique, despite remarkable decreases of those protein levels in P120 ALS mice. In conclusion, early changes of motor behavior and electrophysiological parameters in ALS mouse model must be taken into attention in the analyses of disease mechanisms and therapeutic effects. (C) 2011 Published by Elsevier B.V.

Alternative diagnostic diagrams and the `forgotten` population of weak line galaxies in the SDSS

A numerous population of weak line galaxies (WLGs) is often left out of statistical studies on emission-line galaxies (ELGs) due to the absence of an adequate classification scheme, since classical diagnostic diagrams, such as [O iii]/H beta versus [N ii]/H alpha (the BPT diagram), require the measurement of at least four emission lines. This paper aims to remedy this situation by transposing the usual divisory lines between star-forming (SF) galaxies and active galactic nuclei (AGN) hosts and between Seyferts and LINERs to diagrams that are more economical in terms of line quality requirements. By doing this, we rescue from the classification limbo a substantial number of sources and modify the global census of ELGs. More specifically, (1) we use the Sloan Digital Sky Survey Data Release 7 to constitute a suitable sample of 280 000 ELGs, one-third of which are WLGs. (2) Galaxies with strong emission lines are classified using the widely applied criteria of Kewley et al., Kauffmann et al. and Stasinska et al. to distinguish SF galaxies and AGN hosts and Kewley et al. to distinguish Seyferts from LINERs. (3) We transpose these classification schemes to alternative diagrams keeping [N ii]/H alpha as a horizontal axis, but replacing H beta by a stronger line (H alpha or [O ii]), or substituting the ionization-level sensitive [O iii]/H beta ratio with the equivalent width of H alpha (W(H alpha)). Optimized equations for the transposed divisory lines are provided. (4) We show that nothing significant is lost in the translation, but that the new diagrams allow one to classify up to 50 per cent more ELGs. (5) Introducing WLGs in the census of galaxies in the local Universe increases the proportion of metal-rich SF galaxies and especially LINERs. In the course of this analysis, we were led to make the following points. (i) The Kewley et al. BPT line for galaxy classification is generally ill-used. (ii) Replacing [O iii]/H beta by W(H alpha) in the classification introduces a change in the philosophy of the distinction between LINERs and Seyferts, but not in its results. Because the W(H alpha) versus [N ii]/H alpha diagram can be applied to the largest sample of ELGs without loss of discriminating power between Seyferts and LINERs, we recommend its use in further studies. (iii) The dichotomy between Seyferts and LINERs is washed out by WLGs in the BPT plane, but it subsists in other diagnostic diagrams. This suggests that the right wing in the BPT diagram is indeed populated by at least two classes, tentatively identified with bona fide AGN and `retired` galaxies that have stopped forming stars and are ionized by their old stellar populations.

The Process of Simulation Authoring/Creation by Chemistry Teachers: A Service Learning Experience

Two case studies are presented to describe the process of public school teachers authoring and creating chemistry simulations. They are part of the Virtual Didactic Laboratory for Chemistry, a project developed by the School of the Future of the University of Sao Paulo. the documental analysis of the material produced by two groups of teachers reflects different selection process for both themes and problem-situations when creating simulations. The study demonstrates the potential for chemistry learning with an approach that takes students' everyday lives into account and is based on collaborative work among teachers and researches. Also, from the teachers' perspectives, the possibilities of interaction that a simulation offers for classroom activities are considered.

Modulation of Mediotemporal and Ventrostriatal Function in Humans by Delta 9-Tetrahydrocannabinol A Neural Basis for the Effects of Cannabis sativa on Learning and Psychosis

Context: Cannabis sativa use can impair verbal learning, provoke acute psychosis, and increase the risk of schizophrenia. It is unclear where C sativa acts in the human brain to modulate verbal learning and to induce psychotic symptoms. Objectives: To investigate the effects of 2 main psychoactive constituents of C sativa, Delta 9-tetrahydrocannabinol (Delta 9-THC) and cannabidiol, on regional brain function during verbal paired associate learning. Design: Subjects were studied on 3 separate occasions using a block design functional magnetic resonance imaging paradigm while performing a verbal paired associate learning task. Each imaging session was preceded by the ingestion of Delta 9-THC (10 mg), cannabidiol (600 mg), or placebo in a double-blind, randomized, placebo-controlled, repeated-measures, within-subject design. Setting: University research center. Participants: Fifteen healthy, native English-speaking, right-handed men of white race/ethnicity who had used C sativa 15 times or less and had minimal exposure to other illicit drugs in their lifetime. Main Outcome Measures: Regional brain activation ( blood oxygen level-dependent response), performance in a verbal learning task, and objective and subjective ratings of psychotic symptoms, anxiety, intoxication, and sedation. Results: Delta 9-Tetrahydrocannabinol increased psychotic symptoms and levels of anxiety, intoxication, and sedation, whereas no significant effect was noted on these parameters following administration of cannabidiol. Performance in the verbal learning task was not significantly modulated by either drug. Administration of Delta 9-THC augmented activation in the parahippocampal gyrus during blocks 2 and 3 such that the normal linear decrement in activation across repeated encoding blocks was no longer evident. Delta 9-Tetrahydrocannabinol also attenuated the normal time-dependent change in ventrostriatal activation during retrieval of word pairs, which was directly correlated with concurrently induced psychotic symptoms. In contrast, administration of cannabidiol had no such effect. Conclusion: The modulation of mediotemporal and ventrostriatal function by Delta 9-THC may underlie the effects of C sativa on verbal learning and psychotic symptoms, respectively.

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.

Students' collective knowledge construction in the virtual learning environment ""ToLigado - your school interactive newspaper""

Introduction. The ToLigado Project - Your School Interactive Newspaper is an interactive virtual learning environment conceived, developed, implemented and supported by researchers at the School of the Future Research Laboratory of the University of Sao Paulo, Brazil. Method. This virtual learning environment aims to motivate trans-disciplinary research among public school students and teachers in 2,931 schools equipped with Internet-access computer rooms. Within this virtual community, students produce collective multimedia research documents that are immediately published in the portal. The project also aims to increase students' autonomy for research, collaborative work and Web authorship. Main sections of the portal are presented and described. Results. Partial results of the first two years' implementation are presented and indicate a strong motivation among students to produce knowledge despite the fragile hardware and software infrastructure at the time. Discussion. In this new environment, students should be seen as 'knowledge architects' and teachers as facilitators, or 'curiosity managers'. The ToLigado portal may constitute a repository for future studies regarding student attitudes in virtual learning environments, students' behaviour as 'authors', Web authorship involving collective knowledge production, teachers' behaviour as facilitators, and virtual learning environments as digital repositories of students' knowledge construction and social capital in virtual learning communities.

Cooperation, interaction and learning in local production systems: Evidence in Brazilian firms

In a local production system (LPS), besides external economies, the interaction, cooperation, and learning are indicated by the literature as complementary ways of enhancing the LPS's competitiveness and gains. In Brazil, the greater part of LPSs, mostly composed by small enterprises, displays incipient relationships and low levels of interaction and cooperation among their actors. The size of the participating enterprises itself for specificities that engender organizational constraints, which, in turn, can have a considerable impact on their relationships and learning dynamics. For that reason, it is the purpose of this article to present an analysis of interaction, cooperation, and learning relationships among several types of actors pertaining to an LPS in the farming equipment and machinery sector, bearing in mind the specificities of small enterprises. To this end, the fieldwork carried out in this study aimed at: (i) investigating external and internal knowledge sources conducive to learning and (ii) identifying and analyzing motivating and inhibiting factors related to specificities of small enterprises in order to bring the LPS members closer together and increase their cooperation and interaction. Empirical evidence shows that internal aspects of the enterprises, related to management and infrastructure, can have a strong bearing on their joint actions, interaction and learning processes.

Evaluation of gastrointestinal motility in awake rats: a learning exercise for undergraduate biomedical students

Souza MA, Souza MH, Palheta RC Jr, Cruz PR, Medeiros BA, Rola FH, Magalhaes PJ, Troncon LE, Santos AA. Evaluation of gastrointestinal motility in awake rats: a learning exercise for undergraduate biomedical students. Adv Physiol Educ 33: 343-348, 2009; doi: 10.1152/advan.90176.2008.-Current medical curricula devote scarce time for practical activities on digestive physiology, despite frequent misconceptions about dyspepsia and dysmotility phenomena. Thus, we designed a hands-on activity followed by a small-group discussion on gut motility. Male awake rats were randomly submitted to insulin, control, or hypertonic protocols. Insulin and control rats were gavage fed with 5% glucose solution, whereas hypertonic-fed rats were gavage fed with 50% glucose solution. Insulin treatment was performed 30 min before a meal. All meals (1.5 ml) contained an equal mass of phenol red dye. After 10, 15, or 20 min of meal gavage, rats were euthanized. Each subset consisted of six to eight rats. Dye recovery in the stomach and proximal, middle, and distal small intestine was measured by spectrophotometry, a safe and reliable method that can be performed by minimally trained students. In a separate group of rats, we used the same protocols except that the test meal contained (99m)Tc as a marker. Compared with control, the hypertonic meal delayed gastric emptying and gastrointestinal transit, whereas insulinic hypoglycemia accelerated them. The session helped engage our undergraduate students in observing and analyzing gut motor behavior. In conclusion, the fractional dye retention test can be used as a teaching tool to strengthen the understanding of basic physiopathological features of gastrointestinal motility.

Assessment of Preclinical Learning on Oral Surgery Using Three Instructional Strategies

The purpose of this investigation was to evaluate three learning methods for teaching basic oral surgical skills Thirty predoctoral dental students without any surgical knowledge or previous surgical experience were divided Into three groups (n=10 each) according to instructional strategy Group 1, active learning Group 2, text reading only, and Group 3, text reading and video demonstration After instruction, the apprentices were allowed to practice incision dissection and suture maneuvers in a bench learning model During the students' performance, a structured practice evaluation test to account for correct or incorrect maneuvers was applied by trained observers Evaluation tests were repeated after thirty and sixty days Data from resulting scores between groups and periods were considered for statistical analysis (ANOVA and Tukey Kramer) with a significant level of a=0 05 Results showed that the active learning group presented the significantly best learning outcomes related to immediate assimilation of surgical procedures compared to other groups All groups results were similar after sixty days of the first practice Assessment tests were fundamental to evaluate teaching strategies and allowed theoretical and proficiency learning feedbacks Repetition and interactive practice promoted retention of knowledge on basic oral surgical skills

The case of thyroid hormones: how to learn physiology by solving a detective case

Lellis-Santos C, Giannocco G, Nunes MT. The case of thyroid hormones: how to learn physiology by solving a detective case. Adv Physiol Educ 35: 219-226, 2011; doi:10.1152/advan.00135.2010.Thyroid diseases are prevalent among endocrine disorders, and careful evaluation of patients' symptoms is a very important part in their diagnosis. Developing new pedagogical strategies, such as problem-based learning (PBL), is extremely important to stimulate and encourage medical and biomedical students to learn thyroid physiology and identify the signs and symptoms of thyroid dysfunction. The present study aimed to create a new pedagogical approach to build deep knowledge about hypo-/hyperthyroidism by proposing a hands-on activity based on a detective case, using alternative materials in place of laboratory animals. After receiving a description of a criminal story involving changes in thyroid hormone economy, students collected data from clues, such as body weight, mesenteric vascularization, visceral fat, heart and thyroid size, heart rate, and thyroid-stimulating hormone serum concentration to solve the case. Nevertheless, there was one missing clue for each panel of data. Four different materials were proposed to perform the same practical lesson. Animals, pictures, small stuffed toy rats, and illustrations were all effective to promote learning, and the detective case context was considered by students as inviting and stimulating. The activity can be easily performed independently of the institution's purchasing power. The practical lesson stimulated the scientific method of data collection and organization, discussion, and review of thyroid hormone actions to solve the case. Hence, this activity provides a new strategy and alternative materials to teach without animal euthanization.

Constant-random practice and the adaptive process in motor learning with varying amounts of constant practice

The adaptive process in motor learning was examined in terms of effects of varying amounts of constant practice performed before random practice. Participants pressed five response keys sequentially, the last one coincident with the lighting of a final visual stimulus provided by a complex coincident timing apparatus. Different visual stimulus speeds were used during the random practice. 33 children (M age=11.6 yr.) were randomly assigned to one of three experimental groups: constant-random, constant-random 33%, and constant-random 66%. The constant-random group practiced constantly until they reached a criterion of performance stabilization three consecutive trials within 50 msec. of error. The other two groups had additional constant practice of 33 and 66%, respectively, of the number of trials needed to achieve the stabilization criterion. All three groups performed 36 trials under random practice; in the adaptation phase, they practiced at a different visual stimulus speed adopted in the stabilization phase. Global performance measures were absolute, constant, and variable errors, and movement pattern was analyzed by relative timing and overall movement time. There was no group difference in relation to global performance measures and overall movement time. However, differences between the groups were observed on movement pattern, since constant-random 66% group changed its relative timing performance in the adaptation phase.

Collaborative e-learning and Learning Objects

The Learning Object (OA) is any digital resource that can be reused to support learning with specific functions and objectives. The OA specifications are commonly offered in SCORM model without considering activities in groups. This deficiency was overcome by the solution presented in this paper. This work specified OA for e-learning activities in groups based on SCORM model. This solution allows the creation of dynamic objects which include content and software resources for the collaborative learning processes. That results in a generalization of the OA definition, and in a contribution with e-learning specifications.

HYBRID AND INCREMENTAL FUZZY LEARNING FOR HUMAN SKIN DETECTION

In this paper, a framework for detection of human skin in digital images is proposed. This framework is composed of a training phase and a detection phase. A skin class model is learned during the training phase by processing several training images in a hybrid and incremental fuzzy learning scheme. This scheme combines unsupervised-and supervised-learning: unsupervised, by fuzzy clustering, to obtain clusters of color groups from training images; and supervised to select groups that represent skin color. At the end of the training phase, aggregation operators are used to provide combinations of selected groups into a skin model. In the detection phase, the learned skin model is used to detect human skin in an efficient way. Experimental results show robust and accurate human skin detection performed by the proposed framework.