114 resultados para temporal difference learning
Resumo:
Thanks to recent advances in molecular biology, allied to an ever increasing amount of experimental data, the functional state of thousands of genes can now be extracted simultaneously by using methods such as cDNA microarrays and RNA-Seq. Particularly important related investigations are the modeling and identification of gene regulatory networks from expression data sets. Such a knowledge is fundamental for many applications, such as disease treatment, therapeutic intervention strategies and drugs design, as well as for planning high-throughput new experiments. Methods have been developed for gene networks modeling and identification from expression profiles. However, an important open problem regards how to validate such approaches and its results. This work presents an objective approach for validation of gene network modeling and identification which comprises the following three main aspects: (1) Artificial Gene Networks (AGNs) model generation through theoretical models of complex networks, which is used to simulate temporal expression data; (2) a computational method for gene network identification from the simulated data, which is founded on a feature selection approach where a target gene is fixed and the expression profile is observed for all other genes in order to identify a relevant subset of predictors; and (3) validation of the identified AGN-based network through comparison with the original network. The proposed framework allows several types of AGNs to be generated and used in order to simulate temporal expression data. The results of the network identification method can then be compared to the original network in order to estimate its properties and accuracy. Some of the most important theoretical models of complex networks have been assessed: the uniformly-random Erdos-Renyi (ER), the small-world Watts-Strogatz (WS), the scale-free Barabasi-Albert (BA), and geographical networks (GG). The experimental results indicate that the inference method was sensitive to average degree k variation, decreasing its network recovery rate with the increase of k. The signal size was important for the inference method to get better accuracy in the network identification rate, presenting very good results with small expression profiles. However, the adopted inference method was not sensible to recognize distinct structures of interaction among genes, presenting a similar behavior when applied to different network topologies. In summary, the proposed framework, though simple, was adequate for the validation of the inferred networks by identifying some properties of the evaluated method, which can be extended to other inference methods.
Resumo:
The brief interaction of precipitation with a forest canopy can create a high spatial variability of both throughfall and solute deposition. We hypothesized that (i) the variability in natural forest systems is high but depends on system-inherent stability, (ii) the spatial variability of solute deposition shows seasonal dynamics depending on the increase in rainfall frequency, and (iii) spatial patterns persist only in the short-term. The study area in the north-western Brazilian state of Rondonia is subject to a climate with a distinct wet and dry season. We collected rain and throughfall on an event basis during the early wet season (n = 14) and peak of the wet season (n = 14) and analyzed the samples for pH and concentrations of NH4+, Na+, K+, Ca2+ Mg2+,, Cl-, NO3-, SO42- and DOC. The coefficient 3 4 cient of variation for throughfall based on both sampling intervals was 29%, which is at the lower end of values reported from other tropical forest sites, but which is higher than in most temperate forests. Coefficients of variation of solute deposition ranged from 29% to 52%. This heterogeneity of solute deposition is neither particularly high nor particularly tow compared with a range of tropical and temperate forest ecosystems. We observed an increase in solute deposition variability with the progressing wet season, which was explained by a negative correlation between heterogeneity of solute deposition and antecedent dry period. The temporal stability of throughfall. patterns was Low during the early wet season, but gained in stability as the wet season progressed. We suggest that rapid plant growth at the beginning of the rainy season is responsible for the lower stability, whereas less vegetative activity during the later rainy season might favor the higher persistence of ""hot"" and ""cold"" spots of throughfall. quantities. The relatively high stability of throughfall patterns during later stages of the wet season may influence processes at the forest floor and in the soil. Solute deposition patterns showed less clear trends but all patterns displayed a short-term stability only. The weak stability of those patterns is apt to impede the formation of solute deposition -induced biochemical microhabitats in the soil. (C) 2008 Elsevier B.V. All rights reserved.
Resumo:
Under physiological conditions, elderly people present memory deficit associated with neuronal loss. This pattern is also associated with Alzheimer`s disease but, in this case, in a dramatically intensified level. Kinin receptors have been involved in neurodegeneration and increase of amyloid-beta concentration, associated with Alzheimer`s disease (AD). Considering these findings, this work evaluated the role of kinin receptors in memory consolidation during the aging process. Male C57BI/6 (wt), knock-out B1 (koB1) or B2 (koB2) mice (3, 6, 12 and 18-month-old - mo; n = 10 per group) were submitted to an acquisition session, reinforcement to learning (24 h later: test 1) and final test (7 days later: test 2), in an active avoidance apparatus, to evaluate memory. Conditioned avoidance responses (CAR, % of 50 trials) were registered. In acquisition sessions, similar CAR were obtained among age matched animals from all strains. However, a significant decrease in CAR was observed throughout the aging process (3mo: 8.8 +/- 2.3%; 6mo: 4.1 +/- 0.6%; 12mo: 2.2 +/- 0.6%, 18mo: 3.6 +/- 0.6%, P < 0.01), indicating a reduction in the learning process. In test 1, as expected, memory retention increased significantly (P < 0.05) in all 3- and 6-month-old animals as well as in 12-month-old-wt and 12-month-old-koB1 (P < 0.01), compared to the training session. However, 12-month-old-koB2 and all 18-month-old animals did not show an increase in memory retention. In test 2, 3- and 6-month-old wt and koB1 mice of all ages showed a significant improvement in memory (P < 0.05) compared to test 1. However, 12-month-old wt and koB2 mice of all ages showed no difference in memory retention. We suggest that, during the aging process, the B1 receptor could be involved in neurodegeneration and memory loss. Nevertheless, the B2 receptor is apparently acting as a neuroprotective factor. (C) 2009 Elsevier Ltd. All rights reserved.
Resumo:
The emerging patterns of breastfeeding, sleep and wake circadian rhythms in an infant and the breastfeeding emergence pattern of his elder sister are presented. Both children were raised under regular contact with photic and non-photic Zeitgebers. Data are related to the first four months of life of the infants, which correspond to the exclusive and ad libitum breastfeeding stage of their lives. Discrimination is made of fasting-associated-wakefulness (FAW) which is a wake state without feeding. Our data show that while FAW episodes are concentrated in the diurnal phase of the day since the first week of life, breastfeeding rhythm takes longer to show statistically significant circadian periodicity (four weeks) and to become monophasic, concentrated in the diurnal phase of the day (three/four months). This precedence of the consolidation of FAW rhythm indicates tight association between nocturnal sleep fragmentation and the drive to feed, in the first months of life of infants.
Resumo:
The ability to transfer weight from one lower limb to the other is essential for the execution of daily life activities and little is known about how weight transfer during unconstrained natural standing is affected by age. This study examined the weight transfer ability of elderly individuals during unconstrained standing (for 30 mill) in comparison to young adults. The subjects (19 healthy elderly adults, range 65-80 years, and 19 healthy young adults, range 18-30 years) stood with each foot on a separate force plate and were allowed to change their posture freely at any time. The limits of stability and base of support width during standing, measures of mobility (using the timed up and go and the preferred walking speed tests), and fear of falling were also measured. In comparison to the young adults, during unconstrained standing the elderly adults produced four times fewer weight transfers of large amplitude (greater than,half of their body weight). The limits of stability and base of support width were significantly smaller for the elderly adults but there were no significant differences in the measures of mobility and in the fear of falling score compared to young adults. The observed significant age-related decrease in the use of weight transfer during unconstrained standing, despite any difference in the measured mobility of the subjects, suggests that this task reveals unnoticed and subtle differences in postural control, which may help to better understand age related impairments in balance that the elderly population experiences. (C) 2010 Elsevier B.V. All rights reserved.
Resumo:
This investigation aimed at assessing the extent to which memory from practice in a specific condition of target displacement modulates temporal errors and movement timing of interceptive movements. We compared two groups practicing with certainty of future target velocity either in unchanged target velocity or in target velocity decrease. Following practice, both experimental groups were probed in the situations of unchanged target velocity and target velocity decrease either under the context of certainty or uncertainty about target velocity. Results from practice showed similar improvement of temporal accuracy between groups, revealing that target velocity decrease did not disturb temporal movement organization when fully predictable. Analysis of temporal errors in the probing trials indicated that both groups had higher timing accuracy in velocity decrease in comparison with unchanged velocity. Effect of practice was detected by increased temporal accuracy of the velocity decrease group in situations of decreased velocity; a trend consistent with the expected effect of practice was observed for temporal errors in the unchanged velocity group and in movement initiation at a descriptive level. An additional point of theoretical interest was the fast adaptation in both groups to a target velocity pattern different from that practiced. These points are discussed under the perspective of integration of vision and motor control by means of an internal forward model of external motion.
Resumo:
PIBIC-CNPq-Conselho Nacional de Desenvolvimento Cientifico e Technologico
Resumo:
An experiment was conducted to investigate the persistence of the effect of ""bandwidth knowledge of results (KR)"" manipulated during the learning phase of performing a manual force-control task. The experiment consisted of two phases, an acquisition phase with the goal of maintaining 60% maximum force in 30 trials, and a second phase with the objective of maintaining 40% of maximum force in 20 further trials. There were four bandwidths of KR: when performance error exceeded 5, 10, or 15% of the target, and a control group (0% bandwidth). Analysis showed that 5, 10, and 15% bandwidth led to better performance than 0% bandwidth KR at the beginning of the second phase and persisted during the extended trials.
Resumo:
This study analyzed inter-individual variability of the temporal structure applied in basketball throwing. Ten experienced male athletes in basketball throwing were filmed and a number of kinematic movement parameters analyzed. A biomechanical model provided the relative timing of the shoulder, elbow and wrist joint movements. Inter-individual variability was analyzed using sequencing and relative timing of tem phases of the throw. To compare the variability of the movement phases between subjects a discriminant analysis and an ANOVA were applied. The Tukey test was applied to determine where differences occurred. The significance level was p = 0.05. Inter-individual variability was explained by three concomitant factors: (a) a precision control strategy, (b) a velocity control strategy and (c) intrinsic characteristics of the subjects. Therefore, despite the fact that some actions are common to the basketball throwing pattern each performed demonstrated particular and individual characteristics.
Resumo:
In this paper, we report the remarkable agreement of the glass forming ability of binary alloys with a new criterion that combines the topological instability parameter (lambda) and the average electronegativity difference among the elements of an alloy, assuming both exert a synergetic effect. The best glass forming compositions for Zr-Cu and Ti-Ni systems are well predicted by this new approach. Although the new criterion needs further refinement, it is concluded that the proposed approach is a promising and simple tool to guide and reduce the tedious and labour intensive work to find good glass former compositions in metallic systems. (C) 2008 Elsevier Ltd. All rights reserved.
Resumo:
This paper presents results on a verification test of a Direct Numerical Simulation code of mixed high-order of accuracy using the method of manufactured solutions (MMS). This test is based on the formulation of an analytical solution for the Navier-Stokes equations modified by the addition of a source term. The present numerical code was aimed at simulating the temporal evolution of instability waves in a plane Poiseuille flow. The governing equations were solved in a vorticity-velocity formulation for a two-dimensional incompressible flow. The code employed two different numerical schemes. One used mixed high-order compact and non-compact finite-differences from fourth-order to sixth-order of accuracy. The other scheme used spectral methods instead of finite-difference methods for the streamwise direction, which was periodic. In the present test, particular attention was paid to the boundary conditions of the physical problem of interest. Indeed, the verification procedure using MMS can be more demanding than the often used comparison with Linear Stability Theory. That is particularly because in the latter test no attention is paid to the nonlinear terms. For the present verification test, it was possible to manufacture an analytical solution that reproduced some aspects of an instability wave in a nonlinear stage. Although the results of the verification by MMS for this mixed-order numerical scheme had to be interpreted with care, the test was very useful as it gave confidence that the code was free of programming errors. Copyright (C) 2009 John Wiley & Sons, Ltd.
Resumo:
The Learning Object (OA) is any digital resource that can be reused to support learning with specific functions and objectives. The OA specifications are commonly offered in SCORM model without considering activities in groups. This deficiency was overcome by the solution presented in this paper. This work specified OA for e-learning activities in groups based on SCORM model. This solution allows the creation of dynamic objects which include content and software resources for the collaborative learning processes. That results in a generalization of the OA definition, and in a contribution with e-learning specifications.
Resumo:
One of the e-learning environment goal is to attend the individual needs of students during the learning process. The adaptation of contents, activities and tools into different visualization or in a variety of content types is an important feature of this environment, bringing to the user the sensation that there are suitable workplaces to his profile in the same system. Nevertheless, it is important the investigation of student behaviour aspects, considering the context where the interaction happens, to achieve an efficient personalization process. The paper goal is to present an approach to identify the student learning profile analyzing the context of interaction. Besides this, the learning profile could be analyzed in different dimensions allows the system to deal with the different focus of the learning.
Resumo:
In this paper, a framework for detection of human skin in digital images is proposed. This framework is composed of a training phase and a detection phase. A skin class model is learned during the training phase by processing several training images in a hybrid and incremental fuzzy learning scheme. This scheme combines unsupervised-and supervised-learning: unsupervised, by fuzzy clustering, to obtain clusters of color groups from training images; and supervised to select groups that represent skin color. At the end of the training phase, aggregation operators are used to provide combinations of selected groups into a skin model. In the detection phase, the learned skin model is used to detect human skin in an efficient way. Experimental results show robust and accurate human skin detection performed by the proposed framework.
Resumo:
This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.