12 resultados para temporal difference learning
em CentAUR: Central Archive University of Reading - UK
Resumo:
In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.
Resumo:
Cognitive functions such as attention and memory are known to be impaired in End Stage Renal Disease (ESRD), but the sites of the neural changes underlying these impairments are uncertain. Patients and controls took part in a latent learning task, which had previously shown a dissociation between patients with Parkinson’s disease and those with medial temporal damage. ESRD patients (n=24) and age and education-matched controls (n=24) were randomly assigned to either an exposed or unexposed condition. In Phase 1 of the task, participants learned that a cue (word) on the back of a schematic head predicted that the subsequently seen face would be smiling. For the exposed (but not unexposed) condition, an additional (irrelevant) colour cue was shown during presentation. In Phase 2, a different association, between colour and facial expression, was learned. Instructions were the same for each phase: participants had to predict whether the subsequently viewed face was going to be happy or sad. No difference in error rate between the groups was found in Phase 1, suggesting that patients and controls learned at a similar rate. However, in Phase 2, a significant interaction was found between group and condition, with exposed controls performing significantly worse than unexposed (therefore demonstrating learned irrelevance). In contrast, exposed patients made a similar number of errors to unexposed in Phase 2. The pattern of results in ESRD was different from that previously found in Parkinson’s disease, suggesting a different neural origin.
Resumo:
In participatory design situations the competence of the facilitator will influence the opportunities for a user group to become engaged in the process of design. Based on the observation of the conversations from a series of design workshops, the performance of design facilitation expertise by an expert architect is compared with a less experienced architectural graduate. The skills that are the focus of this research are the conversational competences deployed by architects to engage users in the design of an architectural project. The difference between the conversational behaviour of a project architect and a less experienced graduate was observed to illustrate with examples the effect the performance of facilitation had on the opportunity for user engagement in design, and of learning the skill of facilitation that occurred in these situations.
Resumo:
We investigated infants' sensitivity to spatiotemporal structure. In Experiment 1, circles appeared in a statistically defined spatial pattern. At test 11-month-olds, but not 8-month-olds, looked longer at a novel spatial sequence. Experiment 2 presented different color/shape stimuli, but only the location sequence was violated during test; 8-month-olds preferred the novel spatial structure, but 5-month-olds did not. In Experiment 3, the locations but not color/shape pairings were constant at test; 5-month-olds showed a novelty preference. Experiment 4 examined "online learning": We recorded eye movements of 8-month-olds watching a spatiotemporal sequence. Saccade latencies to predictable locations decreased. We argue that temporal order statistics involving informative spatial relations become available to infants during the first year after birth, assisted by multiple cues.
Resumo:
Listeners can attend to one of several simultaneous messages by tracking one speaker’s voice characteristics. Using differences in the location of sounds in a room, we ask how well cues arising from spatial position compete with these characteristics. Listeners decided which of two simultaneous target words belonged in an attended “context” phrase when it was played simultaneously with a different “distracter” context. Talker difference was in competition with position difference, so the response indicates which cue‐type the listener was tracking. Spatial position was found to override talker difference in dichotic conditions when the talkers are similar (male). The salience of cues associated with differences in sounds, bearings decreased with distance between listener and sources. These cues are more effective binaurally. However, there appear to be other cues that increase in salience with distance between sounds. This increase is more prominent in diotic conditions, indicating that these cues are largely monaural. Distances between spectra calculated using a gammatone filterbank (with ERB‐spaced CFs) of the room’s impulse responses at different locations were computed, and comparison with listeners’ responses suggested some slight monaural loudness cues, but also monaural “timbre” cues arising from the temporal‐ and spectral‐envelope differences in the speech from different locations.
Resumo:
We studied how the integration of seen and felt tactile stimulation modulates somatosensory processing, and investigated whether visuotactile integration depends on temporal contiguity of stimulation, and its coherence with a pre-existing body representation. During training, participants viewed a rubber hand or a rubber object that was tapped either synchronously with stimulation of their own hand, or in an uncorrelated fashion. In a subsequent test phase, somatosensory event-related potentials (ERPs) were recorded to tactile stimulation of the left or right hand, to assess how tactile processing was affected by previous visuotactile experience during training. An enhanced somatosensory N140 component was elicited after synchronous, compared with uncorrelated, visuotactile training, irrespective of whether participants viewed a rubber hand or rubber object. This early effect of visuotactile integration on somatosensory processing is interpreted as a candidate electrophysiological correlate of the rubber hand illusion that is determined by temporal contiguity, but not by pre-existing body representations. ERPmodulations were observed beyond 200msec post-stimulus, suggesting an attentional bias induced by visuotactile training. These late modulations were absent when the stimulation of a rubber hand and the participant’s own hand was uncorrelated during training, suggesting that pre-existing body representations may affect later stages of tactile processing.
Resumo:
Developing high-quality scientific research will be most effective if research communities with diverse skills and interests are able to share information and knowledge, are aware of the major challenges across disciplines, and can exploit economies of scale to provide robust answers and better inform policy. We evaluate opportunities and challenges facing the development of a more interactive research environment by developing an interdisciplinary synthesis of research on a single geographic region. We focus on the Amazon as it is of enormous regional and global environmental importance and faces a highly uncertain future. To take stock of existing knowledge and provide a framework for analysis we present a set of mini-reviews from fourteen different areas of research, encompassing taxonomy, biodiversity, biogeography, vegetation dynamics, landscape ecology, earth-atmosphere interactions, ecosystem processes, fire, deforestation dynamics, hydrology, hunting, conservation planning, livelihoods, and payments for ecosystem services. Each review highlights the current state of knowledge and identifies research priorities, including major challenges and opportunities. We show that while substantial progress is being made across many areas of scientific research, our understanding of specific issues is often dependent on knowledge from other disciplines. Accelerating the acquisition of reliable and contextualized knowledge about the fate of complex pristine and modified ecosystems is partly dependent on our ability to exploit economies of scale in shared resources and technical expertise, recognise and make explicit interconnections and feedbacks among sub-disciplines, increase the temporal and spatial scale of existing studies, and improve the dissemination of scientific findings to policy makers and society at large. Enhancing interaction among research efforts is vital if we are to make the most of limited funds and overcome the challenges posed by addressing large-scale interdisciplinary questions. Bringing together a diverse scientific community with a single geographic focus can help increase awareness of research questions both within and among disciplines, and reveal the opportunities that may exist for advancing acquisition of reliable knowledge. This approach could be useful for a variety of globally important scientific questions.
Resumo:
Online learning management systems are in use to facilitate the face to face learning process in many universities. There are many variables that shape and influence a student’s perception of an online learning management system. This study investigates whether there is a relationship between the perception of a student regarding the learning management system and their actual usage of such system. It is believed to help better understand the student usage of online learning management system. An online questionnaire was published on a course management system for a selected subject and the student participation was voluntary. Results indicate that no significant relationship between the perception students had about the learning management system and the actual use of the system. Interestingly, a significant relationship was found between having internet access away from university and the student perception about the system. Students who had internet access away from university had better perception about the learning management system even though there was no significant difference in the level of online learning management system usage between the groups.
Resumo:
Bright aurorae can be excited by the acceleration of electrons into the atmosphere in violation of ideal magnetohydrodynamics. Modelling studies predict that the accelerating electric potential consists of electric double layers at the boundaries of an acceleration region but observations suggest that particle acceleration occurs throughout this region. Using multi-spacecraft observations from Cluster we have examined two upward current regions on 14 December 2009. Our observations show that the potential difference below C4 and C3 changed by up to 1.7 kV between their respective crossings, which were separated by 150 s. The field-aligned current density observed by C3 was also larger than that observed by C4. The potential drop above C3 and C4 was approximately the same in both crossings. Using a novel technique of quantitatively comparing the electron spectra measured by Cluster 1 and 3, which were separated in altitude, we determine when these spacecraft made effectively magnetically conjugate observations and use these conjugate observations to determine the instantaneous distribution of the potential drop in the AAR. Our observations show that an average of 15% of the potential drop in the AAR was located between C1 at 6235 km and C3 at 4685 km altitude, with a maximum potential drop between the spacecraft of 500~V and that the majority of the potential drop was below C3. By assuming a spatial invariance along the length of the upward current region, we discuss these observations in terms of temporal changes and the vertical structure of the electrostatic potential drop and in the context of existing models and previous observations single- and multi-spacecraft observations.
Resumo:
From consideration of children's rights in general and equal opportunities for disabled children in particular, it is important to consult children about barriers and supports to learning and participation. Finding appropriate and feasible ways, however, to incorporate this into educational programmes for younger children can present challenges. Here we report on what happened when teachers from reception classes in England for children aged 4–5 years implemented activities designed to access pupils' views about what helps or hinders at school. Teachers evaluated the feasibility and usefulness of the activities and, together with a small sample of children's responses, this showed that young children could indeed identify aspects of school life they like or dislike, laying the foundations for identifying barriers and supports to learning. Teachers' responses highlighted the importance of careful choice of activity to meet the needs of young children, particularly those with communication difficulties and/or low self-confidence, with staff in some cases adapting and merging activities to suit pupils' needs. Sensitive issues emerged concerning the introduction of consultation activities early in children's school careers. The implications of a compliant rather than collaborative approach by teachers are discussed in the context of children's right to have their views heard, and their developing understanding of difference.
Temporal and spatial variability of surface fluxes over the ice edge zone in the northern Baltic Sea
Resumo:
Three land-fast ice stations (one of them was the Finnish research ice breaker Aranda) and the German research aircraft Falcon were applied to measure the turbulent and radiation fluxes over the ice edge zone in the northern Baltic Sea during the Baltic Air-Sea-Ice Study (BASIS) field experiment from 16 February to 6 March 1998. The temporal and spatial variability of the surface fluxes is discussed. Synoptic weather systems passed the experimental area in a rapid sequence and dominated the conditions (wind speed, airsurface temperature difference, cloud field) for the variability of the turbulent and radiation fluxes. At the ice stations, the largest upward sensible heat fluxes of about 100 Wm�2 were measured during the passage of a cold front when the air cooled faster (�5 K per hour) than the surface. The largest downward flux of about �200 Wm�2 occurred during warm air advection when the air temperature reached +10�C but the surface temperature remained at 0�C. Spatial variability of fluxes was observed from the small scale (scale of ice floes and open water spots) to the mesoscale (width of the ice edge zone). The degree of spatial variability depends on the synoptic situation: during melting conditions downward heat fluxes were the same over ice and open water, whereas during strong cold-air advection upward heat fluxes differed by more than 100 Wm�2. A remarkable amount of grey ice with intermediate surface temperature was observed. The ice in the Baltic Sea cannot be described by one ice type only.
Resumo:
Extinction-resistant fear is considered to be a central feature of pathological anxiety. Here we sought to determine if individual differences in Intolerance of Uncertainty (IU), a potential risk factor for anxiety disorders, underlies compromised fear extinction. We tested this hypothesis by recording electrodermal activity in 38 healthy participants during fear acquisition and extinction. We assessed the temporality of fear extinction, by examining early and late extinction learning. During early extinction, low IU was associated with larger skin conductance responses to learned threat vs. safety cues, whereas high IU was associated with skin conductance responding to both threat and safety cues, but no cue discrimination. During late extinction, low IU showed no difference in skin conductance between learned threat and safety cues, whilst high IU predicted continued fear expression to learned threat, indexed by larger skin conductance to threat vs. safety cues. These findings suggest a critical role of uncertainty-based mechanisms in the maintenance of learned fear.