Dynamic automata for mobile robot learning

Researchers at the University of Reading have developed over many years some simple mobile robots that explore an environment they perceive through simple ultrasonic sensors. Information from these sensors has allowed the robots to learn the simple task of moving around while avoiding dynamic obstacles using a static set of fuzzy automata, the choice of which has been criticised, due to its arbitrary nature. This paper considers how a dynamic set of automata can overcome this criticism. In addition, a new reinforcement learning function is outlined which is both scalable to different numbers and types of sensors. The innovations compare successfully with earlier work.

Path planning of robots in noisy workspaces using learning automata

The problem of a manipulator operating in a noisy workspace and required to move from an initial fixed position P0 to a final position Pf is considered. However, Pf is corrupted by noise, giving rise to Pˆf, which may be obtained by sensors. The use of learning automata is proposed to tackle this problem. An automaton is placed at each joint of the manipulator which moves according to the action chosen by the automaton (forward, backward, stationary) at each instant. The simultaneous reward or penalty of the automata enables avoiding any inverse kinematics computations that would be necessary if the distance of each joint from the final position had to be calculated. Three variable-structure learning algorithms are used, i.e., the discretized linear reward-penalty (DLR-P, the linear reward-penalty (LR-P ) and a nonlinear scheme. Each algorithm is separately tested with two (forward, backward) and three forward, backward, stationary) actions.

The influence of time on lead toxicity and bioaccumulation determined by the OECD earthworm toxicity test

Internationally agreed standard protocols for assessing chemical toxicity of contaminants in soil to worms assume that the test soil does not need to equilibrate with the chemical to be tested prior to the addition of the test organisms and that the chemical will exert any toxic effect upon the test organism within 28 days. Three experiments were carried out to investigate these assumptions. The first experiment was a standard toxicity test where lead nitrate was added to a soil in solution to give a range of concentrations. The mortality of the worms and the concentration of lead in the survivors were determined. The LC(50)s for 14 and 28 days were 5311 and 5395 mug(Pb) g(soil)(-1) respectively. The second experiment was a timed lead accumulation study with worms cultivated in soil containing either 3000 or 5000 mug(Pb) g(soil)(-1). The concentration of lead in the worms was determined at various sampling times. Uptake at so' Sol both concentrations was linear with time. Worms in the 5000 mug g(-1) soil accumulated lead at a faster rate (3.16 mug Pb g(tissue)(-1) day(-1)) tiss than those in the 3000 mug g(-1) soil (2.21 mug Pb-tissue g(-1) day(-1)). The third experiment was a timed experiment with worms cultivated in tiss soil containing 7000 mugPb g(soil)(-1). Soil and lead nitrate solution were mixed and stored at 20 degreesC. Worms were added at various times over a 35-day period. The time to death increased from 23 h, when worms were added directly after the lead was added to the soil, to 67 It when worms were added after the soil had equilibrated with the lead for 35 days. In artificially Pb-amended soils the worms accumulate Pb over the duration of their exposure to the Pb. Thus time limited toxicity tests may be terminated before worm body load has reached a toxic level. This could result in under-estimates of the toxicity of Pb to worms. As the equilibration time of artificially amended Pb-bearing soils increases the bioavailability of Pb decreases. Thus addition of worms shortly after addition of Pb to soils may result in the over-estimate of Pb toxicity to worms. The current OECD acute worm toxicity test fails to take these two phenomena into account thereby reducing the environmental relevance of the contaminant toxicities it is used to calculate. (C) 2002 Elsevier Science Ltd. All rights reserved.

Negative correlations between control performance and verbalizable knowledge: indicators for implicit learning in process control tasks?

Negative correlations between task performance in dynamic control tasks and verbalizable knowledge, as assessed by a post-task questionnaire, have been interpreted as dissociations that indicate two antagonistic modes of learning, one being “explicit”, the other “implicit”. This paper views the control tasks as finite-state automata and offers an alternative interpretation of these negative correlations. It is argued that “good controllers” observe fewer different state transitions and, consequently, can answer fewer post-task questions about system transitions than can “bad controllers”. Two experiments demonstrate the validity of the argument by showing the predicted negative relationship between control performance and the number of explored state transitions, and the predicted positive relationship between the number of explored state transitions and questionnaire scores. However, the experiments also elucidate important boundary conditions for the critical effects. We discuss the implications of these findings, and of other problems arising from the process control paradigm, for conclusions about implicit versus explicit learning processes.

The role of the Madden-Julian Oscillation in the El Nino and Indian drought of 2002

In 2002 India experienced a severe drought, one among the five worst droughts since records began in 1871, notable for its countrywide influence. The drought was primarily due to an unprecedented break in the monsoon during July, which persisted for almost the whole month and affected most of the sub-continent. The failure of the monsoon in 2002 was not predicted and India was not prepared for the devastating impacts on, for example, agriculture. This paper documents the evolution of the 2002 Indian summer monsoon and considers the possible factors that contributed to the drought and the failure of the forecasts. The development of the 2002/2003 El Nino and the unusually high levels of Madden-Julian Oscillation (MJO) activity during the monsoon season are identified as the central players. The 2002/2003 El Nino was characterised by very high sea-surface temperatures (SSTs) in the central Pacific that developed rapidly during the monsoon season. It is suggested that the unusual character of the developing El Nino was associated with the MJO and was a consequence of the eastward extension of the West Pacific Warm Pool, brought about primarily by a series of westerly wind events (WWEs) as part of the eastward movement of the active phase of the MJO. During the boreal summer, the MJO is usually characterised by northward movement, but in 2002 the northward component of the MJO was weak and the MJO was dominated by a strong eastward component, probably driven by the abnormally high SSTs in the central Pacific. It is suggested that a positive feedback existed between the developing El Nino and the eastward component of the MJO, which weakened the active phases of the monsoon. In particular, the unprecedented monsoon break in July could be associated with the juxtaposition of strong MJO activity with a developing El Nino, both of which interfered constructively with each other to produce major perturbations to the distribution of tropical heating. Subsequently, the main impact of the developing El Nino was a modulation of the Walker circulation that led to the overall suppression of the Indian monsoon during thess latter part of the season. It is argued that the unique combination of a rapidly developing El Nino and strong MJO activity, which was timed within the seasonal cycle to have maximum impact on the Indian summer monsoon, meant that prediction of the prolonged break in July and the seasonally deficient rainfall was a challenge for both the empirical and dynamical forecasting systems. Copyright (C) 2006 Royal Meteorological Society.

Simulation of the impact of high temperature stress on annual crop yields

Brief periods of high temperature which occur near flowering can severely reduce the yield of annual crops such as wheat and groundnut. A parameterisation of this well-documented effect is presented for groundnut (i.e. peanut; Arachis hypogaeaL.). This parameterisation was combined with an existing crop model, allowing the impact of season-mean temperature, and of brief high-temperature episodes at various times near flowering, to be both independently and jointly examined. The extended crop model was tested with independent data from controlled environment experiments and field experiments. The impact of total crop duration was captured, with simulated duration being within 5% of observations for the range of season-mean temperatures used (20-28 degrees C). In simulations across nine differently timed high temperature events, eight of the absolute differences between observed and simulated yield were less than 10% of the control (no-stress) yield. The parameterisation of high temperature stress also allows the simulation of heat tolerance across different genotypes. Three parameter sets, representing tolerant, moderately sensitive and sensitive genotypes were developed and assessed. The new parameterisation can be used in climate change studies to estimate the impact of heat stress on yield. It can also be used to assess the potential for adaptation of cropping systems to increased temperature threshold exceedance via the choice of genotype characteristics. (c) 2005 Elsevier B.V. All rights reserved.

Relationship between 24-hour urinary-free cortisol excretion and salivary cortisol levels sampled from awakening to bedtime in healthy subjects

The utility of repeated salivary cortisol sampling as a substitute for 24-hour urinary-free cortisol (UFC) assessment was examined. Forty-four participants completed both 24-hour collections and 6 salivary collections at wake-up, 08:00, 12:00, 16:00, 20:00 and bedtime, during the same 24-hour period. The results demonstrated that mean, maximum, and amplitude (maximum minus minimum) for salivary cortisol all correlated positively with urinary cortisol, but the associations of these variables with urinary-free cortisol excretion were relatively small. Furthermore, a single salivary sample taken at wake-up was as good an indicator of overall cortisol production as the measures derived from multiple salivary samples. An examination of subject compliance indicated that many subjects failed to collect the timed salivary collections as instructed. The authors conclude that diurnal salivary cortisol sampling versus 24-hour urinary cortisol collections are likely to provide different information about ambient hypothalamic-pituitary-adrenal productivity, and therefore these measures should not be used interchangeably. In addition, subject compliance is a serious consideration in designing studies that employ home salivary collections. Published by Elsevier Science Inc.

Perceiving time to collision activates the sensorimotor cortex

The survival of many animals hinges upon their ability to avoid collisions with other animals or objects or to precisely control the timing of collisions. Optical expansion provides a compelling impression of object approach and in principle can provide the basis for judgments of time to collision (TTC) [1]. It has been demonstrated that pigeons [2] and houseflies [3] have neural systems that can initiate rapid coordinated actions on the basis of optical expansion. In the case of humans, the linkage between judgments of TTC and coordinated action has not been established at a cortical level. Using functional magnetic resonance imaging (fMRI), we identified superior-parietal and motor-cortex areas that are selectively active during perceptual TTC judgments, some of which are normally involved in producing reach-to-grasp responses. These activations could not be attributed to actual movement of participants. We demonstrate that networks involved in the computational problem of extracting TTC from expansion information have close correspondence with the sensorimotor systems that would be involved in preparing a timed motor response, such as catching a ball or avoiding collision.

An agent based approach to distributed task modeling for co-operative task support

This paper describes the design and implementation of an agent based network for the support of collaborative switching tasks within the control room environment of the National Grid Company plc. This work includes aspects from several research disciplines, including operational analysis, human computer interaction, finite state modelling techniques, intelligent agents and computer supported co-operative work. Aspects of these procedures have been used in the analysis of collaborative tasks to produce distributed local models for all involved users. These models have been used as the basis for the production of local finite state automata. These automata have then been embedded within an agent network together with behavioural information extracted from the task and user analysis phase. The resulting support system is capable of task and communication management within the transmission despatch environment.

The long-term safety and efficacy of bilateral transplantation of human fetal striatal tissue in patients with mild to moderate Huntington's disease.

Huntington's disease (HD) is a fatal autosomal dominant neurodegenerative disease involving progressive motor, cognitive and behavioural decline, leading to death approximately 20 years after motor onset. The disease is characterised pathologically by an early and progressive striatal neuronal cell loss and atrophy, which has provided the rationale for first clinical trials of neural repair using fetal striatal cell transplantation. Between 2000 and 2003, the 'NEST-UK' consortium carried out bilateral striatal transplants of human fetal striatal tissue in five HD patients. This paper describes the long-term follow up over a 3-10-year postoperative period of the patients, grafted and non-grafted, recruited to this cohort using the 'Core assessment program for intracerebral transplantations-HD' assessment protocol. No significant differences were found over time between the patients, grafted and non-grafted, on any subscore of the Unified Huntington's Disease Rating Scale, nor on the Mini Mental State Examination. There was a trend towards a slowing of progression on some timed motor tasks in four of the five patients with transplants, but overall, the trial showed no significant benefit of striatal allografts in comparison with a reference cohort of patients without grafts. Importantly, no significant adverse or placebo effects were seen. Notably, the raclopride positron emission tomography (PET) signal in individuals with transplants, indicated that there was no obvious surviving striatal graft tissue. This study concludes that fetal striatal allografting in HD is safe. While no sustained functional benefit was seen, we conclude that this may relate to the small amount of tissue that was grafted in this safety study compared with other reports of more successful transplants in patients with HD.

“I still can’t question”: issues affecting EFL development in an immersion environment

This study examined the development of EFL proficiency in an immersion environment. Adult Chinese speakers of English were tested at the beginning and end of a ten-month period of immersion in the UK on their acquisition of English question forms using a timed grammaticality judgement task. Participants showed significantly faster response times after ten months, but no significant difference in accuracy of target-like judgements, suggesting that immersion benefits fluency more than accuracy.

Upstream control of Agulhas Ring shedding

Rings shed in the Agulhas Retroflection region play an important role in the global thermohaline circulation. The shedding of these rings has been considered very irregular. In this paper, we present evidence for remote control of the timing and frequency of the ring shedding events. This turns out to be a far more regular process, at a frequency of 4–5 cycles per year. The movement of the Agulhas Retroflection, and thereby the shedding of rings, is timed by incoming eddies from the upstream regions. Eddies from the Mozambique Channel, and from the East Madagascar current reach the retroflection region at the frequency of 4–5 times per year. The existence of these eddies can be related to incoming Rossby waves that cross the Indian Ocean and reach the Agulhas Current system. These may in turn be part of a basin-wide oscillation. The irregularity found in ring shedding statistics can be ascribed to processes occurring between the actual shedding and the first unambiguous observation of a separated ring.