Motion planning and stochastic control with experimental validation on a planetary rover

Motion planning for planetary rovers must consider control uncertainty in order to maintain the safety of the platform during navigation. Modelling such control uncertainty is difficult due to the complex interaction between the platform and its environment. In this paper, we propose a motion planning approach whereby the outcome of control actions is learned from experience and represented statistically using a Gaussian process regression model. This model is used to construct a control policy for navigation to a goal region in a terrain map built using an on-board RGB-D camera. The terrain includes flat ground, small rocks, and non-traversable rocks. We report the results of 200 simulated and 35 experimental trials that validate the approach and demonstrate the value of considering control uncertainty in maintaining platform safety.

A stochastic neighborhood conditional autoregressive model for spatial data

A spatial process observed over a lattice or a set of irregular regions is usually modeled using a conditionally autoregressive (CAR) model. The neighborhoods within a CAR model are generally formed deterministically using the inter-distances or boundaries between the regions. An extension of CAR model is proposed in this article where the selection of the neighborhood depends on unknown parameter(s). This extension is called a Stochastic Neighborhood CAR (SNCAR) model. The resulting model shows flexibility in accurately estimating covariance structures for data generated from a variety of spatial covariance models. Specific examples are illustrated using data generated from some common spatial covariance functions as well as real data concerning radioactive contamination of the soil in Switzerland after the Chernobyl accident.

On optimal control of constrained linear systems with imperfect state information and stochastic disturbances

We address the problem of finite horizon optimal control of discrete-time linear systems with input constraints and uncertainty. The uncertainty for the problem analysed is related to incomplete state information (output feedback) and stochastic disturbances. We analyse the complexities associated with finding optimal solutions. We also consider two suboptimal strategies that could be employed for larger optimization horizons.

Approximate solutions to stochastic dynamic programs

This paper examines the properties of various approximation methods for solving stochastic dynamic programs in structural estimation problems. The problem addressed is evaluating the expected value of the maximum of available choices. The paper shows that approximating this by the maximum of expected values frequently has poor properties. It also shows that choosing a convenient distributional assumptions for the errors and then solving exactly conditional on the distributional assumption leads to small approximation errors even if the distribution is misspecified. © 1997 Cambridge University Press.

Asymptotic minimax robust and misspecified Lorden quickest change detection for dependent stochastic processes

The quick detection of an abrupt unknown change in the conditional distribution of a dependent stochastic process has numerous applications. In this paper, we pose a minimax robust quickest change detection problem for cases where there is uncertainty about the post-change conditional distribution. Our minimax robust formulation is based on the popular Lorden criteria of optimal quickest change detection. Under a condition on the set of possible post-change distributions, we show that the widely known cumulative sum (CUSUM) rule is asymptotically minimax robust under our Lorden minimax robust formulation as a false alarm constraint becomes more strict. We also establish general asymptotic bounds on the detection delay of misspecified CUSUM rules (i.e. CUSUM rules that are designed with post- change distributions that differ from those of the observed sequence). We exploit these bounds to compare the delay performance of asymptotically minimax robust, asymptotically optimal, and other misspecified CUSUM rules. In simulation examples, we illustrate that asymptotically minimax robust CUSUM rules can provide better detection delay performance at greatly reduced computation effort compared to competing generalised likelihood ratio procedures.

Enhanced stochastic mobility prediction with multi-output Gaussian processes

Outdoor robots such as planetary rovers must be able to navigate safely and reliably in order to successfully perform missions in remote or hostile environments. Mobility prediction is critical to achieving this goal due to the inherent control uncertainty faced by robots traversing natural terrain. We propose a novel algorithm for stochastic mobility prediction based on multi-output Gaussian process regression. Our algorithm considers the correlation between heading and distance uncertainty and provides a predictive model that can easily be exploited by motion planning algorithms. We evaluate our method experimentally and report results from over 30 trials in a Mars-analogue environment that demonstrate the effectiveness of our method and illustrate the importance of mobility prediction in navigating challenging terrain.

Learned stochastic mobility prediction for planning with control uncertainty on unstructured terrain

Motion planning for planetary rovers must consider control uncertainty in order to maintain the safety of the platform during navigation. Modelling such control uncertainty is difficult due to the complex interaction between the platform and its environment. In this paper, we propose a motion planning approach whereby the outcome of control actions is learned from experience and represented statistically using a Gaussian process regression model. This mobility prediction model is trained using sample executions of motion primitives on representative terrain, and predicts the future outcome of control actions on similar terrain. Using Gaussian process regression allows us to exploit its inherent measure of prediction uncertainty in planning. We integrate mobility prediction into a Markov decision process framework and use dynamic programming to construct a control policy for navigation to a goal region in a terrain map built using an on-board depth sensor. We consider both rigid terrain, consisting of uneven ground, small rocks, and non-traversable rocks, and also deformable terrain. We introduce two methods for training the mobility prediction model from either proprioceptive or exteroceptive observations, and report results from nearly 300 experimental trials using a planetary rover platform in a Mars-analogue environment. Our results validate the approach and demonstrate the value of planning under uncertainty for safe and reliable navigation.

Differential effects of monotony versus fatigue on driving performance and the effectiveness of various detection methods : implications for road safety in the ACT

Background Situational driving factors, including fatigue, distraction, inattention and monotony, are recognised killers in Australia, contributing to an estimated 40% of fatal crashes and 34% of all crashes . More often than not the main contributing factor is identified as fatigue, yet poor driving performance has been found to emerge early in monotonous conditions, independent of fatigue symptoms and time on task. This early emergence suggests an important role for monotony. However, much road safety research suggests that monotony is solely a task characteristic that directly causes fatigue and associated symptoms and there remains an absence of consistent evidence explaining the relationship. Objectives We report an experimental study designed to disentangle the characteristics and effects of monotony from those associated with fatigue. Specifically, we examined whether poor driving performance associated with hypovigilance emerges as a consequence of monotony, independent of fatigue. We also examined whether monotony is a multidimensional construct, determined by environmental characteristics and/or task demands that independently moderate sustained attention and associated driving performance. Method Using a driving simulator, participants completed four, 40 minute driving scenarios. The scenarios varied in the degree of monotony as determined by the degree of variation in road design (e.g., straight roads vs. curves) and/or road side scenery. Fatigue, as well as a number of other factors known to moderate vigilance and driving performance, was controlled for. To track changes across time, driving performance was assessed in five minute time periods using a range of behavioural, subjective and physiological measures, including steering wheel movements, lane positioning, electroencephalograms, skin conductance, and oculomotor activity. Results Results indicate that driving performance is worse in monotonous driving conditions characterised by low variability in road design. Critically, performance decrements associated with monotony emerge very early, suggesting monotony effects operate independent of fatigue. Conclusion Monotony is a multi-dimensional construct where, in a driving context, roads containing low variability in design are monotonous and those high in variability are non-monotonous. Importantly, low variability in road side scenery does not appear to exacerbate monotony or associated poor performance. However, high variability in road side scenery can act as a distraction and impair sustained attention and poor performance when driving on monotonous roads. Furthermore, high sensation seekers seem to be more susceptible to distraction when driving on monotonous roads. Implications of our results for the relationship between monotony and fatigue, and the possible construct-specific detection methods in a road safety context, will be discussed.