Assessment of Speech Dialog Systems using Multi-Modal Cognitive Load Analysis and Driving Performance Metrics

In this paper, cognitive load analysis via acoustic- and CAN-Bus-based driver performance metrics is employed to assess two different commercial speech dialog systems (SDS) during in-vehicle use. Several metrics are proposed to measure increases in stress, distraction and cognitive load and we compare these measures with statistical analysis of the speech recognition component of each SDS. It is found that care must be taken when designing an SDS as it may increase cognitive load which can be observed through increased speech response delay (SRD), changes in speech production due to negative emotion towards the SDS, and decreased driving performance on lateral control tasks. From this study, guidelines are presented for designing systems which are to be used in vehicular environments.

Driving performance on monotonous roads

Driving on motorways has largely been reduced to a lane-keeping task with cruise control. Rapidly, drivers are likely to get bored with such a task and take their attention away from the road. This is of concern in terms of road safety – particularly for professional drivers - since inattention has been identified as one of the main contributing factors to road crashes and is estimated to be involved in 20 to 30% of these crashes. Furthermore, drivers are not aware that their vigilance level has decreased and that their driving performance is impaired. Intelligent Transportation System (ITS) intervention can be used as a countermeasure against vigilance decrement. This paper aims to identify a variety of metrics impacted during monotonous driving - ranging from vehicle data to physiological variables - and relate them to two monotonous factors namely the monotony of the road design (straightness) and the monotony of the environment (landscape, signage, traffic). Data are collected in a driving simulator instrumented with an eye tracking system, a heart rate monitor and an electrodermal activity device (N=25 participants). The two monotonous factors are varied (high and low) leading to the use of four different driving scenarios (40 minutes each). We show with Generalised Linear Mixed Models that driver performance decreases faster when the road is monotonous. We also highlight that road monotony impairs a variety of driving performance and vigilance measures, ranging from speed, lateral position of the vehicle to physiological measurements such as heart rate variability, blink frequency and electrodermal activity. This study informs road designers of the importance of having a varied road environment. It also provides a range of metrics that can be used to detect in real-time the impairment of driving performance on monotonous roads. Such knowledge could result in the development of an in-vehicle device warning drivers at early signs of driving performance impairment on monotonous roads.

Driving performance impairments due to hypovigilance on monotonous roads

Drivers' ability to react to unpredictable events deteriorates when exposed to highly predictable and uneventful driving tasks. Highway design reduces the driving task mainly to a lane-keeping manoeuvre. Such a task is monotonous, providing little stimulation and this contributes to crashes due to inattention. Research has shown that driver's hypovigilance can be assessed with EEG measurements and that driving performance is impaired during prolonged monotonous driving tasks. This paper aims to show that two dimensions of monotony - namely road design and road side variability - decrease vigilance and impair driving performance. This is the first study correlating hypovigilance and driver performance in varied monotonous conditions, particularly on a short time scale (a few seconds). We induced vigilance decrement as assessed with an EEG during a monotonous driving simulator experiment. Road monotony was varied through both road design and road side variability. The driver's decrease in vigilance occurred due to both road design and road scenery monotony and almost independently of the driver's sensation seeking level. Such impairment was also correlated to observable measurements from the driver, the car and the environment. During periods of hypovigilance, the driving performance impairment affected lane positioning, time to lane crossing, blink frequency, heart rate variability and non-specific electrodermal response rates. This work lays the foundation for the development of an in-vehicle device preventing hypovigilance crashes on monotonous roads.

Examining the effects of an eco-driving system on driver distraction

Driver distraction has recently been defined by Regan as "the diversion of attention away from activities critical for safe driving toward a competing activity, which may result in insufficient or no attention to activities critical for safe driving (Regan, Hallett & Gordon, 2011, p.1780)". One source of distraction is in-vehicle devices, even though they might provide other benefits, e.g. navigation systems. Currently, eco-driving systems have been growing rapidly in popularity. These systems send messages to drivers so that driving performance can be improved in terms of fuel efficiency. However, there remain unanswered questions about whether eco-driving systems endanger drivers by distracting them. In this research, the CARRS-Q advanced driving simulator was used in order to provide safety for participants and meanwhile simulate real world driving. The distraction effects of tasks involving three different in-vehicle systems were investigated: changing a CD, entering a five digit number as a part of navigation task and responding to an eco-driving task. Driving in these scenarios was compared with driving in the absence of these distractions, and while drivers engaged in critical manoeuvres. In order to account for practice effects, the same scenarios were duplicated on a second day. The three in-vehicle systems were not the exact facsimiles of any particular existing system, but were designed to have similar characteristics to those of system available. In general, the results show that drivers’ mental workloads are significantly higher in navigation and CD changing scenarios in comparison to the two other scenarios, which implies that these two tasks impose more visual/manual and cognitive demands. However, eco-driving mental workload is still high enough to be called marginally significant (p ~ .05) across manoeuvres. Similarly, event detection tasks show that drivers miss significantly more events in the navigation and CD changing scenarios in comparison to both the baseline and eco-driving scenario across manoeuvres. Analysis of the practice effect shows that drivers’ baseline scenario and navigation scenario exhibit significantly less demand on the second day. However, the number of missed events across manoeuvres confirmed that drivers can detect significantly more events on the second day for all scenarios. Distraction was also examined separately for five groups of manoeuvres (straight, lane changing, overtaking, braking for intersections and braking for roundabouts), in two locations for each condition. Repeated measures mixed ANOVA results show that reading an eco-driving message can potentially impair driving performance. When comparing the three in–vehicle distractions tested, attending to an eco-driving message is similar in effect to the CD changing task. The navigation task degraded driver performance much more than these other sources of distraction. In lane changing manoeuvres, drivers’ missed response counts degraded when they engaged in reading eco-driving messages at the first location. However, drivers’ event detection abilities deteriorated less at the second lane changing location. In baseline manoeuvres (driving straight), participants’ mean minimum speed degraded more in the CD changing scenario. Drivers’ lateral position shifted more in both CD changing and navigation tasks in comparison with both eco-driving and baseline scenarios, so they were more visually distracting. Participants were better at event detection in baseline manoeuvres in comparison with other manoeuvres. When approaching an intersection, the navigation task caused more events to be missed by participants, whereas eco-driving messages seemed to make drivers less distracted. The eco-driving message scenario was significantly less distracting than the navigation system scenario (fewer missed responses) when participants commenced braking for roundabouts. To sum up, in spite of the finding that two other in-vehicle tasks are more distracting than the eco-driving task, the results indicate that even reading a simple message while driving could potentially lead to missing an important event, especially when executing critical manoeuvres. This suggests that in-vehicle eco-driving systems have the potential to contribute to increased crash risk through distraction. However, there is some evidence of a practice effect which suggests that future research should focus on performance with habitual rather than novel tasks. It is recommended that eco-driving messages be delivered to drivers off-line when possible.

Do repeated rumble strip hits improve driver alertness?

Driving while sleepy is associated with increased crash risk. Rumble strips are designed to alert a sleepy or inattentive driver when they deviate outside their driving lane. The current study sought to examine the effects of repeated rumble strip hits on levels of physiological and subjective sleepiness as well as simulated driving performance. In total, 36 regular shift workers drove a high-fidelity moving base simulator on a simulated road with rumble strips installed at the shoulder and centre line after a working a full night shift. The results show that on average, the first rumble strip occurred after 20 minutes of driving, with subsequent hits occurring 10 minutes later, with the last three occurring approximately every 5 minutes thereafter. Specifically, it was found that the first rumble strip hit reduced physiological sleepiness; however, subsequent hits did not increase alertness. Moreover, the results also demonstrate that increased subjective sleepiness levels, via the Karolinska Sleepiness Scale, were associated with a greater probability of hitting a rumble strip. The present results suggest that sleepiness is very resilient to even strongly arousing stimuli, with physiologicl and subjective sleepiness increasing over the duration of the drive, despite the interference by rumble strips.

The performance of concrete exposed to marine environments: predictive modelling and use of laboratory/on site test methods

This paper reports an approach by which laboratory based testing and numerical modelling can be combined to predict the long term performance of a range of concretes exposed to marine environments. Firstly, a critical review of the test methods for assessing the chloride penetration resistance of concrete is given. The repeatability of the different test results is also included. In addition to the test methods, a numerical simulation model is used to explore the test data further to obtain long-term chloride ingress trends. The combined use of testing and modelling is validated with the help of long-term chloride ingress data from a North Sea exposure site. In summary, the paper outlines a methodology for determining the long term performance of concrete in marine environments.

A durability performance-index for concrete: developments in a novel test method

Implementation of both design for durability and performance-based standards and specifications are limited by the lack of rapid, simple, science based test methods for characterising the transport properties and deterioration resistance of concrete. This paper presents developments in the application of electrical property measurements as a testing methodology to evaluate the relative performance of a range of concrete mixes. The technique lends itself to in-situ monitoring thereby allowing measurements to be obtained on the as-placed concrete. Conductivity measurements are presented for concretes with and without supplementary cementitious materials (SCM’s) from demoulding up to 350 days. It is shown that electrical conductivity measurements display a continual decrease over the entire test period and attributed to pore structure refinement due to hydration and pozzolanic reaction. The term formation factor is introduced to rank concrete performance in terms of is resistance to chloride penetration.

Feedlot performance, feed efficiency and carcass traits in Nellore cattle selected for postweaning weight

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Development of specifications for the superpave simple performance tests

This study describes the development and establishment of a proposed Simple Performance Test (SPT) specification in order to contribute to the asphalt materials technology in the state of Michigan. The properties and characteristic of materials, performance testing of specimens, and field analyses are used in developing draft SPT specifications. These advanced and more effective specifications should significantly improve the qualities of designed and constructed hot mix asphalt (HMA) leading to improvement in pavement life in Michigan. The objectives of this study include the following: 1) using the SPT, conduct a laboratory study to measure the parameters including the dynamic modulus terms (E*/sinϕ and E*) and the flow number (Fn) for typical Michigan HMA mixtures, 2) correlate the results of the laboratory study to field performance as they relate to flexible pavement performance (rutting, fatigue, and low temperature cracking), and 3) make recommendations for the SPT criteria at specific traffic levels (e.g. E3, E10, E30), including recommendations for a draft test specification for use in Michigan. The specification criteria of dynamic modulus were developed based upon field rutting performance and contractor warranty criteria.

An analysis of the effectiveness of written driver license examinations in evaluating applicant driving abilities. Task 1 - revisions of test and manual.

Arizona Department of Transportation, Phoenix

An analysis of the effectiveness of written driver license examinations in evaluating applicant driving abilities. Task 2 - Arizona driver licensing for the 90's.

Arizona Department of Transportation, Phoenix

An analysis of the effectiveness of written driver license examinations in evaluating applicant driving abilities. Task 3 - Arizona classified license system.

Arizona Department of Transportation, Phoenix

Safe driving knowledge dissemination and testing techniques. Volume I. General findings. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Safe driving knowledge dissemination and testing techniques: volume II: final report.

National Highway Traffic Safety Administration, Washington, D.C.

Identification of driver licensing research requirements. Final report.

National Highway Traffic Safety Administration, Washington, D.C.