Automatic inference of driving task demand from visual cues of emotion and attention

Sensing the mental, physical and emotional demand of a driving task is of primary importance in road safety research and for effectively designing in-vehicle information systems (IVIS). Particularly, the need of cars capable of sensing and reacting to the emotional state of the driver has been repeatedly advocated in the literature. Algorithms and sensors to identify patterns of human behavior, such as gestures, speech, eye gaze and facial expression, are becoming available by using low cost hardware: This paper presents a new system which uses surrogate measures such as facial expression (emotion) and head pose and movements (intention) to infer task difficulty in a driving situation. 11 drivers were recruited and observed in a simulated driving task that involved several pre-programmed events aimed at eliciting emotive reactions, such as being stuck behind slower vehicles, intersections and roundabouts, and potentially dangerous situations. The resulting system, combining face expressions and head pose classification, is capable of recognizing dangerous events (such as crashes and near misses) and stressful situations (e.g. intersections and way giving) that occur during the simulated drive.

Task demand effects on postural control in older adults

The literature shows conflicting results regarding older adults' (OA) postural control performance. Differing task demands amongst scientific studies may contribute to such ambiguous results. Therefore, the purpose of this study was to examine the performance of postural control in older adults and the relationship between visual information and body sway as a function of task demands. Old and young adults (YA) maintained an upright stance on different bases of support (normal, tandem and reduced), both with and without vision, and both with and without room movement. In the more demanding tasks, the older adults displayed greater body sway than the younger adults and older adults were more influenced by the manipulation of the visual information due to the room movement. However, in the normal support condition, the influence of the moving room was similar for the two groups. These results suggest that task demand is an important aspect to consider when examining postural control in older adults. (c) 2006 Elsevier B.V. All rights reserved.

Increased sensitivity in mapping task demand in visuospatial processing using reaction-time-dependent hemodynamic response predictors in rapid event-related fMRI

Searching for the neural correlates of visuospatial processing using functional magnetic resonance imaging (fMRI) is usually done in an event-related framework of cognitive subtraction, applying a paradigm comprising visuospatial cognitive components and a corresponding control task. Besides methodological caveats of the cognitive subtraction approach, the standard general linear model with fixed hemodynamic response predictors bears the risk of being underspecified. It does not take into account the variability of the blood oxygen level-dependent signal response due to variable task demand and performance on the level of each single trial. This underspecification may result in reduced sensitivity regarding the identification of task-related brain regions. In a rapid event-related fMRI study, we used an extended general linear model including single-trial reaction-time-dependent hemodynamic response predictors for the analysis of an angle discrimination task. In addition to the already known regions in superior and inferior parietal lobule, mapping the reaction-time-dependent hemodynamic response predictor revealed a more specific network including task demand-dependent regions not being detectable using the cognitive subtraction method, such as bilateral caudate nucleus and insula, right inferior frontal gyrus and left precentral gyrus.

Sensitivity of the lane change test as a measure of in-vehicle system demand

The Lane Change Test (LCT) is one of the growing number of methods developed to quantify driving performance degradation brought about by the use of in-vehicle devices. Beyond its validity and reliability, for such a test to be of practical use, it must also be sensitive to the varied demands of individual tasks. The current study evaluated the ability of several recent LCT lateral control and event detection parameters to discriminate between visual-manual and cognitive surrogate In-Vehicle Information System tasks with different levels of demand. Twenty-seven participants (mean age 24.4 years) completed a PC version of the LCT while performing visual search and math problem solving tasks. A number of the lateral control metrics were found to be sensitive to task differences, but the event detection metrics were less able to discriminate between tasks. The mean deviation and lane excursion measures were able to distinguish between the visual and cognitive tasks, but were less sensitive to the different levels of task demand. The other LCT metrics examined were less sensitive to task differences. A major factor influencing the sensitivity of at least some of the LCT metrics could be the type of lane change instructions given to participants. The provision of clear and explicit lane change instructions and further refinement of its metrics will be essential for increasing the utility of the LCT as an evaluation tool.

Revisiting the Task-Capability interface model for incorporating human factors into car-following models

Human factors such as distraction, fatigue, alcohol and drug use are generally ignored in car-following (CF) models. Such ignorance overestimates driver capability and leads to most CF models’ inability in realistically explaining human driving behaviors. This paper proposes a novel car-following modeling framework by introducing the difficulty of driving task measured as the dynamic interaction between driving task demand and driver capability. Task difficulty is formulated based on the famous Task Capability Interface (TCI) model, which explains the motivations behind driver’s decision making. The proposed method is applied to enhance two popular CF models: Gipps’ model and IDM, and named as TDGipps and TDIDM respectively. The behavioral soundness of TDGipps and TDIDM are discussed and their stabilities are analyzed. Moreover, the enhanced models are calibrated with the vehicle trajectory data, and validated to explain both regular and human factor influenced CF behavior (which is distraction caused by hand-held mobile phone conversation in this paper). Both the models show better performance than their predecessors, especially in presence of human factors.

Changes in corticomotor excitability and inhibition after exercise are influenced by hand dominance and motor demand

Previous studies on handedness have often reported functional asymmetries in corticomotor excitability (CME) associated with voluntary movement. Recently, we have shown that the degree of post-exercise corticomotor depression (PED) and increase in short-interval cortical inhibition (SICI) after a repetitive finger movement task was less when the task was performed at a maximal voluntary rate (MVR) than when it was performed at a submaximal sustainable rate (SR). In the current study, we have compared the time course of PED and SICI in the dominant (DOM) and nondominant (NDOM) hands after an MVR and SR finger movement task to determine the influence of hand dominance and task demand. We tracked motor-evoked potential (MEP) amplitude from the first dorsal interosseous muscle of the DOM and NDOM hand for 20 min after a 10-s index finger flexion-extension task at MVR and SR. For all hand-task combinations, we report a period of PED and increased SICI lasting for up to 8 min. We find that the least demanding task, one that involved index finger movement of the DOM hand at SR, was associated with the greatest change in PED and SICI from baseline (63.6±5.7% and 79±2%, P<0.001, PED and SICI, respectively), whereas the most demanding task (MVR of the NDOM hand) was associated with the least change from baseline (PED: 88.1±3.6%, SICI: 103±2%; P<0.001). Our findings indicate that the changes in CME and inhibition associated with repetitive finger movement are influenced both by handedness and the degree of demand of the motor task and are inversely related to task demand, being smallest for an MVR task of the NDOM hand and greatest for an SR task of the DOM hand. The findings provide additional evidence for differences in neuronal processing between the dominant and nondominant hemispheres in motor control.

An examination of monotony and hypovigilance, independent of fatigue : relevance to road safety

Driving is a vigilance task, requiring sustained attention to maintain performance and avoid crashes. Hypovigilance (i.e., marked reduction in vigilance) while driving manifests as poor driving performance and is commonly attributed to fatigue (Dinges, 1995). However, poor driving performance has been found to be more frequent when driving in monotonous road environments, suggesting that monotony plays a role in generating hypovigilance (Thiffault & Bergeron, 2003b). Research to date has tended to conceptualise monotony as a uni-dimensional task characteristic, typically used over a prolonged period of time to facilitate other factors under investigation, most notably fatigue. However, more often than not, more than one exogenous factor relating to the task or operating environment is manipulated to vary or generate monotony (Mascord & Heath, 1992). Here we aimed to explore whether monotony is a multi-dimensional construct that is determined by characteristics of both the task proper and the task environment. The general assumption that monotony is a task characteristic used solely to elicit hypovigilance or poor performance related to fatigue appears to have led to there being little rigorous investigation into the exact nature of the relationship. While the two concepts are undoubtedly linked, the independent effect of monotony on hypovigilance remains largely ignored. Notwithstanding, there is evidence that monotony effects can emerge very early in vigilance tasks and are not necessarily accompanied by fatigue (see Meuter, Rakotonirainy, Johns, & Wagner, 2005). This phenomenon raises a largely untested, empirical question explored in two studies: Can hypovigilance emerge as a consequence of task and/or environmental monotony, independent of time on task and fatigue? In Study 1, using a short computerised vigilance task requiring responses to be withheld to infrequent targets, we explored the differential impacts of stimuli and task demand manipulations on the development of a monotonous context and the associated effects on vigilance performance (as indexed by respone errors and response times), independent of fatigue and time on task. The role of individual differences (sensation seeking, extroversion and cognitive failures) in moderating monotony effects was also considered. The results indicate that monotony affects sustained attention, with hypovigilance and associated performance worse in monotonous than in non-monotonous contexts. Critically, performance decrements emerged early in the task (within 4.3 minutes) and remained consistent over the course of the experiment (21.5 minutes), suggesting that monotony effects can operate independent of time on task and fatigue. A combination of low task demands and low stimulus variability form a monotonous context characterised by hypovigilance and poor task performance. Variations to task demand and stimulus variability were also found to independently affect performance, suggesting that monotony is a multi-dimensional construct relating to both task monotony (associated with the task itself) and environmental monotony (related to characteristics of the stimulus). Consequently, it can be concluded that monotony is multi-dimensional and is characterised by low variability in stimuli and/or task demands. The proposition that individual differences emerge under conditions of varying monotony with high sensation seekers and/or extroverts performing worse in monotonous contexts was only partially supported. Using a driving simulator, the findings of Study 1 were extended to a driving context to identify the behavioural and psychophysiological indices of monotony-related hypovigilance associated with variations to road design and road side scenery (Study 2). Supporting the proposition that monotony is a multi-dimensional construct, road design variability emerged as a key moderating characteristic of environmental monotony, resulting in poor driving performance indexed by decrements in steering wheel measures (mean lateral position). Sensation seeking also emerged as a moderating factor, where participants high in sensation seeking tendencies displayed worse driving behaviour in monotonous conditions. Importantly, impaired driving performance was observed within 8 minutes of commencing the driving task characterised by environmental monotony (low variability in road design) and was not accompanied by a decline in psychophysiological arousal. In addition, no subjective declines in alertness were reported. With fatigue effects associated with prolonged driving (van der Hulst, Meijman, & Rothengatter, 2001) and indexed by drowsiness, this pattern of results indicates that monotony can affect driver vigilance, independent of time on task and fatigue. Perceptual load theory (Lavie, 1995, 2005) and mindlessness theory (Robertson, Manly, Andrade, Baddley, & Yiend, 1997) provide useful theoretical frameworks for explaining and predicting monotony effects by positing that the low load (of task and/or stimuli) associated with a monotonous task results in spare attentional capacity which spills over involuntarily, resulting in the processing of task-irrelevant stimuli or task unrelated thoughts. That is, individuals – even when not fatigued - become easily distracted when performing a highly monotonous task, resulting in hypovigilance and impaired performance. The implications for road safety, including the likely effectiveness of fatigue countermeasures to mitigate monotony-related driver hypovigilance are discussed.

Étude intracrânienne sur les mécanismes cérébraux permettant la reconnaissance d’objets

La reconnaissance d’objets est une tâche complexe au cours de laquelle le cerveau doit assembler de manière cohérente tous les éléments d’un objet accessible à l’œil afin de le reconnaître. La construction d’une représentation corticale de l’objet se fait selon un processus appelé « bottom-up », impliquant notamment les régions occipitales et temporales. Un mécanisme « top-down » au niveau des régions pariétales et frontales, facilite la reconnaissance en suggérant des identités potentielles de l’objet à reconnaître. Cependant, le mode de fonctionnement de ces mécanismes est peu connu. Plusieurs études ont démontré une activité gamma induite au moment de la perception cohérente de stimuli, lui conférant ainsi un rôle important dans la reconnaissance d’objets. Cependant, ces études ont utilisé des techniques d’enregistrement peu précises ainsi que des stimuli répétitifs. La première étude de cette thèse vise à décrire la dynamique spatio-temporelle de l’activité gamma induite à l’aide de l’électroencéphalographie intracrânienne, une technique qui possède des résolutions spatiales et temporelles des plus précises. Une tâche d’images fragmentées a été conçue dans le but de décrire l’activité gamma induite selon différents niveaux de reconnaissance, tout en évitant la répétition de stimuli déjà reconnus. Afin de mieux circonscrire les mécanismes « top-down », la tâche a été répétée après un délai de 24 heures. Les résultats démontrent une puissante activité gamma induite au moment de la reconnaissance dans les régions « bottom-up ». Quant aux mécanismes « top-down », l’activité était plus importante aux régions occipitopariétales. Après 24 heures, l’activité était davantage puissante aux régions frontales, suggérant une adaptation des procédés « top-down » selon les demandes de la tâche. Très peu d’études se sont intéressées au rythme alpha dans la reconnaissance d’objets, malgré qu’il soit bien reconnu pour son rôle dans l’attention, la mémoire et la communication des régions neuronales distantes. La seconde étude de cette thèse vise donc à décrire plus précisément l’implication du rythme alpha dans la reconnaissance d’objets en utilisant les techniques et tâches identiques à la première étude. Les analyses révèlent une puissante activité alpha se propageant des régions postérieures aux régions antérieures, non spécifique à la reconnaissance. Une synchronisation de la phase de l’alpha était, quant à elle, observable qu’au moment de la reconnaissance. Après 24 heures, un patron similaire était observable, mais l’amplitude de l’activité augmentait au niveau frontal et les synchronies de la phase étaient davantage distribuées. Le rythme alpha semble donc refléter des processus attentionnels et communicationnels dans la reconnaissance d’objets. En conclusion, cette thèse a permis de décrire avec précision la dynamique spatio-temporelle de l’activité gamma induite et du rythme alpha ainsi que d’en apprendre davantage sur les rôles potentiels que ces deux rythmes occupent dans la reconnaissance d’objets.

Want to block earworms from conscious awareness?B(u)y gum!

Three experiments examine the role of articulatory motor planning in experiencing an involuntary musical recollection (an “earworm”). Experiment 1 shows that interfering with articulatory motor programming by chewing gum reduces both the number of voluntary and the number of involuntary—unwanted—musical thoughts. This is consistent with other findings that chewing gum interferes with voluntary processes such as recollections from verbal memory, the interpretation of ambiguous auditory images, and the scanning of familiar melodies, but is not predicted by theories of thought suppression, which assume that suppression is made more difficult by concurrent tasks or cognitive loads. Experiment 2 shows that chewing the gum affects the experience of “hearing” the music and cannot be ascribed to a general effect on thinking about a tune only in abstract terms. Experiment 3 confirms that the reduction of musical recollections by chewing gum is not the consequence of a general attentional or dual-task demand. The data support a link between articulatory motor programming and the appearance in consciousness of both voluntary and unwanted musical recollections.

Measuring audience response on-line : an evaluation of the portable audience response facility (pARF)

If it is the case that artists and art explore organization of the brain (Zeki & Lamb, 1994), then the investigation of response to artistic performance holds promise as a window to perceptual and cognitive processes. The portable Audience Response Facility (pARF) is an instrument for recording real‐time audience response (Stevens et al. 2009). Twenty, handheld, Personal Digital Assistants (PDAs) collect responses on customizable skin interfaces. The pARF server transmits the customizable options, synchronizes devices and collects data for export. In this paper we report ratings of the usability of the pARF that were collected after 37 participants had used it to continuously rate engagement along a single dimension while a female dance artist gave two performances of a short solo contemporary dance work. The motion of the dancer was also captured as she performed the piece but only usability rating data are reported here. Ratings indicate that the cognitive load imposed by continuously rating engagement while watching a dance performance was manageable and the pARF was easy to use. An extended familiarization phase may further reduce dual task demand.

Características comportamentais do controle postural de jovens, adultos e idosos

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Perseveração motora em crianças: impacto da condição de deficiência mental

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Sex Differences in Semantic Processing: Event-Related Brain Potentials Distinguish between Lower and Higher Order Semantic Analysis during Word Reading

Behavioral studies suggest that women and men differ in the strategic elaboration of verbally encoded information especially in the absence of external task demand. However, measuring such covert processing requires other than behavioral data. The present study used event-related potentials to compare sexes in lower and higher order semantic processing during the passive reading of semantically related and unrelated word pairs. Women and men showed the same early context effect in the P1-N1 transition period. This finding indicates that the initial lexical-semantic access is similar in men and women. In contrast, sexes differed in higher order semantic processing. Women showed an earlier and longer lasting context effect in the N400 accompanied by larger signal strength in temporal networks similarly recruited by men and women. The results suggest that women spontaneously conduct a deeper semantic analysis. This leads to faster processing of related words in the active neural networks as reflected in a shorter stability of the N400 map in women. Taken together, the findings demonstrate that there is a selective sex difference in the controlled semantic analysis during passive word reading that is not reflected in different functional organization but in the depth of processing.