Automatic eye blink detection using consumer web cameras

This research aims to advance blinking detection in the context of work activity. Rather than patients having to attend a clinic, blinking videos can be acquired in a work environment, and further automatically analyzed. Therefore, this paper presents a methodology to perform the automatic detection of eye blink using consumer videos acquired with low-cost web cameras. This methodology includes the detection of the face and eyes of the recorded person, and then it analyzes the low-level features of the eye region to create a quantitative vector. Finally, this vector is classified into one of the two categories considered —open and closed eyes— by using machine learning algorithms. The effectiveness of the proposed methodology was demonstrated since it provides unbiased results with classification errors under 5%

Eye blink in newborn and preschool-age children

Purpose: To investigate the dynamics of ocular eyelid movements in newborn infants and preschool-age children.Methods: Fifty newborn infants and 200 preschool children aged 4-6 years were examined. Images of each child, with his or her eyes in the primary eye position looking at an object placed at the child's height, were recorded with a digital videocamera for 3 mins. Complete and incomplete blink rates, opening, closing and complete blink times were calculated.Results: Newborn infants presented a lower number of incomplete movements than preschool children. The complete blink rate was lower in newborn infants (6.2 blinks/min) than in preschool children (8.0 blinks/minute). Eyelid closing, opening and compete blink times were longer in newborn infants than in preschool children at all observation times.Conclusions: Newborn infants had a different pattern of eyelid movement compared with preschool children. Specific characteristics that are found in this group of children particularly, such as immaturity of the neural system and more resistant tear film, may explain these findings in part.

Spontaneous eye blink analysis in the normal individual

Purpose: Spontaneous eye blink activity in the primary eye position and its relationship to age and gender were assessed using digital image processing techniques to quantify blink opening and closing time. Methods: One hundred-and-eighty healthy volunteers (90 males and 90 females), divided into the age groups 0-3, 4-12, 13-20, 21-40, 41-60 and ≥60 years old, were evaluated prospectively. They were videotaped digitally in a standard setting and the images were transferred to a personal computer (Macintosh 400) and processed with the iMovie software. Blink opening and closing time were measured at 30 frames/second. The data were then subjected to statistical analysis. Results: The closing time was significantly longer than the opening time for all ages and both genders. Elderly individuals (≥41 years old) and women had significantly longer closing times. Conclusion: Image processing techniques made possible the observation of differences in spontaneous eye blink opening and closing time in relation to age and gender. Copyright © 2005 Taylor & Francis LLC.

Inactivation of the superior cerebellar peduncle blocks expression but not acquisition of the rabbit's classically conditioned eye-blink response.

The localization of sites of memory formation within the mammalian brain has proven to be a formidable task even for simple forms of learning and memory. Recent studies have demonstrated that reversibly inactivating a localized region of cerebellum, including the dorsal anterior interpositus nucleus, completely prevents acquisition of the conditioned eye-blink response with no effect upon subsequent learning without inactivation. This result indicates that the memory trace for this type of learning is located either (i) within this inactivated region of cerebellum or (ii) within some structure(s) efferent from the cerebellum to which output from the interpositus nucleus ultimately projects. To distinguish between these possibilities, two groups of rabbits were conditioned (by using two conditioning stimuli) while the output fibers of the interpositus (the superior cerebellar peduncle) were reversibly blocked with microinjections of the sodium channel blocker tetrodotoxin. Rabbits performed no conditioned responses during this inactivation training. However, training after inactivation revealed that the rabbits (trained with either conditioned stimulus) had fully learned the response during the previous inactivation training. Cerebellar output, therefore, does not appear to be essential for acquisition of the learned response. This result, coupled with the fact that inactivation of the appropriate region of cerebellum completely prevents learning, provides compelling evidence supporting the hypothesis that the essential memory trace for the classically conditioned eye-blink response is localized within the cerebellum.

Covariation and interference between physiological reflexes: Eye-blink startle cardiac defense, and skin conductance

Comparative studies of autonomic and somatic reflexes, such as cardiac defense and motor startle, are rare. However, examination of the pattern of covariation, independence, or interference among physiological reflexes may help to clarify their functional significance and elucidate their complex modulation by psychological factors. Here we report the results of a study that examined the pattern of interference of eye-blink startle on subsequent cardiac defense. Participants were 63 students (31 women) distributed into three groups according to the sensory modality of the eliciting stimulus during the startle trials: acoustic high intensity (105 dB), acoustic low intensity (65 dB), and visual modality. Startle trials consisted of 12 presentations of the eliciting stimulus with a duration of 50 ms, instantaneous risetime, and a variable inter-stimulus interval of 16 – 20 s.Defense trials began 20 s after the last startle trial and consisted, for all groups, of 3 presentations of the high intensity acoustic stimulus with a duration of 500 ms and an inter-stimulus interval of 215 s. Results showed a clear interference of the startle trials on the subsequent defense trials when both types of trials shared identical sensory modality (acoustic) independently of intensity: the expected pattern of cardiac defense in the first trial only appeared in the visual modality. Similar interference effects were observed in the skin conductance response. Subjective reactivity to the defense stimulus did not detect differences between conditions.

The effect of repeated prepulse and reflex stimulus presentations on startle prepulse inhibition

The magnitude of a startle reflex is inhibited if the reflex-eliciting stimuli is preceded by a prepulse stimulus at a short lead interval. Previous research in humans has shown that the extent of prepulse inhibition decreases over repeated presentations of reflex stimuli and prepulse-reflex stimulus pairings. The present study (N=70) investigated the effect of repeated presentations of prepulse stimuli, reflex stimuli, or prepulse-reflex stimulus pairings on prepulse inhibition. Five groups of subjects were presented during habituation training with either (a) reflex stimuli, (b) prepulse-reflex stimulus pairings, (c) a random sequence of prepulse and reflex stimuli, (d) prepulse stimuli, or (e) experimentally irrelevant light stimuli. Prepulse inhibition was reduced if startle stimuli were presented during habituation ((a), (b), (c)), but not after repeated presentation of the prepulse or the light stimulus ((d), (e)). The reduction in prepulse inhibition was abolished after dishabituation of the startle reflex. The present results indicate that habituation of the startle reflex can result in a reduction of prepulse inhibition. (C) 1998 Elsevier Science B.V.

Análise da sonolência na condução rodoviária a partir de sinais EEG

A Sociedade Europeia de Pesquisa do Sono realizou muito recentemente um estudo, onde mostrou que a prevalência média de adormecimento ao volante nos últimos 2 anos foi de 17%. Além disto, tem sido provado por todo o mundo que a sonolência durante a condução é uma das principais causas de acidentes de trânsito. Torna-se assim conveniente, o desenvolvimento de sistemas que analisem a suscetibilidade de um determinado condutor para adormecer no trânsito, bem como de ferramentas que monitorem em tempo real o estado físico e mental do condutor, para alertarem nos momentos críticos. Apesar do estudo do sono se ter iniciado há vários anos, a maioria das investigações focaram-se no ciclo normal do sono, estudando os indivíduos de forma relaxada e de olhos fechados. Só mais recentemente, têm surgido os estudos que se focam nas situações de sonolência em atividade, como _e o caso da condução. Uma grande parte Dos estudos da sonolência em condução têm utilizado a eletroencefalografia (EEG), de forma a perceber se existem alterações nas diferentes bandas de frequência desta, que possam indicar o estado de sonolência do condutor. Além disso, a evolução da sonolência a partir de alterações no piscar dos olhos (que podem ser vistas nos sinais EEG) também tem sido alvo de grande pesquisa, tendo vindo a revelar resultados bastante promissores. Neste contexto e em parceria com a empresa HealthyRoad, esta tese está integrada no projeto HealthyDrive, que visa o desenvolvimento de um sistema de alerta e deteção de sinais de fadiga e sonolência nos condutores de veículos automóveis. A contribuição desta tese no projeto prendeu-se com o estudo da sonolência dos indivíduos em condução a partir de sinais EEG, para desta forma investigar possíveis indicadores dos diferentes níveis desta que possam ser utilizados pela empresa no projeto. Foram recolhidos e analisados 17 sinais EEG de indivíduos em simulação de condução. Além disso foram desenvolvidos dois métodos de análise destes sinais: O primeiro para a deteção e análise dos piscar de olhos a partir de EEG, o segundo para análise do espetro de potência. Ambos os métodos foram utilizados para analisar os sinais recolhidos e investigar que tipo de relação existe entre a sonolência do condutor e as alterações nos piscares dos olhos, bem como as alterações do espetro do EEG. Os resultados mostraram uma correlação entre a duração do piscar de olhos e a sonolência do condutor. Com o aumento da sonolência velicou-se um aumento da duração do piscar, desencadeado principalmente pelo aumento na duração de fecho, que chegou aos 51.2%. Em relação ao espectro de potência, os resultados sugerem que a potência relativa de todas as bandas analisadas fornecem informações relevantes sobre a sonolência do condutor. Além disso, o parâmetro (_+_)/_ demostrou estar relacionado com variações da sonolência, diminuindo com o seu avanço e aumentando significativamente (111%) no instante em que os condutores adormeceram.

Respiration, metabolic balance, and attention in affective picture processing

The jointly voluntary and involuntary control of respiration, unique among essential physiological processes, the interconnection of breathing with and its influence on the autonomic nervous system, and disease states associated with the interface between psychology and respiration (e.g., anxiety disorders, hyperventilation syndrome, asthma) make the study of the relationship between respiration and emotion both theoretically and clinically of great relevance. However, the respiratory behavior during affective states is not yet completely understood. We studied breathing pattern responses to 13 picture series varying widely in their affective tone in 37 adults (18 men, 19 women, mean age 26). Time and volume parameters were recorded with the LifeShirt system (VivoMetrics Inc., Ventura, California, USA, see image). We also measured end-tidal pCO2 (EtCO2) with a Microcap Handheld Capnograph (Oridion Medical 1987 Ltd., Jerusalem, Israel) to determine if ventilation is in balance with metabolic demands and spontaneous eye-blinking to investigate the link between respiration and attention. At the end of each picture series, the participants reported their subjective feeling in the affective dimensions of pleasantness and arousal. Increasing self-rated arousal was associated with increasing minute ventilation but not with decreases in EtCO2, suggesting that ventilatory changes during picture viewing paralleled variations in metabolic activity. EtCO2 correlated with pleasantness, and eye-blink rate decreased with increasing unpleasantness in line with a negativity bias in attention. Like MV, inspiratory drive (i.e., mean inspiratory flow) increased with arousal. This relationship reflected increases in inspiratory volume rather than shortening of the time parameters. This study confirms that respiratory responses to affective stimuli are organized to a certain degree along the dimensions of pleasantness and arousal. It shows, for the first time, that during picture viewing, ventilatory increases with increasing arousal are in balance with metabolic activity and that inspiratory volume is modulated by arousal. MV emerges as the most reliable respiratory index of self-perceived arousal. Finally, end-tidal pCO2 is slightly lower during processing of negative as compared to positive picture contents, which is proposed to enhance sensory perception and reflect a negativity bias in attention.

Respiration, metabolic balance, and attention in affective picture processing

The respiratory behavior during affective states is not completely understood. We studied breathing pattern responses to picture series in 37 participants. We also measured end-tidal pCO2 (EtCO2) to determine if ventilation is in balance with metabolic demands and spontaneous eye-blinking to investigate the link between respiration and attention. Minute ventilation (MV) and inspiratory drive increased with self-rated arousal. These relationships reflected increases in inspiratory volume rather than shortening of the time parameters. EtCO2 covaried with pleasantness but not arousal. Eye-blink rate decreased with increasing unpleasantness in line with a negativity bias in attention. This study confirms that respiratory responses to affective stimuli are organized to a certain degree along the dimensions of valence and arousal. It shows, for the first time, that during picture viewing, ventilatory increases with increasing arousal are in balance with metabolic activity and that inspiratory volume is modulated by arousal. MV emerges as the most reliable respiratory index of self-perceived arousal

Pharmacology of human experimental anxiety

This review covers the effect of drugs affecting anxiety using four psychological procedures for inducing experimental anxiety applied to healthy volunteers and patients with anxiety disorders. The first is aversive conditioning of the skin conductance responses to tones. The second is simulated public speaking, which consists of speaking in front of a video camera, with anxiety being measured with psychometric scales. The third is the Stroop Color-Word test, in which words naming colors are painted in the same or in a different shade, the incongruence generating a cognitive conflict. The last test is a human version of a thoroughly studied animal model of anxiety, fear-potentiated startle, in which the eye-blink reflex to a loud noise is recorded. The evidence reviewed led to the conclusion that the aversive conditioning and potentiated startle tests are based on classical conditioning of anticipatory anxiety. Their sensitivity to benzodiazepine anxiolytics suggests that these models generate an emotional state related to generalized anxiety disorder. On the other hand, the increase in anxiety determined by simulated public speaking is resistant to benzodiazepines and sensitive to drugs affecting serotonergic neurotransmission. This pharmacological profile, together with epidemiological evidence indicating its widespread prevalence, suggests that the emotional state generated by public speaking represents a species-specific response that may be related to social phobia and panic disorder. Because of scant pharmacological data, the status of the Stroop Color-Word test remains uncertain. In spite of ethical and economic constraints, human experimental anxiety constitutes a valuable tool for the study of the pathophysiology of anxiety disorders.

Modulation du réflexe acoustique de sursaut et de l’inhibition par le prépulse : une comparaison entre les jeunes adultes et les âgés

Une des théories actuellement prépondérante pour expliquer le déclin cognitif observé chez les personnes âgées est une perte généralisée de la fonction inhibitrice. En revanche, de plus en plus d’études révèlent un maintien et même un gain sur le plan émotionnel chez les âgés. Afin de caractériser l’effet de l’âge sur la fonction inhibitrice et sur les émotions, nous avons utilisé le paradigme bien connu du réflexe acoustique de sursaut et de son inhibition par le prépulse, un phénomène reconnu comme reflétant le filtrage sensorimoteur, soit une mesure pré-attentionnelle d’inhibition. Le réflexe acoustique de sursaut est une réponse du corps tout entier à un bruit fort et inattendu et a été mesuré via la magnitude et la latence du clignement des yeux. La présentation d’un son faible (prépulse) quelques millisecondes avant le bruit de sursaut réduit la réponse de sursaut. Deux groupes de participants (jeunes adultes et âgés) ont visionné des images plaisantes, neutres et déplaisantes issues du International Affective Picture System (IAPS), lesquelles étaient associées à des stimuli auditifs évaluant le réflexe acoustique de sursaut et son inhibition par le prépulse. Les résultats démontrent que le réflexe de sursaut est modulé différemment par les émotions chez les jeunes adultes et les âgés. Plus particulièrement, les adultes âgés ont un plus grand réflexe de sursaut que les jeunes adultes lorsqu’ils visionnent des images plaisantes et neutres. Le processus d’inhibition par le prépulse est également modulé différemment par les émotions chez les âgés et les jeunes adultes: les âgés ont une plus grande inhibition du réflexe de sursaut que les jeunes adultes lorsqu’ils visionnent des images plaisantes et déplaisantes, mais ils ne diffèrent pas des jeunes adultes pour les images neutres. Dans l’ensemble, les résultats obtenus ne sont pas compatibles avec une perte d’inhibition chez les adultes âgés, et supportent plutôt un biais émotionnel positif.

Le sens du goût chez l'aveugle congénital

Thèse réalisée en collaboration avec le Département de neurosciences et pharmacologie de l'Université de Copenhague, Danemark.

Aging is associated with positive responding to neutral information but reduced recovery from negative information

Studies on aging and emotion suggest an increase in reported positive affect, a processing bias of positive over negative information, as well as increasingly adaptive regulation in response to negative events with advancing age. These findings imply that older individuals evaluate information differently, resulting in lowered reactivity to, and/or faster recovery from, negative information, while maintaining more positive responding to positive information. We examined this hypothesis in an ongoing study on Midlife in the US (MIDUS II) where emotional reactivity and recovery were assessed in a large number of respondents (N = 159) from a wide age range (36–84 years). We recorded eye-blink startle magnitudes and corrugator activity during and after the presentation of positive, neutral and negative pictures. The most robust age effect was found in response to neutral stimuli, where increasing age is associated with a decreased corrugator and eyeblink startle response to neutral stimuli. These data suggest that an age-related positivity effect does not essentially alter the response to emotion-laden information, but is reflected in a more positive interpretation of affectively ambiguous information. Furthermore, older women showed reduced corrugator recovery from negative pictures relative to the younger women and men, suggesting that an age-related prioritization of well-being is not necessarily reflected in adaptive regulation of negative affect.

A statistical approach to the problem of restoring damaged and contaminated images

We address the problem of automatically identifying and restoring damaged and contaminated images. We suggest a novel approach based on a semi-parametric model. This has two components, a parametric component describing known physical characteristics and a more flexible non-parametric component. The latter avoids the need for a detailed model for the sensor, which is often costly to produce and lacking in robustness. We assess our approach using an analysis of electroencephalographic images contaminated by eye-blink artefacts and highly damaged photographs contaminated by non-uniform lighting. These experiments show that our approach provides an effective solution to problems of this type.