Signal processing of physiological signals for automated assessment of stress in computer users

The need to provide computers with the ability to distinguish the affective state of their users is a major requirement for the practical implementation of affective computing concepts. This dissertation proposes the application of signal processing methods on physiological signals to extract from them features that can be processed by learning pattern recognition systems to provide cues about a person's affective state. In particular, combining physiological information sensed from a user's left hand in a non-invasive way with the pupil diameter information from an eye-tracking system may provide a computer with an awareness of its user's affective responses in the course of human-computer interactions. In this study an integrated hardware-software setup was developed to achieve automatic assessment of the affective status of a computer user. A computer-based "Paced Stroop Test" was designed as a stimulus to elicit emotional stress in the subject during the experiment. Four signals: the Galvanic Skin Response (GSR), the Blood Volume Pulse (BVP), the Skin Temperature (ST) and the Pupil Diameter (PD), were monitored and analyzed to differentiate affective states in the user. Several signal processing techniques were applied on the collected signals to extract their most relevant features. These features were analyzed with learning classification systems, to accomplish the affective state identification. Three learning algorithms: Naïve Bayes, Decision Tree and Support Vector Machine were applied to this identification process and their levels of classification accuracy were compared. The results achieved indicate that the physiological signals monitored do, in fact, have a strong correlation with the changes in the emotional states of the experimental subjects. These results also revealed that the inclusion of pupil diameter information significantly improved the performance of the emotion recognition system. ^

Endocrine regulation of dynamic communication signals in gymnotiform fish

Communication signals are shaped by the opposing selection pressures imposed by predators and mates. A dynamic signal might serve as an adaptive compromise between an inconspicuous signal that evades predators and an extravagant signal preferred by females. Such a signal has been described in the gymnotiform electric fish, Brachyhypopomus gauderio, which produces a sexually dimorphic electric organ discharge (EOD). The EOD varies on a circadian rhythm and in response to social cues. This signal plasticity is mediated by the slow action of androgens and rapid action of melanocortins. My dissertation research tested the hypotheses that (1) signal plasticity is related to sociality levels in gymnotiform species, and (2) differences in signal plasticity are regulated by differential sensitivity to androgen and melanocortin hormones. To assess the breadth of dynamic signaling within the order Gymnotiformes, I sampled 13 species from the five gymnotiform families. I recorded EODs to observe spontaneous signal oscillations after which I injected melanocortin hormones, saline control, or presented the fish with a conspecific. I showed that through the co-option of the ancient melanocortin pathway, gymnotiforms dynamically regulate EOD amplitude, spectral frequency, both, or neither. To investigate whether observed EOD plasticities are related to species-specific sociality I tested four species; two territorial, highly aggressive species, Gymnotus carapo and Apteronotus leptorhynchus, a highly gregarious species, Eigenmannia cf. virescens , and an intermediate short-lived species with a fluid social system, Brachyhypopomus gauderio. I examined the relationship between the androgens testosterone and 11-ketotestosterone, the melanocortin α-MSH, and their roles in regulating EOD waveform. I implanted all fish with androgen and blank silicone implants, and injected with α-MSH before and at the peak of implant effect. I found that waveforms of the most territorial and aggressive species were insensitive to hormone treatments; maintaining a static, stereotyped signal that preserves encoding of individual identity. Species with a fluid social system were most responsive to hormone treatments, exhibiting signals that reflect immediate condition and reproductive state. In conclusion, variation in gymnotiform signal plasticity is hormonally regulated and seems to reflect species-specific sociality.