A practical system for hands-off computer interaction based on electromyogram (EMG)/eye gaze tracking (EGT)

Effective interaction with personal computers is a basic requirement for many of the functions that are performed in our daily lives. With the rapid emergence of the Internet and the World Wide Web, computers have become one of the premier means of communication in our society. Unfortunately, these advances have not become equally accessible to physically handicapped individuals. In reality, a significant number of individuals with severe motor disabilities, due to a variety of causes such as Spinal Cord Injury (SCI), Amyothrophic Lateral Sclerosis (ALS), etc., may not be able to utilize the computer mouse as a vital input device for computer interaction. The purpose of this research was to further develop and improve an existing alternative input device for computer cursor control to be used by individuals with severe motor disabilities. This thesis describes the development and the underlying principle for a practical hands-off human-computer interface based on Electromyogram (EMG) signals and Eye Gaze Tracking (EGT) technology compatible with the Microsoft Windows operating system (OS). Results of the software developed in this thesis show a significant improvement in the performance and usability of the EMG/EGT cursor control HCI.

Signal processing and information fusing algorithms for the synthesis of an alternative electromyogram/eye gaze tracking computer cursor control system

This research pursued the conceptualization and real-time verification of a system that allows a computer user to control the cursor of a computer interface without using his/her hands. The target user groups for this system are individuals who are unable to use their hands due to spinal dysfunction or other afflictions, and individuals who must use their hands for higher priority tasks while still requiring interaction with a computer. ^ The system receives two forms of input from the user: Electromyogram (EMG) signals from muscles in the face and point-of-gaze coordinates produced by an Eye Gaze Tracking (EGT) system. In order to produce reliable cursor control from the two forms of user input, the development of this EMG/EGT system addressed three key requirements: an algorithm was created to accurately translate EMG signals due to facial movements into cursor actions, a separate algorithm was created that recognized an eye gaze fixation and provided an estimate of the associated eye gaze position, and an information fusion protocol was devised to efficiently integrate the outputs of these algorithms. ^ Experiments were conducted to compare the performance of EMG/EGT cursor control to EGT-only control and mouse control. These experiments took the form of two different types of point-and-click trials. The data produced by these experiments were evaluated using statistical analysis, Fitts' Law analysis and target re-entry (TRE) analysis. ^ The experimental results revealed that though EMG/EGT control was slower than EGT-only and mouse control, it provided effective hands-free control of the cursor without a spatial accuracy limitation, and it also facilitated a reliable click operation. This combination of qualities is not possessed by either EGT-only or mouse control, making EMG/EGT cursor control a unique and practical alternative for a user's cursor control needs. ^

Signal processing of physiological signals for automated assessment of stress in computer users

The need to provide computers with the ability to distinguish the affective state of their users is a major requirement for the practical implementation of affective computing concepts. This dissertation proposes the application of signal processing methods on physiological signals to extract from them features that can be processed by learning pattern recognition systems to provide cues about a person's affective state. In particular, combining physiological information sensed from a user's left hand in a non-invasive way with the pupil diameter information from an eye-tracking system may provide a computer with an awareness of its user's affective responses in the course of human-computer interactions. In this study an integrated hardware-software setup was developed to achieve automatic assessment of the affective status of a computer user. A computer-based "Paced Stroop Test" was designed as a stimulus to elicit emotional stress in the subject during the experiment. Four signals: the Galvanic Skin Response (GSR), the Blood Volume Pulse (BVP), the Skin Temperature (ST) and the Pupil Diameter (PD), were monitored and analyzed to differentiate affective states in the user. Several signal processing techniques were applied on the collected signals to extract their most relevant features. These features were analyzed with learning classification systems, to accomplish the affective state identification. Three learning algorithms: Naïve Bayes, Decision Tree and Support Vector Machine were applied to this identification process and their levels of classification accuracy were compared. The results achieved indicate that the physiological signals monitored do, in fact, have a strong correlation with the changes in the emotional states of the experimental subjects. These results also revealed that the inclusion of pupil diameter information significantly improved the performance of the emotion recognition system. ^

Space time coding for polynomial phase modulated signals

Polynomial phase modulated (PPM) signals have been shown to provide improved error rate performance with respect to conventional modulation formats under additive white Gaussian noise and fading channels in single-input single-output (SISO) communication systems. In this dissertation, systems with two and four transmit antennas using PPM signals were presented. In both cases we employed full-rate space-time block codes in order to take advantage of the multipath channel. For two transmit antennas, we used the orthogonal space-time block code (OSTBC) proposed by Alamouti and performed symbol-wise decoding by estimating the phase coefficients of the PPM signal using three different methods: maximum-likelihood (ML), sub-optimal ML (S-ML) and the high-order ambiguity function (HAF). In the case of four transmit antennas, we used the full-rate quasi-OSTBC (QOSTBC) proposed by Jafarkhani. However, in order to ensure the best error rate performance, PPM signals were selected such as to maximize the QOSTBC’s minimum coding gain distance (CGD). Since this method does not always provide a unique solution, an additional criterion known as maximum channel interference coefficient (CIC) was proposed. Through Monte Carlo simulations it was shown that by using QOSTBCs along with the properly selected PPM constellations based on the CGD and CIC criteria, full diversity in flat fading channels and thus, low BER at high signal-to-noise ratios (SNR) can be ensured. Lastly, the performance of symbol-wise decoding for QOSTBCs was evaluated. In this case a quasi zero-forcing method was used to decouple the received signal and it was shown that although this technique reduces the decoding complexity of the system, there is a penalty to be paid in terms of error rate performance at high SNRs.

Endocrine regulation of dynamic communication signals in gymnotiform fish

Communication signals are shaped by the opposing selection pressures imposed by predators and mates. A dynamic signal might serve as an adaptive compromise between an inconspicuous signal that evades predators and an extravagant signal preferred by females. Such a signal has been described in the gymnotiform electric fish, Brachyhypopomus gauderio, which produces a sexually dimorphic electric organ discharge (EOD). The EOD varies on a circadian rhythm and in response to social cues. This signal plasticity is mediated by the slow action of androgens and rapid action of melanocortins. My dissertation research tested the hypotheses that (1) signal plasticity is related to sociality levels in gymnotiform species, and (2) differences in signal plasticity are regulated by differential sensitivity to androgen and melanocortin hormones. To assess the breadth of dynamic signaling within the order Gymnotiformes, I sampled 13 species from the five gymnotiform families. I recorded EODs to observe spontaneous signal oscillations after which I injected melanocortin hormones, saline control, or presented the fish with a conspecific. I showed that through the co-option of the ancient melanocortin pathway, gymnotiforms dynamically regulate EOD amplitude, spectral frequency, both, or neither. To investigate whether observed EOD plasticities are related to species-specific sociality I tested four species; two territorial, highly aggressive species, Gymnotus carapo and Apteronotus leptorhynchus, a highly gregarious species, Eigenmannia cf. virescens , and an intermediate short-lived species with a fluid social system, Brachyhypopomus gauderio. I examined the relationship between the androgens testosterone and 11-ketotestosterone, the melanocortin α-MSH, and their roles in regulating EOD waveform. I implanted all fish with androgen and blank silicone implants, and injected with α-MSH before and at the peak of implant effect. I found that waveforms of the most territorial and aggressive species were insensitive to hormone treatments; maintaining a static, stereotyped signal that preserves encoding of individual identity. Species with a fluid social system were most responsive to hormone treatments, exhibiting signals that reflect immediate condition and reproductive state. In conclusion, variation in gymnotiform signal plasticity is hormonally regulated and seems to reflect species-specific sociality.

Transcriptome Analysis Reveals New Insights into the Modulation of Endometrial Stromal Cell Receptive Phenotype by Embryo-Derived Signals Interleukin-1 and Human Chorionic Gonadotropin: Possible Involvement in Early Embryo Implantation

The presence of the conceptus in uterine cavity necessitates an elaborate network of interactions between the implanting embryo and a receptive endometrial tissue. We believe that embryo-derived signals play an important role in the remodeling and the extension of endometrial receptivity period. Our previous studies provided original evidence that human Chorionic Gonadotropin (hCG) modulates and potentiates endometrial epithelial as well as stromal cell responsiveness to interleukin 1 (IL1), one of the earliest embryonic signals, which may represent a novel pathway by which the embryo favors its own implantation and growth within the maternal endometrial host. The present study was designed to gain a broader understanding of hCG impact on the modulation of endometrial cell receptivity, and in particular, cell responsiveness to IL1 and the acquisition of growth-promoting phenotype capable of receiving, sustaining, and promoting early and crucial steps of embryonic development. Our results showed significant changes in the expression of genes involved in cell proliferation, immune modulation, tissue remodeling, apoptotic and angiogenic processes. This points to a relevant impact of these embryonic signals on the receptivity of the maternal endometrium, its adaptation to the implanting embryo and the creation of an environment that is favorable for the implantation and the growth of this latter within a new and likely hostile host tissue. Interestingly our data further identified a complex interaction between IL1 and hCG, which, despite a synergistic action on several significant endometrial target genes, may encompass a tight control of endogenous IL1 and extends to other IL1 family members.

Paleoenvironments and geochemical signals from the late Barremian to the middle Aptian in a Tethyan marginal basin, northeast Spain: Implications for carbon sequestration in restricted basins

The hallmark of oceanic anoxic event 1a (OAE1a) (early Aptian ~125 Ma) corresponds to worldwide deposition of black shales with total organic carbon (TOC) content > 2% and a δ13C positive excursion up to ~5‰. OAE1a has been related to large igneous province volcanism and dissociation of methane hydrates during the Lower Cretaceous. However, the occurrence of atypical, coeval and diachronous organic-rich deposits associated with OAE1a, which are also characterized by positive spikes of the δ 13C in epicontinental to restricted marine environments of the Tethys Ocean, indicates localized responses decoupled from complex global forcing factors. ^ The present research is a high-resolution, multiproxy approach to assess the paleoenvironmental conditions that led to enhanced carbon sequestration from the late Barremian to the middle Aptian in a restricted, Tethyan marginal basin prior to and during OAE1a. I studied the lower 240 m of the El Pui section, Organyà Basin, Spanish Pyrenees. The basin developed as the result of extensional tectonism linked to the opening of the Atlantic Ocean. At the field scale the section consists of a sequence of alternating beds of cm – m-scale, medium-gray to grayish-black limestones and marlstones with TOC up to ~4%. ^ The results indicate that the lowest 85 m of the section, from latest Barremian -earliest Aptian, characterize a deepening phase of the basin concomitant with sustained riverine flux and intensified primary productivity. These changes induced a shift in the sedimentation pattern and decreased the oxygen levels in the water column through organic matter respiration and limited ventilation of the basin. ^ The upper 155 m comprising the earliest – late-early Aptian document the occurrence of OAE1a and its associated geochemical signatures (TOC up to 3% and a positive shift in δ13C of ~5‰). However, a low enrichment of redox-sensitive trace elements indicates that the basin did not achieve anoxic conditions. The results also suggest that a shallower-phase of the basin, coeval with platform progradation, may have increased ventilation of the basin at the same time that heightened sedimentation rates and additional input of organic matter from terrestrial sources increased the burial and preservation rate of TOC in the sediment.^

Paleoenvironments and Geochemical Signals from the Late Barremian to the Middle Aptian in a Tethyan Marginal Basin, Northeast Spain: Implications for Carbon Sequestration in Restricted Basins

The hallmark of oceanic anoxic event 1a (OAE1a) (early Aptian ~125 Ma) corresponds to worldwide deposition of black shales with total organic carbon (TOC) content > 2% and a d13C positive excursion up to ~5‰. OAE1a has been related to large igneous province volcanism and dissociation of methane hydrates during the Lower Cretaceous. However, the occurrence of atypical, coeval and diachronous organic-rich deposits associated with OAE1a, which are also characterized by positive spikes of the d13C in epicontinental to restricted marine environments of the Tethys Ocean, indicates localized responses decoupled from complex global forcing factors. The present research is a high-resolution, multiproxy approach to assess the paleoenvironmental conditions that led to enhanced carbon sequestration from the late Barremian to the middle Aptian in a restricted, Tethyan marginal basin prior to and during OAE1a. I studied the lower 240 m of the El Pui section, Organyà Basin, Spanish Pyrenees. The basin developed as the result of extensional tectonism linked to the opening of the Atlantic Ocean. At the field scale the section consists of a sequence of alternating beds of cm – m-scale, medium-gray to grayish-black limestones and marlstones with TOC up to ~4%. The results indicate that the lowest 85 m of the section, from latest Barremian –earliest Aptian, characterize a deepening phase of the basin concomitant with sustained riverine flux and intensified primary productivity. These changes induced a shift in the sedimentation pattern and decreased the oxygen levels in the water column through organic matter respiration and limited ventilation of the basin. The upper 155 m comprising the earliest – late-early Aptian document the occurrence of OAE1a and its associated geochemical signatures (TOC up to 3% and a positive shift in d13C of ~5‰). However, a low enrichment of redox-sensitive trace elements indicates that the basin did not achieve anoxic conditions. The results also suggest that a shallower-phase of the basin, coeval with platform progradation, may have increased ventilation of the basin at the same time that heightened sedimentation rates and additional input of organic matter from terrestrial sources increased the burial and preservation rate of TOC in the sediment.