Seeing Spaces: An Eye-Tracking Study Of Speech Segmentation

Speech is often a multimodal process, presented audiovisually through a talking face. One area of speech perception influenced by visual speech is speech segmentation, or the process of breaking a stream of speech into individual words. Mitchel and Weiss (2013) demonstrated that a talking face contains specific cues to word boundaries and that subjects can correctly segment a speech stream when given a silent video of a speaker. The current study expanded upon these results, using an eye tracker to identify highly attended facial features of the audiovisual display used in Mitchel and Weiss (2013). In Experiment 1, subjects were found to spend the most time watching the eyes and mouth, with a trend suggesting that the mouth was viewed more than the eyes. Although subjects displayed significant learning of word boundaries, performance was not correlated with gaze duration on any individual feature, nor was performance correlated with a behavioral measure of autistic-like traits. However, trends suggested that as autistic-like traits increased, gaze duration of the mouth increased and gaze duration of the eyes decreased, similar to significant trends seen in autistic populations (Boratston & Blakemore, 2007). In Experiment 2, the same video was modified so that a black bar covered the eyes or mouth. Both videos elicited learning of word boundaries that was equivalent to that seen in the first experiment. Again, no correlations were found between segmentation performance and SRS scores in either condition. These results, taken with those in Experiment, suggest that neither the eyes nor mouth are critical to speech segmentation and that perhaps more global head movements indicate word boundaries (see Graf, Cosatto, Strom, & Huang, 2002). Future work will elucidate the contribution of individual features relative to global head movements, as well as extend these results to additional types of speech tasks.

The Divine Eye in Ancient Egypt and in the Midrash Interpretation of Formative Judaism.

This paper studies the “eye” as a religious phenomenon from the multiple traditions of ancient Egypt compared with rabbinic Judaism in late antiquity using a semiotic approach based upon the theories of Umberto Eco. This method was chosen because the eye is a graphic as well as a linguistic sign which both express religious concepts. Generally, the eye represented an all-seeing and omnipresent divinity. In other words, the god was reduced to an eye, whereby the form of the symbol suggests a meaning to the viewer or religious practitioner. In this manner the eye represented the whole body of a deity in Egyptian and the power of a discerning God in rabbinic texts. By focusing upon the semantic aspect of the eye metaphor in both Egyptian and rabbinic texts two religious traditions of the visually perceivable are analyzed from a semiotic perspective.