Reading hybrid texts : remarks on text/image transitions

The reading of printed materials implies the visual processing of information originated in two distinct semiotic systems. The rapid identification of redundancy, complementation or contradiction rhetoric strategies between the two information types may be crucial for an adequate interpretation of bimodal materials. Hybrid texts (verbal and visual) are particular instances of bimodal materials, where the redundant information is often neglected while the complementary and the contradictory ones are essential.Studies using the 504 ASL eye-tracking system while reading either additive or exhibiting captions (Baptista, 2009) revealed fixations on the verbal material and transitions between the written and the pictorial in a much higher number and duration than the initially foreseen as necessary to read the verbal text. We therefore hypothesized that confirmation strategies of the written information are taking place, by using information available in the other semiotic system.Such eye-gaze patterns obtained from denotative texts and pictures seem to contradict some of the scarce existing data on visual processing of texts and images, namely cartoons (Carroll, Young and Guertain, 1992), descriptive captions (Hegarty, 1992 a and b), and advertising images with descriptive and explanatory texts (cf. Rayner and Rotello, 2001, who refer to a previous reading of the whole text before looking at the image, or even Rayner, Miller and Rotello, 2008 who refer to an earlier and longer look at the picture) and seem to consolidate findings of Radach et al. (2003) on systematic transitions between text and image.By framing interest areas in the printed pictorial material of non redundant hybrid texts, we have identified the specific areas where transitions take place after fixations in the verbal text. The way those transitions are processed brings a new interest to further research.

Using eye-tracking to study anaphoric relations processing in European Portuguese

In this study we evaluate processing costs of different types of anaphoric expressions during reading. We consider three types of anaphoric expressions in Subject sentential position: a null pronoun (pro), and two gaps produced by syntactic movement: a WHvariable and a NP copy. Given that coreferential pro exhibits more referential weight than wh- and NP-gaps, and grounded on theories of referential processing based on relations of hierarchy and accessibility of the antecedent, we raise the hypothesis that the more dependent on its antecedent the anaphoric null constituent is, and the more minimal is the distance in terms of hierarchical structure between the anaphoric null element and its antecedent, the lower are the cognitive costs in processing. To test our hypothesis, we registered the eye movements with R6-HS ASL system of 20 Portuguese adult native speakers. Text regions including the selected anaphoric expressions were delimited and tagged. We analyzed the reading time of each region taking into account the number and duration of eye fixations per region; we used the reading time by character in milliseconds in order to compare values between regions of different length. We found a significant advantage in the reading time of the gaps arising from movement over the reading time of pro.

Emotion perception in pre-kindergarten school children at Central Institute for the Deaf

This paper studies the ability of pre-kindergarten students with both normal hearing and impaired hearing to identify emotions in speech through audition only. In addition, the study assesses whether a listener's familiarity with a speaker's voice has an effect on his/her ability to identify the emotion of the speaker.

Evaluating the efficacy of monaural vs. binaural FM fittings in children with auditory processing disorders

The purpose of this project was to determine whether a monaural FM or binaural FM fitting strategy is more appropriate for children with Auditory Processing Disorders.

Developing pragmatic skills at the pre-school level: a case study

This paper reviews a study undertaken to develop activities to help teach communicative functions of language.

Effect of auditory processing on the preference of monaural amplification for adults with symmetrical hearing loss

The purpose of this project was to determine if subjects with symmetrical hearing loss who prefer a monaural hearing aid fit to a binaural hearing aid fit may demonstrate an auditory processing disorder causing them to experience binaural interference when fit binaurally.

Are distortion levels a problem with digital signal processing hearing aids and frequency modulation (FM) systems?

The purpose of this study was to examine objective and subjective distortion present when frequency modulation (FM) systems were coupled with four digital signal processing (DSP) hearing aids. Electroacoustic analysis and subjective listening tests by experienced audiologists revealed that distortion levels varied across hearing aids and channels.

The reassessment of central auditory processing disorders in children 7 to 12 years of age

This paper provides a review of central auditory processing disorders in children.

Central auditory processing: a current literature review and summary of interviews with researchers on controversial issues related to auditory processing disorders

This paper discusses issues related to Auditory Processing Disorders (ADP) evaluation and management, focusing mainly on the disorder in children.

An analysis of chart stories from the pre-primary department, 1973-74

This paper is an analysis of Chart Stories made by teachers at CID and their effectiveness as a language development tool.

Analisis del lenguaje provocado: nivel pre-oracional

This paper is a Spanish language version of the CID GAEL-P test

Phonological processing in the reading of deaf and normally hearing children

This paper reviews measurement of phonological processes in reading among deaf children and children who are of normal hearing.

The effect of pre-implant puretone thresholds on post-implant speech perception ability in children

This paper studies the effect of residual hearing on post-implant speech perception in children with cochlear implants. The effect of pre-implant auditory experience and the effect of neuronal survival in the implanted ear were investigated.

Compensatory signal processing for profoundly hearing-impaired listeners: the transmission of fundamental frequency

This paper reviews a study to determine the usefulness of signal processing along with lipreading in improving speech perception of profoundly hearing impaired persons.

Relationship among otoacoustic emission suppression and auditory processing measures in adults

The purpose of this Capstone Project is to help determine whether performing otoacoustic emissions with contralateral noise may be used in the diagnosis of Auditory Processing Disorder.