Impact of captions on deaf and hearing perception of multimedia video clips

We investigate the impact of captions on deaf and hearing perception of multimedia video clips. We measure perception using a parameter called Quality of Perception (QoP), which encompasses not only a user's satisfaction with multimedia clips, but also his/her ability to perceive, synthesise and analyse the informational content of such presentations. By studying perceptual diversity, it is our aim to identify trends that will help future implementation of adaptive multimedia technologies. Results show that although hearing level has a significant affect on information assimilation, the effect of captions is not significant on the objective level of information assimilated. Deaf participants predict that captions significantly improve their level of information assimilation, although no significant objective improvement was measured. The level of enjoyment is unaffected by a participant’s level of hearing or use of captions.

Identificação de contrastes vocálicos do Português Brasileiro

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Spatial hearing and sound perception in musical composition

This thesis explores the possibilities of spatial hearing in relation to sound perception, and presents three acousmatic compositions based on a musical aesthetic that emphasizes this relation in musical discourse. The first important characteristic of these compositions is the exclusive use of sine waves and other time invariant sound signals. Even though these types of sound signals present no variations in time, it is possible to perceive pitch, loudness, and tone color variations as soon as they move in space due to acoustic processes involved in spatial hearing. To emphasize the perception of such variations, this thesis proposes to divide a tone in multiple sound units and spread them in space using several loudspeakers arranged around the listener. In addition to the perception of sound attribute variations, it is also possible to create rhythm and texture variations that depend on how sound units are arranged in space. This strategy permits to overcome the so called "sound surrogacy" implicit in acousmatic music, as it is possible to establish cause-effect relations between sound movement and the perception of sound attribute, rhythm, and texture variations. Another important consequence of using sound fragmentation together with sound spatialization is the possibility to produce diffuse sound fields independently from the levels of reverberation of the room, and to create sound spaces with a certain spatial depth without using any kind of artificial sound delay or reverberation.

The effects of hearing aid gain on speech perception and the articulation index

This paper discusses a study to determine if changes in aided articulation indices predict changes in aided speech perception ability.

The perception of vowels in hearing and hearing-impaired subjects

This paper examines the relationship between speech discrimination ability and vowel map accuracy and vowel map size.

Effects of combined electric and acoustic hearing on speech perception of a pediatric cochlear implant user

The primary objective of this study was to document the benefits and possible detriments of combining ipsilateral acoustic hearing in the cochlear implant ear of a patient with preserved low frequency residual hearing post cochlear implantation. The secondary aim was to examine the efficacy of various cochlear implant mapping and hearing aid fitting strategies in relation to electro-acoustic benefits.

The inner-relationship among lipreading ability, auditory speech perception ability, hearing loss, and language level in hearing impaired children

This paper reviews a study done to determine the correlation between lipreading, auditory speech perception, language abilities, and hearing loss levels in hearing impaired children.

A test of auditory-visual speech perception for hearing-impaired children

This paper discusses a test for speech perception and scoring to test likelihood of success with mainstreaming.

Evaluating lexically controlled word lists for open set speech perception testing in profoundly hearing impaired children

This paper evaluates speech perception testing in pediatric cochlear implant users. Using pre-recorded stimulus presentation, the author replicated an earlier experiment comparing the Lexical Neighborhood List (LNT) test to the Phonetically Balanced Kindergarten (PB-K) test in estimating speech perception abilities in hearing impaired children.

Conducive hearing loss: its effect on speech perception and language development

This paper discusses the effects of conducive hearing loss on language development.

Word level speech perception under four levels of simulated profound hearing loss

This paper discusses a study to determine average performance on word discrimination tests using the CID Early Speech Perception Test (ESP).

Four discourse level speech perception under four levels of simulated profound hearing loss

This paper reviews a study to determine the maximum discourse level speech perception capabilities of profoundly deaf children in four speech perception categories as defined by the Early Speech Perception Test (ESP).

Frequency responses of hearing aids and their effects on the speech perception of eight hard-of-hearing subjects

This dissertation examines the relationship between frequency response and word-discrimination performance of hearing-impaired persons. Three questions are addressed: does the restoration of the normal field-to-eardrum transfer function improve word discrimination; is the restoration of the normal shape of the audibility curve (uniform hearing level at all frequencies) beneficial to hearing-impaired listeners; and can speech discrimination be improved by an extension of the present narrow-band response in hearing aids.

Evaluation of sentence perception of adults with hearing loss when using a video teleconferencing system

This study evaluate the speech perception of hearing-impaired adults (with varying degrees of deafness) when using a video teleconferencing system (an integrated service digital network).

The effect of talker age and gender on speech perception of pediatric hearing aid users

Even though pediatric hearing aid (HA) users listen most often to female talkers, clinically-used speech tests primarily consist of adult male talkers' speech. Potential effects of age and/or gender of the talker on speech perception of pediatric HA users were examined using two speech tests, hVd-vowel identification and CNC word recognition, and using speech materials spoken by four talker types (adult males, adult females, 10-12 year old girls, and 5-7 year old girls). For the nine pediatric HA users tested, word scores for the male talker's speech were higher than those for the female talkers, indicating that talker type can affect word recognition scores and that clinical tests may over-estimate everyday speech communication abilities of pediatric HA users.