Reading hybrid texts : remarks on text/image transitions

The reading of printed materials implies the visual processing of information originated in two distinct semiotic systems. The rapid identification of redundancy, complementation or contradiction rhetoric strategies between the two information types may be crucial for an adequate interpretation of bimodal materials. Hybrid texts (verbal and visual) are particular instances of bimodal materials, where the redundant information is often neglected while the complementary and the contradictory ones are essential.Studies using the 504 ASL eye-tracking system while reading either additive or exhibiting captions (Baptista, 2009) revealed fixations on the verbal material and transitions between the written and the pictorial in a much higher number and duration than the initially foreseen as necessary to read the verbal text. We therefore hypothesized that confirmation strategies of the written information are taking place, by using information available in the other semiotic system.Such eye-gaze patterns obtained from denotative texts and pictures seem to contradict some of the scarce existing data on visual processing of texts and images, namely cartoons (Carroll, Young and Guertain, 1992), descriptive captions (Hegarty, 1992 a and b), and advertising images with descriptive and explanatory texts (cf. Rayner and Rotello, 2001, who refer to a previous reading of the whole text before looking at the image, or even Rayner, Miller and Rotello, 2008 who refer to an earlier and longer look at the picture) and seem to consolidate findings of Radach et al. (2003) on systematic transitions between text and image.By framing interest areas in the printed pictorial material of non redundant hybrid texts, we have identified the specific areas where transitions take place after fixations in the verbal text. The way those transitions are processed brings a new interest to further research.

Grabbing attention while reading website pages: the influence of verbal emotional cues in advertising

The increasing use of the World Wide Web has promised a huge advertising platform for marketers. Investment in online advertising is growing and is expected to overcome traditional media. However, recent studies have reported that users avoid looking at advertising displayed on the World Wide Web. This study aimed at examining the impact of verbal emotional cues (negative/neutral/positive) to capture attention on website’s advertising areas through an eye tracker system. The results revealed significant statistical differences between fixations to negative, positive words and neutral words. Significant differences between the number of fixations and recognition of the target words were found only for the negative valence words. We conclude that negative emotional words could play a major role on user attention to advertising.

The effect of "picture story" context on verbal elicted imitation in deaf students

This paper reviews a study to determine the effects of including a supporting context in an imitation procedure for use with the deaf.

The relation between Wechsler Performance Quotients and quotients on the Snijders-Oomen Non-Verbal Intelligence Scale

This paper examines the relationship between results of the Wechsler-Bellevue Performance Test of Intelligence and the Snijders-Oomen Non-Verbal Intelligence Scale (SONS) as given to hearing-impaired students at Central Institute for the Deaf.

Mothers' verbal language to young hearing impaired children

This paper discusses the effect of a mother's language on the language development of her hearing impaired child.

Comparing cochlear implant users' and their partners' subjective assessment of verbal strategy use with objective assessment: does this change following psychosocial therapy?

This paper investigates the effectiveness of a group-based psychosocial rehabilitation program for cochlear implant patients and their frequent communication partners.

Borg's rating of perceived exertion scales: do the verbal anchors mean the same for different clinical groups?

Objective: To examine the interpretation of the verbal anchors used in the Borg rating of perceived exertion (RPE) scales in different clinical groups and a healthy control group. Design: Prospective experimental study. Setting: Rehabilitation center. Participants: Nineteen subjects with brain injury, 16 with chronic low back pain (CLBP), and 20 healthy controls. Interventions: Not applicable. Main Outcome Measures: Subjects used a visual analog scale (VAS) to rate their interpretation of the verbal anchors from the Borg RPE 6-20 and the newer 10-point category ratio scale. Results: All groups placed the verbal anchors in the order that they occur on the scales. There were significant within-group differences (P > .05) between VAS scores for 4 verbal anchors in the control group, 8 in the CLBP group, and 2 in the brain injury group. There was no significant difference in rating of each verbal anchor between the groups (P > .05). Conclusions: All subjects rated the verbal anchors in the order they occur on the scales, but there was less agreement in rating of each verbal anchor among subjects in the brain injury group. Clinicians should consider the possibility of small discrepancies in the meaning of the verbal anchors to subjects, particularly those recovering from brain injury, when they evaluate exercise perceptions.

An analysis of verbal responses to music in a group of adult non-specialists

In a workshop setting, two pieces of recorded music were presented to a group of adult non-specialists; a key feature was to set up structured discussion within which the respondents considered each piece of music as a whole and not in its constituent parts. There were two areas of interest, namely to explore whether the respondents were likely to identify the musical features or to make extra-musical associations and, to establish the extent to which there would be commonality and difference in their approach to formulating the verbal responses. An inductive approach was used in the analysis of data to reveal some of the working theories underpinning the intuitive musicianship of the adult non-specialist listener. Findings have shown that, when unprompted by forced choice responses, the listeners generated responses that could be said to be information-poor in terms of musical features but rich in terms of the level of personal investment they made in formulating their responses. This is evidenced in a number of connections they made between the discursive and the non-discursive, including those which are relational and mediated by their experiences. Implications for music education are considered.

The neural bases of the short-term storage of verbal information are anatomically variable across individuals

What are the precise brain regions supporting the short-term retention of verbal information? A previous functional magnetic resonance imaging (fMRI) study suggested that they may be topographically variable across individuals, occurring, in most, in regions posterior to prefrontal cortex (PFC), and that detection of these regions may be best suited to a single-subject (SS) approach to fMRI analysis (Feredoes and Postle, 2007). In contrast, other studies using spatially normalized group-averaged (SNGA) analyses have localized storage-related activity to PFC. To evaluate the necessity of the regions identified by these two methods, we applied repetitive transcranial magnetic stimulation (rTMS) to SS- and SNGA-identified regions throughout the retention period of a delayed letter-recognition task. Results indicated that rTMS targeting SS analysis-identified regions of left perisylvian and sensorimotor cortex impaired performance, whereas rTMS targeting the SNGA-identified region of left caudal PFC had no effect on performance. Our results support the view that the short-term retention of verbal information can be supported by regions associated with acoustic, lexical, phonological, and speech-based representation of information. They also suggest that the brain bases of some cognitive functions may be better detected by SS than by SNGA approaches to fMRI data analysis.

Issues and benefits of using 3D Interfaces: visual and verbal tasks

Spatial memory is important for locating objects in hierarchical data structures, such as desktop folders. There are, however, some contradictions in literature concerning the effectiveness of 3D user interfaces when compared to their 2D counterparts. This paper uses a task-based approach in order to investigate the effectiveness of adding a third dimension to specific user tasks, i.e. the impact of depth on navigation in a 3D file manager. Results highlight issues and benefits of using 3D interfaces for visual and verbal tasks, and introduces the possible existence of a correlation between aptitude scores achieved on the Guilford- Zimmerman Orientation Survey and Electroencephalography- measured brainwave activity as participants search for targets of variable perceptual salience in 2D and 3D environments.

The acquisition of person and number morphology within the verbal domain in Early Greek

The aim of this paper is to examine the acquisition pattern of person and number verb morphology within the generative framework and to compare the results of the analyses with previous research in Greek and other European languages. The study considers previous data on the acquisition of subject-verb agreement, and thereafter, examines the acquisition of person and number morphology in a new dataset of two monolingual Greek-speaking children. The analyses present quantitative data of accuracy of person and number marking, error data, and qualitative analyses addressing the productivity of person and number marking. The results suggest that person and number morphology is used correctly and productively from a very early age in Greek speaking children. The findings provide new insight into early Greek language acquisition and are also relevant for research in early development of languages with rich inflectional morphology.