Special issue: Selected papers from the sixth IFIP 2.6 working conference on visual database systems: Guest editors' introduction

While multimedia data, image data in particular, is an integral part of most websites and web documents, our quest for information so far is still restricted to text based search. To explore the World Wide Web more effectively, especially its rich repository of truly multimedia information, we are facing a number of challenging problems. Firstly, we face the ambiguous and highly subjective nature of defining image semantics and similarity. Secondly, multimedia data could come from highly diversified sources, as a result of automatic image capturing and generation processes. Finally, multimedia information exists in decentralised sources over the Web, making it difficult to use conventional content-based image retrieval (CBIR) techniques for effective and efficient search. In this special issue, we present a collection of five papers on visual and multimedia information management and retrieval topics, addressing some aspects of these challenges. These papers have been selected from the conference proceedings (Kluwer Academic Publishers, ISBN: 1-4020- 7060-8) of the Sixth IFIP 2.6 Working Conference on Visual Database Systems (VDB6), held in Brisbane, Australia, on 29–31 May 2002.

Visual biology of Hawaiian coral reef fishes. II. Colors of Hawaiian coral reef fish

The colors of 51 species of Hawaiian reef fish have been measured using a spectrometer and therefore can be described in objective terms that are not influenced by the human visual experience. In common with other known reef fish populations, the colors of Hawaiian reef fish occupy spectral positions from 300-800nm; yellow or orange with blue, yellow with black, and black with white are the most frequently combined colors; and there is no link between possession of ultraviolet (UV) reflectance and UV visual sensitivity or the potential for UV visual sensitivity. In contrast to other reef systems, blue, yellow, and orange appear more frequently in Hawaiian reef fish. Based on spectral quality of reflections from fish skin, trends in fish colors can be seen that are indicative of both visually driven selective pressures and chemical or physical constraints on the design of colors. UV-reflecting colors can function as semiprivate communication signals. White or yellow with black form highly contrasting patterns that transmit well through clear water. Labroid fishes display uniquely complex colors but lack the ability to see the UV component that is common in their pigments. Step-shaped spectral curves are usually long-wavelength colors such as yellow or red, and colors with a peak-shaped spectral curves are green, blue, violet, and UV.

Snakes and kittens in the grass: No evidence for preferential processing of fear-relevant animals in visual search

Ohman and colleagues provided evidence for preferential processing of pictures depicting fear-relevant animals by showing that pictures of snakes and spiders are found faster among pictures of fiowers and mushrooms than vice versa and that the speed of detecting fear-relevant animals was not affected by set size whereas the speed of detecting fiowers/mushrooms was. Experiment 1 replicated this finding. Experiment 2, however, found similar search advantages when pictures of cats and horses or of wolves and big cats were to be found among pictures of flowers and mushrooms. Moreover, Experiment 3, in a within subject comparison, failed to find faster identification of snakes and spiders than of cats and horses among flowers and mushrooms. The present findings seem to indicate that previous reports of preferential processing of pictures of snakes and spiders in a visual search task may reflect a processing advantage for animal pictures in general rather than fear-relevance.

Activation of visual areas during the attentional blink

When two targets are presented in rapid succession, identification of the first target is nearly perfect while identification of the second is severely impaired at shorter inter-target lags, and then gradually improves as lag increases. This second-target deficit is known as the attentional blink (AB). Numerous studies have implicated competition for access to higher-order processing mechanisms as the primary cause of the AB. However, relatively few studies have directly examined how the AB modulates activity in specific brain areas. To this end, we used fMRI to measure activation in the occipital and parietal cortices (including V1, V2, and area MT) during an AB task. Participants were presented with an initial target of oriented line segments embedded in a central stream of letter distractors. This central target was followed 100 - 700 ms later by a peripheral ‘X’ presented at one of four locations along with three ‘+’ distractors. All peripheral items were presented in the centre of a small field of moving dots. Participants made non-speeded judgments about line-segment orientation and the location of the second target at the end of a trial and to ignore all other stimuli. The results showed a robust AB characterised by a linear improvement in second-target accuracy as lag increased. This pattern of behavioural results was mirrored by changes in activation patterns across a number of visual areas indicating robust modulation of brain activity by the AB.

The fMRI response of the LGN and V1 to cardinal red-green, blue-yellow, and achromatic visual stimuli

We compared the responsiveness of the LGN and the early retinotopic cortical areas to stimulation of the two cone-opponent systems (red - green and blue - yellow) and the achromatic system. This was done at two contrast levels to control for any effect of contrast. MR images were acquired on seven subjects with a 4T Bruker MedSpec scanner. The early visual cortical areas were localised by phase encoded retinotopic mapping with a volumetric analysis (Dumoulin et al, 2003 NeuroImage 18 576 - 587). We initially located the LGN in four subjects by using flickering stimuli in a separate scanning session, but subsequently identified it using the experimental stimuli. Experimental stimuli were sine-wave counterphasing rings (2 Hz, 0.5 cycle deg-1), cardinal for the selective activation of the L/M cone-opponent (RG), S cone-opponent (BY), and achromatic (Ach) systems. A region of interest analysis was performed. When presented at equivalent absolute contrasts (cone contrast = 5% - 6%), the BOLD response of the LGN is strongest to isoluminant red - green stimuli and weakest to blue - yellow stimuli, with the achromatic response falling in between. Area V1, on the other hand, responds best to both chromatic stimuli, with the achromatic response falling below. The key change from the LGN to V1 is a dramatic boost in the relative blue - yellow response, which occurred at both contrast levels used. This greatly enhanced cortical response to blue - yellow relative to the red - green and achromatic responses may be due to an increase in cell number and/or cell response between the LGN and V1. We speculate that the effect might reflect the operation of contrast constancy across colour mechanisms at the cortical level.

Attentional modulation of visual cortex activity following right parietal damage in humans

Pathological inattention following parietal damage causes perceptual impairments for visual stimuli in the contralesional hemifield. Here we used functional magnetic resonance imaging (fMRI) to examine visual cortex activity in parietal patients as they performed a spatial attention task. Righthemisphere patients and healthy controls viewed counterphasing checkerboards in which coloured targets appeared briefly within the contralesional and ipsilesional hemifields. In separate fMRI runs participants focused their attention covertiy on the left or right hemifield, or on both hemifields concurrentiy. They were required to detect coloured targets that appeared briefly within the attended hemifield(s), and to withhold responses to distractor stimuli. Neural activit}' was significantly attenuated in early visual areas within the damaged hemisphere. Crucially, although attention significantiy modulated early visual activit}' within the intact (left) hemisphere, there was relatively littie modulation of activity within the affected hemisphere. Our findings suggest that parietal lesions alter early cortical responses to contralesional visual inputs.

Grammatical priming of visual word recognition in fourth-grade children

Previous work examining context effects in children has been limited to semantic context. The current research examined the effects of grammatical priming of word-naming in fourth-grade children. In Experiment 1, children named both inflected and uninflected noun and verb target words faster when they were preceded by grammatically constraining primes than when they were preceded by neutral primes. Experiment 1 used a long stimulus onset asynchrony (SOA) interval of 750 msec. Experiment 2 replicated the grammatical priming effect at two SOA intervals (400 msec and 700 msec), suggesting that the grammatical priming effect does not reflect the operation of any gross strategic effects directly attributable to the long SOA interval employed in Experiment 1. Grammatical context appears to facilitate target word naming by constraining target word class. Further work is required to elucidate the loci of this effect.

Eye-movements and visual imagery: A working memory approach to the treatment of post-traumatic stress disorder

It has been claimed that the symptoms of post-traumatic stress disorder (PTSD) can be ameliorated by eye-movement desensitization-reprocessing therapy (EMD-R), a procedure that involves the individual making saccadic eye-movements while imagining the traumatic event. We hypothesized that these eye-movements reduce the vividness of distressing images by disrupting the function of the visuospatial sketchpad (VSSP) of working memory, and that by doing so they reduce the intensity of the emotion associated with the image. This hypothesis was tested by asking non-PTSD participants to form images of neutral and negative pictures under dual task conditions. Their images were less vivid with concurrent eye-movements and with a concurrent spatial tapping task that did not involve eye-movements. In the first three experiments, these secondary tasks did not consistently affect participants' emotional responses to the images. However, Expt 4 used personal recollections as stimuli for the imagery task, and demonstrated a significant reduction in emotional response under the same dual task conditions. These results suggest that, if EMD-R works, it does so by reducing the vividness and emotiveness of traumatic images via the VSSP of working memory. Other visuospatial tasks may also be of therapeutic value.

Comparative effects of ageing and dementia of the Alzheimer type on orientation of visual attention

Age-related changes and the effects of dementia of the Alzheimer type (DAT) were investigated during a visual orienting attention task in which attention was pre-cued to one or other hemifields. Central cues were either valid, neutral, invalid or NoGo (inhibitory). The response time cost-benefit analysis showed a decreased benefit after valid cueing in the old compared with the young group with no change in the cost of invalid cueing. The older group were also slower over all cue types. These results suggest there is an age-related reduced ability to covertly orient attention in a visual hemifield before target onset. In contrast, the DAT group showed an increased response time benefit and showed a trend for a decreased cost in response time compared with controls. This was due to slowest response times after neutral cues. They also made significantly more response errors particularly following neutral cueing, and were less able to inhibit responses on NoGo trials than controls. The increased benefit and reduced cost found in the DAT group was interpreted as an impairment in dividing attention between left and right target locations.