Special issue: Selected papers from the sixth IFIP 2.6 working conference on visual database systems: Guest editors' introduction

While multimedia data, image data in particular, is an integral part of most websites and web documents, our quest for information so far is still restricted to text based search. To explore the World Wide Web more effectively, especially its rich repository of truly multimedia information, we are facing a number of challenging problems. Firstly, we face the ambiguous and highly subjective nature of defining image semantics and similarity. Secondly, multimedia data could come from highly diversified sources, as a result of automatic image capturing and generation processes. Finally, multimedia information exists in decentralised sources over the Web, making it difficult to use conventional content-based image retrieval (CBIR) techniques for effective and efficient search. In this special issue, we present a collection of five papers on visual and multimedia information management and retrieval topics, addressing some aspects of these challenges. These papers have been selected from the conference proceedings (Kluwer Academic Publishers, ISBN: 1-4020- 7060-8) of the Sixth IFIP 2.6 Working Conference on Visual Database Systems (VDB6), held in Brisbane, Australia, on 29–31 May 2002.

Texture alignment in simple shear

We illustrate the flow behaviour of fluids with isotropic and anisotropic microstructure (internal length, layering with bending stiffness) by means of numerical simulations of silo discharge and flow alignment in simple shear. The Cosserat theory is used to provide an internal length in the constitutive model through bending stiffness to describe isotropic microstructure and this theory is coupled to a director theory to add specific orientation of grains to describe anisotropic microstructure. The numerical solution is based on an implicit form of the Material Point Method developed by Moresi et al. [1].

Visual biology of Hawaiian coral reef fishes. II. Colors of Hawaiian coral reef fish

The colors of 51 species of Hawaiian reef fish have been measured using a spectrometer and therefore can be described in objective terms that are not influenced by the human visual experience. In common with other known reef fish populations, the colors of Hawaiian reef fish occupy spectral positions from 300-800nm; yellow or orange with blue, yellow with black, and black with white are the most frequently combined colors; and there is no link between possession of ultraviolet (UV) reflectance and UV visual sensitivity or the potential for UV visual sensitivity. In contrast to other reef systems, blue, yellow, and orange appear more frequently in Hawaiian reef fish. Based on spectral quality of reflections from fish skin, trends in fish colors can be seen that are indicative of both visually driven selective pressures and chemical or physical constraints on the design of colors. UV-reflecting colors can function as semiprivate communication signals. White or yellow with black form highly contrasting patterns that transmit well through clear water. Labroid fishes display uniquely complex colors but lack the ability to see the UV component that is common in their pigments. Step-shaped spectral curves are usually long-wavelength colors such as yellow or red, and colors with a peak-shaped spectral curves are green, blue, violet, and UV.

Polarization vision and its role in biological signaling

Visual pigments, the molecules in photoreceptors that initiate the process of vision, are inherently dichroic, differentially absorbing light according to its axis of polarization. Many animals have taken advantage of this property to build receptor systems capable of analyzing the polarization of incoming light, as polarized light is abundant in natural scenes (commonly being produced by scattering or reflection). Such polarization sensitivity has long been associated with behavioral tasks like orientation or navigation. However, only recently have we become aware that it can be incorporated into a high-level visual perception akin to color vision, permitting segmentation of a viewed scene into regions that differ in their polarization. By analogy to color vision, we call this capacity polarization vision. It is apparently used for tasks like those that color vision specializes in: contrast enhancement, camouflage breaking, object recognition, and signal detection and discrimination. While color is very useful in terrestrial or shallow-water environments, it is an unreliable cue deeper in water due to the spectral modification of light as it travels through water of various depths or of varying optical quality. Here, polarization vision has special utility and consequently has evolved in numerous marine species, as well as at least one terrestrial animal. In this review, we consider recent findings concerning polarization vision and its significance in biological signaling.

Snakes and kittens in the grass: No evidence for preferential processing of fear-relevant animals in visual search

Ohman and colleagues provided evidence for preferential processing of pictures depicting fear-relevant animals by showing that pictures of snakes and spiders are found faster among pictures of fiowers and mushrooms than vice versa and that the speed of detecting fear-relevant animals was not affected by set size whereas the speed of detecting fiowers/mushrooms was. Experiment 1 replicated this finding. Experiment 2, however, found similar search advantages when pictures of cats and horses or of wolves and big cats were to be found among pictures of flowers and mushrooms. Moreover, Experiment 3, in a within subject comparison, failed to find faster identification of snakes and spiders than of cats and horses among flowers and mushrooms. The present findings seem to indicate that previous reports of preferential processing of pictures of snakes and spiders in a visual search task may reflect a processing advantage for animal pictures in general rather than fear-relevance.

Recognition memory effects in event-based prospective memory

Prospective memory (ProM) is the memory for future actions. It requires retrieving content of anaction in response to an ambiguous cue. Currently, it is unclear if ProM is a distinct form of memory, or merely a variant of retrospective memory (RetM). While content retrieval in ProM appears analogous to conventional RetM, less is known about the process of cue detection. Using a modified version of the standard ProM paradigm, three experiments manipulated stimulus characteristics known to influence RetM, in order to examine their effects on ProM performance. Experiment 1 (N — 80) demonstrated that low frequency stimuli elicited significantly higher hit rates and lower false alarm rates than high frequency stimuli, comparable to the mirror effect in RetM. Experiment 2 (N = 80) replicated these results, and showed that repetition of distracters during the test phase significantly increased false alarm rates to second and subsequent presentations of low frequency distracters. Building on these results. Experiment 3 (AT = 40) showed that when the study list was strengthened, the repeated presentation of targets and distracters did not significantly affect response rates. These experiments demonstrate more overlap between ProM and RetM than has previously been acknowledged. The implications for theories of ProM are considered.

Activation of visual areas during the attentional blink

When two targets are presented in rapid succession, identification of the first target is nearly perfect while identification of the second is severely impaired at shorter inter-target lags, and then gradually improves as lag increases. This second-target deficit is known as the attentional blink (AB). Numerous studies have implicated competition for access to higher-order processing mechanisms as the primary cause of the AB. However, relatively few studies have directly examined how the AB modulates activity in specific brain areas. To this end, we used fMRI to measure activation in the occipital and parietal cortices (including V1, V2, and area MT) during an AB task. Participants were presented with an initial target of oriented line segments embedded in a central stream of letter distractors. This central target was followed 100 - 700 ms later by a peripheral ‘X’ presented at one of four locations along with three ‘+’ distractors. All peripheral items were presented in the centre of a small field of moving dots. Participants made non-speeded judgments about line-segment orientation and the location of the second target at the end of a trial and to ignore all other stimuli. The results showed a robust AB characterised by a linear improvement in second-target accuracy as lag increased. This pattern of behavioural results was mirrored by changes in activation patterns across a number of visual areas indicating robust modulation of brain activity by the AB.

The fMRI response of the LGN and V1 to cardinal red-green, blue-yellow, and achromatic visual stimuli

We compared the responsiveness of the LGN and the early retinotopic cortical areas to stimulation of the two cone-opponent systems (red - green and blue - yellow) and the achromatic system. This was done at two contrast levels to control for any effect of contrast. MR images were acquired on seven subjects with a 4T Bruker MedSpec scanner. The early visual cortical areas were localised by phase encoded retinotopic mapping with a volumetric analysis (Dumoulin et al, 2003 NeuroImage 18 576 - 587). We initially located the LGN in four subjects by using flickering stimuli in a separate scanning session, but subsequently identified it using the experimental stimuli. Experimental stimuli were sine-wave counterphasing rings (2 Hz, 0.5 cycle deg-1), cardinal for the selective activation of the L/M cone-opponent (RG), S cone-opponent (BY), and achromatic (Ach) systems. A region of interest analysis was performed. When presented at equivalent absolute contrasts (cone contrast = 5% - 6%), the BOLD response of the LGN is strongest to isoluminant red - green stimuli and weakest to blue - yellow stimuli, with the achromatic response falling in between. Area V1, on the other hand, responds best to both chromatic stimuli, with the achromatic response falling below. The key change from the LGN to V1 is a dramatic boost in the relative blue - yellow response, which occurred at both contrast levels used. This greatly enhanced cortical response to blue - yellow relative to the red - green and achromatic responses may be due to an increase in cell number and/or cell response between the LGN and V1. We speculate that the effect might reflect the operation of contrast constancy across colour mechanisms at the cortical level.

Attentional modulation of visual cortex activity following right parietal damage in humans

Pathological inattention following parietal damage causes perceptual impairments for visual stimuli in the contralesional hemifield. Here we used functional magnetic resonance imaging (fMRI) to examine visual cortex activity in parietal patients as they performed a spatial attention task. Righthemisphere patients and healthy controls viewed counterphasing checkerboards in which coloured targets appeared briefly within the contralesional and ipsilesional hemifields. In separate fMRI runs participants focused their attention covertiy on the left or right hemifield, or on both hemifields concurrentiy. They were required to detect coloured targets that appeared briefly within the attended hemifield(s), and to withhold responses to distractor stimuli. Neural activit}' was significantly attenuated in early visual areas within the damaged hemisphere. Crucially, although attention significantiy modulated early visual activit}' within the intact (left) hemisphere, there was relatively littie modulation of activity within the affected hemisphere. Our findings suggest that parietal lesions alter early cortical responses to contralesional visual inputs.

Eye-movements and visual imagery: A working memory approach to the treatment of post-traumatic stress disorder

It has been claimed that the symptoms of post-traumatic stress disorder (PTSD) can be ameliorated by eye-movement desensitization-reprocessing therapy (EMD-R), a procedure that involves the individual making saccadic eye-movements while imagining the traumatic event. We hypothesized that these eye-movements reduce the vividness of distressing images by disrupting the function of the visuospatial sketchpad (VSSP) of working memory, and that by doing so they reduce the intensity of the emotion associated with the image. This hypothesis was tested by asking non-PTSD participants to form images of neutral and negative pictures under dual task conditions. Their images were less vivid with concurrent eye-movements and with a concurrent spatial tapping task that did not involve eye-movements. In the first three experiments, these secondary tasks did not consistently affect participants' emotional responses to the images. However, Expt 4 used personal recollections as stimuli for the imagery task, and demonstrated a significant reduction in emotional response under the same dual task conditions. These results suggest that, if EMD-R works, it does so by reducing the vividness and emotiveness of traumatic images via the VSSP of working memory. Other visuospatial tasks may also be of therapeutic value.

Autopathogenic T helper cell type 1 (Th1) and protective Th2 clones differ in their recognition of the autoantigenic peptide of myelin proteolipid protein

We previously generated a panel of T helper cell 1 (Th1) clones specific for an encephalitogenic peptide of myelin proteolipid protein (PLP) peptide 139-151 (HSLGKWLGHPDKF) that induces experimental autoimmune encephalomyelitis (EAE) upon adoptive transfer. In spite of the differences in their T cell receptor (TCR) gene usage, all these Th1 clones required W144 as the primary and most critical TCR contact residue for the activation. In this study, we determined the TCR contact residues of a panel of Th2/Th0 clones specific for the PLP peptide 139-151 generated either by immunization with the PLP 139-151 peptide with anti-B7-1 antibody or by immunization with an altered peptide Q144. Using alanine-substituted peptide analogues of the native PLP peptide, we show that the Th2 clones have shifted their primary contact residue to the NH2-terminal end of the peptide. These Th2 cells do not show any dependence on the W144, but show a critical requirement for L141/G142 as their major TCR contact residue. Thus, in contrast with the Th1 clones that did not proliferate to A144-substituted peptide, the Th2 clones tolerated a substitution at position 144 and proliferated to A144 peptide. This alternative A144 reactive repertoire appears to have a critical role in the regulation of autoimmune response to PLP 139-151 because preimmunization with A144 to expand the L141/G142-reactive repertoire protects mice from developing EAE induced with the native PLP 139-151 peptide. These data suggest that a balance between two different T cell repertoires specific for same autoantigenic epitope can determine disease phenotype, i.e., resistance or susceptibility to an autoimmune disease.

Comparative effects of ageing and dementia of the Alzheimer type on orientation of visual attention

Age-related changes and the effects of dementia of the Alzheimer type (DAT) were investigated during a visual orienting attention task in which attention was pre-cued to one or other hemifields. Central cues were either valid, neutral, invalid or NoGo (inhibitory). The response time cost-benefit analysis showed a decreased benefit after valid cueing in the old compared with the young group with no change in the cost of invalid cueing. The older group were also slower over all cue types. These results suggest there is an age-related reduced ability to covertly orient attention in a visual hemifield before target onset. In contrast, the DAT group showed an increased response time benefit and showed a trend for a decreased cost in response time compared with controls. This was due to slowest response times after neutral cues. They also made significantly more response errors particularly following neutral cueing, and were less able to inhibit responses on NoGo trials than controls. The increased benefit and reduced cost found in the DAT group was interpreted as an impairment in dividing attention between left and right target locations.