Visual search and eye movements: Studies of perceptual span

In visual search one tries to find the currently relevant item among other, irrelevant items. In the present study, visual search performance for complex objects (characters, faces, computer icons and words) was investigated, and the contribution of different stimulus properties, such as luminance contrast between characters and background, set size, stimulus size, colour contrast, spatial frequency, and stimulus layout were investigated. Subjects were required to search for a target object among distracter objects in two-dimensional stimulus arrays. The outcome measure was threshold search time, that is, the presentation duration of the stimulus array required by the subject to find the target with a certain probability. It reflects the time used for visual processing separated from the time used for decision making and manual reactions. The duration of stimulus presentation was controlled by an adaptive staircase method. The number and duration of eye fixations, saccade amplitude, and perceptual span, i.e., the number of items that can be processed during a single fixation, were measured. It was found that search performance was correlated with the number of fixations needed to find the target. Search time and the number of fixations increased with increasing stimulus set size. On the other hand, several complex objects could be processed during a single fixation, i.e., within the perceptual span. Search time and the number of fixations depended on object type as well as luminance contrast. The size of the perceptual span was smaller for more complex objects, and decreased with decreasing luminance contrast within object type, especially for very low contrasts. In addition, the size and shape of perceptual span explained the changes in search performance for different stimulus layouts in word search. Perceptual span was scale invariant for a 16-fold range of stimulus sizes, i.e., the number of items processed during a single fixation was independent of retinal stimulus size or viewing distance. It is suggested that saccadic visual search consists of both serial (eye movements) and parallel (processing within perceptual span) components, and that the size of the perceptual span may explain the effectiveness of saccadic search in different stimulus conditions. Further, low-level visual factors, such as the anatomical structure of the retina, peripheral stimulus visibility and resolution requirements for the identification of different object types are proposed to constrain the size of the perceptual span, and thus, limit visual search performance. Similar methods were used in a clinical study to characterise the visual search performance and eye movements of neurological patients with chronic solvent-induced encephalopathy (CSE). In addition, the data about the effects of different stimulus properties on visual search in normal subjects were presented as simple practical guidelines, so that the limits of human visual perception could be taken into account in the design of user interfaces.

Dynamics of contour, object and face processing in the human visual cortex

The neural basis of visual perception can be understood only when the sequence of cortical activity underlying successful recognition is known. The early steps in this processing chain, from retina to the primary visual cortex, are highly local, and the perception of more complex shapes requires integration of the local information. In Study I of this thesis, the progression from local to global visual analysis was assessed by recording cortical magnetoencephalographic (MEG) responses to arrays of elements that either did or did not form global contours. The results demonstrated two spatially and temporally distinct stages of processing: The first, emerging 70 ms after stimulus onset around the calcarine sulcus, was sensitive to local features only, whereas the second, starting at 130 ms across the occipital and posterior parietal cortices, reflected the global configuration. To explore the links between cortical activity and visual recognition, Studies II III presented subjects with recognition tasks of varying levels of difficulty. The occipito-temporal responses from 150 ms onwards were closely linked to recognition performance, in contrast to the 100-ms mid-occipital responses. The averaged responses increased gradually as a function of recognition performance, and further analysis (Study III) showed the single response strengths to be graded as well. Study IV addressed the attention dependence of the different processing stages: Occipito-temporal responses peaking around 150 ms depended on the content of the visual field (faces vs. houses), whereas the later and more sustained activity was strongly modulated by the observers attention. Hemodynamic responses paralleled the pattern of the more sustained electrophysiological responses. Study V assessed the temporal processing capacity of the human object recognition system. Above sufficient luminance, contrast and size of the object, the processing speed was not limited by such low-level factors. Taken together, these studies demonstrate several distinct stages in the cortical activation sequence underlying the object recognition chain, reflecting the level of feature integration, difficulty of recognition, and direction of attention.

Effects of Mean Luminance Changes on Human Contrast Perception

Background When we are viewing natural scenes, every saccade abruptly changes both the mean luminance and the contrast structure falling on any given retinal location. Thus it would be useful if the two were independently encoded by the visual system, even when they change simultaneously. Recordings from single neurons in the cat visual system have suggested that contrast information may be quite independently represented in neural responses to simultaneous changes in contrast and luminance. Here we test to what extent this is true in human perception. Methodology/Principal Findings Small contrast stimuli were presented together with a 7-fold upward or downward step of mean luminance (between 185 and 1295 Td, corresponding to 14 and 98 cd/m2), either simultaneously or with various delays (50–800 ms). The perceived contrast of the target under the different conditions was measured with an adaptive staircase method. Over the contrast range 0.1–0.45, mainly subtractive attenuation was found. Perceived contrast decreased by 0.052±0.021 (N = 3) when target onset was simultaneous with the luminance increase. The attenuation subsided within 400 ms, and even faster after luminance decreases, where the effect was also smaller. The main results were robust against differences in target types and the size of the field over which luminance changed. Conclusions/Significance Perceived contrast is attenuated mainly by a subtractive term when coincident with a luminance change. The effect is of ecologically relevant magnitude and duration; in other words, strict contrast constancy must often fail during normal human visual behaviour. Still, the relative robustness of the contrast signal is remarkable in view of the limited dynamic response range of retinal cones. We propose a conceptual model for how early retinal signalling may allow this.

Perception of surface brightness

The human visual system has adapted to function in different lighting environments and responds to contrast instead of the amount of light as such. On the one hand, this ensures constancy of perception, for example, white paper looks white both in bright sunlight and in dim moonlight, because contrast is invariant to changes in overall light level. On the other hand, the brightness of the surfaces has to be reconstructed from the contrast signal because no signal from surfaces as such is conveyed to the visual cortex. In the visual cortex, the visual image is decomposed to local features by spatial filters that are selective for spatial frequency, orientation, and phase. Currently it is not known, however, how these features are subsequently integrated to form objects and object surfaces. In this thesis the integration mechanisms of achromatic surfaces were studied by psychophysically measuring the spatial frequency and orientation tuning of brightness perception. In addition, the effect of textures on the spread of brightness and the effect of phase of the inducing stimulus on brightness were measured. The novel findings of the thesis are that (1) a narrow spatial frequency band, independent of stimulus size and complexity, mediates brightness information (2) figure-ground brightness illusions are narrowly tuned for orientation (3) texture borders, without any luminance difference, are able to block the spread of brightness, and (4) edges and even- and odd-symmetric Gabors have a similar antagonistic effect on brightness. The narrow spatial frequency tuning suggests that only a subpopulation of neurons in V1 is involved in brightness perception. The independence of stimulus size and complexity indicates that the narrow tuning reflects hard-wired processing in the visual system. Further, it seems that figure-ground segregation and mechanisms integrating contrast polarities are closely related to the low level mechanisms of brightness perception. In conclusion, the results of the thesis suggest that a subpopulation of neurons in visual cortex selectively integrates information from different contrast polarities to reconstruct surface brightness.

Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Scattering and Refraction as Contrast Mechanisms in X-Ray Imaging

Differentiation of various types of soft tissues is of high importance in medical imaging, because changes in soft tissue structure are often associated with pathologies, such as cancer. However, the densities of different soft tissues may be very similar, making it difficult to distinguish them in absorption images. This is especially true when the consideration of patient dose limits the available signal-to-noise ratio. Refraction is more sensitive than absorption to changes in the density, and small angle x-ray scattering on the other hand contains information about the macromolecular structure of the tissues. Both of these can be used as potential sources of contrast when soft tissues are imaged, but little is known about the visibility of the signals in realistic imaging situations. In this work the visibility of small-angle scattering and refraction in the context of medical imaging has been studied using computational methods. The work focuses on the study of analyzer based imaging, where the information about the sample is recorded in the rocking curve of the analyzer crystal. Computational phantoms based on simple geometrical shapes with differing material properties are used. The objects have realistic dimensions and attenuation properties that could be encountered in real imaging situations. The scattering properties mimic various features of measured small-angle scattering curves. Ray-tracing methods are used to calculate the refraction and attenuation of the beam, and a scattering halo is accumulated, including the effect of multiple scattering. The changes in the shape of the rocking curve are analyzed with different methods, including diffraction enhanced imaging (DEI), extended DEI (E-DEI) and multiple image radiography (MIR). A wide angle DEI, called W-DEI, is introduced and its performance is compared with that of the established methods. The results indicate that the differences in scattered intensities from healthy and malignant breast tissues are distinguishable to some extent with reasonable dose. Especially the fraction of total scattering has large enough differences that it can serve as a useful source of contrast. The peaks related to the macromolecular structure come to angles that are rather large, and have intensities that are only a small fraction of the total scattered intensity. It is found that such peaks seem to have only limited usefulness in medical imaging. It is also found that W-DEI performs rather well when most of the intensity remains in the direct beam, indicating that dark field imaging methods may produce the best results when scattering is weak. Altogether, it is found that the analysis of scattered intensity is a viable option even in medical imaging where the patient dose is the limiting factor.

Contrast-enhanced ultrasound of abdominal organs in cats

The primary aim of this thesis was the evaluation of the perfusion of normal organs in cats using contrast-enhanced ultrasound (CEUS), to serve as a reference for later clinical studies. Little is known of the use of CEUS in cats, especially regarding its safety and the effects of anesthesia on the procedure, thus, secondary aims here were to validate the quantitative analyzing method, to investigate the biological effects of CEUS on feline kidneys, and to assess the effect of anesthesia on splenic perfusion in cats undergoing CEUS. -- The studies were conducted on healthy, young, purpose-bred cats. CEUS of the liver, left kidney, spleen, pancreas, small intestine, and mesenteric lymph nodes was performed to characterize the normal perfusion of these organs on ten anesthetized, male cats. To validate the quantification method, the effects of placement and size of the region of interest (ROI) on perfusion parameters were investigated using CEUS: Three separate sets of ROIs were placed in the kidney cortex, varying in location, size, or depth. The biological effects of CEUS on feline kidneys were estimated by measuring urinary enzymatic activities, analyzing urinary specific gravity, pH, protein, creatinine, albumin, and sediment, and measuring plasma urea and creatinine concentrations before and after CEUS. Finally, the impact of anesthesia on contrast enhancement of the spleen was investigated by imaging cats with CEUS first awake and later under anesthesia on separate days. -- Typical perfusion patterns were found for each of the studied organs. The liver had a gradual and more heterogeneous perfusion pattern due to its dual blood flow and close proximity to the diaphragm. An obvious and statistically significant difference emerged in the perfusion between the kidney cortex and medulla. Enhancement in the spleen was very heterogeneous at the beginning of imaging, indicating focal dissimilarities in perfusion. No significant differences emerged in the perfusion parameters between the pancreas, small intestine, and mesenteric lymph nodes. -- The ROI placement and size were found to have an influence on the quantitative measurements of CEUS. Increasing the depth or the size of the ROI decreased the peak intensity value significantly, suggesting that where and how the ROI is placed does matter in quantitative analyses. --- A significant increase occurred in the urinary N-acetyl-β-D-glucosaminidase (NAG) to creatinine ratio after CEUS. No changes were noted in the serum biochemistry profile after CEUS, with the exception of a small decrease in blood urea concentration. The magnitude of the rise in the NAG/creatinine ratio was, however, less than the circadian variation reported earlier in healthy cats. Thus, the changes observed in the laboratory values after CEUS of the left kidney did not indicate any detrimental effects in kidneys. Heterogeneity of the spleen was observed to be less and time of first contrast appearance earlier in nonanesthetized cats than in anesthetized ones, suggesting that anesthesia increases heterogeneity of the feline spleen in CEUS. ---- In conclusion, the results suggest that CEUS can be used also in feline veterinary patients as an additional diagnostics aid. The perfusion patterns found in the imaged organs were typical and similar to those seen earlier in other species, with the exception of the heterogeneous perfusion pattern in the cat spleen. Differences in the perfusion between organs corresponded with physiology. Based on the results, estimation of focal perfusion defects of the spleen in cats should be performed with caution and after the disappearance of the initial heterogeneity, especially in anesthetized or sedated cats. Finally, these results indicate that CEUS can be used safely to analyze kidney perfusion also in cats. Future clinical studies are needed to evaluate the full potential of CEUS in feline medicine as a tool for diagnosing lesions in various organ systems.

Determination of intestinal permeability in healthy horses using the contrast medium iohexol

Tämä lisensiaatin tutkielma koostuu kolmesta osasta; kirjallisuuskatsauksesta, kokeellisesta osasta ja liitteistä. Iohexol on ionisoitumaton, trijodattu ja vesiliukoinen röntgenvarjoaine. Iohexolia on hyödynnetty lääketieteessä useita vuosia. Iohexolia on käytetty muun muassa angio- ja myelografiassa, lisäksi iohexolia on hyödynnetty arvioitaessa munuaiskerästen suodattumisnopeutta sekä suoliston läpäisevyyden muutoksia. Hevosen tulehduksellisessa suolistosairaudessa (Inflammatory bowel disease, IBD) suoliston rakenne ja sen läpäisevyys muuttuu; tyypillistä on tulehdussolujen kertyminen suoliston seinämään ja myös sidekudosmuodostusta saattaa esiintyä. Suolisto muutoksia saatetaan havaita sekä ohut- että paksusuolessa. IBD aiheuttaa hevoselle laihtumista, johtuen ravintoaineiden puutteellisesta imeytymisestä ja proteiinien menetyksestä suoleen suoliston häiriötilan yhteydessä. Tällä hetkellä IBD:n diagnostiikka perustuu tyypillisiin oireisiin, kliiniseen tutkimukseen, verinäytteisiin, glukoosin imeytymistestiin ja peräsuolesta otettuun koepalaan. IBD:n diagnostiikka on kuitenkin erittäin haastavaa ja tutkimusmenetelmiin liittyy lukuisia ongelmia, jotka vähentävät niiden luotettavuutta IBD:n diagnostiikassa. Tutkimuksemme tarkoituksena on kehittää hevosen IBD:n diagnostiikkaa entistä helpompaan, luotettavampaan ja turvallisempaan suuntaan. Tämän alustavan tutkimuksen tavoitteet olivat: (1) tutkia voidaanko iohexol havaita hevosen seerumissa oraalisen annostelun jälkeen ja (2) muodostaa iohexolin pitoisuuskuvaaja ajan funktiona terveillä hevosilla. Materiaalimme koostui kymmenestä terveestä hevosesta, joilla ei ollut havaittu laihtumista tai ripulia. Ennen iohexolin annostelua hevosille suoritettiin kliininen tutkimus ja verinäytteet otettiin maha-suolikanavan sairauden poissulkemiseksi. Hevosille suoritettiin myös mahalaukun tähystys. 16 tunnin paaston jälkeen 1 ml/kg Iohexolia annosteltiin 10 % -liuoksena nenämahaletkulla suoraan mahaan ja verinäytteet otettiin 0, 30, 60, 120, 180, 240, 300 ja 360 minuuttia annostelun jälkeen. Iohexolin pitoisuus määritettiin käyttämällä korkean erotuskyvyn nestekromatografiaa. Iohexolin pitoisuuksista tietyillä ajanhetkillä muodostettiin kuvaaja. Hevosilla ei havaittu maha-suolikanavan sairauksia. Kaikki hevoset olivat hyvässä kuntoluokassa ja mahalaukun tähystyksessä ei havaittu merkittäviä muutoksia. Verinäytteiden tulokset olivat viiterajoissa. Kaikki hevoset sietivät iohexolia hyvin ja haittavaikutuksia ei havaittu. Iohexol oli havaittavissa seerumissa 60 minuutin kuluttua annostelusta. Kuvaajassa voitiin havaita kaksi huippua. Statistiset menetelmät tukivat löydöksiä. Iohexol testi oli yksinkertainen suorittaa ja siihen ei liittynyt haittavaikutuksia. Annos 1ml/kg oli havaittavissa seerumissa. Iohexolin pitoisuuskuvaaja muodosti kaksi huippua, ja tämänkaltainen ilmiö on kuvattu kirjallisuudessa aikaisemmin useiden lääkkeiden tapauksessa. Hevosella ilmiö liittyy todennäköisesti maha-suolikanavan rakenteellisiin ja fysiologisiin eroavaisuuksiin ja lisätutkimuksia ilmiön varmistamiseksi tarvitaan. Iohexol näyttää olevan potentiaalinen merkkiaine suoliston läpäisevyyden arviointiin ja lisätutkimuksia IBD:tä sairastavien hevosten seerumin iohexolin pitoisuuksista verrattuna terveiden hevosten seerumin iohexolin pitoisuuksiin on suunnitteilla.