View-Invariant Object Category Learning, Recognition, and Search: How Spatial and Object Attention Are Coordinated Using Surface-Based Attentional Shrouds

Air Force Office of Scientific Research (F49620-01-1-0397); National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624)

Cortical Dynamics of Contextually-Cued Attentive Visual Learning and Search: Spatial and Object Evidence Accumulation

How do humans use predictive contextual information to facilitate visual search? How are consistently paired scenic objects and positions learned and used to more efficiently guide search in familiar scenes? For example, a certain combination of objects can define a context for a kitchen and trigger a more efficient search for a typical object, such as a sink, in that context. A neural model, ARTSCENE Search, is developed to illustrate the neural mechanisms of such memory-based contextual learning and guidance, and to explain challenging behavioral data on positive/negative, spatial/object, and local/distant global cueing effects during visual search. The model proposes how global scene layout at a first glance rapidly forms a hypothesis about the target location. This hypothesis is then incrementally refined by enhancing target-like objects in space as a scene is scanned with saccadic eye movements. The model clarifies the functional roles of neuroanatomical, neurophysiological, and neuroimaging data in visual search for a desired goal object. In particular, the model simulates the interactive dynamics of spatial and object contextual cueing in the cortical What and Where streams starting from early visual areas through medial temporal lobe to prefrontal cortex. After learning, model dorsolateral prefrontal cortical cells (area 46) prime possible target locations in posterior parietal cortex based on goalmodulated percepts of spatial scene gist represented in parahippocampal cortex, whereas model ventral prefrontal cortical cells (area 47/12) prime possible target object representations in inferior temporal cortex based on the history of viewed objects represented in perirhinal cortex. The model hereby predicts how the cortical What and Where streams cooperate during scene perception, learning, and memory to accumulate evidence over time to drive efficient visual search of familiar scenes.

A Neural Theory of Attentive Visual Search: Interactions of Boundary, Surface, Spatial, and Object Representations

Visual search data are given a unified quantitative explanation by a model of how spatial maps in the parietal cortex and object recognition categories in the inferotemporal cortex deploy attentional resources as they reciprocally interact with visual representations in the prestriate cortex. The model visual representations arc organized into multiple boundary and surface representations. Visual search in the model is initiated by organizing multiple items that lie within a given boundary or surface representation into a candidate search grouping. These items arc compared with object recognition categories to test for matches or mismatches. Mismatches can trigger deeper searches and recursive selection of new groupings until a target object io identified. This search model is algorithmically specified to quantitatively simulate search data using a single set of parameters, as well as to qualitatively explain a still larger data base, including data of Aks and Enns (1992), Bravo and Blake (1990), Chellazzi, Miller, Duncan, and Desimone (1993), Egeth, Viri, and Garbart (1984), Cohen and Ivry (1991), Enno and Rensink (1990), He and Nakayarna (1992), Humphreys, Quinlan, and Riddoch (1989), Mordkoff, Yantis, and Egeth (1990), Nakayama and Silverman (1986), Treisman and Gelade (1980), Treisman and Sato (1990), Wolfe, Cave, and Franzel (1989), and Wolfe and Friedman-Hill (1992). The model hereby provides an alternative to recent variations on the Feature Integration and Guided Search models, and grounds the analysis of visual search in neural models of preattentive vision, attentive object learning and categorization, and attentive spatial localization and orientation.

Space, Time and Learning in the Hippocampus: How Fine Spatial and Temporal Scales Are Expanded into Population Codes for Behavioral Control

The hippocampus participates in multiple functions, including spatial navigation, adaptive timing, and declarative (notably, episodic) memory. How does it carry out these particular functions? The present article proposes that hippocampal spatial and temporal processing are carried out by parallel circuits within entorhinal cortex, dentate gyrus, and CA3 that are variations of the same circuit design. In particular, interactions between these brain regions transform fine spatial and temporal scales into population codes that are capable of representing the much larger spatial and temporal scales that are needed to control adaptive behaviors. Previous models of adaptively timed learning propose how a spectrum of cells tuned to brief but different delays are combined and modulated by learning to create a population code for controlling goal-oriented behaviors that span hundreds of milliseconds or even seconds. Here it is proposed how projections from entorhinal grid cells can undergo a similar learning process to create hippocampal place cells that can cover a space of many meters that are needed to control navigational behaviors. The suggested homology between spatial and temporal processing may clarify how spatial and temporal information may be integrated into an episodic memory.

A Neural Network Model for the Spatial and Temporal Response of Retinal Ganglion Cells

This article introduces a quantitative model of early visual system function. The model is formulated to unify analyses of spatial and temporal information processing by the nervous system. Functional constraints of the model suggest mechanisms analogous to photoreceptors, bipolar cells, and retinal ganglion cells, which can be formally represented with first order differential equations. Preliminary numerical simulations and analytical results show that the same formal mechanisms can explain the behavior of both X (linear) and Y (nonlinear) retinal ganglion cell classes by simple changes in the relative width of the receptive field (RF) center and surround mechanisms. Specifically, an increase in the width of the RF center results in a change from X-like to Y-like response, in agreement with anatomical data on the relationship between α- and

Spatial and energetic mode dynamics of cold atomic systems

In this thesis we relate the formal description of various cold atomic systems in the energy eigenbasis, to the observable spatial mode dynamics. Herein the `spatial mode dynamics' refers to the direction of photon emission following the spontaneous emission of an excited fermion in the presence of a same species and spin ideal anisotropic Fermi sea in its internal ground state. Due to the Pauli principle, the presence of the ground state Fermi sea renders the phase space, anisotropic and only partially accessible, thereby a ecting the direction of photon emission following spontaneous emission. The spatial and energetic mode dynamics also refers to the quantum `tunneling' interaction between localised spatial modes, synonymous with double well type potentials. Here we relate the dynamics of the wavefunction in both the energetic and spatial representations. Using this approach we approximate the relationship between the spatial and energetic representations of a wavefunction spanning three spatial and energetic modes. This is extended to a process known as Spatial Adiabatic Passage, which is a technique to transport matter waves between localised spatial modes. This approach allows us to interpret the transport of matter waves as a signature of a geometric phase acquired by the one of the internal energy eigenstates of the system during the cyclical evolution. We further show that this geometric phase may be used to create spatial mode qubit and qutrit states.

Soft sediment ecology of Lough Hyne Marine Reserve - spatial and temporal patterns

Distribution of soft sediment benthic fauna and the environmental factors affecting them were studied, to investigate changes across spatial and temporal scales. Investigations took place at Lough Hyne Marine Reserve using a range of methods. Data on the sedimentation rates of organic and inorganic matter were collected at monthly intervals for one year at a number of sites around the Lough, by use of vertical midwater-column sediment traps. Sedimentation of these two fractions were not coupled; inorganic matter sedimentation depended on hydrodynamic and weather factors, while the organic matter sedimentation was more complex, being dependent on biological and chemical processes in the water column. The effects of regular hypoxic episodes on benthic fauna due to a natural seasonal thermocline were studied in the deep Western Trough, using camera-equipped remotely-operated vehicle to follow transects, on a three-monthly basis over one year. In late summer, the area below the thermocline of the Western Trough was devoid of visible fauna. Decapod crustaceans were the first taxon to make use of ameliorating oxygen conditions in autumn, by darting below the thermocline depth, most likely to scavenge. This was indicated by tracks that they left on the surface of the Trough floor. Some species, most noticeably Fries’ goby Lesueurigobius friesii, migrated below the thermocline depth when conditions were normoxic and established semi-permanent burrows. Their population encompassed all size classes, indicating that this habitat was not limited to juveniles of this territorial species. Recolonisation by macrofauna and burrowing megafauna was studied during normoxic conditions, from November 2009 to May 2010. Macrofauna displayed a typical post-disturbance pattern of recolonisation with one species, the polychaete Scalibregma inflatum, occurring at high abundance levels in March 2010. In May, this population had become significantly reduced and a more diverse community was established. The abundance of burrowing infauna comprising decapods crabs and Fries’ gobies, was estimated by identifying and counting their distinctive burrow structures. While above the summer thermocline depth, burrow abundance increased in a linear fashion, below the thermocline depth a slight reduction of burrow abundance occurred in May, when oxygen conditions deteriorated again. The majority of the burrows occurring in May were made by Fries’ gobies, which are thought to encounter low oxygen concentrations in their burrows. Reduction in burrow abundance of burrowing shrimps Calocaris macandreae and Callianassa subterranea (based on descriptions of burrow structures from the literature), from March to May, might be related to their reduced activity in hypoxia, leading to loss of structural burrow maintenance. Spatial and temporal changes to macrofaunal assemblage structures were studied seasonally for one year across 5 sites in the Lough and subject to multivariate statistical analysis. Assemblage structures were significantly correlated with organic matter levels in the sediment, the amounts of organic matter settling out of the water column one month before macrofaunal sampling took place as well as current speed and temperature. This study was the first to investigate patterns and processes in the Lough soft sediment ecology across all 3 basins on a temporal and spatial scale. An investigation into the oceanographic aspects of the development, behaviour and break-down of the summer thermocline of Lough Hyne was performed in collaboration with researchers from other Irish institutions.

Variability in north temperate dung beetle assemblages at different spatial and temporal scales

This study examined the spatial and temporal variability of dung beetle assemblages across a variety of scales e.g. from the between-pad scale (examining the effects of dung size and type) to larger spatial scales encompassing southern Ireland. Dung beetle assemblage structure as sampled by dung pad cohort samples and dung baited pitfall trapping were compared. Generally, the rank order of abundance of dung beetle species was significantly correlated between pitfall catches and cohort pad samples. Across different dung sizes, in both pitfall catches and cohort pad samples, the relative abundance of species was frequently significantly different, but the rank order of abundance of dung beetle was usually significantly correlated. Considerable variations in pitfall catches at temporal scales of a few days appeared to be closely related to weather conditions and rotational grazing. However, despite considerable variation in absolute abundances between consecutive days of sampling, assemblage structure typically remained very similar. The relationship between dung pad size and dung beetle colonisation was investigated. In field experiments in which pads of different sizes (0.25 L, 0.5 L, 1.0 L and 1.5 L) were artificially deposited, there was a positive relationship between pad size and both biomass and number of beetles colonising dung pads and pitfall traps. In addition, with one exception, the field experiments indicated a general positive relationship between dung pad size and biomass density (dung beetle biomass per unit dung volume). A laboratory experiment indicated that pat residence times of A. rufipes were significantly correlated with dung pad size. Investigation of naturally-deposited cow dung pads in the field also indicated that both larval numbers and densities were significantly correlated with dung pad size. These results were discussed in the context of theory related to aggregation and coexistence of species, and resource utilisation by organisms in ephemeral, patchy resources. The colonisation by dung beetles of dung types from native herbivores (sheep, horse and cow) was investigated in field experiments. There were significant differences between the dung types in the chemical parameters measured, and there were significant differences in abundances of dung beetles colonising the dung types. Sheep dung was typically the preferred dung type. Data from these field experiments, and from published literature, indicated that dung beetle species can display dung type preferences, in terms of comparisons of both absolute and relative abundances. In addition, data from laboratory experiments indicate that both Aphodius larval production and pat residence times tended to be higher in those dung types which were preferred by adult Aphodius in the colonisation experiments. Data from dung-baited pitfall trapping (from this and another study) at several sites (up to 180 km distant) and over a number of years (between 1991 and 1996) were used to investigate spatial and temporal variation in dung beetle assemblage structure and composition (Aphodius, Sphaeridium and Geotrupes) across a range of scales in southern Ireland. Species richness levels, species composition and rank order of abundances were very similar between the assemblages. The temporal variability between seasons within any year exceeded temporal variability between years. DCA ordinations indicated that there was a similar level of variability between assemblage structure from the between-field (~1km) to regional (~180 km) spatial scales, and between year (6 years) temporal scales. At the biogeographical spatial scale, analysis of data from the literature indicated that there was considerable variability at this scale, largely due to species turnover.

Spatial and temporal scales of neuronal correlation in visual area V4.

The spiking activity of nearby cortical neurons is correlated on both short and long time scales. Understanding this shared variability in firing patterns is critical for appreciating the representation of sensory stimuli in ensembles of neurons, the coincident influences of neurons on common targets, and the functional implications of microcircuitry. Our knowledge about neuronal correlations, however, derives largely from experiments that used different recording methods, analysis techniques, and cortical regions. Here we studied the structure of neuronal correlation in area V4 of alert macaques using recording and analysis procedures designed to match those used previously in primary visual cortex (V1), the major input to V4. We found that the spatial and temporal properties of correlations in V4 were remarkably similar to those of V1, with two notable differences: correlated variability in V4 was approximately one-third the magnitude of that in V1 and synchrony in V4 was less temporally precise than in V1. In both areas, spontaneous activity (measured during fixation while viewing a blank screen) was approximately twice as correlated as visual-evoked activity. The results provide a foundation for understanding how the structure of neuronal correlation differs among brain regions and stages in cortical processing and suggest that it is likely governed by features of neuronal circuits that are shared across the visual cortex.

Summarising spatial and temporal information in CPR data

The Continuous Plankton Recorder survey provides pan-oceanic data on geographic distribution, species composition, seasonal cycles of abundance, and long-term change during the last 70 years. In this paper we compare and contrast some of the historic data-analytic protocols of the survey, focusing primarily on the various means by which spatio-temporal information in CPR data has been exposed. Relative strengths and limitations are assessed, followed by suggestions for future approaches to the visualisation and summarising of CPR data.