A Solution of the Figure-ground Problem for Biological Vision

A neural network model of 3-D visual perception and figure-ground separation by visual cortex is introduced. The theory provides a unified explanation of how a 2-D image may generate a 3-D percept; how figures pop-out from cluttered backgrounds; how spatially sparse disparity cues can generate continuous surface representations at different perceived depths; how representations of occluded regions can be completed and recognized without usually being seen; how occluded regions can sometimes be seen during percepts of transparency; how high spatial frequency parts of an image may appear closer than low spatial frequency parts; how sharp targets are detected better against a figure and blurred targets are detector better against a background; how low spatial frequency parts of an image may be fused while high spatial frequency parts are rivalrous; how sparse blue cones can generate vivid blue surface percepts; how 3-D neon color spreading, visual phantoms, and tissue contrast percepts are generated; how conjunctions of color-and-depth may rapidly pop-out during visual search. These explanations arise derived from an ecological analysis of how monocularly viewed parts of an image inherit the appropriate depth from contiguous binocularly viewed parts, as during DaVinci stereopsis. The model predicts the functional role and ordering of multiple interactions within and between the two parvocellular processing streams that join LGN to prestriate area V4. Interactions from cells representing larger scales and disparities to cells representing smaller scales and disparities are of particular importance.

Normal and Amnesis Learning, Recognition, and Memory by a Neural Model of Cortico-Hippocampal Interactions

The processes by which humans and other primates learn to recognize objects have been the subject of many models. Processes such as learning, categorization, attention, memory search, expectation, and novelty detection work together at different stages to realize object recognition. In this article, Gail Carpenter and Stephen Grossberg describe one such model class (Adaptive Resonance Theory, ART) and discuss how its structure and function might relate to known neurological learning and memory processes, such as how inferotemporal cortex can recognize both specialized and abstract information, and how medial temporal amnesia may be caused by lesions in the hippocampal formation. The model also suggests how hippocampal and inferotemporal processing may be linked during recognition learning.

A Unified Model of Spatiotemporal Processing in the Retina

A computational model of visual processing in the vertebrate retina provides a unified explanation of a range of data previously treated by disparate models. Three results are reported here: the model proposes a functional explanation for the primary feed-forward retinal circuit found in vertebrate retinae, it shows how this retinal circuit combines nonlinear adaptation with the desirable properties of linear processing, and it accounts for the origin of parallel transient (nonlinear) and sustained (linear) visual processing streams as simple variants of the same retinal circuit. The retina, owing to its accessibility and to its fundamental role in the initial transduction of light into neural signals, is among the most extensively studied neural structures in the nervous system. Since the pioneering anatomical work by Ramón y Cajal at the turn of the last century[1], technological advances have abetted detailed descriptions of the physiological, pharmacological, and functional properties of many types of retinal cells. However, the relationship between structure and function in the retina is still poorly understood. This article outlines a computational model developed to address fundamental constraints of biological visual systems. Neurons that process nonnegative input signals-such as retinal illuminance-are subject to an inescapable tradeoff between accurate processing in the spatial and temporal domains. Accurate processing in both domains can be achieved with a model that combines nonlinear mechanisms for temporal and spatial adaptation within three layers of feed-forward processing. The resulting architecture is structurally similar to the feed-forward retinal circuit connecting photoreceptors to retinal ganglion cells through bipolar cells. This similarity suggests that the three-layer structure observed in all vertebrate retinae[2] is a required minimal anatomy for accurate spatiotemporal visual processing. This hypothesis is supported through computer simulations showing that the model's output layer accounts for many properties of retinal ganglion cells[3],[4],[5],[6]. Moreover, the model shows how the retina can extend its dynamic range through nonlinear adaptation while exhibiting seemingly linear behavior in response to a variety of spatiotemporal input stimuli. This property is the basis for the prediction that the same retinal circuit can account for both sustained (X) and transient (Y) cat ganglion cells[7] by simple morphological changes. The ability to generate distinct functional behaviors by simple changes in cell morphology suggests that different functional pathways originating in the retina may have evolved from a unified anatomy designed to cope with the constraints of low-level biological vision.

Cortical Dynamics of 3-D Vision and Figure-Ground Pop-Out

Air Force Office of Scientific Research (90-0175); Defense Advanced Research Projects Agency (90-0083); Office of Naval Research (N00014-91-J-4100)

A Spectral Network Model of Pitch Perception

A model of pitch perception, called the Spatial Pitch Network or SPINET model, is developed and analyzed. The model neurally instantiates ideas front the spectral pitch modeling literature and joins them to basic neural network signal processing designs to simulate a broader range of perceptual pitch data than previous spectral models. The components of the model arc interpreted as peripheral mechanical and neural processing stages, which arc capable of being incorporated into a larger network architecture for separating multiple sound sources in the environment. The core of the new model transforms a spectral representation of an acoustic source into a spatial distribution of pitch strengths. The SPINET model uses a weighted "harmonic sieve" whereby the strength of activation of a given pitch depends upon a weighted sum of narrow regions around the harmonics of the nominal pitch value, and higher harmonics contribute less to a pitch than lower ones. Suitably chosen harmonic weighting functions enable computer simulations of pitch perception data involving mistuned components, shifted harmonics, and various types of continuous spectra including rippled noise. It is shown how the weighting functions produce the dominance region, how they lead to octave shifts of pitch in response to ambiguous stimuli, and how they lead to a pitch region in response to the octave-spaced Shepard tone complexes and Deutsch tritones without the use of attentional mechanisms to limit pitch choices. An on-center off-surround network in the model helps to produce noise suppression, partial masking and edge pitch. Finally, it is shown how peripheral filtering and short term energy measurements produce a model pitch estimate that is sensitive to certain component phase relationships.

A Self-Organizing Neural Model of Motor Equivalent Reaching and Tool Use by a Multijoint Arm

This paper describes a self-organizing neural model for eye-hand coordination. Called the DIRECT model, it embodies a solution of the classical motor equivalence problem. Motor equivalence computations allow humans and other animals to flexibly employ an arm with more degrees of freedom than the space in which it moves to carry out spatially defined tasks under conditions that may require novel joint configurations. During a motor babbling phase, the model endogenously generates movement commands that activate the correlated visual, spatial, and motor information that are used to learn its internal coordinate transformations. After learning occurs, the model is capable of controlling reaching movements of the arm to prescribed spatial targets using many different combinations of joints. When allowed visual feedback, the model can automatically perform, without additional learning, reaches with tools of variable lengths, with clamped joints, with distortions of visual input by a prism, and with unexpected perturbations. These compensatory computations occur within a single accurate reaching movement. No corrective movements are needed. Blind reaches using internal feedback have also been simulated. The model achieves its competence by transforming visual information about target position and end effector position in 3-D space into a body-centered spatial representation of the direction in 3-D space that the end effector must move to contact the target. The spatial direction vector is adaptively transformed into a motor direction vector, which represents the joint rotations that move the end effector in the desired spatial direction from the present arm configuration. Properties of the model are compared with psychophysical data on human reaching movements, neurophysiological data on the tuning curves of neurons in the monkey motor cortex, and alternative models of movement control.

Cortical Dynamics of Feature Binding and Reset: Control of Visual Persistence

An analysis of the reset of visual cortical circuits responsible for the binding or segmentation of visual features into coherent visual forms yields a model that explains properties of visual persistence. The reset mechanisms prevent massive smearing or visual percepts in response to rapidly moving images. The model simulates relationships among psychophysical data showing inverse relations of persistence to flash luminance and duration, greaterr persistence of illusory contours than real contours, a U-shaped temporal function for persistence of illusory contours, a reduction of persistence: due to adaptation with a stimulus of like orientation, an increase or persistence due to adaptation with a stimulus of perpendicular orientation, and an increase of persistence with spatial separation of a masking stimulus. The model suggests that a combination of habituative, opponent, and endstopping mechanisms prevent smearing and limit persistence. Earlier work with the model has analyzed data about boundary formation, texture segregation, shape-from-shading, and figure-ground separation. Thus, several types of data support each model mechanism and new predictions are made.

The Role of Edges and Line-Ends in Illusory Contour Formation

Illusory contours can be induced along direction approximately collinear to edges or approximately perpendicular to the ends of lines. Using a rating scale procedure we explored the relation between the two types of inducers by systematically varying the thickness of inducing elements to result in varying amounts of "edge-like" or "line-like" induction. Inducers for our illusory figures consisted of concentric rings with arcs missing. Observers judged the clarity and brightness of illusory figures as the number of arcs, their thicknesses, and spacings were parametrically varied. Degree of clarity and amount of induced brightness were both found to be inverted-U functions of the number of arcs. These results mandate that any valid model of illusory contour formation must account for interference effects between parallel lines or between those neural units responsible for completion of boundary signals in directions perpendicular to the ends of thin lines. Line width was found to have an efFect on both clarity and brightness, a finding inconsistent with those models which employ only completion perpendicular to inducer orientation.

Store Working Memory Networks for Storage and Recall of Arbitrary Temporal Sequences

Neural network models of working memory, called Sustained Temporal Order REcurrent (STORE) models, are described. They encode the invariant temporal order of sequential events in short term memory (STM) in a way that mimics cognitive data about working memory, including primacy, recency, and bowed order and error gradients. As new items are presented, the pattern of previously stored items is invariant in the sense that, relative activations remain constant through time. This invariant temporal order code enables all possible groupings of sequential events to be stably learned and remembered in real time, even as new events perturb the system. Such a competence is needed to design self-organizing temporal recognition and planning systems in which any subsequence of events may need to be categorized in order to to control and predict future behavior or external events. STORE models show how arbitrary event sequences may be invariantly stored, including repeated events. A preprocessor interacts with the working memory to represent event repeats in spatially separate locations. It is shown why at least two processing levels are needed to invariantly store events presented with variable durations and interstimulus intervals. It is also shown how network parameters control the type and shape of primacy, recency, or bowed temporal order gradients that will be stored.

A Neural Network Model for Cursive Script Production

This article describes a neural network model, called the VITEWRITE model, for generating handwriting movements. The model consists of a sequential controller, or motor program, that interacts with a trajectory generator to move a. hand with redundant degrees of freedom. The neural trajectory generator is the Vector Integration to Endpoint (VITE) model for synchronous variable-speed control of multijoint movements. VITE properties enable a simple control strategy to generate complex handwritten script if the hand model contains redundant degrees of freedom. The proposed controller launches transient directional commands to independent hand synergies at times when the hand begins to move, or when a velocity peak in a given synergy is achieved. The VITE model translates these temporally disjoint synergy commands into smooth curvilinear trajectories among temporally overlapping synergetic movements. The separate "score" of onset times used in most prior models is hereby replaced by a self-scaling activity-released "motor program" that uses few memory resources, enables each synergy to exhibit a unimodal velocity profile during any stroke, generates letters that are invariant under speed and size rescaling, and enables effortless. connection of letter shapes into words. Speed and size rescaling are achieved by scalar GO and GRO signals that express computationally simple volitional commands. Psychophysical data concerning band movements, such as the isochrony principle, asymmetric velocity profiles, and the two-thirds power law relating movement curvature and velocity arise as emergent properties of model interactions.

Serotonin transporter genotype modulates social reward and punishment in rhesus macaques

Background: Serotonin signaling influences social behavior in both human and nonhuman primates. In humans, variation upstream of the promoter region of the serotonin transporter gene (5-HTTLPR) has recently been shown to influence both behavioral measures of social anxiety and amygdala response to social threats. Here we show that length polymorphisms in 5-HTTLPR predict social reward and punishment in rhesus macaques, a species in which 5-HTTLPR variation is analogous to that of humans. Methodology/Principal Findings: In contrast to monkeys with two copies of the long allele (L/L), monkeys with one copy of the short allele of this gene (S/L) spent less time gazing at face than non-face images, less time looking in the eye region of faces, and had larger pupil diameters when gazing at photos of a high versus low status male macaques. Moreover, in a novel primed gambling task, presentation of photos of high status male macaques promoted risk-aversion in S/L monkeys but promoted risk-seeking in L/L monkeys. Finally, as measured by a "pay-per-view" task, S/L monkeys required juice payment to view photos of high status males, whereas L/L monkeys sacrificed fluid to see the same photos. Conclusions/Significance: These data indicate that genetic variation in serotonin function contributes to social reward and punishment in rhesus macaques, and thus shapes social behavior in humans and rhesus macaques alike. © 2009 Watson et al.

Brain activity during episodic retrieval of autobiographical and laboratory events: an fMRI study using a novel photo paradigm.

Functional neuroimaging studies of episodic memory retrieval generally measure brain activity while participants remember items encountered in the laboratory ("controlled laboratory condition") or events from their own life ("open autobiographical condition"). Differences in activation between these conditions may reflect differences in retrieval processes, memory remoteness, emotional content, retrieval success, self-referential processing, visual/spatial memory, and recollection. To clarify the nature of these differences, a functional MRI study was conducted using a novel "photo paradigm," which allows greater control over the autobiographical condition, including a measure of retrieval accuracy. Undergraduate students took photos in specified campus locations ("controlled autobiographical condition"), viewed in the laboratory similar photos taken by other participants (controlled laboratory condition), and were then scanned while recognizing the two kinds of photos. Both conditions activated a common episodic memory network that included medial temporal and prefrontal regions. Compared with the controlled laboratory condition, the controlled autobiographical condition elicited greater activity in regions associated with self-referential processing (medial prefrontal cortex), visual/spatial memory (visual and parahippocampal regions), and recollection (hippocampus). The photo paradigm provides a way of investigating the functional neuroanatomy of real-life episodic memory under rigorous experimental control.

TEACHING AMERICAN CIVIL WAR MUSIC IDSTORY WITH MODERN EDITIONS OF PERIOD MUSIC FOR FULL CONCERT BAND

This dissertation explores a method of teaching the history of Civil War music and musicians through modern full-band editions of original brass band music. In the study of music history the period of the Civil War is rarely discussed, or at best, mentioned only if a student takes a specific course on the history of bands and happens to look deeply into the background of some of the early band pioneers such as Patrick Gilmore, who served in the Union Army as a bandmaster. The history of the musicians, bands, and music performed during the Civil War deserves study to provide a way for students and audiences to learn this history. This project includes lesson plans that can be used with the arrangements of the period music as well as select published music that is also representative of the period. Included with the historical information are four arrangements of original brass band music now scored for full concert band. Each arrangement includes a section scored for brass only with optional brass band parts. Historical information is provided on the Civil War period bands and how each side used them, on the composers of the music, and also on the individual compositions. The historical information can be used to supplement the lesson plans to teach the history, as well as for program notes for audiences. The research involved locating information on both Union and Confederate bands available in books, other dissertations, articles, and interviews with Civil War music historians. The original brass band music is scored for full band. This method will allow teachers and conductors to highlight this period of wind band history and to share it with both students and audiences. Included with this project are photos and video footage taken during a visit with the 1st Brigade Band of Watertown, Wisconsin, an historical organization dedicated to recreating the music and performances of an actual Civil War era band.

Bottlenose dolphins exchange signature whistles when meeting at sea.

The bottlenose dolphin, Tursiops truncatus, is one of very few animals that, through vocal learning, can invent novel acoustic signals and copy whistles of conspecifics. Furthermore, receivers can extract identity information from the invented part of whistles. In captivity, dolphins use such signature whistles while separated from the rest of their group. However, little is known about how they use them at sea. If signature whistles are the main vehicle to transmit identity information, then dolphins should exchange these whistles in contexts where groups or individuals join. We used passive acoustic localization during focal boat follows to observe signature whistle use in the wild. We found that stereotypic whistle exchanges occurred primarily when groups of dolphins met and joined at sea. A sequence analysis verified that most of the whistles used during joins were signature whistles. Whistle matching or copying was not observed in any of the joins. The data show that signature whistle exchanges are a significant part of a greeting sequence that allows dolphins to identify conspecifics when encountering them in the wild.

Interactions spatiales et auto-organisation des végétations semi-arides

Les recherches récapitulées dans cette thèse de doctorat ont porté sur les causes de l’organisation spatiale des végétations périodiques. Ces structures paysagères aux motifs réguliers, tachetés, tigrés ou labyrinthiques, d’échelle décamétrique à hectométrique, couvrant des étendues considérables sur au moins trois continents, constituent un cas d’école dans l’étude des processus endogènes présidant à l’hétérogénéité du couvert végétal. Ces structures prennent place sur un substrat homogène, mis à part la rétroaction du couvert lui-même, et sont marquées par des écotones abrupts et la persistance d’une proportion considérable de sol nu. Plusieurs modèles ont mis en avant l’existence possible d’un phénomène d’auto-organisation du couvert, qui verrait une structure d’ensemble émerger des interactions locales entre individus. Ces modèles se basent sur le jeu simultané de la consommation de la ressource (compétition) et de l’amélioration de l’un ou l’autre des éléments du bilan de la même ressource par le couvert (facilitation). La condition à l’existence d’une structure d’ensemble spatialement périodique et stable réside dans une différence entre la portée de la compétition (plus grande) et celle de la facilitation. L’apparition de ces structures est modulée par le taux de croissance biologique, qui est le reflet des contraintes extérieures telles que l’aridité, le pâturage ou la coupe de bois. Le modus operandi des interactions spatiales supposées entre individus reste largement à préciser.

Nos recherches ont été menées au sud-ouest de la République du Niger, à l’intérieur et dans les environs du parc Régional du W. Trois axes ont été explorés :(i) Une étude de la dépendance spatiale entre la structure de la végétation (biovolumes cartographiés) et les paramètres du milieu abiotique (relief, sol), sur base d’analyses spectrales et cross-spectrales par transformée de Fourier (1D et 2D). (ii) Une étude diachronique (1956, 1975 et 1996) à large échelle (3000 km²) de l’influence de l’aridité et des pressions d’origine anthropique sur l’auto-organisation des végétations périodiques, basée sur la caractérisation de la structure spatiale des paysages sur photos aériennes via la transformée de Fourier en 2D. (iii) Trois études portant sur les interactions spatiales entre individus :En premier lieu, via l’excavation des systèmes racinaires (air pulsé) ;Ensuite, par un suivi spatio-temporel du bilan hydrique du sol (blocs de gypse) ;Enfin, via le marquage de la ressource par du deutérium.

Nous avons ainsi pu établir que les végétations périodiques constituent bien un mode d’auto-organisation pouvant survenir sur substrat homogène et modulé par les contraintes climatiques et anthropiques. Un ajustement rapide entre l’organisation des végétations périodiques et le climat a pu être montrée en zone protégée. La superficie et l’organisation des végétations périodiques y ont tour à tour progressé et régressé en fonction d’épisodes secs ou humides. Par contre, en dehors de l’aire protégée, la possibilité d’une restauration du couvert semble fortement liée au taux d’exploitation des ressources végétales. Ces résultats ont d’importantes implications quant à la compréhension des interactions entre climat et écosystèmes et à l’évaluation de leurs capacités de charge. La caractérisation de la structure spatiale des végétations arides, notamment par la transformée de Fourier d’images HR, devrait être généralisée comme outil de monitoring de l’état de ces écosystèmes. Nos études portant sur les modes d’interactions spatiales ont permis de confirmer l’existence d’une facilitation à courte portée du couvert végétal sur la ressource. Cependant, cette facilitation ne semble pas s’exercer sur le terme du bilan hydrique traditionnellement avancé, à savoir l’infiltration, mais plutôt sur le taux d’évaporation (deux fois moindre à l’ombre des canopées). Ce mécanisme exclut l’existence de transferts diffusifs souterrains entre sols nu et fourrés. Des transferts inverses semblent d’ailleurs montrés par le marquage isotopique. L’étude du bilan hydrique et la cartographie du micro-relief, ainsi que la profondeur fortement réduite de la zone d’exploitation racinaire, jettent de sérieux doutes quant au rôle communément admis des transferts d’eau par ruissellement/diffusion de surface en tant que processus clé dans la compétition à distance entre les plantes. L’alternative réside dans l’existence d’une compétition racinaire de portée supérieure aux canopées. Cette hypothèse trouve une confirmation tant par les rhizosphères excavées, superficielles et étendues, que dans le marquage isotopique, montrant des contaminations d’arbustes situés à plus de 15 m de la zone d’apport. De même, l’étude du bilan hydrique met en évidence les influences simultanées et contradictoires (facilitation/compétition) des ligneux sur l’évapotranspiration.

/

This PhD thesis gathers results of a research dealing with the causes of the spatial organisation of periodic vegetations. These landscape structures, featuring regular spotted, labyrinthine or banded patterns of decametric to hectometric scale, and extending over considerable areas on at least three continents, constitute a perfect study case to approach endogenous processes leading to vegetation heterogeneities. These patterns occur over homogeneous substratum, except for vegetation’s own feedbacks, and are marked by sharp ecotones and the persistence of a considerable amount of bare soil. A number of models suggested a possible case of self-organized patterning, in which the general structure would emerge from local interactions between individuals. Those models rest on the interplay of competitive and facilitative effects, relating to soil water consumption and to soil water budget enhancement by vegetation. A general necessary condition for pattern formation to occur is that negative interactions (competition) have a larger range than positive interactions (facilitation). Moreover, all models agree with the idea that patterning occurs when vegetation growth decreases, for instance as a result of reduced water availability, domestic grazing or wood cutting, therefore viewing patterns as a self-organised response to environmental constraints. However the modus operandi of the spatial interactions between individual plants remains largely to be specified.

We carried out a field research in South-West Niger, within and around the W Regional Park. Three research lines were explored: (i) The study of the spatial dependency between the vegetation pattern (mapped biovolumes) and the factors of the abiotic environment (soil, relief), on the basis of spectral and cross-spectral analyses with Fourier transform (1D and 2D). (ii) A broad scale diachronic study (1956, 1975, 1996) of the influence of aridity and human induced pressures on the vegetation self-patterning, based on the characterisation of patterns on high resolution remote sensing data via 2D Fourier transform. (iii) Three different approaches of the spatial interactions between individuals: via root systems excavation with pulsed air; via the monitoring in space and time of the soil water budget (gypsum blocks method); and via water resource labelling with deuterated water.

We could establish that periodic vegetations are indeed the result of a self-organisation process, occurring in homogeneous substratum conditions and modulated by climate and human constraints. A rapid adjustment between vegetation patterning and climate could be observed in protected zones. The area and patterning of the periodic vegetations successively progressed and regressed, following drier or wetter climate conditions. On the other hand, outside protected areas, the restoration ability of vegetation appeared to depend on the degree of vegetation resource exploitation. These results have important implications regarding the study of vegetation-climate interactions and the evaluation of ecosystems’ carrying capacities. Spatial pattern characterisation in arid vegetations using Fourier transform of HR remote sensing data should be generalised for the monitoring of those ecosystems. Our studies dealing with spatial interaction mechanisms confirmed the existence of a short range facilitation of the cover on water resource. However, this facilitation does not seem to act through the commonly accepted infiltration component, but rather on the evaporative rate (twice less within thickets). This mechanism excludes underground diffusive transfers between bare ground and vegetation. Inverse transfers were even shown by deuterium labelling. Water budget study and micro-elevation mapping, along with consistent soil shallowness, together cast serious doubts on the traditional mechanism of run-off/diffusion of surface water as a key process of the long range competition between plants. An alternative explanation lies in long range root competition. This hypothesis find support as well in the excavated root systems, shallow and wide, as in isotopic labelling, showing contaminations of shrubs located up to 15 m of the irrigated area. Water budget study also evidenced simultaneous contradictory effects (facilitation/competition) of shrubs on evapotranspiration.