Organization of the inferotemporal cortex in the macaque monkey: Connections of areas PITv and CITvp

Visual cortex of macaque monkeys consists of a large number of cortical areas that span the occipital, parietal, temporal, and frontal lobes and occupy more than half of cortical surface. Although considerable progress has been made in understanding the contributions of many occipital areas to visual perceptual processing, much less is known concerning the specific functional contributions of higher areas in the temporal and frontal lobes. Previous behavioral and electrophysiological investigations have demonstrated that the inferotemporal cortex (IT) is essential to the animal's ability to recognize and remember visual objects. While it is generally recognized that IT consists of a number of anatomically and functionally distinct visual-processing areas, there remains considerable controversy concerning the precise number, size, and location of these areas. Therefore, the precise delineation of the cortical subdivisions of inferotemporal cortex is critical for any significant progress in the understanding of the specific contributions of inferotemporal areas to visual processing. In this study, anterograde and/or retrograde neuroanatomical tracers were injected into two visual areas in the ventral posterior and central portions of IT (areas PITv and CITvp) to elucidate the corticocortical connections of these areas with well known areas of occipital cortex and with less well understood regions of inferotemporal cortex. The locations of injection sites and the delineation of the borders of many occipital areas were aided by the pattern of interhemispheric connections, revealed following callosal transection and subsequent labeling with HRP. The resultant patterns of connections were represented on two-dimensional computational (CARET) and manual cortical maps and the laminar characteristics and density of the projection fields were quantified. The laminar and density features of these corticocortical connections demonstrate thirteen anatomically distinct subdivisions or areas distributed within the superior temporal sulcus and across the inferotemporal gyrus. These results serve to refine previous descriptions of inferotemporal areas, validate recently identified areas, and provide a new description of the hierarchical relationships among occipitotemporal cortical areas in macaques. ^

Formation of mnemonic neuronal responses to visual paired associates in inferotemporal cortex is impaired by perirhinal and entorhinal lesions.

Functional roles of the cortical backward signal in long-term memory formation were studied in monkeys performing a visual pair-association task. Before the monkeys learned the task, the anterior commissure was transected, disconnecting the anterior temporal cortex of each hemisphere. After training with 12 pairs of pictures, single units were recorded from the inferotemporal cortex of the monkeys as the control. By injecting a grid of ibotenic acid, we unilaterally lesioned the entorhinal and perirhinal cortex, which provides massive direct and indirect backward projections ipsilaterally to the inferotemporal cortex. After the lesion, the monkeys fixated the cue stimulus normally, relearned the preoperatively learned set (set A), and learned a new set (set B) of paired associates. Then, single units were recorded from the same area as for the prelesion control. We found that (i) in spite of the lesion, the sampled neurons responded strongly and selectively to both the set A and set B patterns and (ii) the paired associates elicited significantly correlated responses in the control neurons before the lesion but not in the cells tested after the lesion, either for set A or set B stimuli. We conclude that the ability of inferotemporal neurons to represent association between picture pairs was lost after the lesion of entorhinal and perirhinal cortex, most likely through disruption of backward neural signals to the inferotemporal neurons, while the ability of the neurons to respond to a particular visual stimulus was left intact.

A study of pyramidal cell structure in the cingulate cortex of the macaque monkey with comparative notes on inferotemporal and primary visual cortex

Recent studies have revealed a marked degree of variation in the pyramidal cell phenotype in visual, somatosensory, motor and prefrontal cortical areas in the brain of different primates, which are believed to subserve specialized cortical function. In the present study we carried out comparisons of dendritic structure of layer III pyramidal cells in the anterior and posterior cingulate cortex and compared their structure with those sampled from inferotemporal cortex (IT) and the primary visual area (V1) in macaque monkeys. Cells were injected with Lucifer Yellow in flat-mounted cortical slices, and processed for a light-stable DAB reaction product. Size, branching pattern, and spine density of basal dendritic arbors was determined, and somal areas measured. We found that pyramidal cells in anterior cingulate cortex were more branched and more spinous than those in posterior cingulate cortex, and cells in both anterior and posterior cingulate were considerably larger, more branched, and more spinous than those in area V1. These data show that pyramidal cell structure differs between posterior dysgranular and anterior granular cingulate cortex, and that pyramidal neurons in cingulate cortex have different structure to those in many other cortical areas. These results provide further evidence for a parallel between structural and functional specialization in cortex.

Dendritic branching patterns of pyramidal cells in the visual cortex of the new world marmoset monkey, with comparative notes on the old world macaque monkey

The basal dendritic arbors of 442 supragranular pyramidal cells in visual cortex of the marmoset monkey were compared by fractal analyses. As detailed in a previous study,(1) individual cells were injected with Lucifer Yellow and processed for a DAB reaction product. The basal dendritic arbors were drawn, in the tangential plane, and the fractal dimension (D) determined by the dilation method. The fractal dimensions were compared between cells in ten cortical areas containing cells involved in visual processing, including the primary visual area (Vi), the second visual area (V2), the dorsoanterior area (DA), the dorsomedial area (DM), the dorsolateral. area (DL), the middle temporal area (MT), the posterior parietal area (PP), the fundus of the superior temporal area (FST) and the caudal and rostral subdivisions of inferotemporal cortex (ITc and ITr, respectively). Of 45 pairwise interareal comparisons of the fractal dimension of neurones, 20 were significantly different. Moreover, comparison of data according to previously published visual processing pathways revealed a trend for cells with greater fractal dimensions in higher cortical areas. Comparison of the present results with those in homologous cortical areas in the macaque monkey(2) revealed some similarities between the two species. The similarity in the trends of D values of cells in both species may reflect developmental features which, result in different functional attributes.

Dendritic branching of pyramidal cells in the visual cortex of the nocturnal owl monkey: A fractal analysis

The branching structure of neurones is thought to influence patterns of connectivity and how inputs are integrated within the arbor. Recent studies have revealed a remarkable degree of variation in the branching structure of pyramidal cells in the cerebral cortex of diurnal primates, suggesting regional specialization in neuronal function. Such specialization in pyramidal cell structure may be important for various aspects of visual function, such as object recognition and color processing. To better understand the functional role of regional variation in the pyramidal cell phenotype in visual processing, we determined the complexity of the dendritic branching pattern of pyramidal cells in visual cortex of the nocturnal New World owl monkey. We used the fractal dilation method to quantify the branching structure of pyramidal cells in the primary visual area (V1), the second visual area (V2) and the caudal and rostral subdivisions of inferotemporal cortex (ITc and ITr, respectively), which are often associated with color processing. We found that, as in diurnal monkeys, there was a trend for cells of increasing fractal dimension with progression through these cortical areas. The increasing complexity paralleled a trend for increasing symmetry. That we found a similar trend in both diurnal and nocturnal monkeys suggests that it was a feature of a common anthropoid ancestor.

Modeling Invariances in Inferotemporal Cell Tuning

In macaque inferotemporal cortex (IT), neurons have been found to respond selectively to complex shapes while showing broad tuning ("invariance") with respect to stimulus transformations such as translation and scale changes and a limited tuning to rotation in depth. Training monkeys with novel, paperclip-like objects, Logothetis et al. could investigate whether these invariance properties are due to experience with exhaustively many transformed instances of an object or if there are mechanisms that allow the cells to show response invariance also to previously unseen instances of that object. They found object-selective cells in anterior IT which exhibited limited invariance to various transformations after training with single object views. While previous models accounted for the tuning of the cells for rotations in depth and for their selectivity to a specific object relative to a population of distractor objects, the model described here attempts to explain in a biologically plausible way the additional properties of translation and size invariance. Using the same stimuli as in the experiment, we find that model IT neurons exhibit invariance properties which closely parallel those of real neurons. Simulations show that the model is capable of unsupervised learning of view-tuned neurons. The model also allows to make experimentally testable predictions regarding novel stimulus transformations and combinations of stimuli.

Learning and recall of form discriminations during reversible cooling deactivation of ventral-posterior suprasylvian cortex in the cat.

Extrastriate visual cortex of the ventral-posterior suprasylvian gyrus (vPS cortex) of freely behaving cats was reversibly deactivated with cooling to determine its role in performance on a battery of simple or masked two-dimensional pattern discriminations, and three-dimensional object discriminations. Deactivation of vPS cortex by cooling profoundly impaired the ability of the cats to recall the difference between all previously learned pattern and object discriminations. However, the cats' ability to learn or relearn pattern and object discriminations while vPS was deactivated depended upon the nature of the pattern or object and the cats' prior level of exposure to them. During cooling of vPS cortex, the cats could neither learn the novel object discriminations nor relearn a highly familiar masked or partially occluded pattern discrimination, although they could relearn both the highly familiar object and simple pattern discriminations. These cooling-induced deficits resemble those induced by cooling of the topologically equivalent inferotemporal cortex of monkeys and provides evidence that the equivalent regions contribute to visual processing in similar ways.

Fractal analysis of pyramidal cells in the visual cortex of the galago (Otolemur garnetti): Regional variation in dendritic branching patterns between visual areas

Previously it has been shown that the branching pattern of pyramidal cells varies markedly between different cortical areas in simian primates. These differences are thought to influence the functional complexity of the cells. In particular, there is a progressive increase in the fractal dimension of pyramidal cells with anterior progression through cortical areas in the occipitotemporal (OT) visual stream, including the primary visual area (V1), the second visual area (V2), the dorsolateral area (DL, corresponding to the fourth visual area) and inferotemporal cortex (IT). However, there are as yet no data on the fractal dimension of these neurons in prosimian primates. Here we focused on the nocturnal prosimian galago (Otolemur garnetti). The fractal dimension (D), and aspect ratio (a measure of branching symmetry), was determined for I I I layer III pyramidal cells in V1, V2, DL and IT. We found, as in simian primates, that the fractal dimension of neurons increased with anterior progression from V1 through V2, DL, and IT. Two important conclusions can be drawn from these results: (1) the trend for increasing branching complexity with anterior progression through OT areas was likely to be present in a common primate ancestor, and (2) specialization in neuron structure more likely facilitates object recognition than spectral processing.

Regional specialization in pyramidal cell structure in the visual cortex of the galago: An intracellular injection study of striate and extrastriate areas with comparative notes on New World and Old World monkeys

Recent studies have revealed marked differences in the basal dendritic structure of layer III pyramidal cells in the cerebral cortex of adult simian primates. In particular, there is a consistent trend for pyramidal cells of increasing complexity with anterior progression through occipitotemporal cortical visual areas. These differences in pyramidal cell structure, and their systematic nature, are believed to be important for specialized aspects of visual processing within, and between, cortical areas. However, it remains unknown whether this regional specialization in the pyramidal cell phenotype is unique to simians, is unique to primates in general or is widespread amongst mammalian species. In the present study we investigated pyramidal cell structure in the prosimian galago (Otolemur garnetti). We found, as in simians, that the basal dendritic arbors of pyramidal cells differed between cortical areas. More specifically, pyramidal cells became progressively more spinous through the primary (V1), second (V2), dorsolateral (DL) and inferotemporal ( IT) visual areas. Moreover, pyramidal neurons in V1 of the galago are remarkably similar to those in other primate species, in spite of large differences in the sizes of this area. In contrast, pyramidal cells in inferotemporal cortex are quite variable among primate species. These data suggest that regional specialization in pyramidal cell phenotype was a likely feature of cortex in a common ancestor of simian and prosimian primates, but the degree of specialization varies between species. Copyright (C) 2005 S. Karger AG, Basel.

A Detailed Look at Scale and Translation Invariance in a Hierarchical Neural Model of Visual Object Recognition

The HMAX model has recently been proposed by Riesenhuber & Poggio as a hierarchical model of position- and size-invariant object recognition in visual cortex. It has also turned out to model successfully a number of other properties of the ventral visual stream (the visual pathway thought to be crucial for object recognition in cortex), and particularly of (view-tuned) neurons in macaque inferotemporal cortex, the brain area at the top of the ventral stream. The original modeling study only used ``paperclip'' stimuli, as in the corresponding physiology experiment, and did not explore systematically how model units' invariance properties depended on model parameters. In this study, we aimed at a deeper understanding of the inner workings of HMAX and its performance for various parameter settings and ``natural'' stimulus classes. We examined HMAX responses for different stimulus sizes and positions systematically and found a dependence of model units' responses on stimulus position for which a quantitative description is offered. Interestingly, we find that scale invariance properties of hierarchical neural models are not independent of stimulus class, as opposed to translation invariance, even though both are affine transformations within the image plane.

Generalization over contrast and mirror reversal, but not figure-ground reversal, in an "edge-based

Baylis & Driver (Nature Neuroscience, 2001) have recently presented data on the response of neurons in macaque inferotemporal cortex (IT) to various stimulus transformations. They report that neurons can generalize over contrast and mirror reversal, but not over figure-ground reversal. This finding is taken to demonstrate that ``the selectivity of IT neurons is not determined simply by the distinctive contours in a display, contrary to simple edge-based models of shape recognition'', citing our recently presented model of object recognition in cortex (Riesenhuber & Poggio, Nature Neuroscience, 1999). In this memo, I show that the main effects of the experiment can be obtained by performing the appropriate simulations in our simple feedforward model. This suggests for IT cell tuning that the possible contributions of explicit edge assignment processes postulated in (Baylis & Driver, 2001) might be smaller than expected.

Stimulus Simplification and Object Representation: A Modeling Study

Tsunoda et al. (2001) recently studied the nature of object representation in monkey inferotemporal cortex using a combination of optical imaging and extracellular recordings. In particular, they examined IT neuron responses to complex natural objects and "simplified" versions thereof. In that study, in 42% of the cases, optical imaging revealed a decrease in the number of activation patches in IT as stimuli were "simplified". However, in 58% of the cases, "simplification" of the stimuli actually led to the appearance of additional activation patches in IT. Based on these results, the authors propose a scheme in which an object is represented by combinations of active and inactive columns coding for individual features. We examine the patterns of activation caused by the same stimuli as used by Tsunoda et al. in our model of object recognition in cortex (Riesenhuber 99). We find that object-tuned units can show a pattern of appearance and disappearance of features identical to the experiment. Thus, the data of Tsunoda et al. appear to be in quantitative agreement with a simple object-based representation in which an object's identity is coded by its similarities to reference objects. Moreover, the agreement of simulations and experiment suggests that the simplification procedure used by Tsunoda (2001) is not necessarily an accurate method to determine neuronal tuning.

Early malnutrition decreases contrast sensitivity to circular concentric gratings

Early malnutrition refers to inadequate nutrition during the critical period of nervous system development followed by nutritional recovery, resulting in a short stature according to age but normal weight according to short stature. We measured the effects of early malnutrition on contrast sensitivity (CS) to concentric circular gratings in 18 children of both sexes, aged 8 to 11 years (mean = 9.2 years, standard deviation = .99 years). Nine of the children were eutrophic (E group), and nine experienced early malnutrition (EM group) based on state healthcare records and Waterlow's anthropometric parameters. Contrast sensitivity to four spatial frequencies (.25, 1.0, 2.0, and 8.0 cycles per degree [cpd]) was measured using a temporal two-alternative forced-choice psychophysical method with mean luminance of 40.1 cd/m². Statistical analyses showed significant differences between groups and a group × frequency interaction. EM group was significantly less sensitive than the E group to the 8.0 cpd frequency and needed 1.49-times more contrast to detect the gratings. These results suggest that early malnutrition impairs CS to high-spatial-frequency concentric circular gratings in children. Therefore, early malnutrition, which is known to affect primary visual cortical areas, may also affect higher visual cortical areas such as V4 and the inferotemporal cortex.

The temporal lobe is a target of output from the basal ganglia.

The basal ganglia are known to receive inputs from widespread regions of the cerebral cortex, such as the frontal, parietal, and temporal lobes. Of these cortical areas, only the frontal lobe is thought to be the target of basal ganglia output. One of the cortical regions that is a source of input to the basal ganglia is area TE, in inferotemporal cortex. This cortical area is thought to be critically involved in the recognition and discrimination of visual objects. Using retrograde transneuronal transport of herpes simplex virus type 1, we have found that one of the output nuclei of the basal ganglia, the substantia nigra pars reticulata, projects via the thalamus to TE. Thus, TE is not only a source of input to the basal ganglia, but also is a target of basal ganglia output. This result implies that the output of the basal ganglia influences higher order aspects of visual processing. In addition, we propose that dysfunction of the basal ganglia loop with TE leads to alterations in visual perception, including visual hallucinations.

The human temporal cortex: Characterization of neurons expressing nitric oxide synthase, neuropeptides and calcium-binding proteins, and their glutamate receptor subunit profiles

Immunocytochemical techniques were used to examine the distribution of neurons immunoreactive (-ir) for nitric oxide synthase (nNOS), somatostatin (SOM), neuropeptide Y (NPY), parvalbumin (PV), calbindin (CB) and calretinin (CH), in the inferotemporal gyros (Brodmann's area 21) of the human neocortex. Neurons that colocalized either nNOS or SOM with PV, CB or CR were also identified by double-labeling techniques. Furthermore, glutamate receptor subunit profiles (GluR1, GluR2/3, GluR2/4, GluR5/6/7 and NMDAR1) were also determined for these cells. The number and distribution of cells containing nNOS, SOM, NPY, PV, CB or CR differed for each antigen. In addition, distinct subpopulations of neurons displayed different degrees of colocalization of these antigens depending on which antigens were compared. Moreover, cells that contained nNOS, SOM, NPY, PV, GB or CR expressed different receptor subunit profiles. These results show that specific subpopulations of neurochemically identified nonpyramidal cells may be activated via different receptor subtypes. As these different subpopulations of cells project to specific regions of pyramidal calls, facilitation of subsets of these cells via different receptor subunits may activate different inhibitory circuits. Thus, various distinct, but overlapping, inhibitory circuits may act in concert in the modulation of normal cortical function, plasticity and disease.