Neural routing circuits for forming invariant representations of visual objects

This thesis presents a biologically plausible model of an attentional mechanism for forming position- and scale-invariant representations of objects in the visual world. The model relies on a set of control neurons to dynamically modify the synaptic strengths of intra-cortical connections so that information from a windowed region of primary visual cortex (Vl) is selectively routed to higher cortical areas. Local spatial relationships (i.e., topography) within the attentional window are preserved as information is routed through the cortex, thus enabling attended objects to be represented in higher cortical areas within an object-centered reference frame that is position and scale invariant. The representation in V1 is modeled as a multiscale stack of sample nodes with progressively lower resolution at higher eccentricities. Large changes in the size of the attentional window are accomplished by switching between different levels of the multiscale stack, while positional shifts and small changes in scale are accomplished by translating and rescaling the window within a single level of the stack. The control signals for setting the position and size of the attentional window are hypothesized to originate from neurons in the pulvinar and in the deep layers of visual cortex. The dynamics of these control neurons are governed by simple differential equations that can be realized by neurobiologically plausible circuits. In pre-attentive mode, the control neurons receive their input from a low-level "saliency map" representing potentially interesting regions of a scene. During the pattern recognition phase, control neurons are driven by the interaction between top-down (memory) and bottom-up (retinal input) sources. The model respects key neurophysiological, neuroanatomical, and psychophysical data relating to attention, and it makes a variety of experimentally testable predictions.

Anatomical and developmental patterns of interleukin-2 gene expression in the mouse: analysis of IL-2 expressing cells and partial characterization of interactions involved in mediating IL-2 gene expression in vivo

Interleukin-2 (IL-2) is an important mediator in the vertebrate immune system. IL-2 is a potent growth factor that mature T lymphocytes use as a proliferation signal and the production of IL-2 is crucial for the clonal expansion of antigen-specific T cells in the primary immune response. IL-2 driven proliferation is dependent on the interaction of the lymphokine with its cognate multichain receptor. IL-2 expression is induced only upon stimulation and transcriptional activation of the IL-2 gene relies extensively on the coordinate interaction of numerous inducible and constitutive trans-acting factors. Over the past several years, thousands of papers have been published regarding molecular and cellular aspects of IL-2 gene expression and IL-2 function. The vast majority of these reports describe work that has been carried out in vitro. However, considerably less is known about control of IL-2 gene expression and IL-2 function in vivo.

To gain new insight into the regulation of IL-2 gene expression in vivo, anatomical and developmental patterns of IL-2 gene expression in the mouse were established by employing in situ hybridization and immunohistochemical staining methodologies to tissue sections generated from normal mice and mutant animals in which T -cell development was perturbed. Results from these studies revealed several interesting aspects of IL-2 gene expression, such as (1) induction of IL-2 gene expression and protein synthesis in the thymus, the primary site of T-cell development in the body, (2) cell-type specificity of IL-2 gene expression in vivo, (3) participation of IL-2 in the extrathymic expansion of mature T cells in particular tissues, independent of an acute immune response to foreign antigen, (4) involvement of IL-2 in maintaining immunologic balance in the mucosal immune system, and (5) potential function of IL-2 in early events associated with hematopoiesis.

Extensive analysis of IL-2 mRNA accumulation and protein production in the murine thymus at various stages of development established the existence of two classes of intrathymic IL-2 producing cells. One class of intrathymic IL-2 producers was found exclusively in the fetal thymus. Cells belonging to this subset were restricted to the outermost region of the thymus. IL-2 expression in the fetal thymus was highly transient; a dramatic peak ofiL-2 mRNA accumulation was identified at day 14.5 of gestation and maximal IL-2 protein production was observed 12 hours later, after which both IL-2 mRNA and protein levels rapidly decreased. Significantly, the presence of IL-2 expressing cells in the day 14-15 fetal thymus was not contingent on the generation of T-cell receptor (TcR) positive cells. The second class of IL-2 producing cells was also detectable in the fetal thymus (cells found in this class represented a minority subset of IL-2 producers in the fetal thymus) but persist in the thymus during later stages of development and after birth. Intrathymic IL-2 producers in postnatal animals were located in the subcapsular region and cortex, indicating that these cells reside in the same areas where immature T cells are consigned. The frequency of IL-2 expressing cells in the postnatal thymus was extremely low, indicating that induction of IL-2 expression and protein synthesis are indicative of a rare activation event. Unlike the fetal class of intrathymic IL-2 producers, the presence of IL-2 producing cells in the postnatal thymus was dependent on to the generation of TcR+ cells. Subsequent examination of intrathymic IL-2 production in mutant postnatal mice unable to produce either αβ or γδ T cells showed that postnatal IL-2 producers in the thymus belong to both αβ and γδ lineages. Additionally, further studies indicated that IL-2 synthesis by immature αβ -T cells depends on the expression of bonafide TcR αβ-heterodimers. Taken altogether, IL-2 production in the postnatal thymus relies on the generation of αβ or γδ-TcR^+ cells and induction of IL-2 protein synthesis can be linked to an activation event mediated via the TcR.

With regard to tissue specificity of IL-2 gene expression in vivo, analysis of whole body sections obtained from normal neonatal mouse pups by in situ hybridization demonstrated that IL-2 mRNA^+ cells were found in both lymphoid and nonlymphoid tissues with which T cells are associated, such as the thymus (as described above), dermis and gut. Tissues devoid of IL-2 mRNA^+ cells included brain, heart, lung, liver, stomach, spine, spinal cord, kidney, and bladder. Additional analysis of isolated tissues taken from older animals revealed that IL-2 expression was undetectable in bone marrow and in nonactivated spleen and lymph nodes. Thus, it appears that extrathymic IL-2 expressing cells in nonimmunologically challenged animals are relegated to particular epidermal and epithelial tissues in which characterized subsets of T cells reside and thatinduction of IL-2 gene expression associated with these tissues may be a result of T-cell activation therein.

Based on the neonatal in situ hybridization results, a detailed investigation into possible induction of IL-2 expression resulting in IL-2 protein synthesis in the skin and gut revealed that IL-2 expression is induced in the epidermis and intestine and IL-2 protein is available to drive cell proliferation of resident cells and/or participate in immune function in these tissues. Pertaining to IL-2 expression in the skin, maximal IL-2 mRNA accumulation and protein production were observed when resident Vγ_3^+ T-cell populations were expanding. At this age, both IL-2 mRNA^+ cells and IL-2 protein production were intimately associated with hair follicles. Likewise, at this age a significant number of CD3ε^+ cells were also found in association with follicles. The colocalization of IL-2 expression and CD3ε^+ cells suggests that IL-2 expression is induced when T cells are in contact with hair follicles. In contrast, neither IL-2 mRNA nor IL-2 protein were readily detected once T-cell density in the skin reached steady-state proportions. At this point, T cells were no longer found associated with hair follicles but were evenly distributed throughout the epidermis. In addition, IL-2 expression in the skin was contingent upon the presence of mature T cells therein and induction of IL-2 protein synthesis in the skin did not depend on the expression of a specific TcR on resident T cells. These newly disclosed properties of IL-2 expression in the skin indicate that IL-2 may play an additional role in controlling mature T-cell proliferation by participating in the extrathymic expansion of T cells, particularly those associated with the epidermis.

Finally, regarding IL-2 expression and protein synthesis in the gut, IL-2 producing cells were found associated with the lamina propria of neonatal animals and gut-associated IL-2 production persisted throughout life. In older animals, the frequency of IL-2 producing cells in the small intestine was not identical to that in the large intestine and this difference may reflect regional specialization of the mucosal immune system in response to enteric antigen. Similar to other instances of IL-2 gene expression in vivo, a failure to generate mature T cells also led to an abrogation of IL-2 protein production in the gut. The presence of IL-2 producing cells in the neonatal gut suggested that these cells may be generated during fetal development. Examination of the fetal gut to determine the distribution of IL-2 producing cells therein indicated that there was a tenfold increase in the number of gut-associated IL-2 producers at day 20 of gestation compared to that observed four days earlier and there was little difference between the frequency of IL-2 producing cells in prenatal versus neonatal gut. The origin of these fetally-derived IL-2 producing cells is unclear. Prior to the immigration of IL-2 inducible cells to the fetal gut and/or induction of IL-2 expression therein, IL-2 protein was observed in the fetal liver and fetal omentum, as well as the fetal thymus. Considering that induction of IL-2 protein synthesis may be an indication of future functional capability, detection of IL-2 producing cells in the fetal liver and fetal omentum raises the possibility that IL-2 producing cells in the fetal gut may be extrathymic in origin and IL-2 producing cells in these fetal tissues may not belong solely to the T lineage. Overall, these results provide increased understanding of the nature of IL-2 producing cells in the gut and how the absence of IL-2 production therein and in fetal hematopoietic tissues can result in the acute pathology observed in IL-2 deficient animals.

On erasure coding for distributed storage and streaming communications

The work presented in this thesis revolves around erasure correction coding, as applied to distributed data storage and real-time streaming communications.

First, we examine the problem of allocating a given storage budget over a set of nodes for maximum reliability. The objective is to find an allocation of the budget that maximizes the probability of successful recovery by a data collector accessing a random subset of the nodes. This optimization problem is challenging in general because of its combinatorial nature, despite its simple formulation. We study several variations of the problem, assuming different allocation models and access models, and determine the optimal allocation and the optimal symmetric allocation (in which all nonempty nodes store the same amount of data) for a variety of cases. Although the optimal allocation can have nonintuitive structure and can be difficult to find in general, our results suggest that, as a simple heuristic, reliable storage can be achieved by spreading the budget maximally over all nodes when the budget is large, and spreading it minimally over a few nodes when it is small. Coding would therefore be beneficial in the former case, while uncoded replication would suffice in the latter case.

Second, we study how distributed storage allocations affect the recovery delay in a mobile setting. Specifically, two recovery delay optimization problems are considered for a network of mobile storage nodes: the maximization of the probability of successful recovery by a given deadline, and the minimization of the expected recovery delay. We show that the first problem is closely related to the earlier allocation problem, and solve the second problem completely for the case of symmetric allocations. It turns out that the optimal allocations for the two problems can be quite different. In a simulation study, we evaluated the performance of a simple data dissemination and storage protocol for mobile delay-tolerant networks, and observed that the choice of allocation can have a significant impact on the recovery delay under a variety of scenarios.

Third, we consider a real-time streaming system where messages created at regular time intervals at a source are encoded for transmission to a receiver over a packet erasure link; the receiver must subsequently decode each message within a given delay from its creation time. For erasure models containing a limited number of erasures per coding window, per sliding window, and containing erasure bursts whose maximum length is sufficiently short or long, we show that a time-invariant intrasession code asymptotically achieves the maximum message size among all codes that allow decoding under all admissible erasure patterns. For the bursty erasure model, we also show that diagonally interleaved codes derived from specific systematic block codes are asymptotically optimal over all codes in certain cases. We also study an i.i.d. erasure model in which each transmitted packet is erased independently with the same probability; the objective is to maximize the decoding probability for a given message size. We derive an upper bound on the decoding probability for any time-invariant code, and show that the gap between this bound and the performance of a family of time-invariant intrasession codes is small when the message size and packet erasure probability are small. In a simulation study, these codes performed well against a family of random time-invariant convolutional codes under a number of scenarios.

Finally, we consider the joint problems of routing and caching for named data networking. We propose a backpressure-based policy that employs virtual interest packets to make routing and caching decisions. In a packet-level simulation, the proposed policy outperformed a basic protocol that combines shortest-path routing with least-recently-used (LRU) cache replacement.

Wnt and FGF signaling in C. elegans vulval cell lineage polarity

The interpretation of extracellular cues leading to the polarization of intracellular components and asymmetric cell divisions is a fundamental part of metazoan organogenesis. The C. elegans vulva, with its invariant cell lineage and interaction of multiple cell signaling pathways, provides an excellent model for the study of cell polarity within an organized epithelial tissue. Herein I discuss the interaction of Wnt and FGF signaling in controlling vulval cell lineage polarity with emphasis on the posterior-most cell that forms the vulva, P7.p.

The mirror symmetry of the C. elegans vulva is achieved by the opposite division orientation of the vulval precursor cells (VPCs) flanking the axis of symmetry. Opposing Wnt signals control the division patterns of the VPCs by controlling the localization of SYS-1/ β-catenin toward the direction of the Wnt gradient. Multiple Wnt signals, expressed at the axis of symmetry, promote the wild-type, anterior-facing, P7.p orientation, whereas Wnts EGL-20 and CWN-1 from the tail and posterior body wall muscle, respectively, promote the daughter cells of P7.p to face the posterior. EGL-20 acts through a member of the LDL receptor superfamily, LRP-2, along with Ror/CAM-1 and Van Gogh/VANG-1. All three transmembrane proteins control orientation through the localization of the SYS-1.

The Fibroblast Growth Factor (FGF) pathway acts in concert with LIN-17/Frizzled to regulate the localization of SYS-1. The source of the FGF ligand is the 1° VPC, P6.p, which controls the polarity of the neighboring 2° VPC, P7.p, by signaling through the sex myoblasts (SMs), activating the FGF pathway. The Wnt, cwn-1, is expressed in the posterior body wall muscle of the worm as well as the SMs, making it the only Wnt expressed on the posterior and anterior sides of P7.p at the time of the polarity decision. Both sources of cwn-1 act instructively to influence P7.p polarity in the direction of the Wnt gradient. The FGF pathway leads to the regulation of cwn-1 transcripts in the SMs. These results illustrate the first evidence of the interaction between FGF and Wnt in C. elegans development and vulval cell lineage polarity as well as highlight the promiscuous nature of Wnt signaling within C. elegans.

I. Impact spallation experiments: fracture patterns and spall velocities. II. Craters in carbonate rocks: an electron paramagnetic resonance analysis of shock damage

This work is divided into two independent papers.

PAPER 1.

Spall velocities were measured for nine experimental impacts into San Marcos gabbro targets. Impact velocities ranged from 1 to 6.5 km/sec. Projectiles were iron, aluminum, lead, and basalt of varying sizes. The projectile masses ranged from a 4 g lead bullet to a 0.04 g aluminum sphere. The velocities of fragments were measured from high-speed films taken of the events. The maximum spall velocity observed was 30 m/sec, or 0.56 percent of the 5.4 km/sec impact velocity. The measured velocities were compared to the spall velocities predicted by the spallation model of Melosh (1984). The compatibility between the spallation model for large planetary impacts and the results of these small scale experiments are considered in detail.

The targets were also bisected to observe the pattern of internal fractures. A series of fractures were observed, whose location coincided with the boundary between rock subjected to the peak shock compression and a theoretical "near surface zone" predicted by the spallation model. Thus, between this boundary and the free surface, the target material should receive reduced levels of compressive stress as compared to the more highly shocked region below.

PAPER 2.

Carbonate samples from the nuclear explosion crater, OAK, and a terrestrial impact crater, Meteor Crater, were analyzed for shock damage using electron para- magnetic resonance, EPR. The first series of samples for OAK Crater were obtained from six boreholes within the crater, and the second series were ejecta samples recovered from the crater floor. The degree of shock damage in the carbonate material was assessed by comparing the sample spectra to spectra of Solenhofen limestone, which had been shocked to known pressures.

The results of the OAK borehole analysis have identified a thin zone of highly shocked carbonate material underneath the crater floor. This zone has a maximum depth of approximately 200 ft below sea floor at the ground zero borehole and decreases in depth towards the crater rim. A layer of highly shocked material is also found on the surface in the vicinity of the reference bolehole, located outside the crater. This material could represent a fallout layer. The ejecta samples have experienced a range of shock pressures.

It was also demonstrated that the EPR technique is feasible for the study of terrestrial impact craters formed in carbonate bedrock. The results for the Meteor Crater analysis suggest a slight degree of shock damage present in the β member of the Kaibab Formation exposed in the crater walls.

Gauge Invariant Spectral Cauchy Characteristic Extraction of Gravitational Waves in Computational General Relativity

We present a complete system for Spectral Cauchy characteristic extraction (Spectral CCE). Implemented in C++ within the Spectral Einstein Code (SpEC), the method employs numerous innovative algorithms to efficiently calculate the Bondi strain, news, and flux.

Spectral CCE was envisioned to ensure physically accurate gravitational wave-forms computed for the Laser Interferometer Gravitational wave Observatory (LIGO) and similar experiments, while working toward a template bank with more than a thousand waveforms to span the binary black hole (BBH) problem’s seven-dimensional parameter space.

The Bondi strain, news, and flux are physical quantities central to efforts to understand and detect astrophysical gravitational wave sources within the Simulations of eXtreme Spacetime (SXS) collaboration, with the ultimate aim of providing the first strong field probe of the Einstein field equation.

In a series of included papers, we demonstrate stability, convergence, and gauge invariance. We also demonstrate agreement between Spectral CCE and the legacy Pitt null code, while achieving a factor of 200 improvement in computational efficiency.

Spectral CCE represents a significant computational advance. It is the foundation upon which further capability will be built, specifically enabling the complete calculation of junk-free, gauge-free, and physically valid waveform data on the fly within SpEC.

Firing Patterns of Cerebellar Purkinje Cells During Locomotion and Sleep

The cerebellum is a major supraspinal center involved in the coordination of movement. The principal neurons of the cerebellar cortex, Purkinje cells, receive excitatory synaptic input from two sources: the parallel and climbing fibers. These pathways have markedly different effects: the parallel fibers control the rate of simple sodium spikes, while the climbing fibers induce characteristic complex spike bursts, which are accompanied by dendritic calcium transients and play a key role in regulating synaptic plasticity. While many studies using a variety of species, behaviors, and cerebellar regions have documented modulation in Purkinje cell activity during movement, few have attempted to record from these neurons in unrestrained rodents. In this dissertation, we use chronic, multi-tetrode recording in freely-behaving rats to study simple and complex spike firing patterns during locomotion and sleep. Purkinje cells discharge rhythmically during stepping, but this activity is highly variable across steps. We show that behavioral variables systematically influence the step-locked firing rate in a step-phase-dependent way, revealing a functional clustering of Purkinje cells. Furthermore, we find a pronounced disassociation between patterns of variability driven by the parallel and climbing fibers, as well as functional differences between cerebellar lobules. These results suggest that Purkinje cell activity not only represents step phase within each cycle, but is also shaped by behavior across steps, facilitating control of movement under dynamic conditions. During sleep, we observe an attenuation of both simple and complex spiking, relative to awake behavior. Although firing rates during slow wave sleep (SWS) and rapid eye movement sleep (REM) are similar, simple spike activity is highly regular in SWS, while REM is characterized by phasic increases and pauses in simple spiking. This phasic activity in REM is associated with pontine waves, which propagate into the cerebellar cortex and modulate both simple and complex spiking. Such a temporal coincidence between parallel and climbing fiber activity is known to drive plasticity at parallel fiber synapses; consequently, pontocerebellar waves may provide a mechanism for tuning synaptic weights in the cerebellum during active sleep.