Spinal cord injury therapy through active learning

Therapy employing epidural electrostimulation holds great potential for improving therapy for patients with spinal cord injury (SCI) (Harkema et al., 2011). Further promising results from combined therapies using electrostimulation have also been recently obtained (e.g., van den Brand et al., 2012). The devices being developed to deliver the stimulation are highly flexible, capable of delivering any individual stimulus among a combinatorially large set of stimuli (Gad et al., 2013). While this extreme flexibility is very useful for ensuring that the device can deliver an appropriate stimulus, the challenge of choosing good stimuli is quite substantial, even for expert human experimenters. To develop a fully implantable, autonomous device which can provide useful therapy, it is necessary to design an algorithmic method for choosing the stimulus parameters. Such a method can be used in a clinical setting, by caregivers who are not experts in the neurostimulator's use, and to allow the system to adapt autonomously between visits to the clinic. To create such an algorithm, this dissertation pursues the general class of active learning algorithms that includes Gaussian Process Upper Confidence Bound (GP-UCB, Srinivas et al., 2010), developing the Gaussian Process Batch Upper Confidence Bound (GP-BUCB, Desautels et al., 2012) and Gaussian Process Adaptive Upper Confidence Bound (GP-AUCB) algorithms. This dissertation develops new theoretical bounds for the performance of these and similar algorithms, empirically assesses these algorithms against a number of competitors in simulation, and applies a variant of the GP-BUCB algorithm in closed-loop to control SCI therapy via epidural electrostimulation in four live rats. The algorithm was tasked with maximizing the amplitude of evoked potentials in the rats' left tibialis anterior muscle. These experiments show that the algorithm is capable of directing these experiments sensibly, finding effective stimuli in all four animals. Further, in direct competition with an expert human experimenter, the algorithm produced superior performance in terms of average reward and comparable or superior performance in terms of maximum reward. These results indicate that variants of GP-BUCB may be suitable for autonomously directing SCI therapy.

Microelectrode Implants for Spinal Cord Stimulation in Rats

Paralysis is a debilitating condition afflicting millions of people across the globe, and is particularly deleterious to quality of life when motor function of the legs is severely impaired or completely absent. Fortunately, spinal cord stimulation has shown great potential for improving motor function after spinal cord injury and other pathological conditions. Many animal studies have shown stimulation of the neural networks in the spinal cord can improve motor ability so dramatically that the animals can even stand and step after a complete spinal cord transaction.

This thesis presents work to successfully provide a chronically implantable device for rats that greatly enhances the ability to control the site of spinal cord stimulation. This is achieved through the use of a parylene-C based microelectrode array, which enables a density of stimulation sites unattainable with conventional wire electrodes. While many microelectrode devices have been proposed in the past, the spinal cord is a particularly challenging environment due to the bending and movement it undergoes in a live animal. The developed microelectrode array is the first to have been implanted in vivo while retaining functionality for over a month. In doing so, different neural pathways can be selectively activated to facilitate standing and stepping in spinalized rats using various electrode combinations, and important differences in responses are observed.

An engineering challenge for the usability of any high density electrode array is connecting the numerous electrodes to a stimulation source. This thesis develops several technologies to address this challenge, beginning with a fully passive implant that uses one wire per electrode to connect to an external stimulation source. The number of wires passing through the body and the skin proved to be a hazard for the health of the animal, so a multiplexed implant was devised in which active electronics reduce the number of wires. Finally, a fully wireless implant was developed. As these implants are tested in vivo, encapsulation is of critical importance to retain functionality in a chronic experiment, especially for the active implants, and it was achieved without the use of costly ceramic or metallic hermetic packaging. Active implants were built that retained functionality 8 weeks after implantation, and achieved stepping in spinalized rats after just 8-10 days, which is far sooner than wire-based electrical stimulation has achieved in prior work.

Surface markers of regionalization in the vertebrate nervous system

In order to identify new molecules that might play a role in regional specification of the nervous system, we generated and characterized monoclonal antibodies (mAbs) that have positionally-restricted labeling patterns.

The FORSE-1 mAb was generated using a strategy designed to produce mAbs against neuronal cell surface antigens that might be regulated by regionally-restricted transcription factors in the developing central nervous system (CNS). FORSE-1 staining is enriched in the forebrain as compared to the rest of the CNS until E18. Between E11.5-E13.5, only certain areas of the forebrain are labeled. There is also a dorsoventrally-restricted region of labeling in the hindbrain and spinal cord. The mAb labels a large proteoglycan-like cell-surface antigen (>200 kD). The labeling pattern of FORSE-1 is conserved in various mammals and in chick.

To determine whether the FORSE-1 labeling pattern is similar to that of known transcription factors, the expression of BF-1 and Dlx-2 was compared with FORSE-1. There is a striking overlap between BF-1 and FORSE-1 in the telencephalon. In contrast, FORSE-1 and Dlx-2 have very different patterns of expression in the forebrain, suggesting that regulation by Dlx-2 alone cannot explain the distribution of FORSE-1. They do, however, share some sharp boundaries in the diencephalon. In addition, FORSE-1 identifies some previously unknown boundaries in the developing forebrain. Thus, FORSE-1 is a new cell surface marker that can be used to subdivide the embryonic forebrain into regions smaller than previously described, providing further complexity necessary for developmental patterning.

I also studied the expression of the cell surface protein CD9 in the developing and adult rat nervous system. CD9 is implicated in intercellular signaling and cell adhesion in the hematopoetic system. In the nervous system, CD9 may perform similar functions in early sympathetic ganglia, chromaffin cells, and motor neurons, all of which express the protein. The presence of CD9 on the surfaces of Schwann cells and axons at the appropriate time may allow the protein to participate in the cellular interactions involved in myelination.

Anatomical and developmental patterns of interleukin-2 gene expression in the mouse: analysis of IL-2 expressing cells and partial characterization of interactions involved in mediating IL-2 gene expression in vivo

Interleukin-2 (IL-2) is an important mediator in the vertebrate immune system. IL-2 is a potent growth factor that mature T lymphocytes use as a proliferation signal and the production of IL-2 is crucial for the clonal expansion of antigen-specific T cells in the primary immune response. IL-2 driven proliferation is dependent on the interaction of the lymphokine with its cognate multichain receptor. IL-2 expression is induced only upon stimulation and transcriptional activation of the IL-2 gene relies extensively on the coordinate interaction of numerous inducible and constitutive trans-acting factors. Over the past several years, thousands of papers have been published regarding molecular and cellular aspects of IL-2 gene expression and IL-2 function. The vast majority of these reports describe work that has been carried out in vitro. However, considerably less is known about control of IL-2 gene expression and IL-2 function in vivo.

To gain new insight into the regulation of IL-2 gene expression in vivo, anatomical and developmental patterns of IL-2 gene expression in the mouse were established by employing in situ hybridization and immunohistochemical staining methodologies to tissue sections generated from normal mice and mutant animals in which T -cell development was perturbed. Results from these studies revealed several interesting aspects of IL-2 gene expression, such as (1) induction of IL-2 gene expression and protein synthesis in the thymus, the primary site of T-cell development in the body, (2) cell-type specificity of IL-2 gene expression in vivo, (3) participation of IL-2 in the extrathymic expansion of mature T cells in particular tissues, independent of an acute immune response to foreign antigen, (4) involvement of IL-2 in maintaining immunologic balance in the mucosal immune system, and (5) potential function of IL-2 in early events associated with hematopoiesis.

Extensive analysis of IL-2 mRNA accumulation and protein production in the murine thymus at various stages of development established the existence of two classes of intrathymic IL-2 producing cells. One class of intrathymic IL-2 producers was found exclusively in the fetal thymus. Cells belonging to this subset were restricted to the outermost region of the thymus. IL-2 expression in the fetal thymus was highly transient; a dramatic peak ofiL-2 mRNA accumulation was identified at day 14.5 of gestation and maximal IL-2 protein production was observed 12 hours later, after which both IL-2 mRNA and protein levels rapidly decreased. Significantly, the presence of IL-2 expressing cells in the day 14-15 fetal thymus was not contingent on the generation of T-cell receptor (TcR) positive cells. The second class of IL-2 producing cells was also detectable in the fetal thymus (cells found in this class represented a minority subset of IL-2 producers in the fetal thymus) but persist in the thymus during later stages of development and after birth. Intrathymic IL-2 producers in postnatal animals were located in the subcapsular region and cortex, indicating that these cells reside in the same areas where immature T cells are consigned. The frequency of IL-2 expressing cells in the postnatal thymus was extremely low, indicating that induction of IL-2 expression and protein synthesis are indicative of a rare activation event. Unlike the fetal class of intrathymic IL-2 producers, the presence of IL-2 producing cells in the postnatal thymus was dependent on to the generation of TcR+ cells. Subsequent examination of intrathymic IL-2 production in mutant postnatal mice unable to produce either αβ or γδ T cells showed that postnatal IL-2 producers in the thymus belong to both αβ and γδ lineages. Additionally, further studies indicated that IL-2 synthesis by immature αβ -T cells depends on the expression of bonafide TcR αβ-heterodimers. Taken altogether, IL-2 production in the postnatal thymus relies on the generation of αβ or γδ-TcR^+ cells and induction of IL-2 protein synthesis can be linked to an activation event mediated via the TcR.

With regard to tissue specificity of IL-2 gene expression in vivo, analysis of whole body sections obtained from normal neonatal mouse pups by in situ hybridization demonstrated that IL-2 mRNA^+ cells were found in both lymphoid and nonlymphoid tissues with which T cells are associated, such as the thymus (as described above), dermis and gut. Tissues devoid of IL-2 mRNA^+ cells included brain, heart, lung, liver, stomach, spine, spinal cord, kidney, and bladder. Additional analysis of isolated tissues taken from older animals revealed that IL-2 expression was undetectable in bone marrow and in nonactivated spleen and lymph nodes. Thus, it appears that extrathymic IL-2 expressing cells in nonimmunologically challenged animals are relegated to particular epidermal and epithelial tissues in which characterized subsets of T cells reside and thatinduction of IL-2 gene expression associated with these tissues may be a result of T-cell activation therein.

Based on the neonatal in situ hybridization results, a detailed investigation into possible induction of IL-2 expression resulting in IL-2 protein synthesis in the skin and gut revealed that IL-2 expression is induced in the epidermis and intestine and IL-2 protein is available to drive cell proliferation of resident cells and/or participate in immune function in these tissues. Pertaining to IL-2 expression in the skin, maximal IL-2 mRNA accumulation and protein production were observed when resident Vγ_3^+ T-cell populations were expanding. At this age, both IL-2 mRNA^+ cells and IL-2 protein production were intimately associated with hair follicles. Likewise, at this age a significant number of CD3ε^+ cells were also found in association with follicles. The colocalization of IL-2 expression and CD3ε^+ cells suggests that IL-2 expression is induced when T cells are in contact with hair follicles. In contrast, neither IL-2 mRNA nor IL-2 protein were readily detected once T-cell density in the skin reached steady-state proportions. At this point, T cells were no longer found associated with hair follicles but were evenly distributed throughout the epidermis. In addition, IL-2 expression in the skin was contingent upon the presence of mature T cells therein and induction of IL-2 protein synthesis in the skin did not depend on the expression of a specific TcR on resident T cells. These newly disclosed properties of IL-2 expression in the skin indicate that IL-2 may play an additional role in controlling mature T-cell proliferation by participating in the extrathymic expansion of T cells, particularly those associated with the epidermis.

Finally, regarding IL-2 expression and protein synthesis in the gut, IL-2 producing cells were found associated with the lamina propria of neonatal animals and gut-associated IL-2 production persisted throughout life. In older animals, the frequency of IL-2 producing cells in the small intestine was not identical to that in the large intestine and this difference may reflect regional specialization of the mucosal immune system in response to enteric antigen. Similar to other instances of IL-2 gene expression in vivo, a failure to generate mature T cells also led to an abrogation of IL-2 protein production in the gut. The presence of IL-2 producing cells in the neonatal gut suggested that these cells may be generated during fetal development. Examination of the fetal gut to determine the distribution of IL-2 producing cells therein indicated that there was a tenfold increase in the number of gut-associated IL-2 producers at day 20 of gestation compared to that observed four days earlier and there was little difference between the frequency of IL-2 producing cells in prenatal versus neonatal gut. The origin of these fetally-derived IL-2 producing cells is unclear. Prior to the immigration of IL-2 inducible cells to the fetal gut and/or induction of IL-2 expression therein, IL-2 protein was observed in the fetal liver and fetal omentum, as well as the fetal thymus. Considering that induction of IL-2 protein synthesis may be an indication of future functional capability, detection of IL-2 producing cells in the fetal liver and fetal omentum raises the possibility that IL-2 producing cells in the fetal gut may be extrathymic in origin and IL-2 producing cells in these fetal tissues may not belong solely to the T lineage. Overall, these results provide increased understanding of the nature of IL-2 producing cells in the gut and how the absence of IL-2 production therein and in fetal hematopoietic tissues can result in the acute pathology observed in IL-2 deficient animals.