Spinal cord injury therapy through active learning

Therapy employing epidural electrostimulation holds great potential for improving therapy for patients with spinal cord injury (SCI) (Harkema et al., 2011). Further promising results from combined therapies using electrostimulation have also been recently obtained (e.g., van den Brand et al., 2012). The devices being developed to deliver the stimulation are highly flexible, capable of delivering any individual stimulus among a combinatorially large set of stimuli (Gad et al., 2013). While this extreme flexibility is very useful for ensuring that the device can deliver an appropriate stimulus, the challenge of choosing good stimuli is quite substantial, even for expert human experimenters. To develop a fully implantable, autonomous device which can provide useful therapy, it is necessary to design an algorithmic method for choosing the stimulus parameters. Such a method can be used in a clinical setting, by caregivers who are not experts in the neurostimulator's use, and to allow the system to adapt autonomously between visits to the clinic. To create such an algorithm, this dissertation pursues the general class of active learning algorithms that includes Gaussian Process Upper Confidence Bound (GP-UCB, Srinivas et al., 2010), developing the Gaussian Process Batch Upper Confidence Bound (GP-BUCB, Desautels et al., 2012) and Gaussian Process Adaptive Upper Confidence Bound (GP-AUCB) algorithms. This dissertation develops new theoretical bounds for the performance of these and similar algorithms, empirically assesses these algorithms against a number of competitors in simulation, and applies a variant of the GP-BUCB algorithm in closed-loop to control SCI therapy via epidural electrostimulation in four live rats. The algorithm was tasked with maximizing the amplitude of evoked potentials in the rats' left tibialis anterior muscle. These experiments show that the algorithm is capable of directing these experiments sensibly, finding effective stimuli in all four animals. Further, in direct competition with an expert human experimenter, the algorithm produced superior performance in terms of average reward and comparable or superior performance in terms of maximum reward. These results indicate that variants of GP-BUCB may be suitable for autonomously directing SCI therapy.

Upper hybrid resonance absorption and scattering from a plasma column

The electromagnetic scattering and absorption properties of small (kr~1/2) inhomogeneous magnetoplasma columns are calculated via the full set of Maxwell's equations with tensor dielectric constitutive relation. The cold plasma model with collisional damping is used to describe the column. The equations are solved numerically, subject to boundary conditions appropriate to an infinite parallel strip line and to an incident plane wave. The results are similar for several density profiles and exhibit semiquantitative agreement with measurements in waveguide. The absorption is spatially limited, especially for small collision frequency, to a narrow hybrid resonant layer and is essentially zero when there is no hybrid layer in the column. The reflection is also enhanced when the hybrid layer is present, but the value of the reflection coefficient is strongly modified by the presence of the glass tube. The nature of the solutions and an extensive discussion of the conditions under which the cold collisional model should yield valid results is presented.

Microelectrode Implants for Spinal Cord Stimulation in Rats

Paralysis is a debilitating condition afflicting millions of people across the globe, and is particularly deleterious to quality of life when motor function of the legs is severely impaired or completely absent. Fortunately, spinal cord stimulation has shown great potential for improving motor function after spinal cord injury and other pathological conditions. Many animal studies have shown stimulation of the neural networks in the spinal cord can improve motor ability so dramatically that the animals can even stand and step after a complete spinal cord transaction.

This thesis presents work to successfully provide a chronically implantable device for rats that greatly enhances the ability to control the site of spinal cord stimulation. This is achieved through the use of a parylene-C based microelectrode array, which enables a density of stimulation sites unattainable with conventional wire electrodes. While many microelectrode devices have been proposed in the past, the spinal cord is a particularly challenging environment due to the bending and movement it undergoes in a live animal. The developed microelectrode array is the first to have been implanted in vivo while retaining functionality for over a month. In doing so, different neural pathways can be selectively activated to facilitate standing and stepping in spinalized rats using various electrode combinations, and important differences in responses are observed.

An engineering challenge for the usability of any high density electrode array is connecting the numerous electrodes to a stimulation source. This thesis develops several technologies to address this challenge, beginning with a fully passive implant that uses one wire per electrode to connect to an external stimulation source. The number of wires passing through the body and the skin proved to be a hazard for the health of the animal, so a multiplexed implant was devised in which active electronics reduce the number of wires. Finally, a fully wireless implant was developed. As these implants are tested in vivo, encapsulation is of critical importance to retain functionality in a chronic experiment, especially for the active implants, and it was achieved without the use of costly ceramic or metallic hermetic packaging. Active implants were built that retained functionality 8 weeks after implantation, and achieved stepping in spinalized rats after just 8-10 days, which is far sooner than wire-based electrical stimulation has achieved in prior work.

Theory of the positive column of a gas discharge

An attempt is made to provide a theoretical explanation of the effect of the positive column on the voltage-current characteristic of a glow or an arc discharge. Such theories have been developed before, and all are based on balancing the production and loss of charged particles and accounting for the energy supplied to the plasma by the applied electric field. Differences among the theories arise from the approximations and omissions made in selecting processes that affect the particle and energy balances. This work is primarily concerned with the deviation from the ambipolar description of the positive column caused by space charge, electron-ion volume recombination, and temperature inhomogeneities.

The presentation is divided into three parts, the first of which involved the derivation of the final macroscopic equations from kinetic theory. The final equations are obtained by taking the first three moments of the Boltzmann equation for each of the three species in the plasma. Although the method used and the equations obtained are not novel, the derivation is carried out in detail in order to appraise the validity of numerous approximations and to justify the use of data from other sources. The equations are applied to a molecular hydrogen discharge contained between parallel walls. The applied electric field is parallel to the walls, and the dependent variables—electron and ion flux to the walls, electron and ion densities, transverse electric field, and gas temperature—vary only in the direction perpendicular to the walls. The mathematical description is given by a sixth-order nonlinear two-point boundary value problem which contains the applied field as a parameter. The amount of neutral gas and its temperature at the walls are held fixed, and the relation between the applied field and the electron density at the center of the discharge is obtained in the process of solving the problem. This relation corresponds to that between current and voltage and is used to interpret the effect of space charge, recombination, and temperature inhomogeneities on the voltage-current characteristic of the discharge.

The complete solution of the equations is impractical both numerically and analytically, and in Part II the gas temperature is assumed uniform so as to focus on the combined effects of space charge and recombination. The terms representing these effects are treated as perturbations to equations that would otherwise describe the ambipolar situation. However, the term representing space charge is not negligible in a thin boundary layer or sheath near the walls, and consequently the perturbation problem is singular. Separate solutions must be obtained in the sheath and in the main region of the discharge, and the relation between the electron density and the applied field is not determined until these solutions are matched.

In Part III the electron and ion densities are assumed equal, and the complicated space-charge calculation is thereby replaced by the ambipolar description. Recombination and temperature inhomogeneities are both important at high values of the electron density. However, the formulation of the problem permits a comparison of the relative effects, and temperature inhomogeneities are shown to be important at lower values of the electron density than recombination. The equations are solved by a direct numerical integration and by treating the term representing temperature inhomogeneities as a perturbation.

The conclusions reached in the study are primarily concerned with the association of the relation between electron density and axial field with the voltage-current characteristic. It is known that the effect of space charge can account for the subnormal glow discharge and that the normal glow corresponds to a close approach to an ambipolar situation. The effect of temperature inhomogeneities helps explain the decreasing characteristic of the arc, and the effect of recombination is not expected to appear except at very high electron densities.