Spinal cord injury therapy through active learning

Therapy employing epidural electrostimulation holds great potential for improving therapy for patients with spinal cord injury (SCI) (Harkema et al., 2011). Further promising results from combined therapies using electrostimulation have also been recently obtained (e.g., van den Brand et al., 2012). The devices being developed to deliver the stimulation are highly flexible, capable of delivering any individual stimulus among a combinatorially large set of stimuli (Gad et al., 2013). While this extreme flexibility is very useful for ensuring that the device can deliver an appropriate stimulus, the challenge of choosing good stimuli is quite substantial, even for expert human experimenters. To develop a fully implantable, autonomous device which can provide useful therapy, it is necessary to design an algorithmic method for choosing the stimulus parameters. Such a method can be used in a clinical setting, by caregivers who are not experts in the neurostimulator's use, and to allow the system to adapt autonomously between visits to the clinic. To create such an algorithm, this dissertation pursues the general class of active learning algorithms that includes Gaussian Process Upper Confidence Bound (GP-UCB, Srinivas et al., 2010), developing the Gaussian Process Batch Upper Confidence Bound (GP-BUCB, Desautels et al., 2012) and Gaussian Process Adaptive Upper Confidence Bound (GP-AUCB) algorithms. This dissertation develops new theoretical bounds for the performance of these and similar algorithms, empirically assesses these algorithms against a number of competitors in simulation, and applies a variant of the GP-BUCB algorithm in closed-loop to control SCI therapy via epidural electrostimulation in four live rats. The algorithm was tasked with maximizing the amplitude of evoked potentials in the rats' left tibialis anterior muscle. These experiments show that the algorithm is capable of directing these experiments sensibly, finding effective stimuli in all four animals. Further, in direct competition with an expert human experimenter, the algorithm produced superior performance in terms of average reward and comparable or superior performance in terms of maximum reward. These results indicate that variants of GP-BUCB may be suitable for autonomously directing SCI therapy.

Investigations of charge-carrier dynamics at semiconductor/liquid interfaces

Theoretical and experimental investigations of charge-carrier dynamics at semiconductor/liquid interfaces, specifically with respect to interfacial electron transfer and surface recombination, are presented.

Fermi's golden rule has been used to formulate rate expressions for charge transfer of delocalized carriers in a nondegenerately doped semiconducting electrode to localized, outer-sphere redox acceptors in an electrolyte phase. The treatment allows comparison between charge-transfer kinetic data at metallic, semimetallic, and semiconducting electrodes in terms of parameters such as the electronic coupling to the electrode, the attenuation of coupling with distance into the electrolyte, and the reorganization energy of the charge-transfer event. Within this framework, rate constant values expected at representative semiconducting electrodes have been determined from experimental data for charge transfer at metallic electrodes. The maximum rate constant (i.e., at optimal exoergicity) for outer-sphere processes at semiconducting electrodes is computed to be in the range 10^-17-10^-16 cm⁴ s^-1, which is in excellent agreement with prior theoretical models and experimental results for charge-transfer kinetics at semiconductor/liquid interfaces.

Double-layer corrections have been evaluated for semiconductor electrodes in both depletion and accumulation conditions. In conjuction with the Gouy-Chapman-Stern model, a finite difference approach has been used to calculate potential drops at a representative solid/liquid interface. Under all conditions that were simulated, the correction to the driving force used to evaluate the interfacial rate constant was determined to be less than 2% of the uncorrected interfacial rate constant.

Photoconductivity decay lifetimes have been obtained for Si(111) in contact with solutions of CH₃OH or tetrahydrofuran containing one-electron oxidants. Silicon surfaces in contact with electrolyte solutions having Nernstian redox potentials > 0 V vs. SCE exhibited low effective surface recombination velocities regardless of the different surface chemistries. The formation of an inversion layer, and not a reduced density of electrical trap sites on the surface, is shown to be responsible for the long charge-carrier lifetimes observed for these systems. In addition, a method for preparing an air-stable, low surface recombination velocity Si surface through a two-step, chlorination/alkylation reaction is described.

Biophysical and network mechanisms of high frequency extracellular potentials in the rat hippocampus

A fundamental question in neuroscience is how distributed networks of neurons communicate and coordinate dynamically and specifically. Several models propose that oscillating local networks can transiently couple to each other through phase-locked firing. Coherent local field potentials (LFP) between synaptically connected regions is often presented as evidence for such coupling. The physiological correlates of LFP signals depend on many anatomical and physiological factors, however, and how the underlying neural processes collectively generate features of different spatiotemporal scales is poorly understood. High frequency oscillations in the hippocampus, including gamma rhythms (30-100 Hz) that are organized by the theta oscillations (5-10 Hz) during active exploration and REM sleep, as well as sharp wave-ripples (SWRs, 140-200 Hz) during immobility or slow wave sleep, have each been associated with various aspects of learning and memory. Deciphering their physiology and functional consequences is crucial to understanding the operation of the hippocampal network.

We investigated the origins and coordination of high frequency LFPs in the hippocampo-entorhinal network using both biophysical models and analyses of large-scale recordings in behaving and sleeping rats. We found that the synchronization of pyramidal cell spikes substantially shapes, or even dominates, the electrical signature of SWRs in area CA1 of the hippocampus. The precise mechanisms coordinating this synchrony are still unresolved, but they appear to also affect CA1 activity during theta oscillations. The input to CA1, which often arrives in the form of gamma-frequency waves of activity from area CA3 and layer 3 of entorhinal cortex (EC3), did not strongly influence the timing of CA1 pyramidal cells. Rather, our data are more consistent with local network interactions governing pyramidal cells' spike timing during the integration of their inputs. Furthermore, the relative timing of input from EC3 and CA3 during the theta cycle matched that found in previous work to engage mechanisms for synapse modification and active dendritic processes. Our work demonstrates how local networks interact with upstream inputs to generate a coordinated hippocampal output during behavior and sleep, in the form of theta-gamma coupling and SWRs.

Development and Application of Embedding Methods for the Simulation of Large Chemical Systems

The high computational cost of correlated wavefunction theory (WFT) calculations has motivated the development of numerous methods to partition the description of large chemical systems into smaller subsystem calculations. For example, WFT-in-DFT embedding methods facilitate the partitioning of a system into two subsystems: a subsystem A that is treated using an accurate WFT method, and a subsystem B that is treated using a more efficient Kohn-Sham density functional theory (KS-DFT) method. Representation of the interactions between subsystems is non-trivial, and often requires the use of approximate kinetic energy functionals or computationally challenging optimized effective potential calculations; however, it has recently been shown that these challenges can be eliminated through the use of a projection operator. This dissertation describes the development and application of embedding methods that enable accurate and efficient calculation of the properties of large chemical systems.

Chapter 1 introduces a method for efficiently performing projection-based WFT-in-DFT embedding calculations on large systems. This is accomplished by using a truncated basis set representation of the subsystem A wavefunction. We show that naive truncation of the basis set associated with subsystem A can lead to large numerical artifacts, and present an approach for systematically controlling these artifacts.

Chapter 2 describes the application of the projection-based embedding method to investigate the oxidative stability of lithium-ion batteries. We study the oxidation potentials of mixtures of ethylene carbonate (EC) and dimethyl carbonate (DMC) by using the projection-based embedding method to calculate the vertical ionization energy (IE) of individual molecules at the CCSD(T) level of theory, while explicitly accounting for the solvent using DFT. Interestingly, we reveal that large contributions to the solvation properties of DMC originate from quadrupolar interactions, resulting in a much larger solvent reorganization energy than that predicted using simple dielectric continuum models. Demonstration that the solvation properties of EC and DMC are governed by fundamentally different intermolecular interactions provides insight into key aspects of lithium-ion batteries, with relevance to electrolyte decomposition processes, solid-electrolyte interphase formation, and the local solvation environment of lithium cations.

I. Electronic processes in α-sulfur. II. Polaron motion in a D.C. electric field

Part I: The mobilities of photo-generated electrons and holes in orthorhombic sulfur are determined by drift mobility techniques. At room temperature electron mobilities between 0.4 cm²/V-sec and 4.8 cm²/V-sec and hole mobilities of about 5.0 cm²/V-sec are reported. The temperature dependence of the electron mobility is attributed to a level of traps whose effective depth is about 0.12 eV. This value is further supported by both the voltage dependence of the space-charge-limited, D.C. photocurrents and the photocurrent versus photon energy measurements.

As the field is increased from 10 kV/cm to 30 kV/cm a second mechanism for electron transport becomes appreciable and eventually dominates. Evidence that this is due to impurity band conduction at an appreciably lower mobility (4.10^-4 cm²/V-sec) is presented. No low mobility hole current could be detected. When fields exceeding 30 kV/cm for electron transport and 35 kV/cm for hole transport are applied, avalanche phenomena are observed. The results obtained are consistent with recent energy gap studies in sulfur.

The theory of the transport of photo-generated carriers is modified to include the case of appreciable thermos-regeneration from the traps in one transit time.

Part II: An explicit formula for the electric field E necessary to accelerate an electron to a steady-state velocity v in a polarizable crystal at arbitrary temperature is determined via two methods utilizing Feynman Path Integrals. No approximation is made regarding the magnitude of the velocity or the strength of the field. However, the actual electron-lattice Coulombic interaction is approximated by a distribution of harmonic oscillator potentials. One may be able to find the “best possible” distribution of oscillators using a variational principle, but we have not been able to find the expected criterion. However, our result is relatively insensitive to the actual distribution of oscillators used, and our E-v relationship exhibits the physical behavior expected for the polaron. Threshold fields for ejecting the electron for the polaron state are calculated for several substances using numerical results for a simple oscillator distribution.

Rydberg states of diatomic and polyatomic molecules using model potentials

A simple model potential is used to calculate Rydberg series for the molecules: nitrogen, oxygen, nitric oxide, carbon monoxide, carbon dioxide, nitrogen dioxide, nitrous oxide, acetylene, formaldehyde, formic acid, diazomethane, ketene, ethylene, allene, acetaldehyde, propyne, acrolein, dimethyl ether, 1, 3-butadiene, 2-butene, and benzene. The model potential for a molecule is taken as the sum of atomic potentials, which are calibrated to atomic data and contain no further parameters. Our results agree with experimentally measured values to within 5-10% in all cases. The results of these calculations are applied to many unresolved problems connected with the above molecules. Some of the more notable of these problems are the reassignment of states in carbon monoxide, the first ionization potential of nitrogen dioxide, the interpretation of the V state in ethylene, and the mystery bands in substituted ethylenes, the identification of the R and R’ series in benzene and the determination of the orbital scheme in benzene from electron impact data.