Relating thermodynamics to information theory : the equality of free energy and mutual information

In this thesis we uncover a new relation which links thermodynamics and information theory. We consider time as a channel and the detailed state of a physical system as a message. As the system evolves with time, ever present noise insures that the "message" is corrupted. Thermodynamic free energy measures the approach of the system toward equilibrium. Information theoretical mutual information measures the loss of memory of initial state. We regard the free energy and the mutual information as operators which map probability distributions over state space to real numbers. In the limit of long times, we show how the free energy operator and the mutual information operator asymptotically attain a very simple relationship to one another. This relationship is founded on the common appearance of entropy in the two operators and on an identity between internal energy and conditional entropy. The use of conditional entropy is what distinguishes our approach from previous efforts to relate thermodynamics and information theory.

A model for energy and morphology of crystalline grain boundaries with arbitrary geometric character

It has been well-established that interfaces in crystalline materials are key players in the mechanics of a variety of mesoscopic processes such as solidification, recrystallization, grain boundary migration, and severe plastic deformation. In particular, interfaces with complex morphologies have been observed to play a crucial role in many micromechanical phenomena such as grain boundary migration, stability, and twinning. Interfaces are a unique type of material defect in that they demonstrate a breadth of behavior and characteristics eluding simplified descriptions. Indeed, modeling the complex and diverse behavior of interfaces is still an active area of research, and to the author's knowledge there are as yet no predictive models for the energy and morphology of interfaces with arbitrary character. The aim of this thesis is to develop a novel model for interface energy and morphology that i) provides accurate results (especially regarding "energy cusp" locations) for interfaces with arbitrary character, ii) depends on a small set of material parameters, and iii) is fast enough to incorporate into large scale simulations.

In the first half of the work, a model for planar, immiscible grain boundary is formulated. By building on the assumption that anisotropic grain boundary energetics are dominated by geometry and crystallography, a construction on lattice density functions (referred to as "covariance") is introduced that provides a geometric measure of the order of an interface. Covariance forms the basis for a fully general model of the energy of a planar interface, and it is demonstrated by comparison with a wide selection of molecular dynamics energy data for FCC and BCC tilt and twist boundaries that the model accurately reproduces the energy landscape using only three material parameters. It is observed that the planar constraint on the model is, in some cases, over-restrictive; this motivates an extension of the model.

In the second half of the work, the theory of faceting in interfaces is developed and applied to the planar interface model for grain boundaries. Building on previous work in mathematics and materials science, an algorithm is formulated that returns the minimal possible energy attainable by relaxation and the corresponding relaxed morphology for a given planar energy model. It is shown that the relaxation significantly improves the energy results of the planar covariance model for FCC and BCC tilt and twist boundaries. The ability of the model to accurately predict faceting patterns is demonstrated by comparison to molecular dynamics energy data and experimental morphological observation for asymmetric tilt grain boundaries. It is also demonstrated that by varying the temperature in the planar covariance model, it is possible to reproduce a priori the experimentally observed effects of temperature on facet formation.

Finally, the range and scope of the covariance and relaxation models, having been demonstrated by means of extensive MD and experimental comparison, future applications and implementations of the model are explored.

Sustainable IT and IT for sustainability

Energy and sustainability have become one of the most critical issues of our generation. While the abundant potential of renewable energy such as solar and wind provides a real opportunity for sustainability, their intermittency and uncertainty present a daunting operating challenge. This thesis aims to develop analytical models, deployable algorithms, and real systems to enable efficient integration of renewable energy into complex distributed systems with limited information.

The first thrust of the thesis is to make IT systems more sustainable by facilitating the integration of renewable energy into these systems. IT represents the fastest growing sectors in energy usage and greenhouse gas pollution. Over the last decade there are dramatic improvements in the energy efficiency of IT systems, but the efficiency improvements do not necessarily lead to reduction in energy consumption because more servers are demanded. Further, little effort has been put in making IT more sustainable, and most of the improvements are from improved "engineering" rather than improved "algorithms". In contrast, my work focuses on developing algorithms with rigorous theoretical analysis that improve the sustainability of IT. In particular, this thesis seeks to exploit the flexibilities of cloud workloads both (i) in time by scheduling delay-tolerant workloads and (ii) in space by routing requests to geographically diverse data centers. These opportunities allow data centers to adaptively respond to renewable availability, varying cooling efficiency, and fluctuating energy prices, while still meeting performance requirements. The design of the enabling algorithms is however very challenging because of limited information, non-smooth objective functions and the need for distributed control. Novel distributed algorithms are developed with theoretically provable guarantees to enable the "follow the renewables" routing. Moving from theory to practice, I helped HP design and implement industry's first Net-zero Energy Data Center.

The second thrust of this thesis is to use IT systems to improve the sustainability and efficiency of our energy infrastructure through data center demand response. The main challenges as we integrate more renewable sources to the existing power grid come from the fluctuation and unpredictability of renewable generation. Although energy storage and reserves can potentially solve the issues, they are very costly. One promising alternative is to make the cloud data centers demand responsive. The potential of such an approach is huge.

To realize this potential, we need adaptive and distributed control of cloud data centers and new electricity market designs for distributed electricity resources. My work is progressing in both directions. In particular, I have designed online algorithms with theoretically guaranteed performance for data center operators to deal with uncertainties under popular demand response programs. Based on local control rules of customers, I have further designed new pricing schemes for demand response to align the interests of customers, utility companies, and the society to improve social welfare.

Effects of self energy of the ions on the double layer structure and properties at the dielectric interface

Although numerous theoretical efforts have been put forth, a systematic, unified and predictive theoretical framework that is able to capture all the essential physics of the interfacial behaviors of ions, such as the Hofmeister series effect, Jones-Ray effect and the salt effect on the bubble coalescence remain an outstanding challenge. The most common approach to treating electrostatic interactions in the presence of salt ions is the Poisson-Boltzmann (PB) theory. However, there are many systems for which the PB theory fails to offer even a qualitative explanation of the behavior, especially for ions distributed in the vicinity of an interface with dielectric contrast between the two media (like the water-vapor/oil interface). A key factor missing in the PB theory is the self energy of the ion.

In this thesis, we develop a self-consistent theory that treats the electrostatic self energy (including both the short-range Born solvation energy and the long-range image charge interactions), the nonelectrostatic contribution of the self energy, the ion-ion correlation and the screening effect systematically in a single framework. By assuming a finite charge spread of the ion instead of using the point-charge model, the self energy obtained by our theory is free of the divergence problems and gives a continuous self energy across the interface. This continuous feature allows ions on the water side and the vapor/oil side of the interface to be treated in a unified framework. The theory involves a minimum set of parameters of the ion, such as the valency, radius, polarizability of the ions, and the dielectric constants of the medium, that are both intrinsic and readily available. The general theory is first applied to study the thermodynamic property of the bulk electrolyte solution, which shows good agreement with the experiment result for predicting the activity coefficient and osmotic coefficient.

Next, we address the effect of local Born solvation energy on the bulk thermodynamics and interfacial properties of electrolyte solution mixtures. We show that difference in the solvation energy between the cations and anions naturally gives rise to local charge separation near the interface, and a finite Galvani potential between two coexisting solutions. The miscibility of the mixture can either increases or decreases depending on the competition between the solvation energy and translation entropy of the ions. The interfacial tension shows a non-monotonic dependence on the salt concentration: it increases linearly with the salt concentration at higher concentrations, and decreases approximately as the square root of the salt concentration for dilute solutions, which is in agreement with the Jones-Ray effect observed in experiment.

Next, we investigate the image effects on the double layer structure and interfacial properties near a single charged plate. We show that the image charge repulsion creates a depletion boundary layer that cannot be captured by a regular perturbation approach. The correct weak-coupling theory must include the self-energy of the ion due to the image charge interaction. The image force qualitatively alters the double layer structure and properties, and gives rise to many non-PB effects, such as nonmonotonic dependence of the surface energy on concentration and charge inversion. The image charge effect is then studied for electrolyte solutions between two plates. For two neutral plates, we show that depletion of the salt ions by the image charge repulsion results in short-range attractive and long-range repulsive forces. If cations and anions are of different valency, the asymmetric depletion leads to the formation of an induced electrical double layer. For two charged plates, the competition between the surface charge and the image charge effect can give rise to like- charge attraction.

Then, we study the inhomogeneous screening effect near the dielectric interface due to the anisotropic and nonuniform ion distribution. We show that the double layer structure and interfacial properties is drastically affected by the inhomogeneous screening if the bulk Debye screening length is comparable or smaller than the Bjerrum length. The width of the depletion layer is characterized by the Bjerrum length, independent of the salt concentration. We predict that the negative adsorption of ions at the interface increases linearly with the salt concentration, which cannot be captured by either the bulk screening approximation or the WKB approximation. For asymmetric salt, the inhomogeneous screening enhances the charge separation in the induced double layer and significantly increases the value of the surface potential.

Finally, to account for the ion specificity, we study the self energy of a single ion across the dielectric interface. The ion is considered to be polarizable: its charge distribution can be self-adjusted to the local dielectric environment to minimize the self energy. Using intrinsic parameters of the ions, such as the valency, radius, and polarizability, we predict the specific ion effect on the interfacial affinity of halogen anions at the water/air interface, and the strong adsorption of hydrophobic ions at the water/oil interface, in agreement with experiments and atomistic simulations.

The theory developed in this work represents the most systematic theoretical technique for weak-coupling electrolytes. We expect the theory to be more useful for studying a wide range of structural and dynamic properties in physicochemical, colloidal, soft-matter and biophysical systems.

A fully-nonlocal energy-based formulation and high-performance realization of the quasicontinuum method

The quasicontinuum (QC) method was introduced to coarse-grain crystalline atomic ensembles in order to bridge the scales from individual atoms to the micro- and mesoscales. Though many QC formulations have been proposed with varying characteristics and capabilities, a crucial cornerstone of all QC techniques is the concept of summation rules, which attempt to efficiently approximate the total Hamiltonian of a crystalline atomic ensemble by a weighted sum over a small subset of atoms. In this work we propose a novel, fully-nonlocal, energy-based formulation of the QC method with support for legacy and new summation rules through a general energy-sampling scheme. Our formulation does not conceptually differentiate between atomistic and coarse-grained regions and thus allows for seamless bridging without domain-coupling interfaces. Within this structure, we introduce a new class of summation rules which leverage the affine kinematics of this QC formulation to most accurately integrate thermodynamic quantities of interest. By comparing this new class of summation rules to commonly-employed rules through analysis of energy and spurious force errors, we find that the new rules produce no residual or spurious force artifacts in the large-element limit under arbitrary affine deformation, while allowing us to seamlessly bridge to full atomistics. We verify that the new summation rules exhibit significantly smaller force artifacts and energy approximation errors than all comparable previous summation rules through a comprehensive suite of examples with spatially non-uniform QC discretizations in two and three dimensions. Due to the unique structure of these summation rules, we also use the new formulation to study scenarios with large regions of free surface, a class of problems previously out of reach of the QC method. Lastly, we present the key components of a high-performance, distributed-memory realization of the new method, including a novel algorithm for supporting unparalleled levels of deformation. Overall, this new formulation and implementation allows us to efficiently perform simulations containing an unprecedented number of degrees of freedom with low approximation error.