Relating thermodynamics to information theory : the equality of free energy and mutual information

In this thesis we uncover a new relation which links thermodynamics and information theory. We consider time as a channel and the detailed state of a physical system as a message. As the system evolves with time, ever present noise insures that the "message" is corrupted. Thermodynamic free energy measures the approach of the system toward equilibrium. Information theoretical mutual information measures the loss of memory of initial state. We regard the free energy and the mutual information as operators which map probability distributions over state space to real numbers. In the limit of long times, we show how the free energy operator and the mutual information operator asymptotically attain a very simple relationship to one another. This relationship is founded on the common appearance of entropy in the two operators and on an identity between internal energy and conditional entropy. The use of conditional entropy is what distinguishes our approach from previous efforts to relate thermodynamics and information theory.

Information-theoretic Studies and Capacity Bounds: Group Network Codes and Energy Harvesting Communication Systems

Network information theory and channels with memory are two important but difficult frontiers of information theory. In this two-parted dissertation, we study these two areas, each comprising one part. For the first area we study the so-called entropy vectors via finite group theory, and the network codes constructed from finite groups. In particular, we identify the smallest finite group that violates the Ingleton inequality, an inequality respected by all linear network codes, but not satisfied by all entropy vectors. Based on the analysis of this group we generalize it to several families of Ingleton-violating groups, which may be used to design good network codes. Regarding that aspect, we study the network codes constructed with finite groups, and especially show that linear network codes are embedded in the group network codes constructed with these Ingleton-violating families. Furthermore, such codes are strictly more powerful than linear network codes, as they are able to violate the Ingleton inequality while linear network codes cannot. For the second area, we study the impact of memory to the channel capacity through a novel communication system: the energy harvesting channel. Different from traditional communication systems, the transmitter of an energy harvesting channel is powered by an exogenous energy harvesting device and a finite-sized battery. As a consequence, each time the system can only transmit a symbol whose energy consumption is no more than the energy currently available. This new type of power supply introduces an unprecedented input constraint for the channel, which is random, instantaneous, and has memory. Furthermore, naturally, the energy harvesting process is observed causally at the transmitter, but no such information is provided to the receiver. Both of these features pose great challenges for the analysis of the channel capacity. In this work we use techniques from channels with side information, and finite state channels, to obtain lower and upper bounds of the energy harvesting channel. In particular, we study the stationarity and ergodicity conditions of a surrogate channel to compute and optimize the achievable rates for the original channel. In addition, for practical code design of the system we study the pairwise error probabilities of the input sequences.

Observations of nitrogen and oxygen isotopes in the low energy cosmic rays

The isotopic composition of the enhanced low energy nitrogen and oxygen cosmic rays can provide information regarding the source of these particles. Using the Caltech Electron/Isotope Spectrometer aboard the IMP-7 satellite, a measurement of this isotopic composition was made. To determine the isotope response of the instrument, a calibration was performed, and it was determined that the standard range-energy tables were inadequate to calculate the isotope response. From the calibration, corrections to the standard range-energy tables were obtained which can be used to calculate the isotope response of this and similar instruments.

The low energy nitrogen and oxygen cosmic rays were determined to be primarily ^(14)N and ^(16)O. Upper limits were obtained for the abundances of the other stable nitrogen and oxygen isotopes. To the 84% confidence level the isotopic abundances are: ^(15)N/N ≤ 0.26 (5.6- 12.7 MeV/nucleon), ^(17)0/0 ≤ 0.13 (7.0- 11.8 MeV/nucleon), (18)0/0 ≤ 0.12 (7.0 - 11.2 MeV/nucleon). The nitrogen composition differs from higher energy measurements which indicate that ^(15)N, which is thought to be secondary, is the dominant isotope. This implies that the low energy enhanced cosmic rays are not part of the same population as the higher energy cosmic rays and that they have not passed through enough material to produce a large fraction of ^(15)N. The isotopic composition of the low energy enhanced nitrogen and oxygen is consistent with the local acceleration theory of Fisk, Kozlovsky, and Ramaty, in which interstellar material is accelerated to several MeV/nucleon. If, on the other hand, the low energy nitrogen and oxygen result from nucleosynthesis in a galactic source, then the nucleosynthesis processes which produce an enhancement of nitrogen and oxygen and a depletion of carbon are restricted to producing predominantly ^(14)N and ^(16)O.

Nuclear reactions leading to energy levels of Ar37 and K37

In view of recent interest in the Cl³⁷ (ʋ solar’^e-)Ar³⁷ reaction cross section, information on some aspects of mass 37 nuclei has been obtained using the K³⁹ (d, ∝) Ar³⁷ and Cl³⁵ (He³, p) Ar³⁷ reactions. Ar³⁷ levels have been found at 0, 1.41, 1.62, 2.22, 2.50, 2.80, 3.17, 3.27, 3.53, 3.61, 3.71, (3.75), (3.90), 3.94, 4.02, (4.21), 4.28, 4.32, 4.40, 4.45, 4.58, 4.63, 4.74, 4.89, 4.98, 5.05, 5.10, 5.13, 5.21, 5.35, 5.41, 5.44, 5.54, 5.58, 5.67, 5.77, and 5.85 MeV (the underlined values correspond to previously tabulated levels). The nuclear temperature calculated from the Ar³⁷ level density is 1.4 MeV. Angular distributions of the lowest six levels with the K³⁹ (d, ∝) Ar³⁷ reaction at E_d = 10 MeV indicate a dominant direct interaction mechanism and the inapplicability of the 2I + 1 rule of the statistical model. Comparison of the spectra obtained with the K³⁹ (d, ∝) Ar³⁷ and Cl³⁵ (He³, p) Ar³⁷ reactions leads to the suggestion that the 5.13-MeV level is the T = 3/2 Cl³⁷ ground state analog. The ground state Q-value of the Ca⁴⁰ (p, ∝) K³⁷ reaction has been measured: -5179 ± 9 keV. This value implies a K³⁷ mass excess of -24804 ± 10 keV. Description of a NMR magnetometer and a sixteen-detector array used in conjunction with a 61-cm double-focusing magnetic spectrometer are included in appendices.

High energy heavy ion induced enhanced adhesion

The work described in this thesis represents an attempt to summarize to date the information collected on the process of high energy heavy ion induced enhanced adhesion. Briefly, the process involves the irradiation of materials covered by thin (≾3μm) films with high energy (E > 200 keV I nucleon) heavy ion beams (such as Fluorine or Chlorine). Enhanced adhesion has been observed on all material combinations tested, including metal on metal, metal on semiconductor, metal on dielectric and dielectric on dielectric systems. In some cases, the enhancement can be quite large, so that a film that could be wiped off a substrate quite easily before irradiation can withstand determined scrubbing afterwards.

Very little is understood yet about this adhesion mechanism, so what is presented are primarily observations about systems studied, and descriptions of the actual preparation and irradiation of samples used. Some discussion is presented about mechanisms that have been considered but rejected.