Automatic learning for the classification of chemical reactions and in statistical thermodynamics

This Thesis describes the application of automatic learning methods for a) the classification of organic and metabolic reactions, and b) the mapping of Potential Energy Surfaces(PES). The classification of reactions was approached with two distinct methodologies: a representation of chemical reactions based on NMR data, and a representation of chemical reactions from the reaction equation based on the physico-chemical and topological features of chemical bonds. NMR-based classification of photochemical and enzymatic reactions. Photochemical and metabolic reactions were classified by Kohonen Self-Organizing Maps (Kohonen SOMs) and Random Forests (RFs) taking as input the difference between the 1H NMR spectra of the products and the reactants. The development of such a representation can be applied in automatic analysis of changes in the 1H NMR spectrum of a mixture and their interpretation in terms of the chemical reactions taking place. Examples of possible applications are the monitoring of reaction processes, evaluation of the stability of chemicals, or even the interpretation of metabonomic data. A Kohonen SOM trained with a data set of metabolic reactions catalysed by transferases was able to correctly classify 75% of an independent test set in terms of the EC number subclass. Random Forests improved the correct predictions to 79%. With photochemical reactions classified into 7 groups, an independent test set was classified with 86-93% accuracy. The data set of photochemical reactions was also used to simulate mixtures with two reactions occurring simultaneously. Kohonen SOMs and Feed-Forward Neural Networks (FFNNs) were trained to classify the reactions occurring in a mixture based on the 1H NMR spectra of the products and reactants. Kohonen SOMs allowed the correct assignment of 53-63% of the mixtures (in a test set). Counter-Propagation Neural Networks (CPNNs) gave origin to similar results. The use of supervised learning techniques allowed an improvement in the results. They were improved to 77% of correct assignments when an ensemble of ten FFNNs were used and to 80% when Random Forests were used. This study was performed with NMR data simulated from the molecular structure by the SPINUS program. In the design of one test set, simulated data was combined with experimental data. The results support the proposal of linking databases of chemical reactions to experimental or simulated NMR data for automatic classification of reactions and mixtures of reactions. Genome-scale classification of enzymatic reactions from their reaction equation. The MOLMAP descriptor relies on a Kohonen SOM that defines types of bonds on the basis of their physico-chemical and topological properties. The MOLMAP descriptor of a molecule represents the types of bonds available in that molecule. The MOLMAP descriptor of a reaction is defined as the difference between the MOLMAPs of the products and the reactants, and numerically encodes the pattern of bonds that are broken, changed, and made during a chemical reaction. The automatic perception of chemical similarities between metabolic reactions is required for a variety of applications ranging from the computer validation of classification systems, genome-scale reconstruction (or comparison) of metabolic pathways, to the classification of enzymatic mechanisms. Catalytic functions of proteins are generally described by the EC numbers that are simultaneously employed as identifiers of reactions, enzymes, and enzyme genes, thus linking metabolic and genomic information. Different methods should be available to automatically compare metabolic reactions and for the automatic assignment of EC numbers to reactions still not officially classified. In this study, the genome-scale data set of enzymatic reactions available in the KEGG database was encoded by the MOLMAP descriptors, and was submitted to Kohonen SOMs to compare the resulting map with the official EC number classification, to explore the possibility of predicting EC numbers from the reaction equation, and to assess the internal consistency of the EC classification at the class level. A general agreement with the EC classification was observed, i.e. a relationship between the similarity of MOLMAPs and the similarity of EC numbers. At the same time, MOLMAPs were able to discriminate between EC sub-subclasses. EC numbers could be assigned at the class, subclass, and sub-subclass levels with accuracies up to 92%, 80%, and 70% for independent test sets. The correspondence between chemical similarity of metabolic reactions and their MOLMAP descriptors was applied to the identification of a number of reactions mapped into the same neuron but belonging to different EC classes, which demonstrated the ability of the MOLMAP/SOM approach to verify the internal consistency of classifications in databases of metabolic reactions. RFs were also used to assign the four levels of the EC hierarchy from the reaction equation. EC numbers were correctly assigned in 95%, 90%, 85% and 86% of the cases (for independent test sets) at the class, subclass, sub-subclass and full EC number level,respectively. Experiments for the classification of reactions from the main reactants and products were performed with RFs - EC numbers were assigned at the class, subclass and sub-subclass level with accuracies of 78%, 74% and 63%, respectively. In the course of the experiments with metabolic reactions we suggested that the MOLMAP / SOM concept could be extended to the representation of other levels of metabolic information such as metabolic pathways. Following the MOLMAP idea, the pattern of neurons activated by the reactions of a metabolic pathway is a representation of the reactions involved in that pathway - a descriptor of the metabolic pathway. This reasoning enabled the comparison of different pathways, the automatic classification of pathways, and a classification of organisms based on their biochemical machinery. The three levels of classification (from bonds to metabolic pathways) allowed to map and perceive chemical similarities between metabolic pathways even for pathways of different types of metabolism and pathways that do not share similarities in terms of EC numbers. Mapping of PES by neural networks (NNs). In a first series of experiments, ensembles of Feed-Forward NNs (EnsFFNNs) and Associative Neural Networks (ASNNs) were trained to reproduce PES represented by the Lennard-Jones (LJ) analytical potential function. The accuracy of the method was assessed by comparing the results of molecular dynamics simulations (thermal, structural, and dynamic properties) obtained from the NNs-PES and from the LJ function. The results indicated that for LJ-type potentials, NNs can be trained to generate accurate PES to be used in molecular simulations. EnsFFNNs and ASNNs gave better results than single FFNNs. A remarkable ability of the NNs models to interpolate between distant curves and accurately reproduce potentials to be used in molecular simulations is shown. The purpose of the first study was to systematically analyse the accuracy of different NNs. Our main motivation, however, is reflected in the next study: the mapping of multidimensional PES by NNs to simulate, by Molecular Dynamics or Monte Carlo, the adsorption and self-assembly of solvated organic molecules on noble-metal electrodes. Indeed, for such complex and heterogeneous systems the development of suitable analytical functions that fit quantum mechanical interaction energies is a non-trivial or even impossible task. The data consisted of energy values, from Density Functional Theory (DFT) calculations, at different distances, for several molecular orientations and three electrode adsorption sites. The results indicate that NNs require a data set large enough to cover well the diversity of possible interaction sites, distances, and orientations. NNs trained with such data sets can perform equally well or even better than analytical functions. Therefore, they can be used in molecular simulations, particularly for the ethanol/Au (111) interface which is the case studied in the present Thesis. Once properly trained, the networks are able to produce, as output, any required number of energy points for accurate interpolations.

Extension of the thermodynamics of small systems to open metastable states: An example

By using a simplified model of small open liquid-like clusters with surface effects, in the gas phase, it is shown how the statistical thermodynamics of small systems can be extended to include metastable supersaturated gaseous states not too far from the gas–liquid equilibrium transition point. To accomplish this, one has to distinguish between mathematical divergence and physical convergence of the open-system partition function.

Thermostatics and thermodynamics ; an introduction to energy, information and states of matter, with engineering applications.

Mode of access: Internet.

Mixed gas equilibrium adsorption on zeolites and energetic heterogeneity of adsorption volume

A model for binary mixture adsorption accounting for energetic heterogeneity and intermolecular interactions is proposed in this paper. The model is based on statistical thermodynamics, and it is able to describe molecular rearrangement of a mixture in a nonuniform adsorption field inside a cavity. The Helmholtz free energy obtained in the framework of this approach has upper and lower limits, which define a permissible range in which all possible solutions will be found. One limit corresponds to a completely chaotic distribution of molecules within a cavity, while the other corresponds to a maximum ordered molecular structure. Comparison of the nearly ideal O-2-N-2-zeolite NaX system at ambient temperature with the system Of O-2-N-2-zeolite CaX at 144 K has shown that a decrease of temperature leads to a molecular rearrangement in the cavity volume, which results from the difference in the fluid-solid interactions. The model is able to describe this behavior and therefore allows predicting mixture adsorption more accurately compared to those assuming energetic uniformity of the adsorption volume. Another feature of the model is its ability to correctly describe the negative deviations from Raoult's law exhibited by the O-2-N-2-CaX system at 144 K. Analysis of the highly nonideal CO2-C2H6-zeolite NaX system has shown that the spatial molecular rearrangement in separate cavities is induced by not only the ion-quadrupole interaction of the CO2 molecule but also the significant difference in molecular size and the difference between the intermolecular interactions of molecules of the same species and those of molecules of different species. This leads to the highly ordered structure of this system.

Comment on "Kinetics of spinodal decomposition in the ising model with vacancy diffusion"

In a recent paper [Phys. Rev. B 50, 3477 (1994)], P. Fratzl and O. Penrose present the results of the Monte Carlo simulation of the spinodal decomposition problem (phase separation) using the vacancy dynamics mechanism. They observe that the t1/3 growth regime is reached faster than when using the standard Kawasaki dynamics. In this Comment we provide a simple explanation for the phenomenon based on the role of interface diffusion, which they claim is irrelevant for the observed behavior.

Relaxation times in a bistable system with parametric, white noise: Theory and experiment

We consider the effects of external, multiplicative white noise on the relaxation time of a general representation of a bistable system from the points of view provided by two, quite different, theoretical approaches: the classical Stratonovich decoupling of correlations and the new method due to Jung and Risken. Experimental results, obtained from a bistable electronic circuit, are compared to the theoretical predictions. We show that the phenomenon of critical slowing down appears as a function of the noise parameters, thereby providing a correct characterization of a noise-induced transition.

Interfacial growth in driven diffusive systems

We have studied the growth of interfaces in driven diffusive systems well below the critical temperature by means of Monte Carlo simulations. We consider the region beyond the linear regime and of large values of the external field which has not been explored before. The simulations support the existence of interfacial traveling waves when asymmetry is introduced in the model, a result previously predicted by a linear-stability analysis. Furthermore, the generalization of the Gibbs-Thomson relation is discussed. The results provide evidence that the external field is a stabilizing effect which can be considered as effectively increasing the surface tension.

Lattice-gas model of particles with orientational and positional degrees of freedom: Mean-field treatment

We consider a lattice-gas model of particles with internal orientational degrees of freedom. In addition to antiferromagnetic nearest-neighbor (NN) and next-nearest-neighbor (NNN) positional interactions we also consider NN and NNN interactions arising from the internal state of the particles. The system then shows positional and orientational ordering modes with associated phase transitions at Tp and To temperatures at which long-range positional and orientational ordering are, respectively, lost. We use mean-field techniques to obtain a general approach to the study of these systems. By considering particular forms of the orientational interaction function we study coupling effects between both phase transitions arising from the interplay between orientational and positional degrees of freedom. In mean-field approximation coupling effects appear only for the phase transition taking place at lower temperatures. The strength of the coupling depends on the value of the long-range order parameter that remains finite at that temperature.

Viral self-assembly as a thermodynamic process

The protein shells, or capsids, of nearly all spherelike viruses adopt icosahedral symmetry. In the present Letter, we propose a statistical thermodynamic model for viral self-assembly. We find that icosahedral symmetry is not expected for viral capsids constructed from structurally identical protein subunits and that this symmetry requires (at least) two internal switching configurations of the protein. Our results indicate that icosahedral symmetry is not a generic consequence of free energy minimization but requires optimization of internal structural parameters of the capsid proteins

Viral self-assembly as a thermodynamic process

The protein shells, or capsids, of nearly all spherelike viruses adopt icosahedral symmetry. In the present Letter, we propose a statistical thermodynamic model for viral self-assembly. We find that icosahedral symmetry is not expected for viral capsids constructed from structurally identical protein subunits and that this symmetry requires (at least) two internal switching configurations of the protein. Our results indicate that icosahedral symmetry is not a generic consequence of free energy minimization but requires optimization of internal structural parameters of the capsid proteins

Thermostatistical description of small systems in nonequilibrium conditions: Energy conversion and harvesting

Hysteresis cycles are very important features of energy conversion and harvesting devices, such as batteries. The efficiency of these may be strongly affected by the physical size of the system. Here, we show that in systems which are small enough, the existence of physical boundaries which produce nonhomogeneities of the interaction potential gives rise to inflections and barriers in the associated free energy. This in turn brings on irreversible processes which can be triggered under suitable external conditions imposed by a heat bath. As an example, by controlling the temperature, the state of a small system may be impelled to oscillate between two different structural configurations or aggregation states avoiding equilibrium coexistence and therefore dissipating energy. This cyclical behavior associated with a hysteresis cycle may be prototypical of energy conversion, storage, or generating nanodevices, as exemplified by Li-ion insertion batteries.

Vacancy-assisted domain-growth in asymmetric binary alloys: A Monte Carlo Study

A Monte Carlo simulation study of the vacancy-assisted domain growth in asymmetric binary alloys is presented. The system is modeled using a three-state ABV Hamiltonian which includes an asymmetry term. Our simulated system is a stoichiometric two-dimensional binary alloy with a single vacancy which evolves according to the vacancy-atom exchange mechanism. We obtain that, compared to the symmetric case, the ordering process slows down dramatically. Concerning the asymptotic behavior it is algebraic and characterized by the Allen-Cahn growth exponent x51/2. The late stages of the evolution are preceded by a transient regime strongly affected by both the temperature and the degree of asymmetry of the alloy. The results are discussed and compared to those obtained for the symmetric case.

Comment on "Kinetics of spinodal decomposition in the ising model with vacancy diffusion"

In a recent paper [Phys. Rev. B 50, 3477 (1994)], P. Fratzl and O. Penrose present the results of the Monte Carlo simulation of the spinodal decomposition problem (phase separation) using the vacancy dynamics mechanism. They observe that the t1/3 growth regime is reached faster than when using the standard Kawasaki dynamics. In this Comment we provide a simple explanation for the phenomenon based on the role of interface diffusion, which they claim is irrelevant for the observed behavior.