Improved SOM learning using simulated annealing

Self-Organizing Map (SOM) algorithm has been extensively used for analysis and classification problems. For this kind of problems, datasets become more and more large and it is necessary to speed up the SOM learning. In this paper we present an application of the Simulated Annealing (SA) procedure to the SOM learning algorithm. The goal of the algorithm is to obtain fast learning and better performance in terms of matching of input data and regularity of the obtained map. An advantage of the proposed technique is that it preserves the simplicity of the basic algorithm. Several tests, carried out on different large datasets, demonstrate the effectiveness of the proposed algorithm in comparison with the original SOM and with some of its modification introduced to speed-up the learning.

LVB: parsimony and simulated annealing in the search for phylogenetic trees

Summary: The program LVB seeks parsimonious phylogenies from nucleotide alignments, using the simulated annealing heuristic. LVB runs fast and gives high quality results.

Simulated annealing technique for fast learning of SOM networks

The Self-Organizing Map (SOM) is a popular unsupervised neural network able to provide effective clustering and data visualization for multidimensional input datasets. In this paper, we present an application of the simulated annealing procedure to the SOM learning algorithm with the aim to obtain a fast learning and better performances in terms of quantization error. The proposed learning algorithm is called Fast Learning Self-Organized Map, and it does not affect the easiness of the basic learning algorithm of the standard SOM. The proposed learning algorithm also improves the quality of resulting maps by providing better clustering quality and topology preservation of input multi-dimensional data. Several experiments are used to compare the proposed approach with the original algorithm and some of its modification and speed-up techniques.

The effect of annealing on the local structure of glassy polycarbonate

Annealing of polycarbonate glasses at temperatures belowTg leads to an increase in yield stress and a drop in the impact strength. Although such behaviour may be related to the corresponding reduction in free volume upon annealing, variations in the wide-angle X-ray scattering curves indicate some modification to the local structure. The area of an intrachain peak at s ∼ 0.7 Å−1 is monitored with respect to annealing temperature and time. It is proposed that the variations may be described by an increasing level of interlocking or (nesting) between neighbouring chain segments, a process which is a natural consequence of the molecular shape of polycarbonate.

GDASH: a grid-enabled program for structure solution from powder diffraction data

The simulated annealing approach to structure solution from powder diffraction data, as implemented in the DASH program, is easily amenable to parallelization at the individual run level. Very large scale increases in speed of execution can therefore be achieved by distributing individual DASH runs over a network of computers. The GDASH program achieves this by packaging DASH in a form that enables it to run under the Univa UD Grid MP system, which harnesses networks of existing computing resources to perform calculations.

MDASH: a multi-core-enabled program for structure solution from powder diffraction data

The simulated annealing approach to structure solution from powder diffraction data, as implemented in the DASH program, is easily amenable to parallelization at the individual run level. Modest increases in speed of execution can therefore be achieved by executing individual DASH runs on the individual cores of CPUs.

Determining the effect of asymmetric data on the variogram. I. Underlying asymmetry

Matheron's usual variogram estimator can result in unreliable variograms when data are strongly asymmetric or skewed. Asymmetry in a distribution can arise from a long tail of values in the underlying process or from outliers that belong to another population that contaminate the primary process. This paper examines the effects of underlying asymmetry on the variogram and on the accuracy of prediction, and the second one examines the effects arising from outliers. Standard geostatistical texts suggest ways of dealing with underlying asymmetry; however, this is based on informed intuition rather than detailed investigation. To determine whether the methods generally used to deal with underlying asymmetry are appropriate, the effects of different coefficients of skewness on the shape of the experimental variogram and on the model parameters were investigated. Simulated annealing was used to create normally distributed random fields of different size from variograms with different nugget:sill ratios. These data were then modified to give different degrees of asymmetry and the experimental variogram was computed in each case. The effects of standard data transformations on the form of the variogram were also investigated. Cross-validation was used to assess quantitatively the performance of the different variogram models for kriging. The results showed that the shape of the variogram was affected by the degree of asymmetry, and that the effect increased as the size of data set decreased. Transformations of the data were more effective in reducing the skewness coefficient in the larger sets of data. Cross-validation confirmed that variogram models from transformed data were more suitable for kriging than were those from the raw asymmetric data. The results of this study have implications for the 'standard best practice' in dealing with asymmetry in data for geostatistical analyses. (C) 2007 Elsevier Ltd. All rights reserved.

Determining the effect of asymmetric data on the variogram. II. Outliers

Asymmetry in a distribution can arise from a long tail of values in the underlying process or from outliers that belong to another population that contaminate the primary process. The first paper of this series examined the effects of the former on the variogram and this paper examines the effects of asymmetry arising from outliers. Simulated annealing was used to create normally distributed random fields of different size that are realizations of known processes described by variograms with different nugget:sill ratios. These primary data sets were then contaminated with randomly located and spatially aggregated outliers from a secondary process to produce different degrees of asymmetry. Experimental variograms were computed from these data by Matheron's estimator and by three robust estimators. The effects of standard data transformations on the coefficient of skewness and on the variogram were also investigated. Cross-validation was used to assess the performance of models fitted to experimental variograms computed from a range of data contaminated by outliers for kriging. The results showed that where skewness was caused by outliers the variograms retained their general shape, but showed an increase in the nugget and sill variances and nugget:sill ratios. This effect was only slightly more for the smallest data set than for the two larger data sets and there was little difference between the results for the latter. Overall, the effect of size of data set was small for all analyses. The nugget:sill ratio showed a consistent decrease after transformation to both square roots and logarithms; the decrease was generally larger for the latter, however. Aggregated outliers had different effects on the variogram shape from those that were randomly located, and this also depended on whether they were aggregated near to the edge or the centre of the field. The results of cross-validation showed that the robust estimators and the removal of outliers were the most effective ways of dealing with outliers for variogram estimation and kriging. (C) 2007 Elsevier Ltd. All rights reserved.

Fast training of self organizing maps for the visual exploration of molecular compounds

Visual exploration of scientific data in life science area is a growing research field due to the large amount of available data. The Kohonen’s Self Organizing Map (SOM) is a widely used tool for visualization of multidimensional data. In this paper we present a fast learning algorithm for SOMs that uses a simulated annealing method to adapt the learning parameters. The algorithm has been adopted in a data analysis framework for the generation of similarity maps. Such maps provide an effective tool for the visual exploration of large and multi-dimensional input spaces. The approach has been applied to data generated during the High Throughput Screening of molecular compounds; the generated maps allow a visual exploration of molecules with similar topological properties. The experimental analysis on real world data from the National Cancer Institute shows the speed up of the proposed SOM training process in comparison to a traditional approach. The resulting visual landscape groups molecules with similar chemical properties in densely connected regions.

Model catalyst studies of the strong metal-support interaction: Surface structure identified by STM on Pd nanoparticles on TiO2(110)

Model catalysts of Pd nanoparticles and films on TiO2 (I 10) were fabricated by metal vapour deposition (MVD). Molecular beam measurements show that the particles are active for CO adsorption, with a global sticking probability of 0.25, but that they are deactivated by annealing above 600 K, an effect indicative of SMSI. The Pd nanoparticles are single crystals oriented with their (I 11) plane parallel to the surface plane of the titania. Analysis of the surface by atomic resolution STM shows that new structures have formed at the surface of the Pd nanoparticles and films after annealing above 800 K. There are only two structures, a zigzag arrangement and a much more complex "pinwheel" structure. The former has a unit cell containing 7 atoms, and the latter is a bigger unit cell containing 25 atoms. These new structures are due to an overlayer of titania that has appeared on the surface of the Pd nanoparticles after annealing, and it is proposed that the surface layer that causes the SMSI effect is a mixed alloy of Pd and Ti, with only two discrete ratios of atoms: Pd/Ti of 1: 1 (pinwheel) and 1:2 (zigzag). We propose that it is these structures that cause the SMSI effect. (c) 2005 Elsevier Inc. All rights reserved.

Lateral phase separation in grafted diblock copolymer films

Tethered films of polystyrene-block-poly(methyl methacrylate) copolymers of varying composition and molecular weight were investigated using atomic force microscopy and the observed structures compared with theoretical predictions. Although the experimental results were in qualitative agreement with the theory, there was significant quantitative variation. This was attributed to the presence of solvent in the films prior to and during annealing, a hypothesis supported by new preliminary calculations reported here. Solvent exchange experiments (where a good solvent for both polymer blocks was gradually replaced by a selective solvent), were also performed on the films. This procedure generated textured films in which the structure was defined by miscibility of the polymer blocks with the second solvent.

The adsorption geometry of sulphur on Ir{100}: a quantitative LEED study

A quantitative low energy electron diffraction (LEED) analysis has been performed for the p(2 x 2)-S and c(2 x 2)-S surface structures formed by exposing the (1 x 1) phase of Ir{100} to H2S at 750 K. S is found to adsorb on the fourfold hollow sites in both structures leading to Pendry R-factor values of 0.17 for the p(2 x 2)-S and 0.16 for the c(2 x 2)-S structures. The distances between S and the nearest and next-nearest Ir atoms were found to be similar in both structures: 2.36 +/- 0.01 angstrom and 3.33 +/- 0.01 angstrom, respectively. The buckling in the second substrate layer is consistent with other structural studies for S adsorption on fcc{100} transition metal surfaces: 0.09 angstrom for p(2 x 2)-S and 0.02 angstrom for c(2 x 2)-S structures. The (1 x 5) reconstruction, which is the most stable phase for clean Ir{100}, is completely lifted and a c(2 x 2)-S overlayer is formed after exposure to H,S at 300 K followed by annealing to 520 K. CO temperature-programmed desorption (TPD) experiments indicate that the major factor in the poisoning of Ir by S is site blocking. (c) 2005 Elsevier B.V. All rights reserved.

Electrochemical deposition of praseodymium oxide on tin-doped indium oxide as a thin sensing film

Fabrication of a thin praseodymium oxide film is of great technological interest in sensor, semiconducting, and ceramic industries. It is shown for the first time that an ultrathin layer of praseodymium oxide can be deposited on tin-doped indium oxide surface (ITO) by applying a negative sweeping voltage (cathodic electrodeposition) to the aqueous solution containing Pr(NO3)(3) and H2O2 using cyclic voltammetry, followed by annealing the film at 500 S C for 1 h. X-ray diffraction suggested that the predominant phase of the film is Pr6O11 and atomic force microscopy and scanning electron microscopy characterizations indicated that this film is assembled with a monolayer coverage of spherical praseodymium oxide nanoparticles packed closely on the ITO surface. AC impedance measurements of the thin Pr6O11 film on ITO also revealed that the composite material displays a much higher electrical conductivity compared to the pure ITO. As a result, the material could suitably be used as a new chemical sensor. (c) 2006 The Electrochemical Society.

Thermal Fractionation and isothermal crystallization of polyethylene nanocomposites prepared by in situ polymerization

Nanocomposites of high-density polyethylene (HDPE) and carbon nanotubes (CNT) of different geometries (single wall, double wall, and multiwall; SWNT, DWNT, and MWNT) were prepared by in situ polymerization of ethylene on CNT whose surface had been previously treated with a metallocene catalytic system. In this work, we have studied the effects of applying the successive self-nucleation and annealing thermal fractionation technique (SSA) to the nanocomposites and have also determined the influence of composition and type of CNT on the isothermal crystallization behavior of the HDPE. SSA results indicate that all types of CNT induce the formation of a population of thicker lamellar crystals that melt at higher temperatures as compared to the crystals formed in neat HDPE prepared under the same catalytic and polymerization conditions and subjected to the same SSA treatment. Furthermore, the peculiar morphology induced by the CNT on the HDPE matrix allows the resolution of thermal fractionation to be much better. The isothermal crystallization results indicated that the strong nucleation effect caused by CNT reduced the supercooling needed for crystallization. The interaction between the HDPE chains and the surface of the CNT is probably very strong as judged by the results obtained, even though it is only physical in nature. When the total crystallinity achieved during isothermal crystallization is considered as a function of CNT content, it was found that a competition between nucleation and topological confinement could account for the results. At low CNT content the crystallinity increases (because of the nucleating effect of CNT on HDPE), however, at higher CNT content there is a dramatic reduction in crystallinity reflecting the increased confinement experienced by the HDPE chains at the interfaces which are extremely large in these nanocomposites. Another consequence of these strong interactions is the remarkable decrease in Avrami index as CNT content increases. When the Avrami index reduces to I or lower, nucleation dominates the overall kinetics as a consequence of confinement effects. Wide-angle X-ray experiments were performed at a high-energy synchrotron source and demonstrated that no change in the orthorhombic unit cell of HDPE occurred during crystallization with or without CNT.