Smoothed Functional Algorithms for Stochastic Optimization Using q-Gaussian Distributions

Smoothed functional (SF) schemes for gradient estimation are known to be efficient in stochastic optimization algorithms, especially when the objective is to improve the performance of a stochastic system However, the performance of these methods depends on several parameters, such as the choice of a suitable smoothing kernel. Different kernels have been studied in the literature, which include Gaussian, Cauchy, and uniform distributions, among others. This article studies a new class of kernels based on the q-Gaussian distribution, which has gained popularity in statistical physics over the last decade. Though the importance of this family of distributions is attributed to its ability to generalize the Gaussian distribution, we observe that this class encompasses almost all existing smoothing kernels. This motivates us to study SF schemes for gradient estimation using the q-Gaussian distribution. Using the derived gradient estimates, we propose two-timescale algorithms for optimization of a stochastic objective function in a constrained setting with a projected gradient search approach. We prove the convergence of our algorithms to the set of stationary points of an associated ODE. We also demonstrate their performance numerically through simulations on a queuing model.

Random vibration testing with controlled samples

This paper proposes a novel experimental test procedure to estimate the reliability of structural dynamical systems under excitations specified via random process models. The samples of random excitations to be used in the test are modified by the addition of an artificial control force. An unbiased estimator for the reliability is derived based on measured ensemble of responses under these modified inputs based on the tenets of Girsanov transformation. The control force is selected so as to reduce the sampling variance of the estimator. The study observes that an acceptable choice for the control force can be made solely based on experimental techniques and the estimator for the reliability can be deduced without taking recourse to mathematical model for the structure under study. This permits the proposed procedure to be applied in the experimental study of time-variant reliability of complex structural systems that are difficult to model mathematically. Illustrative example consists of a multi-axes shake table study on bending-torsion coupled, geometrically non-linear, five-storey frame under uni/bi-axial, non-stationary, random base excitation. Copyright (c) 2014 John Wiley & Sons, Ltd.

On Precoding for Constant K-User MIMO Gaussian Interference Channel With Finite Constellation Inputs

This paper considers linear precoding for the constant channel-coefficient K-user MIMO Gaussian interference channel (MIMO GIC) where each transmitter-i (Tx-i) requires the sending of d(i) independent complex symbols per channel use that take values from fixed finite constellations with uniform distribution to receiver-i (Rx-i) for i = 1, 2, ..., K. We define the maximum rate achieved by Tx-i using any linear precoder as the signal-to-noise ratio (SNR) tends to infinity when the interference channel coefficients are zero to be the constellation constrained saturation capacity (CCSC) for Tx-i. We derive a high-SNR approximation for the rate achieved by Tx-i when interference is treated as noise and this rate is given by the mutual information between Tx-i and Rx-i, denoted as I(X) under bar (i); (Y) under bar (i)]. A set of necessary and sufficient conditions on the precoders under which I(X) under bar (i); (Y) under bar (i)] tends to CCSC for Tx-i is derived. Interestingly, the precoders designed for interference alignment (IA) satisfy these necessary and sufficient conditions. Furthermore, we propose gradient-ascentbased algorithms to optimize the sum rate achieved by precoding with finite constellation inputs and treating interference as noise. A simulation study using the proposed algorithms for a three-user MIMO GIC with two antennas at each node with d(i) = 1 for all i and with BPSK and QPSK inputs shows more than 0.1-b/s/Hz gain in the ergodic sum rate over that yielded by precoders obtained from some known IA algorithms at moderate SNRs.

BELIEF PROPAGATION FOR OPTIMAL EDGE COVER IN THE RANDOM COMPLETE GRAPH

We apply the objective method of Aldous to the problem of finding the minimum-cost edge cover of the complete graph with random independent and identically distributed edge costs. The limit, as the number of vertices goes to infinity, of the expected minimum cost for this problem is known via a combinatorial approach of Hessler and Wastlund. We provide a proof of this result using the machinery of the objective method and local weak convergence, which was used to prove the (2) limit of the random assignment problem. A proof via the objective method is useful because it provides us with more information on the nature of the edge's incident on a typical root in the minimum-cost edge cover. We further show that a belief propagation algorithm converges asymptotically to the optimal solution. This can be applied in a computational linguistics problem of semantic projection. The belief propagation algorithm yields a near optimal solution with lesser complexity than the known best algorithms designed for optimality in worst-case settings.

Finite element simulations of notch tip fields in magnesium single crystals

Recent experiments using three point bend specimens of Mg single crystals have revealed that tensile twins of {10 (1) over bar2}-type form profusely near a notch tip and enhance the fracture toughness through large plastic dissipation. In this work, 3D finite element simulations of these experiments are carried out using a crystal plasticity framework which includes slip and twinning to gain insights on the mechanics of fracture. The predicted load-displacement curves, slip and tensile twinning activities from finite element analysis corroborate well with the experimental observations. The numerical results are used to explore the 3D nature of the crack tip stress, plastic slip and twin volume fraction distributions near the notch root. The occurrence of tensile twinning is rationalized from the variation of normal stress ahead of the notch tip. Further, deflection of the crack path at twin-twin intersections observed in the experiments is examined from an energy standpoint by modeling discrete twins close to the notch root.

Newton-based stochastic optimization using q-Gaussian smoothed functional algorithms

We present the first q-Gaussian smoothed functional (SF) estimator of the Hessian and the first Newton-based stochastic optimization algorithm that estimates both the Hessian and the gradient of the objective function using q-Gaussian perturbations. Our algorithm requires only two system simulations (regardless of the parameter dimension) and estimates both the gradient and the Hessian at each update epoch using these. We also present a proof of convergence of the proposed algorithm. In a related recent work (Ghoshdastidar, Dukkipati, & Bhatnagar, 2014), we presented gradient SF algorithms based on the q-Gaussian perturbations. Our work extends prior work on SF algorithms by generalizing the class of perturbation distributions as most distributions reported in the literature for which SF algorithms are known to work turn out to be special cases of the q-Gaussian distribution. Besides studying the convergence properties of our algorithm analytically, we also show the results of numerical simulations on a model of a queuing network, that illustrate the significance of the proposed method. In particular, we observe that our algorithm performs better in most cases, over a wide range of q-values, in comparison to Newton SF algorithms with the Gaussian and Cauchy perturbations, as well as the gradient q-Gaussian SF algorithms. (C) 2014 Elsevier Ltd. All rights reserved.

Multiscale Symmetry Detection in Scalar Fields by Clustering Contours

The complexity in visualizing volumetric data often limits the scope of direct exploration of scalar fields. Isocontour extraction is a popular method for exploring scalar fields because of its simplicity in presenting features in the data. In this paper, we present a novel representation of contours with the aim of studying the similarity relationship between the contours. The representation maps contours to points in a high-dimensional transformation-invariant descriptor space. We leverage the power of this representation to design a clustering based algorithm for detecting symmetric regions in a scalar field. Symmetry detection is a challenging problem because it demands both segmentation of the data and identification of transformation invariant segments. While the former task can be addressed using topological analysis of scalar fields, the latter requires geometry based solutions. Our approach combines the two by utilizing the contour tree for segmenting the data and the descriptor space for determining transformation invariance. We discuss two applications, query driven exploration and asymmetry visualization, that demonstrate the effectiveness of the approach.

VISUAL OBJECT TRACKING VIA RANDOM FERNS BASED CLASSIFICATION

Designing a robust algorithm for visual object tracking has been a challenging task since many years. There are trackers in the literature that are reasonably accurate for many tracking scenarios but most of them are computationally expensive. This narrows down their applicability as many tracking applications demand real time response. In this paper, we present a tracker based on random ferns. Tracking is posed as a classification problem and classification is done using ferns. We used ferns as they rely on binary features and are extremely fast at both training and classification as compared to other classification algorithms. Our experiments show that the proposed tracker performs well on some of the most challenging tracking datasets and executes much faster than one of the state-of-the-art trackers, without much difference in tracking accuracy.

Double Gaussian distribution of barrier height observed in densely packed GaN nanorods over Si (111) heterostructures

GaN nanorods were grown by plasma assisted molecular beam epitaxy on intrinsic Si (111) substrates which were characterized by powder X-ray diffraction, field emission scanning electron microscopy, and photoluminescence. The current-voltage characteristics of the GaN nanorods on Si (111) heterojunction were obtained from 138 to 493K which showed the inverted rectification behavior. The I-V characteristics were analyzed in terms of thermionic emission model. The temperature variation of the apparent barrier height and ideality factor along with the non-linearity of the activation energy plot indicated the presence of lateral inhomogeneities in the barrier height. The observed two temperature regimes in Richardson's plot could be well explained by assuming two separate Gaussian distribution of the barrier heights. (C) 2014 AIP Publishing LLC.

Direct correlation between non-random distribution of cations and ion transport mechanism in soda-lime silicate glasses

We report a direct correlation between dissimilar ion pair formation and alkali ion transport in soda-lime silicate glasses established via broad band conductivity spectroscopy and local structural probe techniques. The combined Raman and Nuclear Magnetic Resonance (NMR) spectroscopy techniques on these glasses reveal the coexistence of different anionic species and the prevalence of Na+-Ca2+ dissimilar pairs as well as their distributions. The spectroscopic results further confirm the formation of dissimilar pairs atomistically, where it increases with increasing alkaline-earth oxide content These results, are the manifestation of local structural changes in the silicate network with composition which give rise to different environments into which the alkali ions hop. The Na+ ion mobility varies inversely with dissimilar pair formation, i.e. it decreases with increase of non-random formation of dissimilar pairs. Remarkably, we found that increased degree of non-randomness leads to temperature dependent variation in number density of sodium ions. Furthermore, the present study provides the strong link between the dynamics of the alkali ions and different sites associated with it in soda-lime silicate glasses. (C) 2014 Elsevier B.V. All rights reserved.

Faster computation of the Karhunen-Loeve expansion using its domain independence property

The goal of this work is to reduce the cost of computing the coefficients in the Karhunen-Loeve (KL) expansion. The KL expansion serves as a useful and efficient tool for discretizing second-order stochastic processes with known covariance function. Its applications in engineering mechanics include discretizing random field models for elastic moduli, fluid properties, and structural response. The main computational cost of finding the coefficients of this expansion arises from numerically solving an integral eigenvalue problem with the covariance function as the integration kernel. Mathematically this is a homogeneous Fredholm equation of second type. One widely used method for solving this integral eigenvalue problem is to use finite element (FE) bases for discretizing the eigenfunctions, followed by a Galerkin projection. This method is computationally expensive. In the current work it is first shown that the shape of the physical domain in a random field does not affect the realizations of the field estimated using KL expansion, although the individual KL terms are affected. Based on this domain independence property, a numerical integration based scheme accompanied by a modification of the domain, is proposed. In addition to presenting mathematical arguments to establish the domain independence, numerical studies are also conducted to demonstrate and test the proposed method. Numerically it is demonstrated that compared to the Galerkin method the computational speed gain in the proposed method is of three to four orders of magnitude for a two dimensional example, and of one to two orders of magnitude for a three dimensional example, while retaining the same level of accuracy. It is also shown that for separable covariance kernels a further cost reduction of three to four orders of magnitude can be achieved. Both normal and lognormal fields are considered in the numerical studies. (c) 2014 Elsevier B.V. All rights reserved.

The Relationship Between Solar Coronal X-Ray Brightness and Active Region Magnetic Fields: A Study Using High-Resolution Hinode Observations

By using high-resolution observations of nearly co-temporal and co-spatial Solar Optical Telescope spectropolarimeter and X-Ray Telescope coronal X-ray data onboard Hinode, we revisit the problematic relationship between global magnetic quantities and coronal X-ray brightness. Co-aligned vector magnetogram and X-ray data were used for this study. The total X-ray brightness over active regions is well correlated with integrated magnetic quantities such as the total unsigned magnetic flux, the total unsigned vertical current, and the area-integrated square of the vertical and horizontal magnetic fields. On accounting for the inter-dependence of the magnetic quantities, we inferred that the total magnetic flux is the primary determinant of the observed integrated X-ray brightness. Our observations indicate that a stronger coronal X-ray flux is not related to a higher non-potentiality of active-region magnetic fields. The data even suggest a slightly negative correlation between X-ray brightness and a proxy of active-region non-potentiality. Although there are small numerical differences in the established correlations, the main conclusions are qualitatively consistent over two different X-ray filters, the Al-poly and Ti-poly filters, which confirms the strength of our conclusions and validate and extend earlier studies that used low-resolution data. We discuss the implications of our results and the constraints they set on theories of solar coronal heating.

Belief propagation for minimum weight many-to-one matchings in the random complete graph

In a complete bipartite graph with vertex sets of cardinalities n and n', assign random weights from exponential distribution with mean 1, independently to each edge. We show that, as n -> infinity, with n' = n/alpha] for any fixed alpha > 1, the minimum weight of many-to-one matchings converges to a constant (depending on alpha). Many-to-one matching arises as an optimization step in an algorithm for genome sequencing and as a measure of distance between finite sets. We prove that a belief propagation (BP) algorithm converges asymptotically to the optimal solution. We use the objective method of Aldous to prove our results. We build on previous works on minimum weight matching and minimum weight edge cover problems to extend the objective method and to further the applicability of belief propagation to random combinatorial optimization problems.

A Gaussian network model study suggests that structural fluctuations are higher for inactive states than active states of protein kinases

We performed Gaussian network model based normal mode analysis of 3-dimensional structures of multiple active and inactive forms of protein kinases. In 14 different kinases, a more number of residues (1095) show higher structural fluctuations in inactive states than those in active states (525), suggesting that, in general, mobility of inactive states is higher than active states. This statistically significant difference is consistent with higher crystallographic B-factors and conformational energies for inactive than active states, suggesting lower stability of inactive forms. Only a small number of inactive conformations with the DFG motif in the ``in'' state were found to have fluctuation magnitudes comparable to the active conformation. Therefore our study reports for the first time, intrinsic higher structural fluctuation for almost all inactive conformations compared to the active forms. Regions with higher fluctuations in the inactive states are often localized to the aC-helix, aG-helix and activation loop which are involved in the regulation and/or in structural transitions between active and inactive states. Further analysis of 476 kinase structures involved in interactions with another domain/protein showed that many of the regions with higher inactive-state fluctuation correspond to contact interfaces. We also performed extensive GNM analysis of (i) insulin receptor kinase bound to another protein and (ii) holo and apo forms of active and inactive conformations followed by multi-factor analysis of variance. We conclude that binding of small molecules or other domains/proteins reduce the extent of fluctuation irrespective of active or inactive forms. Finally, we show that the perceived fluctuations serve as a useful input to predict the functional state of a kinase.

Giant actuation in bulk carbon nanotubes under coupled electric and magnetic fields

We report an enhanced actuation in bulk carbon nanotubes (CNTs) under coupled electric and magnetic fields, which is much higher than that evaluated in the presence of individual fields. Coupled electric and magnetic fields induce a directional actuation demonstrating a transformation from polarity independent to dependent actuation behavior of CNTs. Both qualitative and quantitative analyses are performed to understand this transformation in the bulk CNTs. Moreover, actuations along radial and axial directions of CNTs have also demonstrated a similar directional behavior.