Optimal Control of Markov Processes with Age-Dependent Transition Rates

We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterise the value function and optimal controls for both discounted and average cost cases.

Completely random nanoporous Cu4O3-CuO-C composite thin films for potential application as multiple channel photonic band gap based filter in the telecommunication wavelengths

In 2003, Babin et al. theoretically predicted (J. Appl. Phys. 94:4244, 2003) that fabrication of organic-inorganic hybrid materials would probably be required to implement structures with multiple photonic band gaps. In tune with their prediction, we report synthesis of such an inorganic-organic nanocomposite, comprising Cu4O3-CuO-C thin films that experimentally exhibit the highest (of any known material) number (as many as eleven) of photonic band gaps in the near infrared. On contrary to the report by Wang et al. (Appl. Phys. Lett. 84:1629, 2004) that photonic crystals with multiple stop gaps require highly correlated structural arrangement such as multilayers of variable thicknesses, we demonstrate experimental realization of multiple stop gaps in completely randomized structures comprising inorganic oxide nanocrystals (Cu4O3 and CuO) randomly embedded in a randomly porous carbonaceous matrix. We report one step synthesis of such nanostructured films through the metalorganic chemical vapor deposition technique using a single source metalorganic precursor, Cu-4(deaH)(dea)(oAc)(5) a <...aEuro parts per thousand(CH3)(2)CO. The films displaying multiple (4/9/11) photonic band gaps with equal transmission losses in the infrared are promising materials to find applications as multiple channel photonic band gap based filter for WDM technology.

Random copolymers consisting of dithienylcyclopentadienone, thiophene and benzothiadiazole for bulk heterojunction solar cells

Novel random copolymers containing dithienylcyclopentadienone, thiophene and benzothiadiazole were synthesized and photovoltaic properties of these materials were evaluated. Thermal, structural, optical and electrochemical characterization of the synthesized copolymers was carried out. These thermally stable copolymers are solution processable unlike the homopolymer. The absorption spectra indicated that with the incorporation of alkyl chains in the thiophene moiety, the onset of absorption increases and hence band gap decreases (1.47 eV to 1.41 eV). Bulk heterojunction solar cells were fabricated with the blend of copolymer and phenyl-C61-butyric acid methyl ester (PCBM) as the active material and device parameters were extracted. The copolymer consists of alkyl thiophene exhibit higher open circuit voltage than the copolymer consisting of thiophene moiety. (c) 2012 Elsevier B.V. All rights reserved.

Theory and Algorithms for Hop-Count-Based Localization with Random Geometric Graph Models of Dense Sensor Networks

Wireless sensor networks can often be viewed in terms of a uniform deployment of a large number of nodes in a region of Euclidean space. Following deployment, the nodes self-organize into a mesh topology with a key aspect being self-localization. Having obtained a mesh topology in a dense, homogeneous deployment, a frequently used approximation is to take the hop distance between nodes to be proportional to the Euclidean distance between them. In this work, we analyze this approximation through two complementary analyses. We assume that the mesh topology is a random geometric graph on the nodes; and that some nodes are designated as anchors with known locations. First, we obtain high probability bounds on the Euclidean distances of all nodes that are h hops away from a fixed anchor node. In the second analysis, we provide a heuristic argument that leads to a direct approximation for the density function of the Euclidean distance between two nodes that are separated by a hop distance h. This approximation is shown, through simulation, to very closely match the true density function. Localization algorithms that draw upon the preceding analyses are then proposed and shown to perform better than some of the well-known algorithms present in the literature. Belief-propagation-based message-passing is then used to further enhance the performance of the proposed localization algorithms. To our knowledge, this is the first usage of message-passing for hop-count-based self-localization.

Peraluminous sapphirine-cordierite pods in Mg-rich orthopyroxene granulite from southern India: Implications for lower crustal processes

Sapphirine-cordierite intergrowths occur as pods within garnet-absent, high-Mg orthopyroxene-granulite xenoliths in the Kambam valley, Madurai Block, southern India. Whereas the cores of the pods are composed of sapphirine (X-Mg = 0.871-0.897) - cordierite (X-Mg = 0.892-0.931) intergrowth along with rutile, zircon and monazite, the rims are characterized by cordierite, apatite, plagioclase, K-feldspar, quartz and minor calcite. The surrounding matrix comprises orthopyroxene (maximum Al2O3 4.1 wt.%, X-Mg 0.848-0.850), plagioclase, biotite and quartz, similar to the assemblage in the surrounding charnockites. Sapphirine in the Kambam rocks is characterized by high Al contents with an end-member composition in the range of 7:9:3 and 3:5:1. The occurrence of peraluminous sapphirine in association with cordierite and in the absence of phases such as sillimanite and garnet is distinct from ultrahigh-temperature assemblages in other localities within the Madurai Block. The peraluminous composition of the pods suggests that these domains could represent cryptic pathways through which aluminous melts migrated. The reaction of such peraluminous melts with Mg-rich orthopyroxene in the host granulite at temperatures of 1025 degrees C and pressures around 8 kbar as computed from phase equilibria modeling followed by an isobaric cooling is inferred to have generated the sapphirine-cordierite pods. The unusual high-Mg orthopyroxene granulite suggests interaction of supracrustal rocks with mafic magmas, which probably acted as the heat source for the partial melting of lower crust and UHT metamorphism.

Nonuniform random geometric graphs with location-dependent radii

We propose a distribution-free approach to the study of random geometric graphs. The distribution of vertices follows a Poisson point process with intensity function n f(center dot), where n is an element of N, and f is a probability density function on R-d. A vertex located at x connects via directed edges to other vertices that are within a cut-off distance r(n)(x). We prove strong law results for (i) the critical cut-off function so that almost surely, the graph does not contain any node with out-degree zero for sufficiently large n and (ii) the maximum and minimum vertex degrees. We also provide a characterization of the cut-off function for which the number of nodes with out-degree zero converges in distribution to a Poisson random variable. We illustrate this result for a class of densities with compact support that have at most polynomial rates of decay to zero. Finally, we state a sufficient condition for an enhanced version of the above graph to be almost surely connected eventually.

Non-Stationary Semi-Markov Decision Processes on a Finite Horizon

We introduce and study a class of non-stationary semi-Markov decision processes on a finite horizon. By constructing an equivalent Markov decision process, we establish the existence of a piecewise open loop relaxed control which is optimal for the finite horizon problem.

Nodal length fluctuations for arithmetic random waves

Using the spectral multiplicities of the standard torus, we endow the Laplace eigenspaces with Gaussian probability measures. This induces a notion of random Gaussian Laplace eigenfunctions on the torus (''arithmetic random waves''). We study the distribution of the nodal length of random eigenfunctions for large eigenvalues, and our primary result is that the asymptotics for the variance is nonuniversal. Our result is intimately related to the arithmetic of lattice points lying on a circle with radius corresponding to the energy.

Random forest algorithm with derived geographical layers for improved classification of remote sensing data

Effective conservation and management of natural resources requires up-to-date information of the land cover (LC) types and their dynamics. The LC dynamics are being captured using multi-resolution remote sensing (RS) data with appropriate classification strategies. RS data with important environmental layers (either remotely acquired or derived from ground measurements) would however be more effective in addressing LC dynamics and associated changes. These ancillary layers provide additional information for delineating LC classes' decision boundaries compared to the conventional classification techniques. This communication ascertains the possibility of improved classification accuracy of RS data with ancillary and derived geographical layers such as vegetation index, temperature, digital elevation model (DEM), aspect, slope and texture. This has been implemented in three terrains of varying topography. The study would help in the selection of appropriate ancillary data depending on the terrain for better classified information.

Fracture processes of self compacting Concrete using image analysis

The mode I fracture toughness of concrete can be experimentally determined using three point bend beam in conjunction with digital image correlation (DIC). Three different geometrically similar sizes of beams are cast for this study. To study the influence of fly ash and silica fume on fracture toughness of SCC, three SCC mixes are prepared with and without mineral additions. The scanning electron microscope (SEM) images are taken on the fractured surface to add information on fracture process in SCC. From this study, it is concluded that the fracture toughness of SCC with mineral addition is higher when compared to those without mineral addition.

Limit laws for coverage in backbone-sensor networks

We study coverage in sensor networks having two types of nodes, namely, sensor nodes and backbone nodes. Each sensor is capable of transmitting information over relatively small distances. The backbone nodes collect information from the sensors. This information is processed and communicated over an ad hoc network formed by the backbone nodes, which are capable of transmitting over much larger distances. We consider two models of deployment for the sensor and backbone nodes. One is a PoissonPoisson cluster model and the other a dependently thinned Poisson point process. We deduce limit laws for functionals of vacancy in both models using properties of association for random measures.

A novel Q-learning algorithm with function approximation for constrained Markov decision processes

We present a novel multi-timescale Q-learning algorithm for average cost control in a Markov decision process subject to multiple inequality constraints. We formulate a relaxed version of this problem through the Lagrange multiplier method. Our algorithm is different from Q-learning in that it updates two parameters - a Q-value parameter and a policy parameter. The Q-value parameter is updated on a slower time scale as compared to the policy parameter. Whereas Q-learning with function approximation can diverge in some cases, our algorithm is seen to be convergent as a result of the aforementioned timescale separation. We show the results of experiments on a problem of constrained routing in a multistage queueing network. Our algorithm is seen to exhibit good performance and the various inequality constraints are seen to be satisfied upon convergence of the algorithm.

Some implications of lepton flavor violating processes in a supersymmetric Type II seesaw model at TeV scale

We have conceived a supersymmetric Type II seesaw model at TeV scale, which has some additional particles consisting of scalar and fermionic triplet Higgs states, whose masses are around a few hundred GeV. In this particular model, we have studied constraints on the masses of triplet states arising from the lepton flavor violating (LFV) processes, such as mu -> 3e and mu -> e gamma. We have analyzed the implications of these constraints on other observable quantities such as the muon anomalous magnetic moment and the decay patterns of scalar triplet Higgses. Scalar triplet Higgs states can decay into leptons and into supersymmetric fields. We have found that the constraints from LFV can affect these various decay modes.

Flow cytometry analysis of human fetal osteoblast fate processes on spark plasma sintered hydroxyapatite-titanium biocomposites

Hydroxyapatite (HA)-based biocomposites have been widely investigated for a multitude of applications and these studies have been largely driven to improve mechanical properties (toughness and strength) without compromising cytocompatibility properties. Apart from routine cell viability/proliferation analysis, limited efforts have been made to quantify the fate processes (cell proliferation, cell cycle, and cell apoptosis) of human fetal osteoblast (hFOB) cells on HA-based composites, in vitro. In this work, the osteoblast cell fate process has been studied on a model hydroxyapatite-titanium (HA-Ti) system using the flow cytometry. In order to retain both HA and Ti, the novel processing technique, that is, spark plasma sintering, was suitably adopted. The cell fate processes of hFOBs, as evaluated using a flow cytometry, revealed statistically insignificant differences among HA-10 wt % Ti and HA and control (tissue culture polystyrene surface) in terms of osteoblast apoptosis, proliferation index as well as division index. For the first time, we provide quantified flow cytometry results to demonstrate that 10 wt % Ti additions to HA do not have any significant influence on the fate processes of human osteoblast-like cells, in vitro.

Application of the random eigenvalue problem in forced response analysis of a linear stochastic structure

The random eigenvalue problem arises in frequency and mode shape determination for a linear system with uncertainties in structural properties. Among several methods of characterizing this random eigenvalue problem, one computationally fast method that gives good accuracy is a weak formulation using polynomial chaos expansion (PCE). In this method, the eigenvalues and eigenvectors are expanded in PCE, and the residual is minimized by a Galerkin projection. The goals of the current work are (i) to implement this PCE-characterized random eigenvalue problem in the dynamic response calculation under random loading and (ii) to explore the computational advantages and challenges. In the proposed method, the response quantities are also expressed in PCE followed by a Galerkin projection. A numerical comparison with a perturbation method and the Monte Carlo simulation shows that when the loading has a random amplitude but deterministic frequency content, the proposed method gives more accurate results than a first-order perturbation method and a comparable accuracy as the Monte Carlo simulation in a lower computational time. However, as the frequency content of the loading becomes random, or for general random process loadings, the method loses its accuracy and computational efficiency. Issues in implementation, limitations, and further challenges are also addressed.