Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Orientational melting and reorientational motion in a cubane molecular crystal: A molecular simulation study

Detailed molecular simulations are carried out to investigate the effect of temperature on orientational order in cubane molecular crystal. We report a transition from an orientationally ordered to an orientationally disordered plastic crystalline phase in the temperature range 425-450 K. This is similar to the experimentally reported transition at 395 K. The nature of this transition is first order and is associated with a 4.8% increase in unit Cell volume that is comparable to the experimentally reported unit cell volume change of 5.4% (Phys. Rev. Lett. 1997, 78, 4938). An orientational order parameter, eta(T), has been defined in terms of average angle of libration of a molecular 3-fold axis and the orientational melting has been characterized by using eta(T). The orientational melting is associated with an anomaly in specific heat at constant pressure (C-p) and compressibility (kappa). The enthalpy of transition and entropy of transition associated with this orientational melting are 20.8 J mol(-1) and 0.046 J mol(-1) K-1, respectively. The structure of crystalline as well as plastic crystalline phases is characterized by using various radial distribution functions and orientational distribution functions. The coefficient of thermal expansion of the plastic crystalline phase is more than twice that of the crystalline phase.

Hybrid moving block bootstrap for stochastic simulation of multi-site multi-season streamflows

The Hybrid approach introduced by the authors for at-site modeling of annual and periodic streamflows in earlier works is extended to simulate multi-site multi-season streamflows. It bears significance in integrated river basin planning studies. This hybrid model involves: (i) partial pre-whitening of standardized multi-season streamflows at each site using a parsimonious linear periodic model; (ii) contemporaneous resampling of the resulting residuals with an appropriate block size, using moving block bootstrap (non-parametric, NP) technique; and (iii) post-blackening the bootstrapped innovation series at each site, by adding the corresponding parametric model component for the site, to obtain generated streamflows at each of the sites. It gains significantly by effectively utilizing the merits of both parametric and NP models. It is able to reproduce various statistics, including the dependence relationships at both spatial and temporal levels without using any normalizing transformations and/or adjustment procedures. The potential of the hybrid model in reproducing a wide variety of statistics including the run characteristics, is demonstrated through an application for multi-site streamflow generation in the Upper Cauvery river basin, Southern India. (C) 2004 Elsevier B.V. All rights reserved.

Synthesis of Unnatural Selenocystines and beta-Aminodiselenides via Regioselective Ring-Opening of Sulfamidates Using a Sequential, One-Pot, Multistep Strategy

A variety of N-alkyl-beta-aminodiselenides have been synthesized in high yield from sulfamidates under mild reaction conditions using potassium selenocyanate and benzyltriethylammonium tetrathiomolybdate ([BnNEt3](2)MoS4) in a sequential, one-pot, multistep reaction. The tolerance of multifarious protecting groups under the reaction conditions is discussed. The methodology was successfully extended to the synthesis of selenocystine,3,3'-dialkylselenocystine, and 3,3'-diphenylisoselenocystine and their direct incorporation into peptides.

Spectrophotometric and potentiometric investigations of copper (II)-Ethanolamine complexes - Part III. diethanolamine (Gaussian analysis of electronic spectra in mono and diethanolamine systems)

Spectrophotometric and potentiometric investigations have been carried out on copper-diethanolamine system. Job plots at 900, 900 and 580 mμ have indicated the formation of CuD++, CuD2++ and CuD3++. The n- pA curves obtained indicate the formation of CuD++, CuD2++, CuD3++, CuDOH+, CuD2OH+ and CuD3OH+. The n- pA curves have been analyzed to obtain the stability constants of these complexes. Absorption curves of pure complexes have been computed by a graphical method. Gaussian analysis of the absorption curves of pure and hydroxy complexes show the presence of a second band, indicating that the structure is that of a distorted octahedron.

The watershed simulation and forecasting system in the National Board of and the Environment

Yhteenveto: Vesistömalleihin perustuva vesistöjen seuranta- ja ennustejärjestelmä vesi- ja ympäristöhallinnossa

Nonlinear vibration analysis of composite laminated and sandwich plates with random material properties

Nonlinear vibration analysis is performed using a C-0 assumed strain interpolated finite element plate model based on Reddy's third order theory. An earlier model is modified to include the effect of transverse shear variation along the plate thickness and Von-Karman nonlinear strain terms. Monte Carlo Simulation with Latin Hypercube Sampling technique is used to obtain the variance of linear and nonlinear natural frequencies of the plate due to randomness in its material properties. Numerical results are obtained for composite plates with different aspect ratio, stacking sequence and oscillation amplitude ratio. The numerical results are validated with the available literature. It is found that the nonlinear frequencies show increasing non-Gaussian probability density function with increasing amplitude of vibration and show dual peaks at high amplitude ratios. This chaotic nature of the dispersion of nonlinear eigenvalues is also r

Three-Dimensional simulation of deformation fields underneath vickers indenter:Effects of power-law Plasticity

The effects of power-law plasticity (yield strength and strain hardening exponent) on the plastic strain distribution underneath a Vickers indenter was systematically investigated by recourse to three-dimensional finite element analysis, motivated by the experimental macro-and micro-indentation on heat-treated Al-Zn-Mg alloy. For meaningful comparison between simulated and experimental results, the experimental heat treatment was carefully designed such that Al alloy achieve similar yield strength with different strain hardening exponent, and vice versa. On the other hand, full 3D simulation of Vickers indentation was conducted to capture subsurface strain distribution. Subtle differences and similarities were discussed based on the strain field shape, size and magnitude for the isolated effect of yield strength and strain hardening exponent.

Response of nonlinear systems to narrow-band excitation

The hardening cubic spring oscillator is studied under narrow-band gaussian excitation. Equivalent linearization leads to multiple steady states. The realizability of the solution is discussed through stochastic stability analysis. Theoretical results are supported by numerical simulation.

Real-Time Simulation of Electrical Machines on FPGA Platform

This paper presents real-time simulation models of electrical machines on FPGA platform. Implementation of the real-time numerical integration methods with digital logic elements is discussed. Several numerical integrations are presented. A real-time simulation of DC machine is carried out on this FPGA platform and important transient results are presented. These results are compared to simulation results obtained through a commercial off-line simulation software

Estimation of signals in colored non gaussian noise based on Gaussian Mixture models

Non-Gaussianity of signals/noise often results in significant performance degradation for systems, which are designed using the Gaussian assumption. So non-Gaussian signals/noise require a different modelling and processing approach. In this paper, we discuss a new Bayesian estimation technique for non-Gaussian signals corrupted by colored non Gaussian noise. The method is based on using zero mean finite Gaussian Mixture Models (GMMs) for signal and noise. The estimation is done using an adaptive non-causal nonlinear filtering technique. The method involves deriving an estimator in terms of the GMM parameters, which are in turn estimated using the EM algorithm. The proposed filter is of finite length and offers computational feasibility. The simulations show that the proposed method gives a significant improvement compared to the linear filter for a wide variety of noise conditions, including impulsive noise. We also claim that the estimation of signal using the correlation with past and future samples leads to reduced mean squared error as compared to signal estimation based on past samples only.

A suprathreshold stochastic resonance based pre-processor for direction-of-arrival estimation

In this paper we propose a nonlinear preprocessor for enhancing the performance of processors used for direction-of-arrival (DOA) estimation in heavy-tailed non-Gaussian noise. The preprocessor based on the phenomenon of suprathreshold stochastic resonance (SSR), provides SNR gain. The preprocessed data is used for DOA estimation by the MUSIC algorithm. Simulation results are presented to show that the SSR preprocessor provides a significant improvement in the performance of MUSIC in heavy-tailed noise at low SNR.

Studies on design, fabrication and reliability assessment of embedded passives on a high-density interconnect (HDI) organic substrate using a sequential build-up process

One of the foremost design considerations in microelectronics miniaturization is the use of embedded passives which provide practical solution. In a typical circuit, over 80 percent of the electronic components are passives such as resistors, inductors, and capacitors that could take up to almost 50 percent of the entire printed circuit board area. By integrating passive components within the substrate instead of being on the surface, embedded passives reduce the system real estate, eliminate the need for discrete and assembly, enhance electrical performance and reliability, and potentially reduce the overall cost. Moreover, it is lead free. Even with these advantages, embedded passive technology is at a relatively immature stage and more characterization and optimization are needed for practical applications leading to its commercialization.This paper presents an entire process from design and fabrication to electrical characterization and reliability test of embedded passives on multilayered microvia organic substrate. Two test vehicles focusing on resistors and capacitors have been designed and fabricated. Embedded capacitors in this study are made with polymer/ceramic nanocomposite (BaTiO3) material to take advantage of low processing temperature of polymers and relatively high dielectric constant of ceramics and the values of these capacitors range from 50 pF to 1.5 nF with capacitance per area of approximately 1.5 nF/cm(2). Limited high frequency measurement of these capacitors was performed. Furthermore, reliability assessments of thermal shock and temperature humidity tests based on JEDEC standards were carried out. Resistors used in this work have been of three types: 1) carbon ink based polymer thick film (PTF), 2) resistor foils with known sheet resistivities which are laminated to printed wiring board (PWB) during a sequential build-up (SBU) process and 3) thin-film resistor plating by electroless method. Realization of embedded resistors on conventional board-level high-loss epoxy (similar to 0.015 at 1 GHz) and proposed low-loss BCB dielectric (similar to 0.0008 at > 40 GHz) has been explored in this study. Ni-P and Ni-W-P alloys were plated using conventional electroless plating, and NiCr and NiCrAlSi foils were used for the foil transfer process. For the first time, Benzocyclobutene (BCB) has been proposed as a board level dielectric for advanced System-on-Package (SOP) module primarily due to its attractive low-loss (for RF application) and thin film (for high density wiring) properties.Although embedded passives are more reliable by eliminating solder joint interconnects, they also introduce other concerns such as cracks, delamination and component instability. More layers may be needed to accommodate the embedded passives, and various materials within the substrate may cause significant thermo -mechanical stress due to coefficient of thermal expansion (CTE) mismatch. In this work, numerical models of embedded capacitors have been developed to qualitatively examine the effects of process conditions and electrical performance due to thermo-mechanical deformations.Also, a prototype working product with the board level design including features of embedded resistors and capacitors are underway. Preliminary results of these are presented.

Elastic property estimation using Ultrasound Assisted Optical Elastography through Remote Palpation - A simulation study - art. no. 61640Q

We propose an effective elastography technique in which an acoustic radiation force is used for remote palpation to generate localized tissue displacements, which are directly correlated to localized variations of tissue stiffness and are measured using a light probe in the same direction of ultrasound propagation. The experimental geometry has provision to input light beam along the ultrasound propagation direction, and hence it can be prealigned to ensure proper interception of the focal region by the light beam. Tissue-mimicking phantoms with homogeneous and isotropic mechanical properties of normal and malignant breast tissue are considered for the study. Each phantom is insonified by a focusing ultrasound transducer (1 MHz). The focal volume of the transducer and the ultrasound radiation force in the region are estimated through solving acoustic wave propagation through medium assuming average acoustic properties. The forward elastography problem is solved for the region of insonification assuming the Lame's parameters and Poisson's ratio, under Dirichlet boundary conditions which gives a distribution of displacement vectors. The direction of displacement, though presented spatial variation, is predominantly towards the ultrasound propagation direction. Using Monte Carlo (MC) simulation we have traced the photons through the phantom and collected the photons arriving at the detector on the boundary of the object in the direction of ultrasound. The intensity correlations are then computed from detected photons. The intensity correlation function computed through MC simulation showed a modulation whose strength is found to be proportional to the amplitude of displacement and inversely related to the storage (elastic) modulus. It is observed that when the storage modulus in the focal region is increased the computed displacement magnitude, as indicated by the depth of modulation in the intensity autocorrelation, decreased and the trend is approximately exponential.