Necessary and sufficient conditions for optimality in constrained general sum stochastic games

In this paper we first derive a necessary and sufficient condition for a stationary strategy to be the Nash equilibrium of discounted constrained stochastic game under certain assumptions. In this process we also develop a nonlinear (non-convex) optimization problem for a discounted constrained stochastic game. We use the linear best response functions of every player and complementary slackness theorem for linear programs to derive both the optimization problem and the equivalent condition. We then extend this result to average reward constrained stochastic games. Finally, we present a heuristic algorithm motivated by our necessary and sufficient conditions for a discounted cost constrained stochastic game. We numerically observe the convergence of this algorithm to Nash equilibrium. (C) 2015 Elsevier B.V. All rights reserved.

Kinematics and dynamics of Jansen leg mechanism: A bond graph approach

The Jansen mechanism is a one degree-of-freedom, planar, 12-link, leg mechanism that can be used in mobile robotic applications and in gait analysis. This paper presents the kinematics and dynamics of the Jansen leg mechanism. The forward kinematics, accomplished using circle intersection method, determines the trajectories of various points on the mechanism in the chassis (stationary link) reference frame. From the foot point trajectory, the step length is shown to vary linearly while step height varies non-linearly with change in crank radius. A dynamic model for the Jansen leg mechanism is proposed using bond graph approach with modulated multiport transformers. For given ground reaction force pattern and crank angular speed, this model helps determine the motor torque profile as well as the link and joint stresses. The model can therefore be used to rate the actuator torque and in design of the hardware and controller for such a system. The kinematics of the mechanism can also be obtained from this dynamic model. The proposed model is thus a useful tool for analysis and design of systems based on the Jansen leg mechanism. (C) 2015 Elsevier B.V. All rights reserved.

Optimal input cross-power spectra in shake table testing of asymmetric structures

The study considers earthquake shake table testing of bending-torsion coupled structures under multi-component stationary random earthquake excitations. An experimental procedure to arrive at the optimal excitation cross-power spectral density (psd) functions which maximize/minimize the steady state variance of a chosen response variable is proposed. These optimal functions are shown to be derivable in terms of a set of system frequency response functions which could be measured experimentally without necessitating an idealized mathematical model to be postulated for the structure under study. The relationship between these optimized cross-psd functions to the most favourable/least favourable angle of incidence of seismic waves on the structure is noted. The optimal functions are also shown to be system dependent, mathematically the sharpest, and correspond to neither fully correlated motions nor independent motions. The proposed experimental procedure is demonstrated through shake table studies on two laboratory scale building frame models.

SPEECH ENHANCEMENT USING DISCRIMINATIVE RANDOM FIELDS

Speech enhancement in stationary noise is addressed using the ideal channel selection framework. In order to estimate the binary mask, we propose to classify each time-frequency (T-F) bin of the noisy signal as speech or noise using Discriminative Random Fields (DRF). The DRF function contains two terms - an enhancement function and a smoothing term. On each T-F bin, we propose to use an enhancement function based on likelihood ratio test for speech presence, while Ising model is used as smoothing function for spectro-temporal continuity in the estimated binary mask. The effect of the smoothing function over successive iterations is found to reduce musical noise as opposed to using only enhancement function. The binary mask is inferred from the noisy signal using Iterated Conditional Modes (ICM) algorithm. Sentences from NOIZEUS corpus are evaluated from 0 dB to 15 dB Signal to Noise Ratio (SNR) in 4 kinds of additive noise settings: additive white Gaussian noise, car noise, street noise and pink noise. The reconstructed speech using the proposed technique is evaluated in terms of average segmental SNR, Perceptual Evaluation of Speech Quality (PESQ) and Mean opinion Score (MOS).

Composite Guidance for Impact Angle Control Against Higher Speed Targets

In the literature, the impact angle control problem has been addressed mostly against lower speed or stationary targets. However, in the current defense scenario, targets of much higher speeds than interceptors are a reality. Moreover, approaching a higher speed target from a specified angle is important for effective seeker acquisition and enhanced warhead effectiveness. This paper proposes a composite proportional navigation guidance law using a combination of the standard proportional navigation and the recently proposed retroproportional navigation guidance laws for intercepting higher speed nonmaneuvering targets at specified impact angles in three-dimensional engagements. An analysis of the set of achievable impact angles by the composite proportional navigation guidance law is presented. It is shown that there exists an impulse bias that, when added to the composite proportional navigation guidance command, expands this set further by reversing the direction of the line-of-sight angular rotation vector. A bound on the magnitude of the bias is also derived. Finally, an implementation of this impulse bias, in the form of a series of pulses, is proposed and analyzed. Simulation results are also presented to support the analysis.

Composite Guidance for Impact Angle Control Against Higher Speed Targets

In the literature, the impact angle control problem has been addressed mostly against lower speed or stationary targets. However, in the current defense scenario, targets of much higher speeds than interceptors are a reality. Moreover, approaching a higher speed target from a specified angle is important for effective seeker acquisition and enhanced warhead effectiveness. This paper proposes a composite proportional navigation guidance law using a combination of the standard proportional navigation and the recently proposed retroproportional navigation guidance laws for intercepting higher speed nonmaneuvering targets at specified impact angles in three-dimensional engagements. An analysis of the set of achievable impact angles by the composite proportional navigation guidance law is presented. It is shown that there exists an impulse bias that, when added to the composite proportional navigation guidance command, expands this set further by reversing the direction of the line-of-sight angular rotation vector. A bound on the magnitude of the bias is also derived. Finally, an implementation of this impulse bias, in the form of a series of pulses, is proposed and analyzed. Simulation results are also presented to support the analysis.

A Nonlinear Guidance Law for Impact Time Control

This paper discusses the problem of impact time control of an interceptor against a stationary target. A nonlinear guidance law is proposed with the interceptor heading angle variation as a function of the range to target. Closed-form expressions for the design parameters are derived for an exact analysis of the impact time. A feedback form of the guidance law is presented for addressing realistic implementation in the presence of autopilot lag. Using the closed-form expressions of the impact time, a cooperative guidance scheme is presented for simultaneous impact in a salvo attack. Extensive simulation studies are presented validating the analytic findings.

Global Response Sensitivity Analysis of Randomly Excited Dynamic Structures

The response of structural dynamical systems excited by multiple random excitations is considered. Two new procedures for evaluating global response sensitivity measures with respect to the excitation components are proposed. The first procedure is valid for stationary response of linear systems under stationary random excitations and is based on the notion of Hellinger's metric of distance between two power spectral density functions. The second procedure is more generally valid and is based on the l2 norm based distance measure between two probability density functions. Specific cases which admit exact solutions are presented, and solution procedures based on Monte Carlo simulations for more general class of problems are outlined. Illustrations include studies on a parametrically excited linear system and a nonlinear random vibration problem involving moving oscillator-beam system that considers excitations attributable to random support motions and guide-way unevenness. (C) 2015 American Society of Civil Engineers.

On nonequilibrium of pyrolysis process in the manufacture of ethene

Nonequilibrium process for cracking ethane and n-buthane in the manufacture of ethene has been analytically and numerically investigated in a Heavi-side function temperature field and through a normal shock wave. The results demonstrate that, while the reaction temperature increases, the maximum value of ethene yield is increased, and the optimal reaction duration is sharply shortened. For the identical initial reaction temperature, the maximum value of ethene yield through a stationary normal shock wave is less than that in a Heavi-side function temperature field. However, the ethene consumption after the maximum value in the former case is less than that in the latter. Higher ethene yield will be obtained by using the gasdynamic heating method than by using the current methods.

Numerical simulation of an adaptive optics system with laser propagation in the atmosphere

A comprehensive model of laser propagation in the atmosphere with a complete adaptive optics (AO) system for phase compensation is presented, and a corresponding computer program is compiled. A direct wave-front gradient control method is used to reconstruct the wave-front phase. With the long-exposure Strehl ratio as the evaluation parameter, a numerical simulation of an AO system in a stationary state with the atmospheric propagation of a laser beam was conducted. It was found that for certain conditions the phase screen that describes turbulence in the atmosphere might not be isotropic. Numerical experiments show that the computational results in imaging of lenses by means of the fast Fourier transform (FFT) method agree well with those computed by means of an integration method. However, the computer time required for the FFT method is 1 order of magnitude less than that of the integration method. Phase tailoring of the calculated phase is presented as a means to solve the problem that variance of the calculated residual phase does not correspond to the correction effectiveness of an AO system. It is found for the first time to our knowledge that for a constant delay time of an AO system, when the lateral wind speed exceeds a threshold, the compensation effectiveness of an AO system is better than that of complete phase conjugation. This finding indicates that the better compensation capability of an AO system does not mean better correction effectiveness. (C) 2000 Optical Society of America.

Analytical Interaction of the Acoustic Wave and Turbulent Flame

A modified resonance model of a weakly turbulent flame in a high-frequency acoustic wave is derived analytically. Under the mechanism of Darrieus-Landau instability, the amplitude of flame wrinkles, which is as functions of the expansion coefficient and the perturbation wave number, increases greatly independent of the 'stationary' turbulence. The high perturbation wave number makes the resonance easier to be triggered but weakened with respect to the extra acoustic wave. In a closed burning chamber with the acoustic wave induced by the flame itself, the high perturbation wave number is to restrain the resonance for a realistic flame.

The Flow Theory of Mechanism-Based Strain Gradient Plasticity

The flow theory of mechanism-based strain gradient (MSG) plasticity is established in this paper following the same multiscale, hierarchical framework for the deformation theory of MSG plasticity in order to connect with the Taylor model in dislocation mechanics. We have used the flow theory of MSG plasticity to study micro-indentation hardness experiments. The difference between deformation and flow theories is vanishingly small, and both agree well with experimental hardness data. We have also used the flow theory of MSG plasticity to investigate stress fields around a stationary mode-I crack tip as well as around a steady state, quasi-statically growing crack tip. At a distance to crack tip much larger than dislocation spacings such that continuum plasticity still applies, the stress level around a stationary crack tip in MSG plasticity is significantly higher than that in classical plasticity. The same conclusion is also established for a steady state, quasi-statically growing crack tip, though only the flow theory can be used because of unloading during crack propagation. This significant stress increase due to strain gradient effect provides a means to explain the experimentally observed cleavage fracture in ductile materials [J. Mater. Res. 9 (1994) 1734, Scripta Metall. Mater. 31 (1994) 1037; Interface Sci. 3(1996) 169].

Effect of liquid bridge volume on the instability in small-Prandtl-number half zones

A perturbation method is used to examine the linear instability of thermocapillary convection in a liquid bridge of floating half-zone filled with a small Prandtl number fluid. The influence of liquid bridge volume on critical Marangoni number and flow features is analyzed. The neutral modes show that the instability is mainly caused by the bulk flow that is driven by the nonuniform thermocapillary forces acting on the free surface. The hydrodynamic instability is dominant in the case of small Prandtl number fluid and the first instability mode is a stationary bifurcation. The azimuthal wave number for the most dangerous mode depends on the liquid bridge volume, and is not always two as in the case of a cylindrical liquid bridge with aspect ratio near 0.6. Its value may be equal to unity when the liquid bridge is relatively slender.

Optimal bounded control of first-passage failure of quasi-integrable Hamiltonian systems with wide-band random excitation

The optimal bounded control of quasi-integrable Hamiltonian systems with wide-band random excitation for minimizing their first-passage failure is investigated. First, a stochastic averaging method for multi-degrees-of-freedom (MDOF) strongly nonlinear quasi-integrable Hamiltonian systems with wide-band stationary random excitations using generalized harmonic functions is proposed. Then, the dynamical programming equations and their associated boundary and final time conditions for the control problems of maximizinig reliability and maximizing mean first-passage time are formulated based on the averaged It$\ddot{\rm o}$ equations by applying the dynamical programming principle. The optimal control law is derived from the dynamical programming equations and control constraints. The relationship between the dynamical programming equations and the backward Kolmogorov equation for the conditional reliability function and the Pontryagin equation for the conditional mean first-passage time of optimally controlled system is discussed. Finally, the conditional reliability function, the conditional probability density and mean of first-passage time of an optimally controlled system are obtained by solving the backward Kolmogorov equation and Pontryagin equation. The application of the proposed procedure and effectiveness of control strategy are illustrated with an example.

Intracellular demography and the dynamics of Salmonella enterica infections.

An understanding of within-host dynamics of pathogen interactions with eukaryotic cells can shape the development of effective preventive measures and drug regimes. Such investigations have been hampered by the difficulty of identifying and observing directly, within live tissues, the multiple key variables that underlay infection processes. Fluorescence microscopy data on intracellular distributions of Salmonella enterica serovar Typhimurium (S. Typhimurium) show that, while the number of infected cells increases with time, the distribution of bacteria between cells is stationary (though highly skewed). Here, we report a simple model framework for the intensity of intracellular infection that links the quasi-stationary distribution of bacteria to bacterial and cellular demography. This enables us to reject the hypothesis that the skewed distribution is generated by intrinsic cellular heterogeneities, and to derive specific predictions on the within-cell dynamics of Salmonella division and host-cell lysis. For within-cell pathogens in general, we show that within-cell dynamics have implications across pathogen dynamics, evolution, and control, and we develop novel generic guidelines for the design of antibacterial combination therapies and the management of antibiotic resistance.