Learning dynamic prices in multiseller electronic retail markets with price sensitive customers, stochastic demands, and inventory replenishments

In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers, and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers), and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not previously been applied. We consider two representative cases: 1) no information case, were none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and 2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents, or pricebots, which use RL-based pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new and promising way of setting dynamic prices in multiseller environments with stochastic demands, price sensitive customers, and inventory replenishments.

Foaming of slags under dynamic conditions

Slag foaming under dynamic conditions has been studied in laboratory scale to examine the influence of properties commonly used to describe the foaminess and foam stability of slags under steady-state conditions. Synthetically produced slags with compositions relevant to tool steel and stainless steel production were studied through X-ray equipment in measurements simulating the dynamic conditions found in real processes. It is found that the dynamic systems display a more complex behavior than systems Under steady state. Traditional theories for foaming do not seem to be valid for slag foaming under dynamic conditions. The foam displays a fluctuating behavior, which the presently available models are not able to take into account. The concept of a foaming index does not seem to be applicable, resulting in the need for alternative models.

The fluctuations in slag foam under dynamic conditions

In the present article, slag foaming phenomenon under dynamic conditions is critically analyzed on the basis of the results of high-temperature X-ray image analysis experiments. The results indicate that the mismatch between the gas generation rate and gas escape rate has a serious impact on the foam height. This mismatch is attributed to the chemical reaction rate, which has to be considered in modeling slag foaming under dynamic conditions. The results further imply that a critical ratio of bubble size/crucible size exists, where wall effects are likely to become prominent.

Communication: Evidence of dynamic heterogeneity in glassy polymer monolayers from interface microrheology measurements

We have developed a novel nanoparticle tracking based interface microrheology technique to perform in situ studies on confined complex fluids. To demonstrate the power of this technique, we show, for the first time, how in situ glass formation in polymers confined at air-water interface can be directly probed by monitoring variation of the mean square displacement of embedded nanoparticles as a function of surface density. We have further quantified the appearance of dynamic heterogeneity and hence vitrification in polymethyl methacrylate monolayers above a certain surface density, through the variation of non-Gaussian parameter of the probes. (C) 2010 American Institute of Physics. [doi:10.1063/1.3471584].

Stability Analysis of Composite Skew Plates Using a Dynamic Method

Stability analysis is carried out considering free lateral vibrations of simply supported composite skew plates that are subjected to both direct and shear in-plane forces. An oblique stress component representation is used, consistent with the skew-geometry of the plate. A double series, expressed in Chebyshev polynomials, is used here as the assumed deflection surface and Ritz method of solution is employed. Numerical results for different combinations of side ratios, skew angle, and in-plane loadings that act individually or in combination are obtained. In this method, the in-plane load parameter is varied until the fundamental frequency goes to zero. The value of the in-plane load then corresponds to a critical buckling load. Plots of frequency parameter versus in-plane loading are given for a few typical cases. Details of crossings and quasi degeneracies of these curves are presented.

Static and dynamic properties of incommensurate smectic-AIC liquid crystals

We study the elasticity, topological defects, and hydrodynamics of the recently discovered incommensurate smectic (AIC) phase, characterized by two collinear mass density waves of incommensurate spatial frequency. The low-energy long-wavelength excitations of the system can be described by a displacement field u(x) and a ��phason�� field w(x) associated, respectively, with collective and relative motion of the two constituent density waves. We formulate the elastic free energy in terms of these two variables and find that when w=0, its functional dependence on u is identical to that of a conventional smectic liquid crystal, while when u=0, its functional dependence on w is the same as that for the angle variable in a slightly anisotropic XY model. An arbitrariness in the definition of u and w allows a choice that eliminates all relevant couplings between them in the long-wavelength elastic energy. The topological defects of the system are dislocations with nonzero u and w components. We introduce a two-dimensional Burgers lattice for these dislocations, and compute the interaction between them. This has two parts: one arising from the u field that is short ranged and identical to the interaction between dislocations in an ordinary smectic liquid crystal, and one arising from the w field that is long ranged and identical to the logarithmic interaction between vortices in an XY model. The hydrodynamic modes of the AIC include first- and second-sound modes whose direction-dependent velocities are identical to those in ordinary smectics. The sound attenuations have a different direction dependence, however. The breakdown of hydrodynamics found in conventional smectic liquid crystals, with three of the five viscosities diverging as 1/? at small frequencies ?, occurs in these systems as well and is identical in all its details. In addition, there is a diffusive phason mode, not found in ordinary smectic liquid crystals, that leads to anomalously slow mechanical response analogous to that predicted in quasicrystals, but on a far more experimentally accessible time scale.

Study Of The Hvdc-Torsional Interactions Through Digital Dynamic Simulation

This paper presents the detailed dynamic digital simulation for the study of phenomenon of torsional interaction between HVDC-Turbine generator shaft, dynamics using the novel converter model presented in [ 1 ] The system model includes detailed representation of the synchronous generator and the shaft dynamics, the ac and dc network transients. The results of a case study indicate the various factors that influence the torsional interaction.

Dynamic security assessment of power systems using structure-preserving energy functions

An application of direct methods to dynamic security assessment of power systems using structure-preserving energy functions (SPEF) is presented. The transient energy margin (TEM) is used as an index for checking the stability of the system as well as ranking the contigencies based on their severity. The computation of the TEM requires the evaluation of the critical energy and the energy at fault clearing. Usually this is done by simulating the faulted trajectory, which is time-consuming. In this paper, a new algorithm which eliminates the faulted trajectory estimation is presented to calculate the TEM. The system equations and the SPEF are developed using the centre-of-inertia (COI) formulation and the loads are modelled as arbitrary functions of the respective bus voltages. The critical energy is evaluated using the potential energy boundary surface (PEBS) method. The method is illustrated by considering two realistic power system examples.

Effect of primary system damping on the optimum design of an untuned viscous dynamic vibration absorber

Explicit criteria for the optimum design of an untuned viscous dynamic vibration absorber are developed for the case of a viscously damped single degree of freedom springmass system. It is shown that for the particular case of an undamped main system, the results reduce to the classical ones obtained by using the concept of a fixed point on the response curve.

Effect of stacking fault energy on the dynamic recrystallization during hot working of FCC metals: A study using processing maps

The influence of stacking fault energy (SFE) on the mechanism of dynamic recrystallization (DRX) during hot deformation of FCC metals is examined in the light of results from the power dissipation maps. The DRX domain for high SFE metals like Al and Ni occurred at homologous temperature below 0·7 and strain rates of 0·001 s−1 while for low SFE metals like Cu and Pb the corresponding values are higher than 0·8 and 100 s−1. The peak efficiencies of power dissipation are 50% and below 40% respectively. A simple model which considers the rate of interface formation (nucleation) involving dislocation generation and simultaneous recovery and the rate of interface migration (growth) occurring with the reduction in interface energy as the driving force, has been proposed to account for the effect of SFE on DRX. The calculations reveal that in high SFE metals, interface migration controls DRX while the interface formation is the controlling factor in low SFE metals. In the latter case, the occurrence of flow softening and oscillations could be accounted for by this model.

Non-linear Dynamic Analysis of a Piezoelectrically Actuated Flapping Wing

An energy method is used in order to derive the non-linear equations of motion of a smart flapping wing. Flapping wing is actuated from the root by a PZT unimorph in the piezofan configuration. Dynamic characteristics of the wing, having the same size as dragonfly Aeshna Multicolor, are analyzed using numerical simulations. It is shown that flapping angle variations of the smart flapping wing are similar to the actual dragonfly wing for a specific feasible voltage. An unsteady aerodynamic model based on modified strip theory is used to obtain the aerodynamic forces. It is found that the smart wing generates sufficient lift to support its own weight and carry a small payload. It is therefore a potential candidate for flapping wing of micro air vehicles.

Inelastic dynamic response of R.C. beam column joints by using B.E.M.

A BEM formulation to obtain the inelastic response of R.C. Beam-Column joints subjected to sinusoidal loading along the boundary is presented. The equations of motion are written along with kinematical and constitutive equations. The dynamic reciprocal theorem is presented and the temporal dependence is removed by assuming steady state response.

Sign Of The Order Parameter In Oriented Systems And Its Utility In The Study Of The Dynamic Properties Of Molecules

Novel one and two dimensional NMR techniques are proposed and utilized for the determination of the signs of the order parameters used for the study of the mobility of the fatty acid chains. The experiments designed to extract this information involve the use of the intensities of the side bands in the spectra of oriented systems spinning at the magic angle. Advantages of the two dimensional technique over the one dimensional method are discussed. The utility of the method in the study of the dynamic properties of membranes and model systems is pointed out.

A finite element analysis of dynamic fracture initiation by ductile failure mechanisms in a 4340 steel

In some recent dropweight impact experiments [5] with pre-notched bend specimens of 4340 steel, it was observed that considerable crack tunneling occurred in the interior of the specimen prior to gross fracture initiation on the free surfaces. The final failure of the side ligaments happened because of shear lip formation. The tunneled region is characterized by a flat, fibrous fracture surface. In this paper, the experiments of [5] (corresponding to 5 m/s impact speed) are analyzed using a plane strain, dynamic finite element procedure. The Gurson constitutive model that accounts for the ductile failure mechanisms of micro-void nucleation, growth and coalescence is employed. The time at which incipient failure was observed near the notch tip in this computation, and the value of the dynamic J-integral, J d, at this time, compare reasonably well with experiments. This investigation shows that J-controlled stress and deformation fields are established near the notch tip whenever J d , increases with time. Also, it is found that the evolution of micro-mechanical quantities near the notch root can be correlated with the time variation of J d .The strain rate and the adiabatic temperature rise experienced at the notch root are examined. Finally, spatial variations of stresses and deformations are analyzed in detail.