Learning dynamic prices in multiseller electronic retail markets with price sensitive customers, stochastic demands, and inventory replenishments

In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers, and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers), and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not previously been applied. We consider two representative cases: 1) no information case, were none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and 2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents, or pricebots, which use RL-based pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new and promising way of setting dynamic prices in multiseller environments with stochastic demands, price sensitive customers, and inventory replenishments.

A note on the observed anisotropy in linear compressibility and thermal expansion of quasicrystals

The linear compressibility and the thermal expansion of Al-Fe and Al-Mn quasicrystals have been reported to be anisotropic. The authors suggest that the observed anisotropy in these properties could be due to the presence of decagonal quasicrystals rather than icosahedral quasicrystals.

Thermal expansion and phase transition in NaVO3

The present x-ray study has been undertook in order to correlate the phase transition in sodium metavanadate NaVO3 crystal with its structural aspects. The thermal expansion behaviour of NaVO3 was studied from room temperature up to 500 C, well beyond the transition temperature.

Stochastic Analysis of Yielding System

The probability distribution of the instantaneous incremental yield of an inelastic system is characterized in terms of a conditional probability and average rate of crossing. The detailed yield statistics of a single degree-of-freedom elasto-plastic system under a Gaussian white noise are obtained for both nonstationary and stationary response. The present analysis indicates that the yield damage is sensitive to viscous damping. The spectra of mean and mean square damage rate are presented.

Estimating Frequencies of Minority Nevirapine-Resistant Strains in Chronically HIV-1-Infected Individuals Naive to Nevirapine by Using Stochastic Simulations and a Mathematical Model

Nevirapine forms the mainstay of our efforts to curtail the pediatric AIDS epidemic through prevention of mother-to-child transmission of HIV-1. A key limitation, however, is the rapid selection of HIV-1 strains resistant to nevirapine following the administration of a single dose. This rapid selection of resistance suggests that nevirapine-resistant strains preexist in HIV-1 patients and may adversely affect outcomes of treatment. The frequencies of nevirapine-resistant strains in vivo, however, remain poorly estimated, possibly because they exist as a minority below current assay detection limits. Here, we employ stochastic simulations and a mathematical model to estimate the frequencies of strains carrying different combinations of the common nevirapine resistance mutations K103N, V106A, Y181C, Y188C, and G190A in chronically infected HIV-1 patients naive to nevirapine. We estimate the relative fitness of mutant strains from an independent analysis of previous competitive growth assays. We predict that single mutants are likely to preexist in patients at frequencies (similar to 0.01% to 0.001%) near or below current assay detection limits (>0.01%), emphasizing the need for more-sensitive assays. The existence of double mutants is subject to large stochastic variations. Triple and higher mutants are predicted not to exist. Our estimates are robust to variations in the recombination rate, cellular superinfection frequency, and the effective population size. Thus, with 10(7) to 10(8) infected cells in HIV-1 patients, even when undetected, nevirapine-resistant genomes may exist in substantial numbers and compromise efforts to prevent mother-to-child transmission of HIV-1, accelerate the failure of subsequent antiretroviral treatments, and facilitate the transmission of drug resistance.

Free vibration of a stochastic beam-column using stochastic fem

The free vibrational characteristics of a beam-column, which is having randomly varying Young's modulus and mass density and subjected to randomly distributed axial loading is analysed. The material property fluctuations and axial loadings are considered to constitute independent one-dimensional, uni-variate, homogeneous real, spatially distributed stochastic fields. Hamilton's principle is used to formulate the problem using stochastic FEM. Vibration frequencies and mode shapes are analysed for their statistical descriptions. A numerical example is shown.

Thermal expansion of doped lanthanum gallates

Thermal expansion of several compositions of Sr and Mg-doped LaGaO3 including an A-site deficient composition (La0.9Sr0.1)(0.98)(Ga0.8Mg0.2)O-2.821 were measured in the temperature range from 298 to 1273 K. The effect of doping on thermal expansion was studied by varying the composition at one site of the perovskite structure (either A or B), while keeping the composition at the other site invariant. Thermal expansion varied nonlinearly with temperature and exhibited an inflexion between 550 and 620 K, probably related to the change in crystal structure from orthorhombic to rhombohedral. The dependence of average thermal expansion coefficient (alpha (av)) on the dopant concentration on either A or B site of the perovskite structure was found to be linear, when the composition at the other site was kept constant. Mg doping on the B-site had a greater effect on the average thermal expansion coefficient than Sr doping on the A-site. Cation deficiency at the A-site decreases thermal expansion when compositions at both sites are held constant.

Effect of wall thickness on the end corrections of the extended inlet and outlet of a double-tuned expansion chamber

Simple expansion chambers, the simplest of the muffler configurations, have very limited practical application due to the presence of periodic troughs in the transmission loss spectrum which drastically lower the overall transmission loss of the muffler. Tuned extended inlet and outlet can be designed to nullify three-fourths of these troughs, making use of the plane wave theory. These cancellations would not occur unless one altered the geometric lengths for the extended tube in order to incorporate the effect of evanescent higher-order modes (multidimensional effect) through end corrections or lumped inertance approximation at the area discontinuities or junctions. End corrections of the extended inlet and outlet have been studied by several researchers. However the effect of wall thickness of the inlet/outlet duct on end correction has not been studied explicitly. This has significant effect on the tuning of an extended inlet/outlet expansion chamber. It is investigated here experimentally as well as numerically (through use of 3-D FEM software) for stationary medium. Crown Copyright (C) 2010 Published by Elsevier Ltd. All rights reserved.

Trafficking in human beings and Foucauldian biopower : A case study in the expansion of the human rights phenomenon

Trafficking in human beings has become one of the most talked about criminal concerns of the 21st century. But this is not all that it has become. Trafficking has also been declared as one of the most pressing human rights issues of our time. In this sense, it has become a part of the expansion of the human rights phenomenon. Although it is easy to see that the crime of trafficking violates several of the human rights of its victims, it is still, in its essence, a fairly conventional although particularly heinous and often transnational crime, consisting of acts between private actors, and lacking, therefore, the vertical effect associated traditionally with human rights violations. This thesis asks, then, why, and how, has the anti-trafficking campaign been translated in human rights language. And even more fundamentally: in light of the critical, theoretical studies surrounding the expansion of the human rights phenomenon, especially that of Costas Douzinas, who has declared that we have come to the end of human rights as a consequence of the expansion and bureaucratization of the phenomenon, can human rights actually bring salvation to the victims of trafficking? The thesis demonstrates that the translation process of the anti-trafficking campaign into human rights language has been a complicated process involving various actors, including scholars, feminist NGOs, local activists and global human rights NGOs. It has also been driven by a complicated web of interests, the most prevalent one the sincere will to help the victims having become entangled with other aims, such as political, economical, and structural goals. As a consequence of its fragmented background, the human rights approach to trafficking seeks still its final form, consisting of several different claims. After an assessment of these claims from a legal perspective, this thesis concludes that the approach is most relevant regarding the mistreatment of victims of trafficking in the hands of state authorities. It seems to be quite common that authorities have trouble identifying the victims of trafficking, which means that the rights granted to themin international and national documents are not realized in practice, but victims of trafficking are systematically deported as illegal immigrants. It is argued that in order to understand the measures of the authorities, and to assess the usefulness of human rights, it is necessary to adopt a Foucauldian perspective and to observe the measures as biopolitical defence mechanisms. From a biopolitical perspective, the victims of trafficking can be seen as a threat to the population a threat that must be eliminated either by assimilating them to the main population with the help of disciplinary techniques, or by excluding them completely from the society. This biopolitical aim is accomplished through an impenetrable net of seemingly insignificant practices and discourses that not even the participants are aware of. As a result of these practices and discourses, trafficking victims only very few of fit the myth of the perfect victim, produced by biopolitical discourses become invisible and therefore subject to deportation as (risky) illegal immigrants, turning them into bare life in the Agambenian sense, represented by the homo sacer, who cannot be sacrificed, yet does not enjoy the protection of the society and its laws. It is argued, following Jacques Rancière and Slavoj i ek, that human rights can, through their universality and formal equality, provide bare life the tools to formulate political claims and therefore utilize their politicization through their exclusion to return to the sphere of power and politics. Even though human rights have inevitably become entangled with biopolitical practices, they are still perhaps the most efficient way to challenge biopower. Human rights have not, therefore, become useless for the victims of trafficking, but they must be conceived as a universal tool to formulate political claims and challenge power .In the case of trafficking this means that human rights must be utilized to constantly renegotiate the borders of the problematic concept of victim of trafficking created by international instruments, policies and discourses, including those that are sincerely aimed to provide help for the victims.

Denumerable state stochastic games with limiting average payoff

We study stochastic games with countable state space, compact action spaces, and limiting average payoff. ForN-person games, the existence of an equilibrium in stationary strategies is established under a certain Liapunov stability condition. For two-person zero-sum games, the existence of a value and optimal strategies for both players are established under the same stability condition.

Effect of Substitution of Ca on Thermal Expansion of Cordierite (Mg2Al4Si5O18)

The effect of substitution of calcium on the anisotropic axial thermal expansion of cordierite was investigated by using a high-temperature X-ray diffraction technique. The compositions were prepared by the sol–gel route. In the Mg2-xCax-Al4Si5O18 system, single-phase cordierite can be prepared for x up to 0.5. Thermal expansion anisotropy (αa–αc) of cordierites reduces progressively by the substitution of increasing amounts of Ca for Mg.

Non-conservatively loaded stochastic columns

A new finite element method is developed to analyse non-conservative structures with more than one parameter behaving in a stochastic manner. As a generalization, this paper treats the subsequent non-self-adjoint random eigenvalue problem that arises when the material property values of the non-conservative structural system have stochastic fluctuations resulting from manufacturing and measurement errors. The free vibration problems of stochastic Beck's column and stochastic Leipholz column whose Young's modulus and mass density are distributed stochastically are considered. The stochastic finite element method that is developed, is implemented to arrive at a random non-self-adjoint algebraic eigenvalue problem. The stochastic characteristics of eigensolutions are derived in terms of the stochastic material property variations. Numerical examples are given. It is demonstrated that, through this formulation, the finite element discretization need not be dependent on the characteristics of stochastic processes of the fluctuations in material property value.

Normal mode sound propagation in an ocean with random narrow-band surface waves

Normal mode sound propagation in an isovelocity ocean with random narrow-band surface waves is considered, assuming the root-mean-square wave height to be small compared to the acoustic wavelength. Nonresonant interaction among the normal modes is studied straightforward perturbation technique. The more interesting case of resonant interaction is investigated using the method of multiple scales to obtain a pair of stochastic coupled amplitude equations which are solved using the Peano-Baker expansion technique. Equations for the spatial evolution of the first and second moments of the mode amplitudes are also derived and solved. It is shown that, irrespective of the initial conditions, the mean values of the mode amplitudes tend to zero asymptotically with increasing range, the mean-square amplitudes tend towards a state of equipartition of energy, and the total energy of the modes is conserved.