Optimal advertisement-innovation mix for maximizing the discounted flow of profit

Due to boom in telecommunications market, there is hectic competition among the cellular handset manufacturers. As cellular manufacturing industry operates in an oligopoly framework, often price-rigidity leads to non-price wars. The handset manufacturing firms indulge in product innovation and also advertise their products in order to achieve their objective of maximizing discounted flow of profit. It is of interest to see what would be the optimal advertisement-innovation mix that would maximize the discounted How of profit for the firms. We used differential game theory to solve this problem. We adopted the open-loop solution methodology. We experimented for various scenarios over a 30 period horizon and derived interesting managerial insights.

A singularity-free cosmological model in ECSK theory

In the framework of the ECSK [Einstein-Cartan-Sciama-Kibble] theory of cosmology, a scalar field nonminimally coupled to the gravitational field is considered. For a Robertson-Walker open universe (k=0) in the radiation era, the field equations admit a singularity-free solution for the scale factor. In theory, the torsion is generated through nonminimal coupling of a scalar field to the gravitation field. The nonsingular nature of the cosmological model automatically solves the flatness problem. Further absence of event horizon and particle horizon explains the high degree of isotropy, especially of 2.7-K background radiation.

Modelling the chemical weathering fluxes at the watershed scale in the Tropics (Mule Hole, South India): Relative contribution of the smectite/kaolinite assemblage versus primary minerals

We investigate the chemical weathering processes and fluxes in a small experimental watershed (SEW) through a modelling approach. The study site is the Mule Hole SEW developed on a gneissic basement located in the climatic gradient of the Western Ghats, South India. The model couples a lumped hydrological model simulating the water budget at the watershed scale to the WITCH model estimating the dissolution/precipitation rates of minerals using laboratory kinetic laws. Forcing functions and parameters of the simulation are defined by the field data. The coupled model is calibrated with stream and groundwater compositions through the testing of a large range of smectite solubility and abundance in the soil horizons. We found that, despite the low abundance of smectite in the dominant soil type of the watershed (4 vol.%), their net dissolution provides 75% of the export of dissolved silica, while primary silicate mineral dissolution releases only 15% of this flux. Overall, smectites (modelled as montmorillonites) are not stable under the present day climatic conditions. Furthermore, the dissolution of trace carbonates in the saprolitic horizon provides 50% of the calcium export at the watershed scale. Modelling results show the contrasted behavior of the two main soil types of the watershed: red soils (88% of the surface) are provider of calcium, while black soils (smectite-rich and characterized by a lower drainage) consumes calcium through overall carbonate precipitation. Our model results stress the key role played by minor/accessory minerals and by the thermodynamic properties of smectite minerals, and by the drainage of the weathering profiles on the weathering budget of a tropical watershed. (C) 2010 Elsevier B.V. All rights reserved.

Uniformly accelerated observer in Moyal spacetime

In Minkowski space, an accelerated reference frame may be defined as one that is related to an inertial frame by a sequence of instantaneous Lorentz transformations. Such an accelerated observer sees a causal horizon, and the quantum vacuum of the inertial observer appears thermal to the accelerated observer, also known as the Unruh effect. We argue that an accelerating frame may be similarly defined (i.e. as a sequence of instantaneous Lorentz transformations) in noncommutative Moyal spacetime, and discuss the twisted quantum field theory appropriate for such an accelerated observer. Our analysis shows that there are several new features in the case of noncommutative spacetime: chiral massless fields in (1 + 1) dimensions have a qualitatively different behavior compared to massive fields. In addition, the vacuum of the inertial observer is no longer an equilibrium thermal state of the accelerating observer, and the Bose-Einstein distribution acquires.-dependent corrections.

S-matrix for magnons in the D1-D5 system

We show that integrability and symmetries of the near horizon geometry of the D1-D5 system determine the S-matrix for the scattering of magnons with polarizations in AdS(3) x S-3 completely up to a phase. Using semi-classical methods we evaluate the phase to the leading and to the one-loop approximation in the strong coupling expansion. We then show that the phase obeys the unitarity constraint implied by the crossing relations to the one-loop order. We also verify that the dispersion relation obeyed by these magnons is one-loop exact at strong coupling which is consistent with their BPS nature.

The top 100 questions of importance to the future of global agriculture

Despite a significant growth in food production over the past half-century, one of the most important challenges facing society today is how to feed an expected population of some nine billion by the middle of the 20th century. To meet the expected demand for food without significant increases in prices, it has been estimated that we need to produce 70-100 per cent more food, in light of the growing impacts of climate change, concerns over energy security, regional dietary shifts and the Millennium Development target of halving world poverty and hunger by 2015. The goal for the agricultural sector is no longer simply to maximize productivity, but to optimize across a far more complex landscape of production, rural development, environmental, social justice and food consumption outcomes. However, there remain significant challenges to developing national and international policies that support the wide emergence of more sustainable forms of land use and efficient agricultural production. The lack of information flow between scientists, practitioners and policy makers is known to exacerbate the difficulties, despite increased emphasis upon evidence-based policy. In this paper, we seek to improve dialogue and understanding between agricultural research and policy by identifying the 100 most important questions for global agriculture. These have been compiled using a horizon-scanning approach with leading experts and representatives of major agricultural organizations worldwide. The aim is to use sound scientific evidence to inform decision making and guide policy makers in the future direction of agricultural research priorities and policy support. If addressed, we anticipate that these questions will have a significant impact on global agricultural practices worldwide, while improving the synergy between agricultural policy, practice and research. This research forms part of the UK Government's Foresight Global Food and Farming Futures project.

Algorithms for Routing and Centralized Scheduling in IEEE 802.16 Mesh Networks

IEEE 802.16 standards for Wireless Metropolitan Area Networks (WMANs) include a mesh mode of operation for improving the coverage and throughput of the network. In this paper, we consider the problem of routing and centralized scheduling for such networks. We first fix the routing, which reduces the network to a tree. We then present a finite horizon dynamic programming framework. Using it we obtain various scheduling algorithms depending upon the cost function. Next we consider simpler suboptimal algorithms and compare their performances.

An actor-critic algorithm with function approximation for discounted cost constrained Markov decision processes

We develop in this article the first actor-critic reinforcement learning algorithm with function approximation for a problem of control under multiple inequality constraints. We consider the infinite horizon discounted cost framework in which both the objective and the constraint functions are suitable expected policy-dependent discounted sums of certain sample path functions. We apply the Lagrange multiplier method to handle the inequality constraints. Our algorithm makes use of multi-timescale stochastic approximation and incorporates a temporal difference (TD) critic and an actor that makes a gradient search in the space of policy parameters using efficient simultaneous perturbation stochastic approximation (SPSA) gradient estimates. We prove the asymptotic almost sure convergence of our algorithm to a locally optimal policy. (C) 2010 Elsevier B.V. All rights reserved.

On the optimality of exhaustive service policies in multiclass queueing systems with modulated arrivals and switchovers

Consider a single-server multiclass queueing system with K classes where the individual queues are fed by K-correlated interrupted Poisson streams generated in the states of a K-state stationary modulating Markov chain. The service times for all the classes are drawn independently from the same distribution. There is a setup time (and/or a setup cost) incurred whenever the server switches from one queue to another. It is required to minimize the sum of discounted inventory and setup costs over an infinite horizon. We provide sufficient conditions under which exhaustive service policies are optimal. We then present some simulation results for a two-class queueing system to show that exhaustive, threshold policies outperform non-exhaustive policies.

Optimal control of a stochastic hybrid system with discounted cost

We address the optimal control problem of a very general stochastic hybrid system with both autonomous and impulsive jumps. The planning horizon is infinite and we use the discounted-cost criterion for performance evaluation. Under certain assumptions, we show the existence of an optimal control. We then derive the quasivariational inequalities satisfied by the value function and establish well-posedness. Finally, we prove the usual verification theorem of dynamic programming.

An Optimized SDE Model for Slotted Aloha

We consider a stochastic differential equation (SDE) model of slotted Aloha with the retransmission probability as the associated parameter. We formulate the problem in both (a) the finite horizon and (b) the infinite horizon average cost settings. We apply the algorithm of 3] for the first setting, while for the second, we adapt a related algorithm from 2] that was originally developed in the simulation optimization framework. In the first setting, we obtain an optimal parameter trajectory that prescribes the parameter to use at any given instant while in the second setting, we obtain an optimal time-invariant parameter. Our algorithms are seen to exhibit good performance.

Geochemistry of water and ground water in the Nhecolandia, Pantanal of Mato Grosso, Brazil: Variability and associated processes

A distinctive feature of the Nhecolandia, a sub-region of the Pantanal wetland in Brazil, is the presence of both saline and freshwater lakes. Saline lakes used to be attributed to a past and phase during the Pleistocene. However, recent studies have shown that saline and fresh water lakes are linked by a continuous water table, indicating that saline water could come from a contemporary concentration process. This concentration process could also be responsible for the large chemical variability of the waters observed in the area. A regional water sampling has been conducted in surface and sub-surface water and the water table, and the results of the geochemical and statistical analysis are presented. Based on sodium contents, the concentration shows a 1: 4443 ratio. All the samples belong to the same chemical family and evolve in a sodic alkaline manner. Calcite or magnesian calcite precipitates very early in the process of concentration, probably followed by the precipitation of magnesian silicates. The most concentrated solutions remain under-saturated with respect to the sodium carbonate salt, even if this equilibrium is likely reached around the saline lakes. Apparently, significant amounts of sulfate and chloride are lost simultaneously from the solutions, and this cannot be explained solely by evaporative concentration. This could be attributed to the sorption on reduced minerals in a green sub-surface horizon in the "cordilhieira" areas. In the saline lakes, low potassium, phosphate, magnesium, and sulfate are attributed to algal blooms. Under the influence of evaporation, the concentration of solutions and associated chemical precipitations are identified as the main factors responsible for the geochemical variability in this environment (about 92 % of the variance). Therefore, the saline lakes of Nhecolandia have to be managed as landscape units in equilibrium with the present water flows and not inherited from a past and phase. In order to elaborate hydrochemical tracers for a quantitative estimation of water flows, three points have to be investigated more precisely: (1) the quantification of magnesium involved in the Mg-calcite precipitation; (2) the identification of the precise stoichiometry of the Mg-silicate; and (3) the verification of the loss of chloride and sulfate by sorption onto labile iron minerals.

STEM+: A Fair and Efficient Algorithm for Scheduling on the DSCH in UMTS Networks

In Universal Mobile Telecommunication Systems (UMTS), the Downlink Shared Channel (DSCH) can be used for providing streaming services. The traffic model for streaming services is different from the commonly used continuously- backlogged model. Each connection specifies a required service rate over an interval of time, k, called the "control horizon". In this paper, our objective is to determine how k DSCH frames should be shared among a set of I connections. We need a scheduler that is efficient and fair and introduce the notion of discrepancy to balance the conflicting requirements of aggregate throughput and fairness. Our motive is to schedule the mobiles in such a way that the schedule minimizes the discrepancy over the k frames. We propose an optimal and computationally efficient algorithm, called STEM+. The proof of the optimality of STEM+, when applied to the UMTS rate sets is the major contribution of this paper. We also show that STEM+ performs better in terms of both fairness and aggregate throughput compared to other scheduling algorithms. Thus, STEM+ achieves both fairness and efficiency and is therefore an appealing algorithm for scheduling streaming connections.

Bidding Dynamics of Rational Advertisers in Sponsored Search Auctions on the Web

In this paper, we address a key problem faced by advertisers in sponsored search auctions on the web: how much to bid, given the bids of the other advertisers, so as to maximize individual payoffs? Assuming the generalized second price auction as the auction mechanism, we formulate this problem in the framework of an infinite horizon alternative-move game of advertiser bidding behavior. For a sponsored search auction involving two advertisers, we characterize all the pure strategy and mixed strategy Nash equilibria. We also prove that the bid prices will lead to a Nash equilibrium, if the advertisers follow a myopic best response bidding strategy. Following this, we investigate the bidding behavior of the advertisers if they use Q-learning. We discover empirically an interesting trend that the Q-values converge even if both the advertisers learn simultaneously.

A Simultaneous Deterministic Perturbation Actor-Critic Algorithm with an Application to Optimal Mortgage Refinancing

We develop a simulation-based, two-timescale actor-critic algorithm for infinite horizon Markov decision processes with finite state and action spaces, with a discounted reward criterion. The algorithm is of the gradient ascent type and performs a search in the space of stationary randomized policies. The algorithm uses certain simultaneous deterministic perturbation stochastic approximation (SDPSA) gradient estimates for enhanced performance. We show an application of our algorithm on a problem of mortgage refinancing. Our algorithm obtains the optimal refinancing strategies in a computationally efficient manner