Revenue management under general discrete choice model of consumer behavior

Customer choice behavior, such as 'buy-up' and 'buy-down', is an importantphe-nomenon in a wide range of industries. Yet there are few models ormethodologies available to exploit this phenomenon within yield managementsystems. We make some progress on filling this void. Specifically, wedevelop a model of yield management in which the buyers' behavior ismodeled explicitly using a multi-nomial logit model of demand. Thecontrol problem is to decide which subset of fare classes to offer ateach point in time. The set of open fare classes then affects the purchaseprobabilities for each class. We formulate a dynamic program todetermine the optimal control policy and show that it reduces to a dynamicnested allocation policy. Thus, the optimal choice-based policy caneasily be implemented in reservation systems that use nested allocationcontrols. We also develop an estimation procedure for our model based onthe expectation-maximization (EM) method that jointly estimates arrivalrates and choice model parameters when no-purchase outcomes areunobservable. Numerical results show that this combined optimization-estimation approach may significantly improve revenue performancerelative to traditional leg-based models that do not account for choicebehavior.

Autonomous underwater vehicle control using reinforcement learning policy search methods

Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task

Towards Direct Policy Search Reinforcement Learning for Robot Control

This paper proposes a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot. Although the dominant approach, when using RL, has been to apply value function based algorithms, the system here detailed is characterized by the use of direct policy search methods. Rather than approximating a value function, these methodologies approximate a policy using an independent function approximator with its own parameters, trying to maximize the future expected reward. The policy based algorithm presented in this paper is used for learning the internal state/action mapping of a behavior. In this preliminary work, we demonstrate its feasibility with simulated experiments using the underwater robot GARBI in a target reaching task

Venture capital meets contract theory: risky claims or formal control?

This paper develops a theory of the joint allocation of formal control and cash-flow rights in venture capital deals. We argue that when the need for investor support calls for very high-powered outside claims, entrepreneurs should optimally retain formal control in order to avoid excessive interference. Hence, we predict that risky claims should be be negatively correlated to control rights, both along the life of a start-up and across deals. This challenges the idea that risky claims should a ways be associated to more formal control, and is in line with contractual terms increasingly used in venture capital, in corporate venturing and in partnership deals between biotech start-ups and large drug companies. The paper provides a theoretical explanation to some puzzling evidence documented in Gompers (1997) and Kaplan and Stromberg (2000), namely the inclusion in venture capital contracts of contingencies that trigger both a reduction in VC control and the conversion! of her preferred stocks into common stocks.

Nuclear Weapons as Symbols. The Role of Norms in Nuclear Policy Making

Throughout history, nuclear weapons have been considered to be the ultimate weapons. This understanding largely detached them from the portfolio of conventional military means and assigned them a symbolic meaning that influenced the identity and norms creation of nations. In most countries today, the development of nuclear weapons is considered morally prohibitive, incompatible with a country’s identity and international outlook. In some states, however, these negative norms are overridden by a positive set of norms, causing nuclear weapons to become either symbols of invulnerability to perceived threats or the regalia of major power status. Main purpose of this paper is to explore on the conditions that cause most states to develop a moral aversion to nuclear weapons, yet effectively lead to their glorification in others. Many studies on the normative understanding of nuclear weapons consider the existence of a negative normative predisposition, often referred to as ‘nuclear taboo’, as a major factor in preventing their acquisition and use. Other studies acknowledge the existence of a nuclear taboo inhibiting the use of nuclear weapons, but point to the existence of the opposing effect of norms, frequently referred to as the ‘nuclear myth’, when it comes to the acquisition of nuclear weapons. This myth emerges when certain symbolic meanings are attached to nuclear weapons, such as a state’s identity, self-image, and its desired position in the international system. With 180 odd countries in the world abstaining from the acquisition of nuclear weapons and 8 countries in possession of them (with two further countries assumed to have pursued their acquisition), one might consider the dominance of the nuclear taboo over the nuclear myth to be the rule. The core question is thus why and how this relationship reversed in the case of defectors.

Economic impact of alternative policy measures implemented on the energy activities of the Catalan production system: an input-output analysis

The aim of the paper is to analyse the economic impact of alternative policies implemented on the energy activities of the Catalan production system. Specifically, we analyse the effects of a tax on intermediate energy uses, a reduction in the final production of energy, and a reduction in intermediate energy uses. The methodology involves two versions of the input-output price model: a competitive price formulation and a mark-up price formulation. The input-output price framework will make it possible to evaluate how the alternative measures modify production prices, consumption prices, private welfare, and intermediate energy uses. The empirical application is for the Catalan economy and uses economic data for the year 2001.

Optimal feedback control rules sensitive to controlled endogenous risk-aversion

The objective of this paper is to correct and improve the results obtained by Van der Ploeg (1984a, 1984b) and utilized in the theoretical literature related to feedback stochastic optimal control sensitive to constant exogenous risk-aversion (see, Jacobson, 1973, Karp, 1987 and Whittle, 1981, 1989, 1990, among others) or to the classic context of risk-neutral decision-makers (see, Chow, 1973, 1976a, 1976b, 1977, 1978, 1981, 1993). More realistic and attractive, this new approach is placed in the context of a time-varying endogenous risk-aversion which is under the control of the decision-maker. It has strong qualitative implications on the agent's optimal policy during the entire planning horizon.

Asymmetric standing facilities: an unexploited monetary policy tool

This paper analyzes the role of standing facilities in the determination of the demand for reserves in the overnight money market. In particular, we study how the asymmetric nature of the deposit and lending facilities could be used as a powerful policy tool for the simultaneous control of prices and quantities in the market for daily funds.

Policy gradient based Reinforcement Learning for real autonomous underwater cable tracking

This paper proposes a field application of a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot in cable tracking task. The learning system is characterized by using a direct policy search method for learning the internal state/action mapping. Policy only algorithms may suffer from long convergence times when dealing with real robotics. In order to speed up the process, the learning phase has been carried out in a simulated environment and, in a second step, the policy has been transferred and tested successfully on a real robot. Future steps plan to continue the learning process on-line while on the real robot while performing the mentioned task. We demonstrate its feasibility with real experiments on the underwater robot ICTINEU AUV

Agriculture, technological change and environmental sustainability: Looking for a win-win water policy strategy

This paper analyses the effects that technological changes in agriculture would have on environmental, social and economic indicators. Specifically, our study is focused on two alternative technological improvements: the modernization of water transportation systems versus the increase in the total factor productivity of agriculture. Using a computable general equilibrium model for the Catalan economy, our results suggest that a water policy that leads to greater economic efficiency is not necessarily optimal if we consider social or environmental criteria. Moreover, improving environmental sustainability depends less on the type of technological change than on the institutional framework in which technological change occurs. Keywords: agricultural technological changes, computable general equilibrium model, economic impact, water policy

A fractionally integrated approach to monetary policy and inflation dynamics

This paper relaxes the standard I(0) and I(1) assumptions typically stated in the monetary VAR literature by considering a richer framework that encompasses the previous two processes as well as other fractionally integrated possibilities. First, a timevarying multivariate spectrum is estimated for post WWII US data. Then, a structural fractionally integrated VAR (VARFIMA) is fitted to each of the resulting time dependent spectra. In this way, both the coefficients of the VAR and the innovation variances are allowed to evolve freely. The model is employed to analyze inflation persistence and to evaluate the stance of US monetary policy. Our findings indicate a strong decline in the innovation variances during the great disinflation, consistent with the view that the good performance of the economy during the 80’s and 90’s is in part a tale of good luck. However, we also find evidence of a decline in inflation persistence together with a stronger monetary response to inflation during the same period. This last result suggests that the Fed may still play a role in accounting for the observed differences in the US inflation history. Finally, we conclude that previous evidence against drifting coefficients could be an artifact of parameter restriction towards the stationary region. Keywords: monetary policy, inflation persistence, fractional integration, timevarying coefficients, VARFIMA. JEL Classification: E52, C32

Rational Partisan Theory with fiscal policy and an independent central bank

The empirical evidence testing the validity of the rational partisan theory (RPT) has been mixed. In this article, we argue that the inclusion of other macroeconomic policies and the presence of an independent central bank can partly contribute to explain this inconclusiveness. This article expands Alesina s (1987) RPT model to include an extra policy and an independent central bank. With these extensions, the implications of RPT are altered signi ficantly. In particular, when the central bank is more concerned about output than public spending (an assumption made by many papers in this literature), then the direct relationship between in flation and output derived in Alesina (1987) never holds. Keywords: central bank, conservativeness, political uncertainty. JEL Classi fication: E58, E63.

On the foundations of well-being economics and policy

When one wishes to implement public policies, there is a previous need of comparing different actions and valuating and evaluating them to assess their social attractiveness. Recently the concept of well-being has been proposed as a multidimensional proxy for measuring societal prosperity and progress; a key research topic is then on how we can measure and evaluate this plurality of dimensions for policy decisions. This paper defends the thesis articulated in the following points: 1. Different metrics are linked to different objectives and values. To use only one measurement unit (on the grounds of the so-called commensurability principle) for incorporating a plurality of dimensions, objectives and values, implies reductionism necessarily. 2. Point 1) can be proven as a matter of formal logic by drawing on the work of Geach about moral philosophy. This theoretical demonstration is an original contribution of this article. Here the distinction between predicative and attributive adjectives is formalised and definitions are provided. Predicative adjectives are further distinguished into absolute and relative ones. The new concepts of set commensurability and rod commensurability are introduced too. 3. The existence of a plurality of social actors, with interest in the policy being assessed, causes that social decisions involve multiple types of values, of which economic efficiency is only one. Therefore it is misleading to make social decisions based only on that one value. 4. Weak comparability of values, which is grounded on incommensurability, is proved to be the main methodological foundation of policy evaluation in the framework of well-being economics. Incommensurability does not imply incomparability; on the contrary incommensurability is the only rational way to compare societal options under a plurality of policy objectives. 5. Weak comparability can be implemented by using multi-criteria evaluation, which is a formal framework for applied consequentialism under incommensurability. Social Multi-Criteria Evaluation, in particular, allows considering both technical and social incommensurabilities simultaneously.

Distortion control for delay-sensitive sources

We investigate the problem of finding minimum-distortion policies for streaming delay-sensitive but distortion-tolerant data. We consider cross-layer approaches which exploit the coupling between presentation and transport layers. We make the natural assumption that the distortion function is convex and decreasing. We focus on a single source-destination pair and analytically find the optimum transmission policy when the transmission is done over an error-free channel. This optimum policy turns out to be independent of the exact form of the convex and decreasing distortion function. Then, for a packet-erasure channel, we analytically find the optimum open-loop transmission policy, which is also independent of the form of the convex distortion function. We then find computationally efficient closed-loop heuristic policies and show, through numerical evaluation, that they outperform the open-loop policy and have near optimal performance.

The achievable region approach to the optimal control of stochastic systems

The achievable region approach seeks solutions to stochastic optimisation problems by: (i) characterising the space of all possible performances(the achievable region) of the system of interest, and (ii) optimisingthe overall system-wide performance objective over this space. This isradically different from conventional formulations based on dynamicprogramming. The approach is explained with reference to a simpletwo-class queueing system. Powerful new methodologies due to the authorsand co-workers are deployed to analyse a general multiclass queueingsystem with parallel servers and then to develop an approach to optimalload distribution across a network of interconnected stations. Finally,the approach is used for the first time to analyse a class of intensitycontrol problems.