Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

Recommender System Based on Consumer Product Reviews

Consumer reviews, opinions and shared experiences in the use of a product is a powerful source of information about consumer preferences that can be used in recommender systems. Despite the importance and value of such information, there is no comprehensive mechanism that formalizes the opinions selection and retrieval process and the utilization of retrieved opinions due to the difficulty of extracting information from text data. In this paper, a new recommender system that is built on consumer product reviews is proposed. A prioritizing mechanism is developed for the system. The proposed approach is illustrated using the case study of a recommender system for digital cameras

Profitability, uncertainty and multi-product firm product proliferation: The Spanish car industry

This article studies how product introduction decisions relate to profitability and uncertainty in the context of multi-product firms and product differentiation. These two features, common to many modern industries, have not received much attention in the literature as compared to the classical problem of firm entry, even if the determinants of firm and product entry are quite different. The theoretical predictions about the sign of the impact of uncertainty on product entry are not conclusive. Therefore, an econometric model relating firms’ product introduction decisions with profitability and profit uncertainty is proposed. Firm’s estimated profits are obtained from a structural model of product demand and supply, and uncertainty is proxied by profits’ variance. The empirical analysis is carried out using data on the Spanish car industry for the period 1990-2000. The results show a positive relationship between product introduction and profitability, and a negative one with respect to profit variability. Interestingly, the degree of uncertainty appears to be a driving force of entry stronger than profitability, suggesting that the product proliferation process in the Spanish car market may have been mainly a consequence of lower uncertainty rather than the result of having a more profitable market

Generació semi-automàtica de façanes procedurals

L’objectiu d’aquest PFC és desenvolupar una eina d’edició de façanes procedural apartir d’una imatge d’una façana real. L’aplicació generarà les regles procedurals de lafaçana a partir de dades adquirides del model que es vol representar, com unafotografia. L’usuari de l’aplicació generarà de forma semi-automàtica i interactiva lesregles de subdivisió i repetició, especificant també la inserció de elementsarquitectònics (portes, finestres), que podran ser instanciats a partir d’una llibreria. Uncop generades, les regles s’escriuran en el format del sistema BuildingEngine perintegrar-se completament dins el procés de modelatge urbà.Aquest projecte es desenvoluparà en Matlab

Full diversity product codes for block erasure and block fading channels

We show how to build full-diversity product codes under both iterative encoding and decoding over non-ergodic channels, in presence of block erasure and block fading. The concept of a rootcheck or a root subcode is introduced by generalizing the same principle recently invented for low-density parity-check codes. We also describe some channel related graphical properties of the new family of product codes, a familyreferred to as root product codes.

Pharmaceutical Generics, Vertical Product Differentiation, and Public Policy

This paper studies oligopolistic competition in off-patent pharmaceutical markets using a vertical product differentiation model. This model can explain the observation that countries with stronger regulations have smaller generic market shares. It can also explain the differences in observed regulatory regimes. Stronger regulation may be due to a higher proportion of production that is done by foreign firms. Finally, a closely related model can account for the observed increase in prices by patent owners after entry of generic producers.

A New Model for Designing a Product Line Using TURF Analysis

This paper introduces the approach of using TURF analysis to design a product line through a binary linear programming model. This improves the efficiency of the search for the solution to the problem compared to the algorithms that have been used to date. Furthermore, the proposed technique enables the model to be improved in order to overcome the main drawbacks presented by TURF analysis in practice.

Network revenue management with product-specific no-shows

Revenue management practices often include overbooking capacity to account for customerswho make reservations but do not show up. In this paper, we consider the network revenuemanagement problem with no-shows and overbooking, where the show-up probabilities are specificto each product. No-show rates differ significantly by product (for instance, each itinerary andfare combination for an airline) as sale restrictions and the demand characteristics vary byproduct. However, models that consider no-show rates by each individual product are difficultto handle as the state-space in dynamic programming formulations (or the variable space inapproximations) increases significantly. In this paper, we propose a randomized linear program tojointly make the capacity control and overbooking decisions with product-specific no-shows. Weestablish that our formulation gives an upper bound on the optimal expected total profit andour upper bound is tighter than a deterministic linear programming upper bound that appearsin the existing literature. Furthermore, we show that our upper bound is asymptotically tightin a regime where the leg capacities and the expected demand is scaled linearly with the samerate. We also describe how the randomized linear program can be used to obtain a bid price controlpolicy. Computational experiments indicate that our approach is quite fast, able to scale to industrialproblems and can provide significant improvements over standard benchmarks.

Product market deregulation and labor market outcomes

We consider the dynamic relationship between product market entry regulationand equilibrium unemployment. The main theoretical contribution is combininga Mortensen-Pissarides model with monopolistic competition in the goods marketand individual wage bargaining. Product market competition affects unemploymentvia two channels: the output expansion effect and a countervailing effect dueto a hiring externality. Competition is then linked to barriers to entry. Acalibrated model compares a high-regulation European regime to a low-regulationAnglo-American one. Our quantitative analysis suggests that under individualbargaining, no more than half a percentage point of European unemployment ratescan be attributed to entry regulation.

The effects of uncertainty avoidance on brand performance: Marketing creativity, product innovation and the brand duration

This paper investigates the link between brand performance and cultural primes in high-risk,innovation-based sectors. In theory section, we propose that the level of cultural uncertaintyavoidance embedded in a firm determine its marketing creativity by increasing the complexityand the broadness of a brand. It determines also the rate of firm product innovations.Marketing creativity and product innovation influence finally the firm marketingperformance. Empirically, we study trademarked promotion in the Software Security Industry(SSI). Our sample consists of 87 firms that are active in SSI from 11 countries in the period1993-2000. We use the data coming from SSI-related trademarks registered by these firms,ending up with 2,911 SSI-related trademarks and a panel of 18,213 observations. We estimatea two stage model in which first we predict the complexity and the broadness of a trademarkas a measure of marketing creativity and the rate of product innovations. Among severalcontrol variables, our variable of theoretical interest is the Hofstede s uncertainty avoidancecultural index. Then, we estimate the trademark duration with a hazard model using thepredicted complexity and broadness as well as the rate of product innovations, along with thesame control variables. Our evidence confirms that the cultural avoidance affects the durationof the trademarks through the firm marketing creativity and product innovation.

Country asymmetries, endogenous product choice and the speed of trade liberalization

In a world with two countries which differ in size, we study theimpact of (the speed of) trade liberalization on firms' profitsand total welfare of the countries involved. Firms correctlyanticipate the pace of trade liberalization and take it intoaccount when deciding on their product choices, which areendogenously determined at the beginning of the game. Competitionin the marketplace then occurs either on quantities or on prices.As long as the autarkic phase continues, local firms are nationalmonopolists. When trade liberalization occurs, firms compete in aninternational duopoly. We analyze trade effects by using twodifferent models of product differentiation. Across all thespecifications adopted (and independently of the price v. quantitycompetition hypothesis), total welfare always unambiguously riseswith the speed of trade liberalization: Possible losses by firmsare always outweighed by consumers' gains, which come under theform of lower prices, enlarged variety of higher average qualitiesavailable. The effect on profits depends on the type of industryanalyzed. Two results in particular seem to be worth of mention.With vertical product differentiation and fixed costs of qualityimprovements, the expected size of the market faced by the firmsdetermines the incentive to invest in quality. The longer the periodof autarky, the lower the possibility that the firm from the smallcountry would be producing the high quality and be the leader in theinternational market when it opens. On the contrary, when trade opensimmediately, national markets do not play any role and firms fromdifferent countries have the same opportunity to become the leader.Hence, immediate trade liberalization might be in the interest ofproducers in the small country. In general, the lower the size of thesmall country, the more likely its firm will gain from tradeliberalization. Losses from the small country firm can arise when itis relegated to low quality good production and the domestic marketsize is not very small. With horizontal product differentiation (thehomogeneous good case being a limit case of it when costs ofdifferentiation tend to infinity), investments in differentiationbenefit both firms in equal manner. Firms from the small country do notrun the risk of being relegated to a lower competitive position undertrade. As a result, they would never lose from it. Instead, firms fromthe large country may still incur losses from the opening of trade whenthe market expansion effect is low (i.e. when the country is very largerelative to the other).

Pharmaceutical generics, vertical product differentiation and public policy

This paper studies oligopolistic competition in off-patent pharmaceuticalmarkets using a vertical product differentiation model. This model canexplain the observation that countries with stronger regulations havesmaller generic market shares. It can also explain the differences inobserved regulatory regimes. Stronger regulation may be due to a higherproportion of production that is done by foreign firms. Finally, a closelyrelated model can account for the observed increase in prices by patentowners after entry of generic producers.

Product market deregulation and the U.S. employment miracle

We consider the dynamic relationship between product market entry regulation and equilibrium unemployment. The main theoretical contribution is combining a job matchingmodel with monopolistic competition in the goods market and individual wage bargaining.Product market competition affects unemployment by two channels: the output expansion effect and a countervailing effect due to a hiring externality. Competition is then linked to barriers to entry. We calibrate the model to US data and perform a policy experiment to assess whether the decrease in trend unemployment during the 1980 s and 1990 s could be attributed to product market deregulation. Our quantitative analysis suggests that under individual bargaining, a decrease of less than two tenths of a percentage point of unemployment rates can be attributed to product market deregulation, a surprisingly small amount.