Linear Bayes policy for learning in contextual-bandits

Machine and Statistical Learning techniques are used in almost all online advertisement systems. The problem of discovering which content is more demanded (e.g. receive more clicks) can be modeled as a multi-armed bandit problem. Contextual bandits (i.e., bandits with covariates, side information or associative reinforcement learning) associate, to each specific content, several features that define the “context” in which it appears (e.g. user, web page, time, region). This problem can be studied in the stochastic/statistical setting by means of the conditional probability paradigm using the Bayes’ theorem. However, for very large contextual information and/or real-time constraints, the exact calculation of the Bayes’ rule is computationally infeasible. In this article, we present a method that is able to handle large contextual information for learning in contextual-bandits problems. This method was tested in the Challenge on Yahoo! dataset at ICML2012’s Workshop “new Challenges for Exploration & Exploitation 3”, obtaining the second place. Its basic exploration policy is deterministic in the sense that for the same input data (as a time-series) the same results are obtained. We address the deterministic exploration vs. exploitation issue, explaining the way in which the proposed method deterministically finds an effective dynamic trade-off based solely in the input-data, in contrast to other methods that use a random number generator.

Don't blame the economists. It is an inverse problem!

The seriousness of the current crisis urgently demands new economic thinking that breaks the austerity vs. deficit spending circle in economic policy. The core tenet of the paper is that the most important problems that natural and social science are facing today are inverse problems, and that a new approach that goes beyond optimization is necessary. The approach presented here is radical in the sense that it identifies the roots in key assumptions in economic theory such as optimal behavior and stability to provide an inverse thinking perspective to economic modeling, of use in economic and financial stability policy. The inverse problem provides a truly multidisciplinary platform where related problems from different disciplines can be studied under a common approach with comparable results.

The Role of Multilateral Coordination in Transport Policy: The Case of the Maghreb Countries

El WCTR es un congreso de reconocido prestigio internacional en el ámbito de la investigación del transporte y aunque las actas publicadas están en formato digital y sin ISSN ni ISBN, lo consideramos lo suficientemente importante como para que se considere en los indicadores. This paper aims at describing how multilateral cooperation policies are influencing national transport policies in developing countries. It considers the evolution of national transport policies and institutional frameworks in Algeria, Morocco and Tunisia in the last 10 years, and analyses the influence that EU cooperation programmes (particularly those within the Euromed programme initiative) and international coordination activities have played in the evolution towards efficient, sustainable transport systems in those countries. Notwithstanding the significant socioeconomic, political and institutional differences among the three countries, three major traits are common to the transport policy framework in all cases: a focus on megaprojects; substitution of traditional ministerial services by ad hoc public agencies to develop those megaprojects, and progressive involvement of international private players for the operation (and eventually the design and construction) of new projects, focusing on know-how transfer rather than investment needs. The hypotheses is that these similarities are largely due to the influence of the international cooperation promoted by the European Union since the mid- 1990s. The new decision making situation is characterized by the involvement of two new relevant stakeholders, the EU and a limited number of global transport operators. The hierarchical governance model evolves towards more complex structures, which explain the three common traits mentioned above. International coordination has been crucial for developing national transport visions, which are coherent with a regional, transnational system.

Assessing the potential of hybrid fossil–solar thermal plants for energy policy making: Brayton cycles

This paper proposes a first study in-depth of solar-fossil hybridization from a general perspective. It develops a set of useful parameters for analyzing and comparing hybrid plants, it studies the case of hybridizing Brayton cycles with current solar technologies and shows a tentative extrapolation of the results to integrated combined cycle systems (ISCSS). In particular, three points have been analyzed: the technical requirements for solar technologies to be hybridized with Brayton cycles, the temperatures and pressures at which hybridization would produce maximum power per unit of fossil fuel, and their mapping to current solar technologies and Brayton cycles. Major conclusions are that a hybrid plant works in optimum conditions which are not equal to those of the solar or power blocks considered independently, and that hybridizing at the Brayton cycle of a combined cycle could be energetically advantageous.

The impact of the economic crisis and policy actions on GHG emissions from road transport in Spain

Road traffic is the greatest contributor to the carbon footprint of the transport sector and reducing it has become one of the main targets of sustainable transport policies. An analysis of the main factors influencing greenhouse gas (GHG) emissions is essential for designing new energy- and environmentally efficient strategies for the road transport. This paper addresses this need by (i) identifying factors which influence the carbon footprint, including traffic activity, fuel economy and socioeconomic development; and (ii) proposing a methodological framework which uses Modified Laspeyres Index decomposition to analyze the effect of important drivers on the changes in emissions of road transport in Spain during the period from 1990 to 2010. The results demonstrate that the country׳s economic growth has been closely linked to the rise in GHG emissions. The innovative contribution of this paper is the special analysis of the changes in mobility patterns and GHG emissions during the economic crisis, when, for the first time, Spanish road traffic emissions decreased. The reduction of road transport and improved energy efficiency has been powerful contributors to this decrease, demonstrating the effectiveness of energy-saving measures. On the basis of this analysis, several tailored policy recommendations have been suggested for future implementation.

Implications of agricultural production, policy and land use changes on water resource assessment

Una gestión más eficiente y equitativa del agua a escala de cuenca no se puede centrar exclusivamente en el recurso hídrico en sí, sino también en otras políticas y disciplinas científicas. Existe un consenso creciente de que, además de la consideración de las cambiantes condiciones climáticas, es necesaria una integración de ámbitos de investigación tales como la agronomía, planificación del territorio y ciencias políticas y económicas a fin de satisfacer de manera sostenible las demandas de agua por parte de la sociedad y del medio natural. La Política Agrícola Común (PAC) es el principal motor de cambio en las tendencias de paisajes rurales y sistemas agrícolas, pero el deterioro del medio ambiente es ahora una de las principales preocupaciones. Uno de los cambios más relevantes se ha producido con la expansión e intensificación del olivar en España, principalmente con nuevas zonas de regadío o la conversión de olivares de secano a sistemas en regadío. Por otra parte, el cambio de las condiciones climáticas podría ejercer un papel importante en las tendencias negativas de las aportaciones a los ríos, pero no queda claro el papel que podrían estar jugando los cambios de uso de suelo y cobertura vegetal sobre las tendencias negativas de caudal observadas. Esta tesis tiene como objetivo mejorar el conocimiento de los efectos de la producción agrícola, política agraria y cambios de uso de suelo y cobertura vegetal sobre las condiciones de calidad del agua, respuesta hidrológica y apropiación del agua por parte de la sociedad. En primer lugar, el estudio determina las tendencias existentes de nitratos y sólidos en suspensión en las aguas superficiales de la cuenca del río Guadalquivir durante el periodo de 1998 a 2009. Desde una perspectiva de política agraria, la investigación trata de evaluar mediante un análisis de datos de panel las principales variables, incluyendo la reforma de la PAC de 2003, que están teniendo una influencia en ambos indicadores de calidad. En segundo lugar, la apropiación del agua y el nivel de contaminación por nitratos debido a la producción del aceite de oliva en España se determinan con una evaluación de la huella hídrica (HH), teniendo en cuenta una variabilidad espacial y temporal a largo de las provincias españolas y entre 1997 y 2008. Por último, la tesis analiza los efectos de los cambios de uso de suelo y cobertura vegetal sobre las tendencias negativas observadas en la zona alta del Turia, cabecera de la cuenca del río Júcar, durante el periodo 1973-2008 mediante una modelización ecohidrológica. En la cuenca del Guadalquivir cerca del 20% de las estaciones de monitoreo muestran tendencias significativas, lineales o cuadráticas, para cada indicador de calidad de agua. La mayoría de las tendencias significativas en nitratos están aumentando, y la mayoría de tendencias cuadráticas muestran un patrón en forma de U. Los modelos de regresión de datos de panel muestran que las variables más importantes que empeoran ambos indicadores de calidad del agua son la intensificación de biomasa y las exportaciones de ambos indicadores de calidad procedentes de aguas arriba. En regiones en las que el abandono agrícola y/o desintensificación han tenido lugar han mejorado las condiciones de calidad del agua. Para los nitratos, el desacoplamiento de las subvenciones a la agricultura y la reducción de la cuantía de las subvenciones a tierras de regadío subyacen en la reducción observada de la concentración de nitratos. Las medidas de modernización de regadíos y el establecimiento de zonas vulnerables a nitratos reducen la concentración en subcuencas que muestran una tendencia creciente de nitratos. Sin embargo, el efecto de las exportaciones de nitratos procedente de aguas arriba, la intensificación de la biomasa y los precios de los cultivos presentan un mayor peso, explicando la tendencia creciente observada de nitratos. Para los sólidos en suspensión, no queda de forma evidente si el proceso de desacoplamiento ha influido negativa o positivamente. Sin embargo, los mayores valores de las ayudas agrarias aún ligadas a la producción, en particular en zonas de regadío, conllevan un aumento de las tasas de erosión. Aunque la cuenca del Guadalquivir ha aumentado la producción agrícola y la eficiencia del uso del agua, el problema de las altas tasas de erosión aún no ha sido mitigado adecuadamente. El estudio de la huella hídrica (HH) revela que en 1 L de aceite de oliva español más del 99,5% de la HH está relacionado con la producción de la aceituna, mientras que menos del 0,5% se debe a otros componentes, es decir, a la botella, tapón y etiqueta. Durante el período estudiado, la HH verde en secano y en regadío representa alrededor del 72% y 12%, respectivamente, del total de la HH. Las HHs azul y gris representan 6% y 10%, respectivamente. La producción de aceitunas se concentra en regiones con una HH menor por unidad de producto. La producción de aceite de oliva ha aumentado su productividad del agua durante 1997-2008, incentivado por los crecientes precios del aceite, como también lo ha hecho la cantidad de exportaciones de agua virtual. De hecho, las mayores zonas productoras presentan una eficiencia alta del uso y de productividad del agua, así como un menor potencial de contaminación por nitratos. Pero en estas zonas se ve a la vez reflejado un aumento de presión sobre los recursos hídricos locales. El aumento de extracciones de agua subterránea relacionadas con las exportaciones de aceite de oliva podría añadir una mayor presión a la ya estresada cuenca del Guadalquivir, mostrando la necesidad de equilibrar las fuerzas del mercado con los recursos locales disponibles. Los cambios de uso de suelo y cobertura vegetal juegan un papel importante en el balance del agua de la cuenca alta del Turia, pero no son el principal motor que sustenta la reducción observada de caudal. El aumento de la temperatura es el principal factor que explica las mayores tasas de evapotranspiración y la reducción de caudales. Sin embargo, los cambios de uso de suelo y el cambio climático han tenido un efecto compensatorio en la respuesta hidrológica. Por un lado, el caudal se ha visto afectado negativamente por el aumento de la temperatura, mientras que los cambios de uso de suelo y cobertura vegetal han compensado positivamente con una reducción de las tasas de evapotranspiración, gracias a los procesos de disminución de la densidad de matorral y de degradación forestal. El estudio proporciona una visión que fortalece la interdisciplinariedad entre la planificación hidrológica y territorial, destacando la necesidad de incluir las implicaciones de los cambios de uso de suelo y cobertura vegetal en futuros planes hidrológicos. Estos hallazgos son valiosos para la gestión de la cuenca del río Turia, y el enfoque empleado es útil para la determinación del peso de los cambios de uso de suelo y cobertura vegetal en la respuesta hidrológica en otras regiones. ABSTRACT Achieving a more efficient and equitable water management at catchment scale does not only rely on the water resource itself, but also on other policies and scientific knowledge. There is a growing consensus that, in addition to consideration of changing climate conditions, integration with research areas such as agronomy, land use planning and economics and political science is required to meet sustainably the societal and environmental water demands. The Common Agricultural Policy (CAP) is a main driver for trends in rural landscapes and agricultural systems, but environmental deterioration is now a principal concern. One of the most relevant changes has occurred with the expansion and intensification of olive orchards in Spain, taking place mainly with new irrigated areas or with the conversion from rainfed to irrigated systems. Moreover, changing climate conditions might exert a major role on water yield trends, but it remains unclear the role that ongoing land use and land cover changes (LULCC) might have on observed river flow trends. This thesis aims to improve the understanding of the effects of agricultural production, policies and LULCC on water quality conditions, hydrological response and human water appropriation. Firstly, the study determines the existing trends for nitrates and suspended solids in the Guadalquivir river basin’s surface waters (south Spain) during the period from 1998 to 2009. From a policy perspective, the research tries to assess with panel data analysis the main drivers, including the 2003 CAP reform, which are having an influence on both water quality indicators. Secondly, water appropriation and nitrate pollution level originating from the production of olive oil in Spain is determined with a water footprint (WF) assessment, considering a spatial temporal variability across the Spanish provinces and from 1997 to 2008 years. Finally, the thesis analyzes the effects of the LULCC on the observed negative trends over the period 1973-2008 in the Upper Turia basin, headwaters of the Júcar river demarcation (east Spain), with ecohydrological modeling. In the Guadalquivir river basin about 20% of monitoring stations show significant trends, linear or quadratic, for each water quality indicator. Most significant trends of nitrates are augmenting than decreasing, and most significant quadratic terms of both indicators exhibit U-shaped patterns. The panel data models show that the most important drivers that are worsening nitrates and suspended solids in the basin are biomass intensification and exports of both water quality indicators from upland regions. In regions that agricultural abandonment and/or de-intensification have taken place the water quality conditions have improved. For nitrates, the decoupling of agricultural subsidies and the reduction of the amount of subsidies to irrigated land underlie the observed reduction of nitrates concentration. Measures of irrigation modernization and establishment of vulnerable zones to nitrates ameliorate the concentration of nitrates in subbasins showing an increasing trend. However, the effect of nitrates load from upland areas, intensification of biomass and crop prices present a greater weight leading to the final increasing trend in this subbasins group, where annual crops dominate. For suspended solids, there is no clear evidence that decoupling process have influenced negatively or positively. Nevertheless, greater values of subsidies still linked to production, particularly in irrigated regions, lead to increasing erosion rates. Although agricultural production has augmented in the basin and water efficiency in the agricultural sector has improved, the issue of high erosion rates has not yet been properly faced. The water footprint (WF) assessment reveals that for 1 L Spanish olive oil more than 99.5% of the WF is related to the olive fruit production, whereas less than 0.5% is due to other components i.e. bottle, cap and label. Over the studied period, the green WF in rainfed and irrigated systems represents about 72% and 12%, respectively, of the total WF. Blue and grey WFs represent 6% and 10%, respectively. The olive production is concentrated in regions with the smallest WF per unit of product. The olive oil production has increased its apparent water productivity from 1997 to 2008 incentivized by growing trade prices, but also did the amount of virtual water exports. In fact, the largest producing areas present high water use efficiency per product and apparent water productivity as well as less nitrates pollution potential, but this enhances the pressure on the available water resources. Increasing groundwater abstractions related to olive oil exports may add further pressure to the already stressed Guadalquivir basin. This shows the need to balance the market forces with the available local resources. Concerning the effects of LULCC on the Upper Turia basin’s streamflow, LULCC play a significant role on the water balance, but it is not the main driver underpinning the observed reduction on Turia's streamflow. Increasing mean temperature is the main factor supporting larger evapotranspiration rates and streamflow reduction. In fact, LULCC and climate change have had an offsetting effect on the streamflow generation during the study period. While streamflow has been negatively affected by increasing temperature, ongoing LULCC have positively compensated with reduced evapotranspiration rates, thanks to mainly shrubland clearing and forest degradation processes. The research provides insight for strengthening the interdisciplinarity between hydrological and spatial planning, highlighting the need to include the implications of LULCC in future hydrological plans. These findings are valuable for the management of the Turia river basin, as well as a useful approach for the determination of the weight of LULCC on the hydrological response in other regions.

Diffusion of photovoltaic in Germany: roles of policy, system suppliers and adopters

In some countries photovoltaic (PV) technology is at a stage of development at which it can compete with conventional electricity sources. A case in point is Germany where PV market has reached a mature stage. As a manifest of this, the German government has recently reduced the feed-in-tariff, which had been the strongest driver of PV diffusion. This development raises a fundamental question: Why would potential adopters be motivated to adopt PV when feed-in tariff diminishes? The point of departure for the literature on diffusion of PV has been on the effect of subsidies but little attention has paid to adopter motives when the policy support is scaled down. This paper presents an in-depth analysis of the adopter motives for photovoltaic applications. Anchored in an extensive exploratory case study we provide an encompassing explanation of roles of policy, adopters and system suppliers on diffusion of PV.

Income, energy expenditure and housing in Madrid: retrofitting policy implications

Fuel poverty can be defined as ‘the inability to afford adequate warmth in the home’ and it is the result of the combination of three factors: low household income, lack of energy efficiency and high energy bills. Within this context, the present research is aimed at characterizing, for the first time, the housing stock of fuel-poor households in the Autonomous Region of Madrid. Fuel poverty incidence was established and households were divided into six different groups according to their relative position regarding fuel and monetary poverty. The housing stock of each group is characterized and those households most in need are identified. These results enable energy retrofitting priorities to be established, focusing on the needs of the different household groups and accounting for their housing stock characteristics. This allows Spanish energy retrofitting policies to be assessed for their capability of tackling fuel poverty and makes it possible to suggest some improvements.

Earthquake prediction: the interaction of public policy and science.

Earthquake prediction research has searched for both informational phenomena, those that provide information about earthquake hazards useful to the public, and causal phenomena, causally related to the physical processes governing failure on a fault, to improve our understanding of those processes. Neither informational nor causal phenomena are a subset of the other. I propose a classification of potential earthquake predictors of informational, causal, and predictive phenomena, where predictors are causal phenomena that provide more accurate assessments of the earthquake hazard than can be gotten from assuming a random distribution. Achieving higher, more accurate probabilities than a random distribution requires much more information about the precursor than just that it is causally related to the earthquake.

Chinese Intellectuals and China`s Policy toward Japan

This dissertation aims at integrating two scholarships: state-society relation studies and Chinese foreign policy analysis. I created Two-level Perception Gap Model to analyze different intellectual groups' relations with party-state by confirming Chinese intellectuals play a role in CFP making in general, China's Japan policy in particular. This model is an alternative approach, instead of conventional wisdom patron-client approach, to explain and analyze the pluralized intellectual-state relations in China. This model first analyzed the role of two intellectual groups, namely think tank scholars and popular nationalist, in China's Japan policy making, and then based on these analyses it explains the interactional patterns between these two intellectual groups and party-state. I used three case studies, which represented different types of issue, Chinese attitude toward the U.S.-Japan alliance and the Japanese defense policy, the controversy over the Yasukuni Shrine Visit, and the territorial dispute over the Diaoyu/Senkaku Islands, to examine this model. First, I examined think tank scholar groups and the extent they influenced "core interest issue and sensitive issue (Issue 1)," Chinese attitude toward the U.S.-Japan alliance and the Japanese defense policy, and their international patterns with party-state. Chapter 3 compares the responses of Chinese officials to the changes in the defense policy of Japan to the analyses from the think tank scholars. As the model assumes, results show that think tank scholars' analyses are consistent with China's policy position; nevertheless, it is difficult to confirm their analyses have influence on Chinese attitude toward the U.S.-Japan alliance and the Japanese defense policy. Based on the analysis of journal articles, most articles do not provide policy suggestions or simply provide suggestions that do not deviate from the policy. As Gu's theory of pluralist institutionalism and my hypothesis points out, most think tank scholars are establishment intellectuals so they tend to be self-disciplined. Second, this model provide a new concept "patriotic dilemma" for analyzing the challenge and constraints brought by popular nationalist discourses and public mobilization to Chinese foreign policy decision makers. Chapter 4 investigated the cases study of the controversy over the Yasukuni Shrine Visit, defined as "major/minor interest issue/ sensitive issue (Issue 3)," and the discourses from the popular nationalist, mainly focusing on anti-Japanese activists. The chapter also observes their influence on nationalist public opinions and analyzes how the nationalist public opinions constrain the policy choices among decision makers. Results strongly supported the hypothesis of patriotic dilemma that, although the popular nationalist group and public opinions constrained the policy choices of Chinese decision makers in the short term, they were unable to change the fundamental policy direction. Third, chapter 5 also focuses on anti-Japanese activists and examines the model with the case of the territorial dispute over the Diaoyu/Senkaku Islands. The result supported that hypothesis that China's policy change was not because of the influence from popular nationalist's discourses or public opinions but because of the change of priority of this issue, from major/minor interest issue to core interest issue. These two chapters also indicate that the patron-client model is unable to describe the popular nationalist. An alternative approach, such as the concept "patriotic dilemma" is needed to describe the relations between the popular nationalist and the government.

Climate Change Policy & the Natural Gas Transmission Sector

Various emission reduction strategies are proposed to manage climate change in the U.S. This applied capstone evaluates the most likely policy options considering impacts and benefits to the natural gas transmission sector (NGT). It examines a case-study including a comparison of policy options to recommend the most beneficial program to the NGT sector. Two conclusions of major importance are: a federally preempted cap-and-trade program would be the most cost-effective for the NGT sector and the NGT sector should not be the point of regulation of any climate policy. Recommendations, strategies, and costs for implementation of a compliance plan for a federally preempted cap-and-trade program were developed as a tool for NGT companies as part of this applied capstone project.

Denver Water, Policy and Economics

An analysis of the Denver Water Department finds that it is charged with supplying water to over 1.1 million residents in the Denver Metropolitan area. With assets of over $1.2 billion dollars and a governing board of five appointed members who must make policy and financial decisions under unusual circumstances for most water districts. Those circumstances include; Colorado is the only State that has a single source of water, precipitation, State and Federal mandated water compacts that limits water resources further, and Colorado Constitutional mandated appropriation water laws. Combined together these circumstances create a difficult atmosphere for policy making and financial planning. When comparing the Denver Water Board with other water departments around the Country, the Denver Water Department seems to be competent in all areas.

Making it easy to do the right thing in healthcare: Advancing improvement science education through accredited pan European higher education modules

Background: Numerous international policy drivers espouse the need to improve healthcare. The application of Improvement Science has the potential to restore the balance of healthcare and transform it to a more person-centred and quality improvement focussed system. However there is currently no accredited Improvement Science education offered routinely to healthcare students. This means that there are a huge number of healthcare professionals who do not have the conceptual or experiential skills to apply Improvement Science in everyday practise. Methods: This article describes how seven European Higher Education Institutions (HEIs) worked together to develop four evidence informed accredited inter-professional Improvement Science modules for under and postgraduate healthcare students. It outlines the way in which a Policy Delphi, a narrative literature review, a review of the competency and capability requirements for healthcare professionals to practise Improvement Science, and a mapping of current Improvement Science education informed the content of the modules. Results: A contemporary consensus definition of Healthcare Improvement Science was developed. The four Improvement Science modules that have been designed are outlined. A framework to evaluate the impact modules have in practise has been developed and piloted. Conclusion: The authors argue that there is a clear need to advance healthcare Improvement Science education through incorporating evidence based accredited modules into healthcare professional education. They suggest that if Improvement Science education, that incorporates work based learning, becomes a staple part of the curricula in inter-professional education then it has real promise to improve the delivery, quality and design of healthcare.

Energizing the Oak Ridges Moraine? Analyzing the Policy Implications of Three Wind Energy Developments on the Oak Ridges Moraine and their Potential Impact on the Coordinated Land Use Planning Review through the Involvement of First Nations and Environmental Non-governmental Organizations

This research explores the policy implications of the approval of three wind energy projects on the Oak Ridges Moraine, and their impact on the Coordinated Land Use Planning Review process. Specifically, it focuses on the involvement of First Nations and environmental non-governmental organizations (ENGOs). This research was conducted through analyzing submissions to the Coordinated Land Use Planning Review, related legislation and policy, Environmental Review Tribunal hearing documents, and interviews with key informants. This research culminates in a number of recommendations to the Coordinated Review informed by the analysis.

Regional health governance: a comparative perspective on EU and ASEAN. EU Centre in Singapore Policy Brief No. 4, June 2012

Globalisation has led to new health challenges for the 21st Century. These challenges have transnational implications and involve a large range of actors and stakeholders. National governments no longer hold the sole responsibility for the health of their people. These changes in health trends have led to the rise of Global Health Governance as a theoretical notion for health policy-making. The Southeast Asian region is particularly prone to public health threats and it is for this reason that this brief looks at the potential of the Association of Southeast Asian Nations (ASEAN) as a regional organisation to take a lead in health cooperation. Through a comparative study between the regional mechanisms for health cooperation of the European Union (EU) and ASEAN, we look at how ASEAN could maximise its potential as a global health actor. Regional institutions and a network of civil society organisations are crucial in relaying global initiatives for health, and ensuring their effective implementation at the national level. While the EU benefits from higher degrees of integration and involvement in the sector of health policy making, ASEAN’s role as a regional body for health governance will depend both on greater horizontal and vertical regional integration through enhanced regional mechanisms and a wider matrix of cooperation.