Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.

Forecasting economic and financial time series with non-linear models

In this paper we discuss the current state-of-the-art in estimating, evaluating, and selecting among non-linear forecasting models for economic and financial time series. We review theoretical and empirical issues, including predictive density, interval and point evaluation and model selection, loss functions, data-mining, and aggregation. In addition, we argue that although the evidence in favor of constructing forecasts using non-linear models is rather sparse, there is reason to be optimistic. However, much remains to be done. Finally, we outline a variety of topics for future research, and discuss a number of areas which have received considerable attention in the recent literature, but where many questions remain.

When rules and principles are not enough: insiders’ views and narratives on the global financial crisis

Much has been written about Wall Street and the global financial crisis (GFC). From a fraudulent derivatives market to a contestable culture of banking bonuses, culpability has been examined within the frames of American praxis, namely that of American exceptionalism. This study begins with an exploratory analysis of non-US voices concerning the nature of the causes of the GFC. The analysis provides glimpses of the globalized extent of assumptions shared, but not debated within the globalization convergence of financial markets as the neo-liberal project. Practical and paradigmatic tensions are revealed in the capture of a London-based set of views articulated by senior financial executives of financial service organizations, the outcomes of which are not overly optimistic for any significant change in praxis within the immediate future.

Concessionary nature of public-private partnerships in Russia and Kazakhstan: a critical review

This article provides a critical overview of Public-Private Partnerships (PPPs) in Russia and Kazakhstan and examines the rationale underpinning such partnerships. The analysis discusses the reasons why governments in Russia and Kazakhstan focus principally on concessions as a form of PPP and goes on to provide a critical assessment of the key approaches and situational factors relating to concessions in these two countries. The article finds that external globalization impulses pressed Russia and Kazakhstan to align their policies and institutions with western orthodoxy and perceived international best practice. An ever-increasing emphasis on use of PPPs has been a key feature of this alignment. However, the governments of Russia and Kazakhstan have increasingly resorted to concessions as progress with the development and implementation of Western style PPP models has stalled. This article concludes that the governments of Russia and Kazakhstan have demonstrated an overly optimistic approach to PPP and as a result may have substantially understated their overall concessional risks and costs. Features of Russian and Kazakhstani PPP arrangements such as ambiguity in output specification and extensive reliance on government subsidies, combined with lack of expertise of private partners, may significantly decrease concession benefits.

Impacts of 20th century aerosol emissions on the South Asian monsoon in the CMIP5 models

Comparison of single-forcing varieties of 20th century historical experiments in a subset of models from the Fifth Coupled Model Intercomparison Project (CMIP5) reveals that South Asian summer monsoon rainfall increases towards the present day in Greenhouse Gas (GHG)-only experiments with respect to pre-industrial levels, while it decreases in anthropogenic aerosol-only experiments. Comparison of these single-forcing experiments with the all-forcings historical experiment suggests aerosol emissions have dominated South Asian monsoon rainfall trends in recent decades, especially during the 1950s to 1970s. The variations in South Asian monsoon rainfall in these experiments follows approximately the time evolution of inter-hemispheric temperature gradient over the same period, suggesting a contribution from the large-scale background state relating to the asymmetric distribution of aerosol emissions about the equator. By examining the 24 available all-forcings historical experiments, we show that models including aerosol indirect effects dominate the negative rainfall trend. Indeed, models including only the direct radiative effect of aerosol show an increase in monsoon rainfall, consistent with the dominance of increasing greenhouse gas emissions and planetary warming on monsoon rainfall in those models. For South Asia, reduced rainfall in the models with indirect effects is related to decreased evaporation at the land surface rather than from anomalies in horizontal moisture flux, suggesting the impact of indirect effects on local aerosol emissions. This is confirmed by examination of aerosol loading and cloud droplet number trends over the South Asia region. Thus, while remote aerosols and their asymmetric distribution about the equator play a role in setting the inter-hemispheric temperature distribution on which the South Asian monsoon, as one of the global monsoons, operates, the addition of indirect aerosol effects acting on very local aerosol emissions also plays a role in declining monsoon rainfall. The disparity between the response of monsoon rainfall to increasing aerosol emissions in models containing direct aerosol effects only and those also containing indirect effects needs to be urgently investigated since the suggested future decline in Asian anthropogenic aerosol emissions inherent to the representative concentration pathways (RCPs) used for future climate projection may turn out to be optimistic. In addition, both groups of models show declining rainfall over China, also relating to local aerosol mechanisms. We hypothesize that aerosol emissions over China are large enough, in the CMIP5 models, to cause declining monsoon rainfall even in the absence of indirect aerosol effects. The same is not true for India.

Towards (more) integrity in academia: transcending neo-liberal assumption of research and knowledge creation and the “rules” supressing academic freedom

European researchers across heterogeneous disciplines voice concerns and argue for new paths towards a brighter future regarding scientific and knowledge creation and communication. Recently, in biological and natural sciences concerns have been expressed that major threats are intentionally ignored. These threats are challenging Europe’s future sustainability towards creating knowledge that effectively deals with emerging social, environmental, health, and economic problems of a planetary scope. Within social science circles however, the root cause regarding the above challenges, have been linked with macro level forces of neo-liberal ways of valuing and relevant rules in academia and beyond which we take for granted. These concerns raised by heterogeneous scholars in natural and the applied social sciences concern the ethics of today’s research and academic integrity. Applying Bourdieu’s sociology may not allow an optimistic lens if change is possible. Rather than attributing the replication of neo-liberal habitus in intentional agent and institutional choices, Bourdieu’s work raises the importance of thoughtlessly internalised habits in human and social action. Accordingly, most action within a given paradigm (in this case, neo-liberalism) is understood as habituated, i.e. unconsciously reproducing external social fields, even ill-defined ways of valuing. This essay analyses these and how they may help critically analyse the current habitus surrounding research and knowledge production, evaluation, and communication and related aspects of academic freedom. Although it is acknowledged that transformation is not easy, the essay presents arguments and recent theory paths to suggest that change nevertheless may be a realistic hope once certain action logics are encouraged.

Investigation of the accuracy of historical irradiance products and interannual variability of solar irradiance using Met Office ground data

Met Office station data from 1980 to 2012 has been used to characterise the interannual variability of incident solar irradiance across the UK. The same data are used to evaluate four popular historical irradiance products to determine which are most suitable for use by the UK PV industry for site selection and system design. The study confirmed previous findings that interannual variability is typically 3–6% and weighted average probability of a particular percentage deviation from the mean at an average site in the UK was calculated. This weighted average showed that fewer than 2% of site-years could be expected to fall below 90% of the long-term site mean. The historical irradiance products were compared against Met Office station data from the input years of each product. This investigation has found that all products perform well. No products have a strong spatial trend. Meteonorm 7 is most conservative (MBE = −2.5%), CMSAF is most optimistic (MBE = +3.4%) and an average of all four products performs better than any one individual product (MBE = 0.3%)

Assessing the performance of dynamical trajectory estimates

Estimating trajectories and parameters of dynamical systems from observations is a problem frequently encountered in various branches of science; geophysicists for example refer to this problem as data assimilation. Unlike as in estimation problems with exchangeable observations, in data assimilation the observations cannot easily be divided into separate sets for estimation and validation; this creates serious problems, since simply using the same observations for estimation and validation might result in overly optimistic performance assessments. To circumvent this problem, a result is presented which allows us to estimate this optimism, thus allowing for a more realistic performance assessment in data assimilation. The presented approach becomes particularly simple for data assimilation methods employing a linear error feedback (such as synchronization schemes, nudging, incremental 3DVAR and 4DVar, and various Kalman filter approaches). Numerical examples considering a high gain observer confirm the theory.

Resilience in crisis reconsidered: the need for values against relativist ethics

The need for a reconsideration of resilience from both a positive and a normative point of view can be discussed using some of the lessons and conclusions drawn from individual resilience studied by psychologists in an educational context. The main point made in this article is that unless we want to approach resilience as a feature which is exogenously given in each population and society and whose dynamics, if any, are not subject to deliberate actions and policies, we need a framework for the evaluation of resilience as a social good. Relying on the hope that resilience is necessarily built in our societies as a force guaranteeing convergence to a socially desirable point of social evolution may be too optimistic and even counterproductive, because it may lead us to an inefficient or biased political and regulatory decision making. When the effect of policies and actions at a national or international level take into account the dynamic effect of such actions on resilience itself, one cannot blindly rely on the goodness of the process any more. This is mainly because resilience is not uniformly embodied in all societies and it does not have a globally positive social value by itself. The issue of socially valuing the options available beyond market-price valuations becomes fundamental in this context.

Ensamhet - gemenskap : Ett spänningsfält i Vilhelm Ekelunds författarskap

For the Swedish poet, essayist and aphorist Vilhelm Ekelund, ensamhet (solitude) and gemenskap (intellectual and spiritual community) were highly complex notions, with various and often contradictory meanings. In this article, I argue that both concepts have positive as well as negative connotations in Ekelund’s texts. Solitude can be sweet and delightful and the poet/writer may long for it, but it can also appear to him as a sordid and painful state. In the same way, life with other people may be just as difficult and complicated. I show that Ekelund as a young poet both embraced solitude as a positive notion and suffered from depressing isolation. The theme of solitude also appeared in his early prose as a heroic stance fitting for an extraordinary person. According to Ekelund, the fate of the truly gifted artist is loneliness, and he will find great difficulties connecting with people around him. In fact, he will find intellectual and spiritual community only when communicating with the great precursors – in Ekelund’s case that meant the prominent figures of Greek and Roman cultural heritage. “Modern” artists interested him only in so much as they openly venerated this classicist tradition. Ekelund may have despaired at the idea of an intellectual or spiritual community with his contemporaries; he was, nevertheless, optimistic regarding the ability of later generations to understand him. He was convinced that he did not write for people in his own time but, indeed, for posterity.

Publicidade: comércio, cultura e profissão (parte inicial)

O universo daquilo que é abertamente comercial na sociedade contemporânea costuma ser tratado nos meios acadêmicos de forma costumeiramente distante, simplista e ressentida. Ou, ao contrário, através do otimismo ingênuo característico da literatura de celebração. O estudo da história social da publicidade e do marketing é estratégico para avançar contra esse maniqueísmo paralisante. Ele ajuda a ampliar a visão das relações entre industrialização capitalista e mercado, urbanização e modernização, comunicação de massa e vida familiar, favorecendo uma visão mais adulta dos significados do consumo, tanto material quanto simbólico. O texto apoia-se em alguns títulos selecionados em uma bibliografia especializada recolhida recentemente nos EUA, e escolhidos por sua relevância em recolocar questões de sociologia da cultura.

O trabalho atrapalha os estudos?

Nas últimas décadas a frequência à escola entre os jovens brasileiros aumentou consideravelmente. A porcentagem de crianças, entre 10 e 14 anos de idade que estão matriculados na escola está acima de 95% e na faixa de 15 a 18 anos de idade, cerca de 70%. Vinte anos atrás estes números eram 80% e 50%, respectivamente. Por outro lado, quando se analisa os dados de participação na força de trabalho o quadro é menos otimista: para ambos os grupos, a participação é bastante elevada e tem apresentado comportamento estável ao longo dos anos. Este estuda analisa o efeito da participação no mercado de trabalho sobre o atraso escolar de crianças de nestes dois grupos de faixa etária utilizando a metodologia de emparelhamento por nota de propensão (propensity score matching) de participação no mercado de trabalho. Como seria de se esperar quanto maior a probabilidade de participar maior o atraso escolar. Mas, nosso principal resultado é que em ambos os grupos e mais acentuadamente para os mais jovens, a diferença de atraso entre os que participam e não participam do mercado de trabalho é mais elevado para valores intermediários de probabilidade de trabalhar. Nos valores extremos da distribuição as diferenças não são tão elevadas e muitas vezes não significantes estatisticamente. Isto significa que para os jovens com elevada probabilidade de participar no mercado de trabalho, e que são os que têm o mais elevado grau de atraso escolar, o trabalho em si não é a maior razão para este mal desempenho. Estes resultados sugerem que as políticas públicas para combate ao atraso escolar entre os grupos mais pobres deveriam ser mais abrangentes envolvendo uma ação mais ampla sobre a família e não apenas na erradicação do trabalho infantil e juvenil.

Títulos de dívida corporativa de empresas brasileiras: investir em emissões do mercado interno ou externo?

O objetivo deste trabalho é analisar a diferença de rentabilidade entre emissões de títulos de dívida corporativa de empresas brasileiras nos mercados local e externo. Sob a ótica do investidor interessado em comprar esses títulos, busca-se responder se, protegendo-se contra oscilações de fatores como câmbio e juros e controlando pelo prazo de vencimento, seria mais rentável em média adquirir um título local (debênture) ou externo (bond) de um mesmo emissor. Para isso, analisamos 177 emissões de debêntures e 119 emissões de bonds de 31 companhias não financeiras brasileiras no período entre janeiro de 2004 e abril de 2013. Regressões em painel com efeitos fixos para controlar pelas características de cada emissor verificam que, em média, o título do mercado externo paga de 164 a 197 bps a mais que o do mercado local, e que tal diferença é estatisticamente significante. A diferença deve-se à maior oferta e variedade de títulos de dívida corporativa no mercado externo, à existência de uma demanda cativa de investidores institucionais por debêntures no mercado local e à falta de integração entre os mercados. A participação de pessoas físicas no mercado externo também é identificada como fator relevante, assim como o possível maior custo de estruturação de dívida cobrado por bancos de investimento no mercado doméstico. Dentre as hipóteses formuladas para o motivo dessa diferença de rentabilidade não ser arbitrada, destacam-se o desconhecimento dos investidores e obstáculos operacionais, como custos de transação, impossibilidade de operação no mercado internacional e de venda a descoberto no mercado local. Tal fato causa ainda uma supervalorização das debêntures pela atuação dos investidores mais otimistas. A alta sensibilidade dos investidores institucionais locais à volatilidade dos retornos, também aparece como fator relevante.

Work, study, both or neither? time allocation of Brazilian teenagers

Labor force participation among youth is extremely high in Brazil when compared to countries with a similar economic background. In Argentina and Chile labor force participation, among those with 10 to 14 years old, is around 1% while in Brazil this rate is as high as 17 %. For the those between 15 and 19 years old these figures are around 10% in Chile, 15% in Argentina and 53% in Brazil. On the other hand the data on school attendance give a more optimistic picture. The percentage of children, between 10 and 14 years old, enrolled in school increased steadily from 79% to 95% from 1981 to 1998 and with age between 15 and 19, from 46% to 66% in the same period. These figures are close to the ones presented by Chile and Argentina. around 99% among the youngest group and around 70% for the 15 to 19 years old group. The objective of the paper is to understand the determinants of the time allocation decision of the Brazilian youth during the last twenty years. Using a multinomial logit regression we investigate the conditional effect of various micro and macro variables on the time allocation decision for the 1991 to 1998 period. Our main findings are: working and studying became the most likely allocation among the youngest in the poor rural areas and, in general, to study, whether working or not, became less dependent on family background for the youngest group but not for the older.

How resource rich countries attract foreign direct investments: a study of Western Asian countries and strategies of industrialization and diversification

Fuel is a self-depleting resource and long term dependency on this commodity alone will not suffice. An export trade oriented approach can lead to faster industrialization while diversification leads to economic sustainable growth. This research seeks to understand how countries compete for foreign direct investments, and how certain activities have the most impact in the competitive global marketplace. Research suggests that when companies decide to invest abroad, they seek only to find countries that facilitate their strategic objectives. The results conclude with appropriate levels of government accountability, credibility and visibility with the private sector, foreign direct investment is attracted by policy advocacy and policy reform. By reviewing countries such as United Arab Emirates in direct comparison to Western Asian countries, including Kuwait and Iraq with high levels of fuel exports, along with Qatar with optimistic marketplace indicators and plentitude of skills and capabilities – research seems to suggest that despite high capabilities and attractive GDP, promotional investment activities yield the highest returns using policy advocacy and reform.