Performance assessment and league tables. Comparing like with like.

We formulate performance assessment as a problem of causal analysis and outline an approach based on the missing data principle for its solution. It is particularly relevant in the context of so-called league tables for educational, health-care and other public-service institutions. The proposed solution avoids comparisons of institutions that have substantially different clientele (intake).

Performance assessment and league tables. Comparing like with like

We formulate performance assessment as a problem of causal analysis and outline an approach based on the missing data principle for its solution. It is particularly relevant in the context of so-called league tables for educational, health-care and other public-service institutions. The proposed solution avoids comparisons of institutions that have substantially different clientele (intake).

Fiscal insurance and debt management in OECD economies

Assuming the role of debt management is to provide hedging against fiscal shocks we consider three questions: i) what indicators can be used to assess the performance of debt management? ii) how well have historical debt management policies performed? and iii) how is that performance affected by variations in debt issuance? We consider these questions using OECD data on the market value of government debt between 1970 and 2000. Motivated by both the optimal taxation literature and broad considerations of debt stability we propose a range of performance indicators for debt management. We evaluate these using Monte Carlo analysis and find that those based on the relative persistence of debt perform best. Calculating these measures for OECD data provides only limited evidence that debt management has helped insulate policy against unexpected fiscal shocks. We also find that the degree of fiscal insurance achieved is not well connected to cross country variations in debt issuance patterns. Given the limited volatility observed in the yield curve the relatively small dispersion of debt management practices across countries makes little difference to the realised degree of fiscal insurance.

Assessing the assignation of public subsidies: Do the experts choose the most efficient R&D projects?

The implementation of public programs to support business R&D projects requires the establishment of a selection process. This selection process faces various difficulties, which include the measurement of the impact of the R&D projects as well as selection process optimization among projects with multiple, and sometimes incomparable, performance indicators. To this end, public agencies generally use the peer review method, which, while presenting some advantages, also demonstrates significant drawbacks. Private firms, on the other hand, tend toward more quantitative methods, such as Data Envelopment Analysis (DEA), in their pursuit of R&D investment optimization. In this paper, the performance of a public agency peer review method of project selection is compared with an alternative DEA method.

Anàlisi cronològica de la pesca al Port de Llançà: període 1977-1996

A partir del buidatge exhaustiu dels fulls de subhasta del peix i de les fitxes tècniques de les embarcacions de la Confraria del Port de Llançà, es fa una anàlisi cronològica qualitativa i quantitativa dels darrers vint anys de pesca. La flota, inicialment constituïda per barques d'arrossegament i de pesca artesanal (palangre petit i tresmail), ha anat evolucionant, i ha quedat bàsicament constituïda actualment pel ròssec i el palangre de fons, que ha substituit progressivament la pesca artesanal. Les pesqueries, notablement multiespecífiques els primers anys, van donar pas, bàsicament amb la incorporació del radar, a una pesca molt més selectiva, dominada essencialment per la captura de lluç entre els anys 1980 i 1985. La progressiva incorporació del palangre de fons fa que a partir del 1986 es tendeixi novament cap a una captura més multiespecífica, perd amb canvis qualitatius importants en la composició d'espècies capturades en relació amb els primers anys

Assessing the assignation of public subsidies: Do the experts choose the most efficient R and D projects?

[spa] La implementación de un programa de subvenciones públicas a proyectos empresariales de I+D comporta establecer un sistema de selección de proyectos. Esta selección se enfrenta a problemas relevantes, como son la medición del posible rendimiento de los proyectos de I+D y la optimización del proceso de selección entre proyectos con múltiples y a veces incomparables medidas de resultados. Las agencias públicas utilizan mayoritariamente el método peer review que, aunque presenta ventajas, no está exento de críticas. En cambio, las empresas privadas con el objetivo de optimizar su inversión en I+D utilizan métodos más cuantitativos, como el Data Envelopment Análisis (DEA). En este trabajo se compara la actuación de los evaluadores de una agencia pública (peer review) con una metodología alternativa de selección de proyectos como es el DEA.

Assessing the assignation of public subsidies: Do the experts choose the most efficient R and D projects?

[spa] La implementación de un programa de subvenciones públicas a proyectos empresariales de I+D comporta establecer un sistema de selección de proyectos. Esta selección se enfrenta a problemas relevantes, como son la medición del posible rendimiento de los proyectos de I+D y la optimización del proceso de selección entre proyectos con múltiples y a veces incomparables medidas de resultados. Las agencias públicas utilizan mayoritariamente el método peer review que, aunque presenta ventajas, no está exento de críticas. En cambio, las empresas privadas con el objetivo de optimizar su inversión en I+D utilizan métodos más cuantitativos, como el Data Envelopment Análisis (DEA). En este trabajo se compara la actuación de los evaluadores de una agencia pública (peer review) con una metodología alternativa de selección de proyectos como es el DEA.

Assessing the assignation of public subsidies: Do the experts choose the most efficient R and D projects?

[spa] La implementación de un programa de subvenciones públicas a proyectos empresariales de I+D comporta establecer un sistema de selección de proyectos. Esta selección se enfrenta a problemas relevantes, como son la medición del posible rendimiento de los proyectos de I+D y la optimización del proceso de selección entre proyectos con múltiples y a veces incomparables medidas de resultados. Las agencias públicas utilizan mayoritariamente el método peer review que, aunque presenta ventajas, no está exento de críticas. En cambio, las empresas privadas con el objetivo de optimizar su inversión en I+D utilizan métodos más cuantitativos, como el Data Envelopment Análisis (DEA). En este trabajo se compara la actuación de los evaluadores de una agencia pública (peer review) con una metodología alternativa de selección de proyectos como es el DEA.

The missing link in key sectors analysis

In general terms key sectors analysis aims at identifying the role, or impact, that the existence of a productive sector has in the economy. Quite a few measures, indicators and methodologies of varied complexity have been proposed in the literature, from multiplier sums to extraction methods, but not without debate about their properties and their information content. All of them, to our knowledge, focus exclusively on the interdependence effects that result from the input-output structure of the economy. By so doing the simple input-output approach misses critical links beyond the interindustry ones. A productive sector’s role is that of producing but also that of generating and distributing income among primary factors as a result of production. Thus when measuring a sector’s role, the income generating process cannot and should not be omitted if we want to better elucidate the sector’ economic role. A simple way to make the missing income link explicit is to use the SAM (Soci

Organisational status and efficiency: the case of the spanish SOE "Paradores"

The purpose of this paper is to provide new evidence on the issue of the effect on public enterprises economic performance of the introduction of some given changes in organisational status and management practices, while keeping the enterprises under public control. Our approach is case study type and relies on comparative efficiency literature. We identify relevant changes on the organisational status of a State owned large hotel group along a period of twenty years, next we measure its annual efficiency indicators, and then evaluate to which extent the observed changes in economic performance can be attributable to the corresponding management reforms carried out. As a result we find that the formally more relevant change in organisational status (the enterprise passing to be a Limited Company), which implied a substantial increase in the enterprise autonomy, did not produce a significant improvement in its economic performance; a finding contrary to what we expected according to agency theory. However, a second relevant organisational change –five years later- when both the principal (government) and the agent (firm’s CEO) changed is consistently related to a significant improvement in economic performance. As a research implication we abide for use more precise agency theory statements; and as a practical implication we argue here that potentialities of improvement brought about by a formal-legal change in the status of the enterprise may require also –in order to actually improve firm’s efficiency- some changes in the firm’s key personal positions: supervisor (principal) and CEO (agent), in the sense that a change to a greater-autonomy for the enterprise it seems should come together a parallel new ‘management culture’. Practical implications Management good practises to apply to other public enterprise’s restructuring in order to improve their efficiency. It’s the first study on organizational changes and efficiency for an important Spanish public enterprise.

Trends in economic research: an international perspective

Given the recent efforts in several countries to reorganize the research institutional setting to improve research productivity, our analysis addresses the following questions: To which extent has the recent awareness over international quality standards in economics around the world been reflected in research performance? How have individual countries fared? Do research quantity and quality indicators tell us the same story? We concentrate on trends taking place since the beginning of the 1990s and rely on a very comprehensive database of scientific journals, to provide a cross-country comparison of the evolution of research in economics. Our findings indicate that Europe is catching-up with the US but, in terms of influential research, the US maintains a dominant position. The main continental European countries, Germany, France, Italy and Spain, experienced some of the largest growth rates in economic scientific output. Other European countries, namely the UK, Norway, the Netherlands, Denmark, and Sweden, have shown remarkable progress in per capita output. Collaborative research seems to be a key factor explaining the relative success of some European countries, in particular when it comes to publishing in top journals, attained predominantly through international collaborations.

Integrated assessment of agricultural sustainability: the pros and cons of reductionism

In this paper I review a series of theoretical concepts that are relevant for the integrated assessment of agricultural sustainability but that are not generally included in the curriculum of the various scientific disciplines dealing with quantitative analysis of agriculture. I first illustrate with plain narratives and concrete examples that sustainability is an extremely complex issue requiring the simultaneous consideration of several aspects, which cannot be reduced into a single indicator of performance. Following, I justify this obvious need for multi-criteria analysis with theoretical concepts dealing with the epistemological predicament of complexity, starting from classic philosophical lessons to arrive to recent developments in complex system theory, in particular Rosen´s theory of modelling relation which is essential to analyze the quality of any quantitative representation. The implications of these theoretical concepts are then illustrated with applications of multi-criteria analysis to the sustainability of agriculture. I wrap up by pointing out the crucial difference between "integrated assessment" and "integrated analysis". An integrated analysis is a set of indicators and analytical models generating an analytical output. An integrated assessment is much more than that. It is about finding an effective way to deal with three key issues: (i) legitimacy – how to handle the unavoidable existence of legitimate but contrasting points of view about different meanings given by social actors to the word "development"; (ii) pertinence – how to handle in a coherent way scientific analyses referring to different scales and dimensions; and (iii) credibility – how to handle the unavoidable existence of uncertainty and genuine ignorance, when dealing with the analysis of future scenarios.

Social network measures for "nosduocentered" networks, their predictive power on performance

Our purpose in this article is to define a network structure which is based on two egos instead of the egocentered (one ego) or the complete network (n egos). We describe the characteristics and properties for this kind of network which we call “nosduocentered network”, comparing it with complete and egocentered networks. The key point for this kind of network is that relations exist between the two main egos and all alters, but relations among others are not observed. After that, we use new social network measures adapted to the nosduocentered network, some of which are based on measures for complete networks such as degree, betweenness, closeness centrality or density, while some others are tailormade for nosduocentered networks. We specify three regression models to predict research performance of PhD students based on these social network measures for different networks such as advice, collaboration, emotional support and trust. Data used are from Slovenian PhD students and their s

Networks of PhD Students and Academic Performance: A Comparison across Countries

In this article we compare regression models obtained to predict PhD students’ academic performance in the universities of Girona (Spain) and Slovenia. Explanatory variables are characteristics of PhD student’s research group understood as an egocentered social network, background and attitudinal characteristics of the PhD students and some characteristics of the supervisors. Academic performance was measured by the weighted number of publications. Two web questionnaires were designed, one for PhD students and one for their supervisors and other research group members. Most of the variables were easily comparable across universities due to the careful translation procedure and pre-tests. When direct comparison was notpossible we created comparable indicators. We used a regression model in which the country was introduced as a dummy coded variable including all possible interaction effects. The optimal transformations of the main and interaction variables are discussed. Some differences between Slovenian and Girona universities emerge. Some variables like supervisor’s performance and motivation for autonomy prior to starting the PhD have the same positive effect on the PhD student’s performance in both countries. On the other hand, variables like too close supervision by the supervisor and having children have a negative influence in both countries. However, we find differences between countries when we observe the motivation for research prior to starting the PhD which increases performance in Slovenia but not in Girona. As regards network variables, frequency of supervisor advice increases performance in Slovenia and decreases it in Girona. The negative effect in Girona could be explained by the fact that additional contacts of the PhD student with his/her supervisor might indicate a higher workload in addition to or instead of a better advice about the dissertation. The number of external student’s advice relationships and social support mean contact intensity are not significant in Girona, but they have a negative effect in Slovenia. We might explain the negative effect of external advice relationships in Slovenia by saying that a lot of external advice may actually result from a lack of the more relevant internal advice

Comprehensive evaluation of the IEEE 802.15.4 MAC layer performance with retransmissions

Supported by IEEE 802.15.4 standardization activities, embedded networks have been gaining popularity in recent years. The focus of this paper is to quantify the behavior of key networking metrics of IEEE 802.15.4 beacon-enabled nodes under typical operating conditions, with the inclusion of packet retransmissions. We corrected and extended previous analyses by scrutinizing the assumptions on which the prevalent Markovian modeling is generally based. By means of a comparative study, we singled out which of the assumptions impact each of the performance metrics (throughput, delay, power consumption, collision probability, and packet-discard probability). In particular, we showed that - unlike what is usually assumed - the probability that a node senses the channel busy is not constant for all the stages of the backoff procedure and that these differences have a noticeable impact on backoff delay, packet-discard probability, and power consumption. Similarly, we showed that - again contrary to common assumption - the probability of obtaining transmission access to the channel depends on the number of nodes that is simultaneously sensing it. We evidenced that ignoring this dependence has a significant impact on the calculated values of throughput and collision probability. Circumventing these and other assumptions, we rigorously characterize, through a semianalytical approach, the key metrics in a beacon-enabled IEEE 802.15.4 system with retransmissions.