Assessing an experimental approach to industrial policy evaluation:Applying RCT+ to the case of Creative Credits

Experimental methods of policy evaluation are well-established in social policy and development eco-nomics but are rare in industrial and innovation policy. In this paper, we consider the arguments forapplying experimental methods to industrial policy measures, and propose an experimental policy eval-uation approach (which we call RCT+). This approach combines the randomised assignment of firmsto treatment and control groups with a longitudinal data collection strategy incorporating quantitativeand qualitative data (so-called mixed methods). The RCT+ approach is designed to provide a causativerather than purely summative evaluation, i.e. to assess both ‘whether’ and ‘how’ programme outcomesare achieved. In this paper, we assess the RCT+ approach through an evaluation of Creative Credits – aUK business-to-business innovation voucher initiative intended to promote new innovation partnershipsbetween SMEs and creative service providers. The results suggest the potential value of the RCT+ approachto industrial policy evaluation, and the benefits of mixed methods and longitudinal data collection.

Evaluation and implementation process for commercial elevator landing doors

Tason ovet voivat olla joko itsesuunniteltuja ja -tehtyjä, tai itse malli ja tuote voidaan ostaa myös yrityksen ulkoa. Tätä make-or-buy kysymystä pohdittaessa ilmenee monta tekijää, jotka vaikuttavat päätökseen. Jos yritys käsittää ostamisen parempana vaihtoehtona, tuote tarvitsee myösimplementointisuunnitelman. Tämän työn päätavoite oli luoda arviointi- ja implementointiprosessi kaupallisille hissin tason oville. Muut tavoitteet olivat: selvittää syyt tälle erikoiselle toiminnolle, löytää kaupallisten ovien käyttöön liittyvät edut ja haitat, sekä luoda kriteerit tason ovien arvioinnille. Lopputuloksena saatiin, että tämän prosessin suorittajan pitää sitoutua arviointi- ja implementointiprosessiin,ja että myös virtuaalitehdas tarvitaan täydentämään arviointivaihetta. Mutta tärkein havainto oli, että tulevaisuuden ovistrategia ei ole vielä täysin päätetty ja siitä syystä yrityksen omat ovimallit pitäisi testata ja verrata niitä kaupallisiin ovimalleihin käyttämällä tämän työn arviointiprosessia.

Evaluation of Implementation of BSc IT Curriculum at Tumaini University

In Tanzania computer knowledge is vital to supplement the pace fast growing economic and development activities, which demands high and reliable level of expertise in com- puting field. In 2006, a research carried out at Tumaini University with purpose to design and implement a contextualized curriculum that can supplement for such needs hence facilitate development in Tanzanian context. A contextualized curriculum took advantage of six principles namely curriculum contex- tualization, projects, practical, interdisciplinary orientation, international recognition and continuous research for the program’s formative and development. Implementation of the curriculum followed the CATI (Contextualize, Apply, Transfer, and Import) model with emphasis on students to identify societal expectations at the early stage in learning process, in which case the graduates will potentially cater for societal expertise needs on ICT. This study adopts an emergent exploratory cross-section research design, while employ- ing a qualitative approach. This study was conducted at Tumaini University in Iringa where by purposeful sampling was used to obtain participants such as students, teach- ers, administrators and employers who participated in several focus group discussions, in-depth interviews and participant observation. The study reveals that six principles are satisfactorily met,despite of bottlenecks such as incompatibility in pedagogical thinking and technology availability for e-learning, learning attitudes, insufficient experts with actual skills and experience,in academic field among the others. The study recommends that iterative longitudinal study should be car- ried out to design for proper intervention in response to these problems which will help in improving and stabilize the curriculum.

Evaluation and implementation of a hybrid cross-platform application combining mobile web-technologies and native device functions

Este Proyecto de Fin de Carrera presenta un prototipo de aplicación móvil híbrida multi-plataforma para Android y iOS. Las aplicaciones móviles híbridas son una combinación de aplicaciones web móviles y aplicaciones móviles nativas. Se desarrollan parcialmente con tecnologías web y pueden acceder a la capa nativa y sensores del teléfono. Para el usuario se presentan como aplicaciones nativas, ya que se pueden descargar de las tiendas de aplicaciones y son instaladas en el dispositivo. El prototipo consiste en la migración del módulo de noticias financieras de las aplicaciones actuales para móviles de una compañía bancaria reimplementándolo como aplicación híbrida utilizando uno de los entornos de desarrollo disponibles en el mercado para este propósito. El desarrollo de aplicaciones híbridas puede ahorrar tiempo y dinero cuando se pretende alcanzar más de una plataforma móvil. El objetivo es la evaluación de las ventajas e inconvenientes que ofrece el desarrollo de aplicaciones híbridas en términos de reducción de costes, tiempo de desarrollo y resultado final de la aplicación. El proyecto consta de varias fases. Durante la primera fase se realiza un estudio sobre las aplicaciones híbridas que podemos encontrar hoy en día en el mercado utilizando los ejemplos de linkedIn, Facebook y Financial times. Se hace hincapié en las tecnologías utilizadas, uso de la red móvil y problemas encontrados. Posteriormente se realiza una comparación de distintos entornos de desarrollo multi-plataforma para aplicaciones híbridas en términos de la estrategia utilizada, plataformas soportadas, lenguajes de programación, acceso a capacidades nativas de los dispositivos y licencias de uso. Esta primera fase da como resultado la elección del entorno de desarrollo más adecuado a las exigencias del proyecto, que es PhoneGap, y continua con un análisis más detallado de dicho entorno en cuanto a su arquitectura, características y componentes. La siguiente fase comienza con un estudio de las aplicaciones actuales de la compañía para extraer el código fuente necesario y adaptarlo a la arquitectura que tendrá la aplicación. Para la realización del prototipo se hace uso de la característica que ofrece PhoneGap para acceder a la capa nativa del dispositivo, esto es, el uso de plugins. Se diseña y desarrolla un plugin que permite acceder a la capa nativa para cada plataforma. Una vez desarrollado el prototipo para la plataforma Android, se migra y adapta para la plataforma iOS. Por último se hace una evaluación de los prototipos en cuanto a su facilidad y tiempo de desarrollo, rendimiento, funcionalidad y apariencia de la interfaz de usuario. ABSTRACT. This bachelor's thesis presents a prototype of a hybrid cross-platform mobile application for Android and iOS. Hybrid mobile applications are a combination of mobile web and mobile native applications. They are built partially with web technologies and they can also access native features and sensors of the device. For a user, they look like native applications as they are downloaded from the application stores and installed on the device. This prototype consists of the migration of the financial news module of current mobile applications from a financial bank reimplementing them as a hybrid application using one of the frameworks available in the market for that purpose. Development of applications on a hybrid way can help reducing costs and effort when targeting more than one platform. The target of the project is the evaluation of the advantages and disadvantages that hybrid development can offer in terms of reducing costs and efforts and the final result of the application. The project starts with an analysis of successfully released hybrid applications using the examples of linkedIn, Facebook and Financial Times, emphasizing the different used technologies, the transmitted network data and the encountered problems during the development. This analysis is followed by a comparison of most popular hybrid crossplatform development frameworks in terms of the different approaches, supported platforms, programming languages, access to native features and license. This first stage has the outcome of finding the development framework that best fits to the requirements of the project, that is PhoneGap, and continues with a deeper analysis of its architecture, features and components. Next stage analyzes current company's applications to extract the needed source code and adapt it to the architecture of the prototype. For the realization of the application, the feature that PhoneGap offers to access the native layer of the device is used. This feature is called plugin. A custom plugin is designed and developed to access the native layer of each targeted platform. Once the prototype is finished for Android, it is migrated and adapted to the iOS platform. As a final conclusion the prototypes are evaluated in terms of ease and time of development, performance, functionality and look and feel.

GPs' perspectives on managing the NHS Health Check in primary care:a qualitative evaluation of implementation in one area of England

OBJECTIVES: To evaluate the implementation of the National Health Service (NHS) Health Check programme in one area of England from the perspective of general practitioners (GPs). DESIGN: A qualitative exploratory study was conducted with GPs and other healthcare professionals involved in delivering the NHS Health Check and with patients. This paper reports the experience of GPs and focuses on the management of the Heath Check programme in primary care. SETTING: Primary care surgeries in the Heart of Birmingham region (now under the auspices of the Birmingham Cross City Clinical Commissioning Group) were invited to take part in the larger scale evaluation. This study focuses on a subset of those surgeries whose GPs were willing to participate. PARTICIPANTS: 9 GPs from different practices volunteered. GPs served an ethnically diverse region with areas of socioeconomic deprivation. Ethnicities of participant GPs included South Asian, South Asian British, white, black British and Chinese. METHODS: Individual semistructured interviews were conducted with GPs face to face or via telephone. Thematic analysis was used to analyse verbatim transcripts. RESULTS: Themes were generated which represent GPs' experiences of managing the NHS Health Check: primary care as a commercial enterprise; 'buy in' to concordance in preventive healthcare; following protocol and support provision. These themes represent the key issues raised by GPs. They reveal variability in the implementation of NHS Health Checks. GPs also need support in allocating resources to the Health Check including training on how to conduct checks in a concordant (or collaborative) way. CONCLUSIONS: The variability observed in this small-scale evaluation corroborates existing findings suggesting a need for more standardisation. Further large-scale research is needed to determine how that could be achieved. Work needs to be done to further develop a concordant approach to lifestyle advice which involves tailored individual goal setting rather than a paternalistic advice-giving model.

Increasing the power of genome wide association studies in natural populations using repeated measures : evaluation and implementation

1. Genomewide association studies (GWAS) enable detailed dissections of the genetic basis for organisms' ability to adapt to a changing environment. In long-term studies of natural populations, individuals are often marked at one point in their life and then repeatedly recaptured. It is therefore essential that a method for GWAS includes the process of repeated sampling. In a GWAS, the effects of thousands of single-nucleotide polymorphisms (SNPs) need to be fitted and any model development is constrained by the computational requirements. A method is therefore required that can fit a highly hierarchical model and at the same time is computationally fast enough to be useful. 2. Our method fits fixed SNP effects in a linear mixed model that can include both random polygenic effects and permanent environmental effects. In this way, the model can correct for population structure and model repeated measures. The covariance structure of the linear mixed model is first estimated and subsequently used in a generalized least squares setting to fit the SNP effects. The method was evaluated in a simulation study based on observed genotypes from a long-term study of collared flycatchers in Sweden. 3. The method we present here was successful in estimating permanent environmental effects from simulated repeated measures data. Additionally, we found that especially for variable phenotypes having large variation between years, the repeated measurements model has a substantial increase in power compared to a model using average phenotypes as a response. 4. The method is available in the R package RepeatABEL. It increases the power in GWAS having repeated measures, especially for long-term studies of natural populations, and the R implementation is expected to facilitate modelling of longitudinal data for studies of both animal and human populations.

Utilising survey data to inform public policy: Comparison of the cost-effectiveness of treatment of ten mental disorders

Background Mental health survey data are now being used proactively to decide how the burden of disease might best be reduced. Aims To study the cost-effectiveness of current and optimal treatments for mental disorders and the proportion of burden avertable by each. Method Data for three affective, four anxiety and two alcohol use disorders and for schizophrenia were compared in terms of cost, burden averted and efficiency of current and optimal treatment. We then calculated the burden unavertable given current knowledge. The unit of health gain was a reduction in the years lived with disability (YLDs). Results Summing across all disorders, current treatment averted 13% of the burden, at an average cost of AUS$30 000 per YLD gained. Optimal treatment at current coverage could avert 20% of the burden, at an average cost of AUS$18 000 per YLD gained. Optimal treatment at optimal coverage could avert 28% of the burden, at AUS$16 000 per YLD gained. Sixty per cent of the burden of mental disorders was deemed to be unavertable. Conclusions The efficiency of treatment varied more than tenfold across disorders. Although coverage of some of the more efficient treatments should be extended, other factors justify continued use of less-efficient treatments for some disorders. Declaration of interest None. Funding detailed in Acknowledgements.

Bootstrap for panel data models with an application to the evaluation of public policies

Le but de cette thèse est d étendre la théorie du bootstrap aux modèles de données de panel. Les données de panel s obtiennent en observant plusieurs unités statistiques sur plusieurs périodes de temps. Leur double dimension individuelle et temporelle permet de contrôler l 'hétérogénéité non observable entre individus et entre les périodes de temps et donc de faire des études plus riches que les séries chronologiques ou les données en coupe instantanée. L 'avantage du bootstrap est de permettre d obtenir une inférence plus précise que celle avec la théorie asymptotique classique ou une inférence impossible en cas de paramètre de nuisance. La méthode consiste à tirer des échantillons aléatoires qui ressemblent le plus possible à l échantillon d analyse. L 'objet statitstique d intérêt est estimé sur chacun de ses échantillons aléatoires et on utilise l ensemble des valeurs estimées pour faire de l inférence. Il existe dans la littérature certaines application du bootstrap aux données de panels sans justi cation théorique rigoureuse ou sous de fortes hypothèses. Cette thèse propose une méthode de bootstrap plus appropriée aux données de panels. Les trois chapitres analysent sa validité et son application. Le premier chapitre postule un modèle simple avec un seul paramètre et s 'attaque aux propriétés théoriques de l estimateur de la moyenne. Nous montrons que le double rééchantillonnage que nous proposons et qui tient compte à la fois de la dimension individuelle et la dimension temporelle est valide avec ces modèles. Le rééchantillonnage seulement dans la dimension individuelle n est pas valide en présence d hétérogénéité temporelle. Le ré-échantillonnage dans la dimension temporelle n est pas valide en présence d'hétérogénéité individuelle. Le deuxième chapitre étend le précédent au modèle panel de régression. linéaire. Trois types de régresseurs sont considérés : les caractéristiques individuelles, les caractéristiques temporelles et les régresseurs qui évoluent dans le temps et par individu. En utilisant un modèle à erreurs composées doubles, l'estimateur des moindres carrés ordinaires et la méthode de bootstrap des résidus, on montre que le rééchantillonnage dans la seule dimension individuelle est valide pour l'inférence sur les coe¢ cients associés aux régresseurs qui changent uniquement par individu. Le rééchantillonnage dans la dimen- sion temporelle est valide seulement pour le sous vecteur des paramètres associés aux régresseurs qui évoluent uniquement dans le temps. Le double rééchantillonnage est quand à lui est valide pour faire de l inférence pour tout le vecteur des paramètres. Le troisième chapitre re-examine l exercice de l estimateur de différence en di¤érence de Bertrand, Duflo et Mullainathan (2004). Cet estimateur est couramment utilisé dans la littérature pour évaluer l impact de certaines poli- tiques publiques. L exercice empirique utilise des données de panel provenant du Current Population Survey sur le salaire des femmes dans les 50 états des Etats-Unis d Amérique de 1979 à 1999. Des variables de pseudo-interventions publiques au niveau des états sont générées et on s attend à ce que les tests arrivent à la conclusion qu il n y a pas d e¤et de ces politiques placebos sur le salaire des femmes. Bertrand, Du o et Mullainathan (2004) montre que la non-prise en compte de l hétérogénéité et de la dépendance temporelle entraîne d importantes distorsions de niveau de test lorsqu'on évalue l'impact de politiques publiques en utilisant des données de panel. Une des solutions préconisées est d utiliser la méthode de bootstrap. La méthode de double ré-échantillonnage développée dans cette thèse permet de corriger le problème de niveau de test et donc d'évaluer correctement l'impact des politiques publiques.

The interorganizational implementation of state health policy: A network approach

This is an implementation analysis of three consecutive state health policies whose goal was to improve access to maternal and child health services in Texas from 1983 to 1986. Of particular interest is the choice of the unit of analysis, the policy subsystem, and the network approach to analysis. The network approach analyzes and compares the structure and decision process of six policy subsystems in order to explain program performance. Both changes in state health policy as well as differences in implementation contexts explain evolution of the program administrative and service unit, the policy subsystem. And, in turn, the evolution of the policy subsystem explains changes in program performance. ^

The political economy of co-ordination challenges in the National Health Service: a postpositivist evaluation of diabetes policy and governance

The present PhD thesis develops and applies an evaluative methodology suited to the evaluation of policy and governance in complex policy areas. While extensive literatures exist on the topic of policy evaluation, governance evaluation has received less attention. At the level of governance, policymakers confront choices between different policy tools and governance arrangements in their attempts to solve policy problems, including variants of hierarchy, networks and markets. There is a need for theoretically-informed empirical research to inform decision-making at this level. To that end, the PhD develops an approach to evaluation by combining postpositivist policy analysis with heterodox political economy. Postpositivist policy analysis recognises that policy problems are often contested, that choices between policy options can involve significant trade-offs and that knowledge of policy options is itself dispersed and fragmented. Similarly, heterodox economics combines a concept of incommensurable values with an appreciation of the strengths and weaknesses of different institutional arrangements to realise them. A central concept of the field is coordination, which orientates policy analysis to the interactions of stakeholders in policy processes. The challenge of governance is to select the appropriate policy tools and arrangements which facilitate coordination. Via a postpositivist exploration of stakeholder ‘frames’, it is possible to ascertain whether coordination is occurring and to identify problems if it is not. Evaluative claims of governance can be made where arrangements can be shown to frustrate the realisation of shared values and objectives. The research makes a contribution to knowledge in a number of ways a) a distinctive evaluative approach that could be applied to other areas of health and public policy b) greater appreciation of the strengths and weaknesses of different forms of evidence in public policy and in particular health policy and c) concrete policy proposals for the governance and organisation of diabetes services, with implications for the NHS more broadly.

On the foundations of well-being economics and policy

When one wishes to implement public policies, there is a previous need of comparing different actions and valuating and evaluating them to assess their social attractiveness. Recently the concept of well-being has been proposed as a multidimensional proxy for measuring societal prosperity and progress; a key research topic is then on how we can measure and evaluate this plurality of dimensions for policy decisions. This paper defends the thesis articulated in the following points: 1. Different metrics are linked to different objectives and values. To use only one measurement unit (on the grounds of the so-called commensurability principle) for incorporating a plurality of dimensions, objectives and values, implies reductionism necessarily. 2. Point 1) can be proven as a matter of formal logic by drawing on the work of Geach about moral philosophy. This theoretical demonstration is an original contribution of this article. Here the distinction between predicative and attributive adjectives is formalised and definitions are provided. Predicative adjectives are further distinguished into absolute and relative ones. The new concepts of set commensurability and rod commensurability are introduced too. 3. The existence of a plurality of social actors, with interest in the policy being assessed, causes that social decisions involve multiple types of values, of which economic efficiency is only one. Therefore it is misleading to make social decisions based only on that one value. 4. Weak comparability of values, which is grounded on incommensurability, is proved to be the main methodological foundation of policy evaluation in the framework of well-being economics. Incommensurability does not imply incomparability; on the contrary incommensurability is the only rational way to compare societal options under a plurality of policy objectives. 5. Weak comparability can be implemented by using multi-criteria evaluation, which is a formal framework for applied consequentialism under incommensurability. Social Multi-Criteria Evaluation, in particular, allows considering both technical and social incommensurabilities simultaneously.