Evaluation of portuguese public administration - institutions, managers and workers

Apresentação realizada a uma delegação da Administração pública da Bulgária, que visitou o INA em 2 de Dezembro de 2008.

Evaluation of a volunteered geographical information trust measure in the case of OpenStreetMap

Dissertation submitted in partial fulfillment of the requirements for the Degree of Master of Science in Geospatial Technologies.

How Heavy Is A Job?: A Critical Survey of Job Evaluation as a Payment Device.

With salaries subjected to scrutiny more than ever, it is increasingly important that the process by which they are determined be understood and justifiable. Both public and private organisations now routinely rely on so-called “job evaluation” as a means of constructing an appropriate pay-scale and as such it is ever more necessary that we appreciate how this system works and that we recognise its limits. Only with such an understanding of the way in which salaries are set can we hope to have a meaningful discussion of their economic function. This paper aims to expound the details of job evaluation both in theory and in practice, and critically assess its shortcomings. In Section 1 below we describe the job evaluation system and in Section 2 we briefly outline the history and the usage of the system in both the private and the public sector. In Section 3 we theoretically analyse the often unstated but nonetheless implicit assumptions made by practitioners of the art of job evaluation. Section 4 applies the analysis of Section 3 to review a particular and important case study, namely The Senior Salaries Review of the Welsh Assembly 2004. Section 5 concludes.

ASIST suicide prevention training - all-island evaluation report

The findings of a Public Health Agency evaluation report on a suicide prevention training programme were today presented at the North South Ministerial Council Health Sector meeting.ASIST, The Applied Suicide Intervention Skills Training programme, has to date been delivered to more than 20,000 people in the Republic of Ireland and more than 11,000 people in Northern Ireland. This two day course, delivered by a wide range of organisations including those from the voluntary/community sector, for professionals and the public helps individuals provide emergency help to people at risk of suicidal behaviour. It also develops a cooperative network among participants, since often many people have to work together to prevent suicide.Talking about the findings of this work, Dr Eddie Rooney, Chief Executive, PHA, said: "Both the PHA and the National Office for Suicide Prevention (NOSP), based in the Republic of Ireland, are concerned for any loss of life through suicide and we send our condolences to all families who have been bereaved. We know ASIST training brings a positive element to suicide prevention. Those who have been trained said that the two biggest advantages are that they know when, how and have the confidence to help people who are under pressure and that it helps to build positive links between community and voluntary organisations and the health service. I am pleased that this has been borne out in the evaluation and we hope ASIST will continue to be of enormous benefit and will contribute to a reduction in suicidal behaviour and the tragedy that this brings to our community".This evaluation found that within organisations where staff had participated in ASIST training, there were improvements in service development; staff attitudes, confidence and skills in relation to suicide and suicide intervention and in policies and procedures. At a community level, ASIST was found to have contributed to a sense of empowerment through an increased confidence in being able to deal with suicide and suicidal behaviour.The report also shows that the ASIST model offers a common language, helping communication between the community or voluntary organisations and those from a health background. In fact this training helped to cancel out any differences between those with mental health qualifications and those without, in terms of knowledge, skills, attitude and willingness to intervene. The study also confirmed that ASIST training was most relevant to those who were likely to be in contact with a person 'at risk'.In welcoming the publication of the report Geoff Day, Director of the NOSP, said: "This report is an independent evaluation of the ASIST programme, it has allowed us to demonstrate the effectiveness of the programme in increasing community participants confidence and ability to respond to individuals in suicidal crisis.He added: "The fact the evaluation was completed on an all-island basis allows the NOSP and the PHA to avoid duplication of resources, improve coordination of suicide prevention training programmes across both jurisdictions and allows us to learn from different approaches used in suicide prevention across the island of Ireland."He reiterated the Health Service Executive commitment to the continued implementation of quality assured training programmes as part of Reach out: the National Strategy for Action on Suicide Prevention.ASIST training is being rolled out in Northern Ireland as part of the implementation of the 'Protect Life' suicide prevention strategy, which was published by the Department of Health, Social Services and Public Safety in 2006.A copy of the evaluation report can be found below and in the publications section of this website, by clicking here

Evaluation of an e-learning course: coercion practices in psychiatric nursing

The goal of the study was to evaluate an e-learning course entitled “Nursing interventions to manage distressed and disturbed patients” and intended for psychiatric nurses, using Kirkpatrick’s evaluation model. The aim was to describe nurses’ reactions, learning, behaviour change and impacts resulting from this e-learning course. This dissertation comprises four papers, and the data were collected 2008-2012 from three different sources; electronic databases, an e-learning platform and psychiatric hospitals. First, a systematic literature review was conducted to understand the effectiveness of e-learning. Second, an RCT study was implemented to investigate the impact of the e-learning course on nurses’ job-satisfaction, knowledge and attitudes (N=158). Third, to complete the picture of nurses views of the e-learning course related to knowledge transfer, the nurses’ perspective was studied (N=33). Lastly, the effects of the e-learning course from nursing managers’ perspective in psychiatric hospital organisations were studied (N=28). The systematic review showed that although the nurses were satisfied with the e-learning, no effects were found in the RCT study of nurses’ job satisfaction. The RCT study showed no effects on nurses’ learning related to knowledge increase, but there was change in attitudes. The managers described the changes in the nurses’ knowledge and attitudes. Among the nurses behaviour changed with knowledge transfer from the e-learning course to practice and they pointed out development issues related to their work. The final impacts of the e-learning course revealed advantages and disadvantages of the e-learning course and its implications for nurses’ work. This dissertation provides new insight into nurses’ reactions, learning, behaviour change and impacts resulting from an e-learning course in their continuing education. In order to improve nurses’ continuing education systematic evaluation is needed, for which Kirkpatrick’s evaluation model is a useful tool.

Le rôle de l’évaluation économique dans la pratique des médecins de famille = The role of economic evaluation in the practice of family physicians

L’évaluation économique en santé consiste en l’analyse comparative d’alternatives de services en regard à la fois de leurs coûts et de leurs conséquences. Elle est un outil d’aide à la décision. La grande majorité des décisions concernant l’allocation des ressources sont prises en clinique; particulièrement au niveau des soins primaires. Puisque chaque décision est associée à un coût d’opportunité, la non-prise en compte des considérations économiques dans les pratiques des médecins de famille peut avoir un impact important sur l’efficience du système de santé. Il existe peu de connaissances quant à l’influence des évaluations économiques sur la pratique clinique. L’objet de la thèse est de comprendre le rôle de l’évaluation économique dans la pratique des médecins de famille. Ses contributions font l’objet de quatre articles originaux (philosophique, théorique, méthodologique et empirique). L’article philosophique suggère l’importance des questions de complexité et de réflexivité en évaluation économique. La complexité est la perspective philosophique, (approche générale épistémologique) qui sous-tend la thèse. Cette vision du monde met l’attention sur l’explication et la compréhension et sur les relations et les interactions (causalité interactive). Cet accent sur le contexte et le processus de production des données souligne l’importance de la réflexivité dans le processus de recherche. L’article théorique développe une conception nouvelle et différente du problème de recherche. L’originalité de la thèse réside également dans son approche qui s’appuie sur la perspective de la théorie sociologique de Pierre Bourdieu; une approche théorique cohérente avec la complexité. Opposé aux modèles individualistes de l’action rationnelle, Bourdieu préconise une approche sociologique qui s’inscrit dans la recherche d’une compréhension plus complète et plus complexe des phénomènes sociaux en mettant en lumière les influences souvent implicites qui viennent chaque jour exercer des pressions sur les individus et leurs pratiques. L’article méthodologique présente le protocole d’une étude qualitative de cas multiples avec niveaux d’analyse imbriqués : les médecins de famille (niveau micro-individuel) et le champ de la médecine familiale (niveau macro-structurel). Huit études de cas furent réalisées avec le médecin de famille comme unité principale d’analyse. Pour le niveau micro, la collecte des informations fut réalisée à l’aide d’entrevues de type histoire de vie, de documents et d’observation. Pour le niveau macro, la collecte des informations fut réalisée à l’aide de documents, et d’entrevues de type semi-structuré auprès de huit informateurs clés, de neuf organisations médicales. L’induction analytique fut utilisée. L’article empirique présente l’ensemble des résultats empiriques de la thèse. Les résultats montrent une intégration croissante de concepts en économie dans le discours officiel des organisations de médecine familiale. Cependant, au niveau de la pratique, l'économisation de ce discours ne semble pas être une représentation fidèle de la réalité puisque la très grande majorité des participants n'incarnent pas ce discours. Les contributions incluent une compréhension approfondie des processus sociaux qui influencent les schèmes de perception, de pensée, d’appréciation et d’action des médecins de famille quant au rôle de l’évaluation économique dans la pratique clinique et la volonté des médecins de famille à contribuer à une allocation efficiente, équitable et légitime des ressources.

Le code d'éthique dans les organisations du réseau de la santé: outil de régulation des conduites?

Au Québec, la Loi sur les services de santé et les services sociaux, Chapitre S-4.2, à son article 233, demande à ce que chacun des établissements de santé, dispose d’un code d’éthique qui essentiellement demande de préciser les droits des usagers et de fixer les conduites attendues du personnel. Le législateur souhaitait améliorer les conduites du personnel dès le début des années 1990 et envisageait désigner un organisme de surveillance pour s’en assurer. Cette contrainte ne fut pas retenue et 20 ans plus tard, la volonté d’assurer des conduites attendues n’est toujours pas assujettie de contraintes ou de contrôles même si elle est toujours souhaitée. En 2003 toutefois, le Ministre a mis en place un processus de visites ministérielles dans les milieux d’hébergement et à ce jour quelques 150 établissements ont été visités. Ces équipes se sont préoccupées entre autre de la fonction du code d’éthique pour soutenir les directions de ces établissements. Elles ne réussissent pas à pouvoir s’appuyer sur le code d’éthique pour qu’il soit l’assise pour baser les décisions cliniques, organisationnelles et de gestion de chacune des organisations du réseau de la santé et des services sociaux du Québec. Il faut à ce moment-ci faire le constat que le code d’éthique, obligatoire, figure au nombre des nombreuses contraintes rencontrées par les organisations. Les établissements doivent passer un processus d’agrément aux trois ans et le code d’éthique n’est pas davantage un élément dynamique retenu à ce processus de validation de normes de qualité. De plus, une revue québécoise spécialisée en gestion de la santé a consacré un numéro complet de 15 articles sur « éthique et comportements » et le code d’éthique y est absent sauf pour deux articles qui s’y attardent spécifiquement. Est-ce une question d’éthique dont il est question par ce code, ou si ce n’est pas davantage de la déontologie, d’autant que le législateur veut avant tout s’assurer de comportements adéquats de la part des employés et des autres personnes qui exercent leur profession. Est-ce qu’un code de conduite ne serait pas plus approprié pour atteindre les fins visées? Cette question est répondue dans ce mémoire qui regarde les concepts d’éthique, de déontologie, de codes, de régulation des comportements. De plus, des analyses détaillées de 35 codes d’éthique actuels de divers établissements et de diverses régions du Québec iv sont présentées. La littérature nous donne les conditions de réussite pour un code et outre l’importance à accorder aux valeurs énoncées dans l’organisation, il est également question des sanctions à prévoir au non-respect de ces valeurs. Elles se doivent d’être claires et appliquées. Enfin, beaucoup d’organisations parlent maintenant de code de conduite et ce terme serait tout à fait approprié pour rejoindre le souhait du législateur qui veut assurer des conduites irréprochables des employés et autres personnes qui y travaillent. C’est la conclusion de ce travail, énoncée sous forme de recommandation.

Uptake pathways: the potential of Bayesian belief networks to assist the management, monitoring and evaluation of development-orientated research

The effectiveness of development assistance has come under renewed scrutiny in recent years. In an era of growing economic liberalisation, research organisations are increasingly being asked to account for the use of public funds by demonstrating achievements. However, in the natural resources (NR) research field, conventional economic assessment techniques have focused on quantifying the impact achieved rather understanding the process that delivered it. As a result, they provide limited guidance for planners and researchers charged with selecting and implementing future research. In response, “pathways” or logic models have attracted increased interest in recent years as a remedy to this shortcoming. However, as commonly applied these suffer from two key limitations in their ability to incorporate risk and assess variance from plan. The paper reports the results of a case study that used a Bayesian belief network approach to address these limitations and outlines its potential value as a tool to assist the planning, monitoring and evaluation of development-orientated research.

High value information in engineering organisations

The management of information in engineering organisations is facing a particular challenge in the ever-increasing volume of information. It has been recognised that an effective methodology is required to evaluate information in order to avoid information overload and to retain the right information for reuse. By using, as a starting point, a number of the current tools and techniques which attempt to obtain ‘the value’ of information, it is proposed that an assessment or filter mechanism for information is needed to be developed. This paper addresses this issue firstly by briefly reviewing the information overload problem, the definition of value, and related research work on the value of information in various areas. Then a “characteristic” based framework of information evaluation is introduced using the key characteristics identified from related work as an example. A Bayesian Network diagram method is introduced to the framework to build the linkage between the characteristics and information value in order to quantitatively calculate the quality and value of information. The training and verification process for the model is then described using 60 real engineering documents as a sample. The model gives a reasonable accurate result and the differences between the model calculation and training judgements are summarised as the potential causes are discussed. Finally, several further issues including the challenge of the framework and the implementations of this evaluation assessment method are raised.

Codification vs personalisation: A study of the information evaluation practice between aerospace and construction industries

In the emerging digital economy, the management of information in aerospace and construction organisations is facing a particular challenge due to the ever-increasing volume of information and the extensive use of information and communication technologies (ICTs). This paper addresses the problems of information overload and the value of information in both industries by providing some cross-disciplinary insights. In particular it identifies major issues and challenges in the current information evaluation practice in these two industries. Interviews were conducted to get a spectrum of industrial perspectives (director/strategic, project management and ICT/document management) on these issues in particular to information storage and retrieval strategies and the contrasting approaches to knowledge and information management of personalisation and codification. Industry feedback was collected by a follow-up workshop to strengthen the findings of the research. An information-handling agenda is outlined for the development of a future Information Evaluation Methodology (IEM) which could facilitate the practice of the codification of high-value information in order to support through-life knowledge and information management (K&IM) practice.

Value management and post-occupancy evaluation: closing the loop

This paper considers the relationship between value management and facilities management. The findings are particularly relevant to large client organisations which procure new buildings on a regular basis. It is argued that the maximum effectiveness of value management can only be achieved if it is used in conjunction with an ongoing commitment to post-occupancy evaluation. SMART value management is seen to provide the means of ensuring that an individual building design is in alignment with the client’s strategic property needs. However, it is also necessary to recognise that an organisation’s strategic property needs will continually be in a state of change. Consequentially, economic and functional under-performance can only be avoided by a regular performance audit of existing property stock in accordance with changing requirements. Such a policy will ensure ongoing competitiveness through organisational learning. While post-occupancy evaluation represents an obvious additional service to be provided by value management consultants, it is vital that the necessary additional skills are acquired. Process management skills and social science research techniques are clearly important. However, there is also a need to improve mechanisms for data manipulation. Success can only be achieved if equal attention is given to issues of process, structure and content.