An Objective Framework to Test the Quality of Candidate Indicators of Good Environmental Status

Large efforts are on-going within the EU to prepare the Marine Strategy Framework Directive’s (MSFD) assessment of the environmental status of the European seas. This assessment will only be as good as the indicators chosen to monitor the eleven descriptors of good environmental status (GEnS). An objective and transparent framework to determine whether chosen indicators actually support the aims of this policy is, however, not yet in place. Such frameworks are needed to ensure that the limited resources available to this assessment optimize the likelihood of achieving GEnS within collaborating states. Here, we developed a hypothesis-based protocol to evaluate whether candidate indicators meet quality criteria explicit to the MSFD, which the assessment community aspires to. Eight quality criteria are distilled from existing initiatives, and a testing and scoring protocol for each of them is presented. We exemplify its application in three worked examples, covering indicators for three GEnS descriptors (1, 5 and 6), various habitat components (seaweeds, seagrasses, benthic macrofauna and plankton), and assessment regions (Danish, Lithuanian and UK waters). We argue that this framework provides a necessary, transparent and standardized structure to support the comparison of candidate indicators, and the decision-making process leading to indicator selection. Its application could help identify potential limitations in currently available candidate metrics and, in such cases, help focus the development of more adequate indicators. Use of such standardized approaches will facilitate the sharing of knowledge gained across the MSFD parties despite context-specificity across assessment regions, and support the evidence-based management of European seas.

An Objective Framework to Test the Quality of Candidate Indicators of Good Environmental Status

Large efforts are on-going within the EU to prepare the Marine Strategy Framework Directive’s (MSFD) assessment of the environmental status of the European seas. This assessment will only be as good as the indicators chosen to monitor the eleven descriptors of good environmental status (GEnS). An objective and transparent framework to determine whether chosen indicators actually support the aims of this policy is, however, not yet in place. Such frameworks are needed to ensure that the limited resources available to this assessment optimize the likelihood of achieving GEnS within collaborating states. Here, we developed a hypothesis-based protocol to evaluate whether candidate indicators meet quality criteria explicit to the MSFD, which the assessment community aspires to. Eight quality criteria are distilled from existing initiatives, and a testing and scoring protocol for each of them is presented. We exemplify its application in three worked examples, covering indicators for three GEnS descriptors (1, 5 and 6), various habitat components (seaweeds, seagrasses, benthic macrofauna and plankton), and assessment regions (Danish, Lithuanian and UK waters). We argue that this framework provides a necessary, transparent and standardized structure to support the comparison of candidate indicators, and the decision-making process leading to indicator selection. Its application could help identify potential limitations in currently available candidate metrics and, in such cases, help focus the development of more adequate indicators. Use of such standardized approaches will facilitate the sharing of knowledge gained across the MSFD parties despite context-specificity across assessment regions, and support the evidence-based management of European seas.

Building public policy on shifting sands: the case of the National Asset Management Agency

Over the last thirty years, there has been an increased demand for better management of public sector organisations (PSOs). This requires that they are answerable for the inputs that they are given but also for what they achieve with these inputs (Hood 1991; Hood 1995). It is suggested that this will improve the management of the organisation through better planning and control, and the achievement of greater accountability (Smith 1995). However, such a rational approach with clear goals and the means to measure achievement can cause difficulties for many PSOs. These difficulties include the distinctive nature of the public sector due to the political environment within which the public sector manager operates (Stewart and Walsh 1992) and the fact that PSOs will have many stakeholders, each of whom will have their own specific objectives based on their own perspective (Boyle 1995). This can
result in goal ambiguity which means that there is leeway in interpreting the results of the PSO. The National Asset Management Agency (NAMA) was set up to bring stability to the financial system by buying loans from the banks (which were in most cases, non-performing loans). The intention was to cleanse the banks of these loans so that they could return to their normal business of taking deposits and making loans. However, the legislation, also gave NAMA a wide range of other responsibilities including responsibility for facilitating credit in the economy and protecting the interests of taxpayers. In more recent times, NAMA has been given responsibility for building social housing. This wide-range of activities is a clear example of a PSO being given multiple goals which may conflict and is therefore likely to lead to goal ambiguity. This makes it very difficult to evaluate NAMA’s performance as they are attempting to meet numerous goals at the same time and also highlights the complexity of policy making in the public sector. The purpose of this paper is to examine how NAMA dealt with goal ambiguity. This will be done through a thematic analysis of its annual reports over the last five years. The paper’s will contribute to the ongoing debate about the evaluation of PSOs and the complex environment within which they operate which makes evaluation difficult as they are
answerable to multiple stakeholders who have different objectives and different criteria for measuring success.

A change in behaviour — getting the balance right for research and policy.

Behaviour change interventions offer clinical pharmacists many opportunities to optimise the use of medicines. ‘MINDSPACE’ is a framework used by a Government-affiliated organisation in the United Kingdom to communicate an approach to changing behaviour through policy. The Theoretical Domains Framework (TDF) organises constructs of psychological theories that are most relevant to behaviour change into 14 domains. Both frameworks offer a way of identifying what drives a change in behaviour, providing a target for an intervention. This article aims to compare and contrast MINDSPACE and the TDF, and serves to inform pharmacy practitioners about the potential strengths and weaknesses of using either framework in a clinical pharmacy context. It appears that neither framework can deliver evidence-based interventions that can be developed and implemented with the pace demanded by policy and practice-based settings. A collaborative approach would ensure timely development of acceptable behaviour change interventions that are grounded in evidence.

Staff training in autism: The one-eyed wo/man….

Having well-trained staff is key to ensuring good quality autism services, especially since people affected with autism generally tend to have higher support needs than other populations in terms of daily living as well as their mental and physical health. Poorly-trained staff can have detrimental effects on service provision and staff morale and can lead to staff burn-out as well as increased service user anxiety and stress. This paper reports on a survey with health, social care, and education staff who work within the statutory autism services sector in the UK that explored their knowledge and training with regards to autism. Interview data obtained from staff and service users offer qualitative illustrations of survey findings. Overall, the findings expose an acute lack of autism specific training that has detrimental impacts. At best this training was based on brief and very basic awareness raising rather than on in-depth understanding of issues related to autism or skills for evidence-based practice. Service users were concerned with the effects that lack of staff training had on the services they received. The paper concludes with a discussion of policy routes to achieving quality staff training based on international best practice. The focus is on improving the quality of life and mental health for services users and staff as well as making potentially significant cost-savings for governments.

Evaluation use within a humanitarian non-governmental organization’s health care user-fee exemption program in West Africa

L’évaluation de l’action humanitaire (ÉAH) est un outil valorisé pour soutenir l’imputabilité, la transparence et l’efficience de programmes humanitaires contribuant à diminuer les inéquités et à promouvoir la santé mondiale. L’EAH est incontournable pour les parties prenantes de programme, les bailleurs de fonds, décideurs et intervenants souhaitant intégrer les données probantes aux pratiques et à la prise de décisions. Cependant, l’utilisation de l’évaluation (UÉ) reste incertaine, l’ÉAH étant fréquemment menée, mais inutilisé. Aussi, les conditions influençant l’UÉ varient selon les contextes et leur présence et applicabilité au sein d’organisations non-gouvernementales (ONG) humanitaires restent peu documentées. Les évaluateurs, parties prenantes et décideurs en contexte humanitaire souhaitant assurer l’UÉ pérenne détiennent peu de repères puisque rares sont les études examinant l’UÉ et ses conditions à long terme. La présente thèse tend à clarifier ces enjeux en documentant sur une période de deux ans l’UÉ et les conditions qui la détermine, au sein d’une stratégie d’évaluation intégrée au programme d’exemption de paiement des soins de santé d’une ONG humanitaire. L’objectif de ce programme est de faciliter l’accès à la santé aux mères, aux enfants de moins de cinq ans et aux indigents de districts sanitaires au Niger et au Burkina Faso, régions du Sahel où des crises alimentaires et économiques ont engendré des taux élevés de malnutrition, de morbidité et de mortalité. Une première évaluation du programme d’exemption au Niger a mené au développement de la stratégie d’évaluation intégrée à ce même programme au Burkina Faso. La thèse se compose de trois articles. Le premier présente une étude d’évaluabilité, étape préliminaire à la thèse et permettant de juger de sa faisabilité. Les résultats démontrent une logique cohérente et plausible de la stratégie d’évaluation, l’accessibilité de données et l’utilité d’étudier l’UÉ par l’ONG. Le second article documente l’UÉ des parties prenantes de la stratégie et comment celle-ci servit le programme d’exemption. L’utilisation des résultats fut instrumentale, conceptuelle et persuasive, alors que l’utilisation des processus ne fut qu’instrumentale et conceptuelle. Le troisième article documente les conditions qui, selon les parties prenantes, ont progressivement influencé l’UÉ. L’attitude des utilisateurs, les relations et communications interpersonnelles et l’habileté des évaluateurs à mener et à partager les connaissances adaptées aux besoins des utilisateurs furent les conditions clés liées à l’UÉ. La thèse contribue à l’avancement des connaissances sur l’UÉ en milieu humanitaire et apporte des recommandations aux parties prenantes de l’ONG.

National Level Stakeholders’ Perceptions of Facilitators and Barriers in Utilization of World Health Organizations’ Preventing Early Pregnancy Guidelines in National Level Health Policy Creation

Thesis (Master's)--University of Washington, 2016-07

“It’s the People That Drive It”: Motivating and Supporting Collaborative Data Use Practices in Three Teacher Education Programs

Thesis (Ph.D.)--University of Washington, 2016-08

Social policy in the Caribbean, its history and development: the evolution of social policy and its modern influences in the Caribbean

"A lecture delivered to the ECLAC/CDCC Training Workshop in Evidence-based Social Policy Formulation for the Caribbean, Port of Spain, Trinidad and Tobago 28-31 October 2002 and Kingston, Jamaica, 26-28 November 2002"

New clinical practice guideline on enteral feeding in very low birth weight infants: first part

Introduction: The nutrition of very low birth weight (VLBW) infants is aimed at promoting a similar growth to that occurring in the uterus. However, in practice this is difficult to achieve and extrauterine growth restriction is frequent. The current tendency is to avoid this restriction by means of early parenteral and enteral nutrition. Nonetheless, uncertainty about many of the practices related with nutrition has resulted in a great variation in the way it is undertaken. In 2009 and 2011 in our hospital there was an unexpected increase in necrotizing enterocolitis. To check to see whether our nutrition policy was involved, we undertook a systematic review and drew up clinical practice guidelines (CPG) about enteral feeding in VLBW infants. New considerations about the duration of the fortification and the use of probiotics have led to an update of these CPG. Methods: A total of 21 clinical questions were designed dealing with the type of milk, starting age, mode of administration, rate and volume of the increments, fortification, use of probiotics and protocol. After conducting a systematic search of the available evidence, the information was contrasted and summarized in order to draw up the recommendations. The quality of the evidence and the strength of the recommendations were determined from the SIGN scale Comment: These CPG aim to help physicians in their decision making. The protocolized application of well-proven measurements reduces the variation in clinical practice and improves results.

New clinical practice guideline on enteral feeding in very low birth weight infants: second part

Introduction: The nutrition of very low birth weight (VLBW) infants is aimed at promoting a similar growth to that occurring in the uterus. However, in practice this is difficult to achieve and extrauterine growth restriction is frequent. The current tendency is to avoid this restriction by means of early parenteral and enteral nutrition. Nonetheless, uncertainty about many of the practices related with nutrition has resulted in a great variation in the way it is undertaken. In 2009 and 2011 in our hospital there was an unexpected increase in necrotizing enterocolitis. To check to see wether our nutrition policy was involved, we underlook a systematic review and drewup clinical practice guidelines (CPG) about enteral feeding in VLBW infants. New considerations about the duration of the fortification and the use of probiotics have led to an update of these CPG. Methods: A total of 21 clinical questions were designed dealing with the type of milk, starting age, mode of administration, rate and volume of the increments, fortification, use of probiotics and protocol. Afete conducting a systematic search of the available evidence, the information was contrasted and summarized in order to draw up the recommendations. The quality of the evidence and the strength of the recommendations were determined from the SIGN scale. Comment: These CPG aim to help physicians in their decision making. The protocolized application of well-proven measurements reduces the variation in clinical practice and improves results.

Evaluating health policy and legal responses : how to reduce barriers and improve access to orphan drugs for rare diseases in Canada

Abstract : Rare diseases are debilitating conditions often leading to severe clinical manifestations for affected patients. Orphan drugs have been developed to treat these rare diseases affecting a small number of individuals. Incentives in the legal framework aimed to recoup the research and development cost of orphan drugs for pharmaceutical companies have been implemented in the United States and the European Union. At the present time, Canada is still lacking a legal and policy framework for orphan drugs. Several problems at the federal and provincial levels remain: lack of research funds for rare diseases, discrepancies on orphan drug policies between provinces, difficulties to access and reimburse these high price drugs. Recommendations and measures are proposed, such as a pan-Canadian (national) scientific committee to establish evidence-based guidelines for patients to access orphan drugs uniformly in all provinces with a disease specific registry, a formal agreement for a centralized Canadian public funding reimbursement procedure, and increasing the role of “guardian” for prices by the Patented Medicines Review Board in Canada. These recommendations and measures will be beneficial for the implementation of a policy framework for orphan drugs in Canada.

Evaluation use within a humanitarian non-governmental organization’s health care user-fee exemption program in West Africa

L’évaluation de l’action humanitaire (ÉAH) est un outil valorisé pour soutenir l’imputabilité, la transparence et l’efficience de programmes humanitaires contribuant à diminuer les inéquités et à promouvoir la santé mondiale. L’EAH est incontournable pour les parties prenantes de programme, les bailleurs de fonds, décideurs et intervenants souhaitant intégrer les données probantes aux pratiques et à la prise de décisions. Cependant, l’utilisation de l’évaluation (UÉ) reste incertaine, l’ÉAH étant fréquemment menée, mais inutilisé. Aussi, les conditions influençant l’UÉ varient selon les contextes et leur présence et applicabilité au sein d’organisations non-gouvernementales (ONG) humanitaires restent peu documentées. Les évaluateurs, parties prenantes et décideurs en contexte humanitaire souhaitant assurer l’UÉ pérenne détiennent peu de repères puisque rares sont les études examinant l’UÉ et ses conditions à long terme. La présente thèse tend à clarifier ces enjeux en documentant sur une période de deux ans l’UÉ et les conditions qui la détermine, au sein d’une stratégie d’évaluation intégrée au programme d’exemption de paiement des soins de santé d’une ONG humanitaire. L’objectif de ce programme est de faciliter l’accès à la santé aux mères, aux enfants de moins de cinq ans et aux indigents de districts sanitaires au Niger et au Burkina Faso, régions du Sahel où des crises alimentaires et économiques ont engendré des taux élevés de malnutrition, de morbidité et de mortalité. Une première évaluation du programme d’exemption au Niger a mené au développement de la stratégie d’évaluation intégrée à ce même programme au Burkina Faso. La thèse se compose de trois articles. Le premier présente une étude d’évaluabilité, étape préliminaire à la thèse et permettant de juger de sa faisabilité. Les résultats démontrent une logique cohérente et plausible de la stratégie d’évaluation, l’accessibilité de données et l’utilité d’étudier l’UÉ par l’ONG. Le second article documente l’UÉ des parties prenantes de la stratégie et comment celle-ci servit le programme d’exemption. L’utilisation des résultats fut instrumentale, conceptuelle et persuasive, alors que l’utilisation des processus ne fut qu’instrumentale et conceptuelle. Le troisième article documente les conditions qui, selon les parties prenantes, ont progressivement influencé l’UÉ. L’attitude des utilisateurs, les relations et communications interpersonnelles et l’habileté des évaluateurs à mener et à partager les connaissances adaptées aux besoins des utilisateurs furent les conditions clés liées à l’UÉ. La thèse contribue à l’avancement des connaissances sur l’UÉ en milieu humanitaire et apporte des recommandations aux parties prenantes de l’ONG.

EVALUATING THE OIL SANDS RECLAMATION PROCESS: ASSESSING POLICY CAPACITY AND STAKEHOLDER ACCESS FOR GOVERNMENT AND NON-GOVERNMENTAL ORGANIZATIONS OPERATING IN ALBERTA’S OIL SANDS

By employing interpretive policy analysis this thesis aims to assess, measure, and explain policy capacity for government and non-government organizations involved in reclaiming Alberta's oil sands. Using this type of analysis to assess policy capacity is a novel approach for understanding reclamation policy; and therefore, this research will provide a unique contribution to the literature surrounding reclamation policy. The oil sands region in northeast Alberta, Canada is an area of interest for a few reasons; primarily because of the vast reserves of bitumen and the environmental cost associated with developing this resource. An increase in global oil demand has established incentive for industry to seek out and develop new reserves. Alberta's oil sands are one of the largest remaining reserves in the world, and there is significant interest in increasing production in this region. Furthermore, tensions in several oil exporting nations in the Middle East remain unresolved, and this has garnered additional support for a supply side solution to North American oil demands. This solution relies upon the development of reserves in both the United States and Canada. These compounding factors have contributed to the increased development in the oil sands of northeastern Alberta. Essentially, a rapid expansion of oil sands operations is ongoing, and is the source of significant disturbance across the region. This disturbance, and the promises of reclamation, is a source of contentious debates amongst stakeholders and continues to be highly visible in the media. If oil sands operations are to retain their social license to operate, it is critical that reclamation efforts be effective. One concern non-governmental organizations (NGOs) expressed criticizes the current monitoring and enforcement of regulatory programs in the oil sands. Alberta's NGOs have suggested the data made available to them originates from industrial sources, and is generally unchecked by government. In an effort to discern the overall status of reclamation in the oil sands this study explores several factors essential to policy capacity: work environment, training, employee attitudes, perceived capacity, policy tools, evidence based work, and networking. Data was collected through key informant interviews with senior policy professionals in government and non-government agencies in Alberta. The following are agencies of interest in this research: Canadian Association of Petroleum Producers (CAPP); Alberta Environment and Sustainable Resource Development (AESRD); Alberta Energy Regulator (AER); Cumulative Environmental Management Association (CEMA); Alberta Environment Monitoring, Evaluation, and Reporting Agency (AEMERA); Wood Buffalo Environmental Association (WBEA). The aim of this research is to explain how and why reclamation policy is conducted in Alberta's oil sands. This will illuminate government capacity, NGO capacity, and the interaction of these two agency typologies. In addition to answering research questions, another goal of this project is to show interpretive analysis of policy capacity can be used to measure and predict policy effectiveness. The oil sands of Alberta will be the focus of this project, however, future projects could focus on any government policy scenario utilizing evidence-based approaches.