Performance Information and Innovation in the Canadian Government (Working Paper 43)

The presentation made at the conference addressed the issue of linkages between performance information and innovation within the Canadian federal government1. This is a three‐part paper prepared as background to that presentation. • Part I provides an overview of three main sources of performance information - results-based systems, program evaluation, and centrally driven review exercises – and reviews the Canadian experience with them. • Part II identifies and discusses a number of innovation issues that are common to the literature reviewed for this paper. • Part III examines actual and potential linkages between innovation and performance information. This section suggests that innovation in the Canadian federal government tends to cluster into two groups: smaller initiatives driven by staff or middle management; and much larger projects involving major programs, whole departments or whole-of-government. Readily available data on smaller innovation projects is skimpy but suggests that performance information does not play a major role in stimulating these initiatives. In contrast, two of the examples of large-scale innovation show that performance information plays a critical role at all stages. The paper concludes by supporting the contention of others writing on this topic: that more research is needed on innovation, particularly on its link to performance information. In that context, other conclusions drawn in this paper are tentative but suggest that the quality of performance information is as important for innovation as it is for performance management. However, innovation is likely to require its own particular performance information that may not be generated on a routine basis for purposes of performance management, particularly in the early stages of innovation. And, while the availability of performance information can be an important success factor in innovation, it does not stand alone. The commonality of a number of other factors identified in the literature surveyed for this paper strongly suggests that equal if not greater priority needs to be given to attenuating factors that inhibit innovation and to nurturing incentives.

Evaluation of the uptake of voluntary calorie posting on menus in Ireland

This report was commissioned by the Department of Health, Ireland. Obesity is a public health problem in Ireland which is largely responsible for the increasing prevalence of diet-related diseases and growing financial burden on our healthcare system. Although overweight and obesity rates may have reached a plateau in Irish adults and children, they remain at an extremely high level as 1 in 4 children areoverweight or obese and an estimated 61% of adults are overweight or obese. Urgent public health action is required to reduce the levels of obesity among our children and adults. A sustainable national intervention strategy that combines government and community-led interventions is required. These interventions need to incorporate both nutrition education and environmental modification strategies to reduce levels of obesity. International literature suggests that calorie posting has the potential to have a positive effect on the obesity crisis by encouraging people to make healthier food choices through informed consumer decisions. This evaluation focuses on the uptake of voluntary calorie posting from a national representative sample of food service businesses in Ireland and explores the attitudes of food service businesses that do and do not display calories. This evaluation will explore the most effective and efficient way of implementing mandatory calorie posting on menus in Ireland.

Evaluation of a Brief Intervention to Assist Health Visitors and Community Practitioners to Engage with Fathers as Part of the Healthy Child Initiative

Aims: To improve engagement of Health Visitors and Community Practitioners delivering the Healthy Child Programme with fathers. To evaluate a one-day, father-focused workshop with a supporting handbook for Practitioners. To identify institutional and organisational barriers to engagement with fathers. Background: The UK government policy encourages health professionals to engage with fathers. This derives from robust evidence that fathers’ early involvement with their children impacts positively on emotional, behavioural and educational development. Yet, there is little evidence that the importance of engaging fathers is reflected in Health Visitor training or that primary-care services are wholly embracing father-inclusive practice. The Fatherhood Institute (FI), a UK charity, has developed a workshop for Practitioners delivering the Healthy Child Programme. Method: A ‘before and after’ evaluation study, comprising a survey followed by telephone interviews, evaluated the impact of the FI workshop on Health Visitors’ and Community Practitioners’ knowledge, attitudes and behaviour in practice. A total of 134 Health Visitors and Community Practitioners from eight NHS Trusts in England attended the workshop from November 2011 to January 2014 at 12 sites. A specially constructed survey, incorporating a validated questionnaire, was administered before the workshop, immediately afterwards and three months later. Telephone interviews further explored participants’ responses. Findings: Analysis of the questionnaire data showed that the workshop and handbook improved participants’ knowledge, attitudes and behaviour in practice. This was sustained over a three-month period. In telephone interviews, most participants said that the workshop had raised their awareness of engaging fathers and offered them helpful strategies. However, they also spoke of barriers to engagement with fathers. NHS Trusts need to review the training and education of Health Visitors and Community Practitioners and take a more strategic approach towards father-inclusive practice and extend services to meet the needs of fathers.

Assessing the resilience of a real-world social-ecological system: lessons from a multidisciplinary evaluation of a South African pastoral system

In the past decades, social-ecological systems (SESs) worldwide have undergone dramatic transformations with often detrimental consequences for livelihoods. Although resilience thinking offers promising conceptual frameworks to understand SES transformations, empirical resilience assessments of real-world SESs are still rare because SES complexity requires integrating knowledge, theories, and approaches from different disciplines. Taking up this challenge, we empirically assess the resilience of a South African pastoral SES to drought using various methods from natural and social sciences. In the ecological subsystem, we analyze rangelands’ ability to buffer drought effects on forage provision, using soil and vegetation indicators. In the social subsystem, we assess households’ and communities’ capacities to mitigate drought effects, applying agronomic and institutional indicators and benchmarking against practices and institutions in traditional pastoral SESs. Our results indicate that a decoupling of livelihoods from livestock-generated income was initiated by government interventions in the 1930s. In the post-apartheid phase, minimum-input strategies of herd management were adopted, leading to a recovery of rangeland vegetation due to unintentionally reduced stocking densities. Because current livelihood security is mainly based on external monetary resources (pensions, child grants, and disability grants), household resilience to drought is higher than in historical phases. Our study is one of the first to use a truly multidisciplinary resilience assessment. Conflicting results from partial assessments underline that measuring narrow indicator sets may impede a deeper understanding of SES transformations. The results also imply that the resilience of contemporary, open SESs cannot be explained by an inward-looking approach because essential connections and drivers at other scales have become relevant in the globalized world. Our study thus has helped to identify pitfalls in empirical resilience assessment and to improve the conceptualization of SES dynamics.

An evaluation of carbon offset supplementation options for beef production systems on coastal speargrass in central Queensland, Australia

In 2014, the Australian Government implemented the Emissions Reduction Fund to offer incentives for businesses to reduce greenhouse gas (GHG) emissions by following approved methods. Beef cattle businesses in northern Australia can participate by applying the 'reducing GHG emissions by feeding nitrates to beef cattle' methodology and the 'beef cattle herd management' methods. The nitrate (NO3) method requires that each baseline area must demonstrate a history of urea use. Projects earn Australian carbon credit units (ACCU) for reducing enteric methane emissions by substituting NO3 for urea at the same amount of fed nitrogen. NO3 must be fed in the form of a lick block because most operations do not have labour or equipment to manage daily supplementation. NO3 concentrations, after a 2-week adaptation period, must not exceed 50 g NO3/adult animal equivalent per day or 7 g NO3/kg dry matter intake per day to reduce the risk of NO3 toxicity. There is also a 'beef cattle herd management' method, approved in 2015, that covers activities that improve the herd emission intensity (emissions per unit of product sold) through change in the diet or management. The present study was conducted to compare the required ACCU or supplement prices for a 2% return on capital when feeding a low or high supplement concentration to breeding stock of either (1) urea, (2) three different forms of NO3 or (3) cottonseed meal (CSM), at N concentrations equivalent to 25 or 50 g urea/animal equivalent, to fasten steer entry to a feedlot (backgrounding), in a typical breeder herd on the coastal speargrass land types in central Queensland. Monte Carlo simulations were run using the software @risk, with probability functions used for (1) urea, NO3 and CSM prices, (2) GHG mitigation, (3) livestock prices and (4) carbon price. Increasing the weight of steers at a set turnoff month by feeding CSM was found to be the most cost-effective option, with or without including the offset income. The required ACCU prices for a 2% return on capital were an order of magnitude higher than were indicative carbon prices in 2015 for the three forms of NO3. The likely costs of participating in ERF projects would reduce the return on capital for all mitigation options. © CSIRO 2016.

Evaluation of the Working for Families Fund 2004-2008.

This report summarises the Final Evaluation Report of the Working for Families Fund (WFF) programme from 2004-08. It was carried out by the Employment Research Institute, Napier University, Edinburgh, for the Scottish Government over this period. Over the four years the budget for WFF was £50 million, a total of 25,508 clients were registered, 53% of all clients (13,594) achieved hard‘ outcomes, such as employment, and a further 13% (3,283) achieved other significant outcomes.

Urban dynamics evaluation of Envigado city

This article presents the methodological conceptualization and the main results of a System Dynamics model, which main objective is to support the housing policies in the city of Envigado -- The used methodology developed a scenario-based model to emulate the approximate evolution of the housing demand and supply for the city, using a scenario of the Gross Domestic Product (GDP) and a housing authorization strategy as input -- Diverse results were obtained, for instance it was found that due to the soil availability, the housing supply reaches the saturation point between 2040 and 2046 -- Finally this article could be considered as an example of how academic tools such as System Dynamics can be used by decisions makers in the government

EVALUATING THE OIL SANDS RECLAMATION PROCESS: ASSESSING POLICY CAPACITY AND STAKEHOLDER ACCESS FOR GOVERNMENT AND NON-GOVERNMENTAL ORGANIZATIONS OPERATING IN ALBERTA’S OIL SANDS

By employing interpretive policy analysis this thesis aims to assess, measure, and explain policy capacity for government and non-government organizations involved in reclaiming Alberta's oil sands. Using this type of analysis to assess policy capacity is a novel approach for understanding reclamation policy; and therefore, this research will provide a unique contribution to the literature surrounding reclamation policy. The oil sands region in northeast Alberta, Canada is an area of interest for a few reasons; primarily because of the vast reserves of bitumen and the environmental cost associated with developing this resource. An increase in global oil demand has established incentive for industry to seek out and develop new reserves. Alberta's oil sands are one of the largest remaining reserves in the world, and there is significant interest in increasing production in this region. Furthermore, tensions in several oil exporting nations in the Middle East remain unresolved, and this has garnered additional support for a supply side solution to North American oil demands. This solution relies upon the development of reserves in both the United States and Canada. These compounding factors have contributed to the increased development in the oil sands of northeastern Alberta. Essentially, a rapid expansion of oil sands operations is ongoing, and is the source of significant disturbance across the region. This disturbance, and the promises of reclamation, is a source of contentious debates amongst stakeholders and continues to be highly visible in the media. If oil sands operations are to retain their social license to operate, it is critical that reclamation efforts be effective. One concern non-governmental organizations (NGOs) expressed criticizes the current monitoring and enforcement of regulatory programs in the oil sands. Alberta's NGOs have suggested the data made available to them originates from industrial sources, and is generally unchecked by government. In an effort to discern the overall status of reclamation in the oil sands this study explores several factors essential to policy capacity: work environment, training, employee attitudes, perceived capacity, policy tools, evidence based work, and networking. Data was collected through key informant interviews with senior policy professionals in government and non-government agencies in Alberta. The following are agencies of interest in this research: Canadian Association of Petroleum Producers (CAPP); Alberta Environment and Sustainable Resource Development (AESRD); Alberta Energy Regulator (AER); Cumulative Environmental Management Association (CEMA); Alberta Environment Monitoring, Evaluation, and Reporting Agency (AEMERA); Wood Buffalo Environmental Association (WBEA). The aim of this research is to explain how and why reclamation policy is conducted in Alberta's oil sands. This will illuminate government capacity, NGO capacity, and the interaction of these two agency typologies. In addition to answering research questions, another goal of this project is to show interpretive analysis of policy capacity can be used to measure and predict policy effectiveness. The oil sands of Alberta will be the focus of this project, however, future projects could focus on any government policy scenario utilizing evidence-based approaches.

Irish state infrastructural investment: an analysis of past patterns, and an outline of a future integrated systems of systems evaluation methodology

The literature clearly links the quality and capacity of a country’s infrastructure to its economic growth and competitiveness. This thesis analyses the historic national and spatial distribution of investment by the Irish state in its physical networks (water, wastewater and roads) across the 34 local authorities and examines how Ireland is perceived internationally relative to its economic counterparts. An appraisal of the current status and shortcomings of Ireland’s infrastructure is undertaken using key stakeholders from foreign direct investment companies and national policymakers to identify Ireland's infrastructural gaps, along with current challenges in how the country is delivering infrastructure. The output of these interviews identified many issues with how infrastructure decision-making is currently undertaken. This led to an evaluation of how other countries are informing decision-making, and thus this thesis presents a framework of how and why Ireland should embrace a Systems of Systems (SoS) methodology approach to infrastructure decision-making going forward. In undertaking this study a number of other infrastructure challenges were identified: significant political interference in infrastructure decision-making and delivery the need for a national agency to remove the existing ‘silo’ type of mentality to infrastructure delivery how tax incentives can interfere with the market; and their significance. The two key infrastructure gaps identified during the interview process were: the need for government intervention in the rollout of sufficient communication capacity and at a competitive cost outside of Dublin; and the urgent need to address water quality and capacity with approximately 25% of the population currently being served by water of unacceptable quality. Despite considerable investment in its national infrastructure, Ireland’s infrastructure performance continues to trail behind its economic partners in the Eurozone and OECD. Ireland is projected to have the highest growth rate in the euro zone region in 2015 and 2016, albeit that it required a bailout in 2010, and, at the time of writing, is beginning to invest in its infrastructure networks again. This thesis proposes the development and implementation of a SoS approach for infrastructure decision-making which would be based on: existing spatial and capacity data of each of the constituent infrastructure networks; and scenario computation and analysis of alternative drivers eg. Demographic change, economic variability and demand/capacity constraints. The output from such an analysis would provide valuable evidence upon which policy makers and decision makers alike could rely, which has been lacking in historic investment decisions.

Human-Computer interaction methodologies applied in the evaluation of haptic digital musical instruments

Recent developments in interactive technologies have seen major changes in the manner in which artists, performers, and creative individuals interact with digital music technology; this is due to the increasing variety of interactive technologies that are readily available today. Digital Musical Instruments (DMIs) present musicians with performance challenges that are unique to this form of computer music. One of the most significant deviations from conventional acoustic musical instruments is the level of physical feedback conveyed by the instrument to the user. Currently, new interfaces for musical expression are not designed to be as physically communicative as acoustic instruments. Specifically, DMIs are often void of haptic feedback and therefore lack the ability to impart important performance information to the user. Moreover, there currently is no standardised way to measure the effect of this lack of physical feedback. Best practice would expect that there should be a set of methods to effectively, repeatedly, and quantifiably evaluate the functionality, usability, and user experience of DMIs. Earlier theoretical and technological applications of haptics have tried to address device performance issues associated with the lack of feedback in DMI designs and it has been argued that the level of haptic feedback presented to a user can significantly affect the user’s overall emotive feeling towards a musical device. The outcome of the investigations contained within this thesis are intended to inform new haptic interface.

Arts in Basic Curriculum : 20-Year Anniversary Evaluation

The Arts in Basic Curriculum (ABC) Project has ensured students throughout South Carolina have a quality, comprehensive arts education for 20 years. Through funding, research, advocacy and training and technical assistance, the Project has been a model for a number of advancements in arts education. The statewide focus, the creation of arts education standards and curriculum, the success of its advocacy and its inroads on arts education assessment and integration mark the ABC Project as a significant leader in the field of arts education. At its 20th anniversary, the ABC Project engaged an independent evaluator to explore the Project’s impact at this stage of its history. This report captures the findings of this 20-year evaluation.

FY 2014-15 & 2015-16 Evaluation of State-Funded Full-Day 4K, part I

This report documents the expansion of 4K and expenditure of funds in Fiscal Years 2014-15 and 2015-16; provides 2015-16 projections for the number of at-risk four-year-olds in each school district and the number of at-risk four-year-olds served in a publicly funded program using available information; details the results of the CIRCLE assessment, which was administered to children in publicly-funded four-year-old (4K) and five-year-old (5K) kindergarten during the 2014-15 school year; describes the four language and literacy assessments that measure 4K and 5K students’ abilities during the 2015-16 school year; and discusses how 4K quality can be defined and the important role of teacher-child instructional interactions in assessing quality of publicly-funded 4K.

Evaluation and Process Improvement of Federal Excess Property for Fire Departments

Currently, there are two federal programs related to excess federal property in which the South Carolina Forestry Commission participates. There is a need to streamline the process for applying for federal excess property as well as tracking its location once it has been received and assigned.

Nausea, Vomiting And Quality Of Life Of Patients With Cancer Undergoing Antineoplastic Treatment: An Evaluation By Pharmacists.

This study aims to evaluate the frequency and severity of nausea and vomiting using two different instruments and relate them to quality of life (QOL) in patients with cancer receiving antineoplastic treatment. Severity of chemotherapy-induced nausea and vomiting (CINV) was measured by Common Terminology Criteria for Adverse Events (CTCAE) and a numerical scale. QOL was assessed using the Functional Assessment of Cancer Therapy-General questionnaire. Of the 50 patients studied, 60.0% reported nausea (40.0% CTCAE grade 1; 66.7% moderate intensity on numerical scale) and 30.0% reported vomiting (46.7% CTCAE grades 1 and 2, each; 66.7% moderate intensity on numerical scale). CINV did not influence overall QOL. The frequency of CINV was high. There was no association between nausea/vomiting and overall QOL.

Neuropsychological and phonological evaluation in the Apert's syndrome: study of two cases

This study evaluated two cases of Apert's syndrome, through phonological, cognitive, and neuropsychological instruments and correlated the results to complementary exams. In short, this study reveals the necessity of application of neuropsychological, cognitive and phonological evaluation and correlation of the results with complementary testings because significant differences can be present in the Apert's syndrome.