Program evaluation primer: A review of three evaluations

Program evaluation—a “tool used to assess the implementation and outcomes of a program, to increase a program’s efficiency and impact over time, and to demonstrate accountability” (MacDonald et. al, 2001, p. 1)—is an essential process to program assessment and improvement. This paper overviews three published program evaluations and considers important aspects of program evaluation more broadly.

Florida's Voluntary Prekindergarten (VPK) Program's Influence on Preschool Teachers' Beliefs and Practices

Three veteran preschool teachers told their stories about navigating the implementation of VPK. Even with parents' misconceptions about VPK's goals, teachers were able to meet its standards by continuing to embrace a play-based, hands-on philosophy that also emphasized children's social and emotional needs.

Development and Application of a Multi-dimensional Strategy for Measuring Fidelity of Implementation of a Districtwide Intervention

This symposium describes a multi-dimensional strategy to examine fidelity of implementation in an authentic school district context. An existing large-district peer mentoring program provides an example. The presentation will address development of a logic model to articulate a theory of change; collaborative creation of a data set aligned with essential concepts and research questions; identification of independent, dependent, and covariate variables; issues related to use of big data that include conditioning and transformation of data prior to analysis; operationalization of a strategy to capture fidelity of implementation data from all stakeholders; and ways in which fidelity indicators might be used.

Digital and Social Inequalities : A Qualitative Assessment of the Impact of the Connecting Equality Program on Argentinean Youth

This paper focuses on the ties between social and digital inequalities among Argentinean youth. It uses a qualitative approach to explore different aspects of the everyday lives of adolescents, such as sociability, leisure time and family use of Information and Communication Technologies (ICTs), in order to assess the impact of the Connecting Equality Program (Programa Conectar Igualdad, PCI) on reducing digital inequalities and fostering social inclusion. What were the existing conditions of access for students and their families when the PCI was first implemented? What influence does the implementation of the PCI have on the individual, family and scholastic appropriation of ICTs? How does the use of computers and the Internet vary among youth? Has this large-scale incorporation of netbooks in schools, and especially homes and free time changed it in any way? Does the appropriation of ICTs through student participation in the PCI contribute to material and symbolic social inclusion? In order to answer these questions, we compare the processes of ICT appropriation among lower and middle class adolescents, focusing on the distinctive uses and meanings assigned to computers and the Internet by boys and girls in their daily lives. For this purpose we analyze data collected through semi-structured interviews in two schools in Greater La Plata, Argentina during 2012. The main findings show that in terms of access, skills and types of use, the implementation of the PCI has had a positive impact among lower class youth, guaranteeing access to their first computers and promoting the sharing of knowledge and digital skills with family members. Moreover, evidence of more diverse and intense use of ICTs among lower class students reveals the development of digital skills related to educational activities. Finally, in terms of sociability, having a personal netbook enables access to information and cultural goods which are very significant in generating ties and strengthening identities and social integration

Digital and Social Inequalities : A Qualitative Assessment of the Impact of the Connecting Equality Program on Argentinean Youth

This paper focuses on the ties between social and digital inequalities among Argentinean youth. It uses a qualitative approach to explore different aspects of the everyday lives of adolescents, such as sociability, leisure time and family use of Information and Communication Technologies (ICTs), in order to assess the impact of the Connecting Equality Program (Programa Conectar Igualdad, PCI) on reducing digital inequalities and fostering social inclusion. What were the existing conditions of access for students and their families when the PCI was first implemented? What influence does the implementation of the PCI have on the individual, family and scholastic appropriation of ICTs? How does the use of computers and the Internet vary among youth? Has this large-scale incorporation of netbooks in schools, and especially homes and free time changed it in any way? Does the appropriation of ICTs through student participation in the PCI contribute to material and symbolic social inclusion? In order to answer these questions, we compare the processes of ICT appropriation among lower and middle class adolescents, focusing on the distinctive uses and meanings assigned to computers and the Internet by boys and girls in their daily lives. For this purpose we analyze data collected through semi-structured interviews in two schools in Greater La Plata, Argentina during 2012. The main findings show that in terms of access, skills and types of use, the implementation of the PCI has had a positive impact among lower class youth, guaranteeing access to their first computers and promoting the sharing of knowledge and digital skills with family members. Moreover, evidence of more diverse and intense use of ICTs among lower class students reveals the development of digital skills related to educational activities. Finally, in terms of sociability, having a personal netbook enables access to information and cultural goods which are very significant in generating ties and strengthening identities and social integration

Digital and Social Inequalities : A Qualitative Assessment of the Impact of the Connecting Equality Program on Argentinean Youth

This paper focuses on the ties between social and digital inequalities among Argentinean youth. It uses a qualitative approach to explore different aspects of the everyday lives of adolescents, such as sociability, leisure time and family use of Information and Communication Technologies (ICTs), in order to assess the impact of the Connecting Equality Program (Programa Conectar Igualdad, PCI) on reducing digital inequalities and fostering social inclusion. What were the existing conditions of access for students and their families when the PCI was first implemented? What influence does the implementation of the PCI have on the individual, family and scholastic appropriation of ICTs? How does the use of computers and the Internet vary among youth? Has this large-scale incorporation of netbooks in schools, and especially homes and free time changed it in any way? Does the appropriation of ICTs through student participation in the PCI contribute to material and symbolic social inclusion? In order to answer these questions, we compare the processes of ICT appropriation among lower and middle class adolescents, focusing on the distinctive uses and meanings assigned to computers and the Internet by boys and girls in their daily lives. For this purpose we analyze data collected through semi-structured interviews in two schools in Greater La Plata, Argentina during 2012. The main findings show that in terms of access, skills and types of use, the implementation of the PCI has had a positive impact among lower class youth, guaranteeing access to their first computers and promoting the sharing of knowledge and digital skills with family members. Moreover, evidence of more diverse and intense use of ICTs among lower class students reveals the development of digital skills related to educational activities. Finally, in terms of sociability, having a personal netbook enables access to information and cultural goods which are very significant in generating ties and strengthening identities and social integration

What's in it for us? A case study research about micro sense making processes through the eyes of front line employees, during culture change implementation

Abstract How employees make sense of change is a very complex process. Recently, academics have neglected to research sense making activities in a micro culture implementation context, through the eyes of front line employees. In contrast to a macro view, a micro perspective limits researchers to only look at an individual, departmental or group level. By doing so, we can zoom in on the details of sense making processes that employees use in their daily work life. A macro (organisational) view is based on the notion that there is a general integrated culture that can be found in all organisational units and departments. It is assumed that culture can be researched by using the entire organisation as one single research entity. This thesis challenges this assumption. In case of planned change it is usually the management community who are in charge of the change intervention. Because of their formal hierarchical position, they have the power to abort or initiate change programs. It is perhaps therefore that researchers tend to be focused on the management community rather than on lower level organisational members, such as front line employees. Apart from the micro view, scholars also neglected to research culture change implementation through the eyes of front line employees. This thesis is an attempt to fill these two gaps that currently exists in academic change management publications. The main research question is therefore: From a micro point of view how do front-line employees make sense of the impact of culture change, during the implementation phase? This thesis starts with a literature review which exposes the two main gaps. The most important outcome of this review is that only 2% of the research articles dealt with culture implementation, through the eyes of front line employees. A conceptual research model is built on the integrated sense making theory of Weber and Manning (2001) and the micro variables of Raelin and Cataldo (2011). These theories emphasize elements of sense making in a daily working context. It is likely that front line employees can identify themselves with research elements such as tasks, skills practices, involvement and behaviour. Front line employees were selected, because as lower level organisational members they are usually the change recipients. They are further away from the change initiating scene (usually the management of an organisation) and form a potential sense making ‘hotspot’ that could provide new academic insights. In order to carry out the primary research, two case organisations were selected in the leisure industry. A participative case study research method was chosen. This meant that the researcher worked in the concerning departments of the case organisations. The goal was to observe and interview front line employees, while they were performing their jobs. The most important advantage of this approach is that the researcher temporarily becomes one with the organisation and is therefore able to acquire both formal and informal narratives that front line employees use during sense making activities. It was found that front line employees make sense of organisational change by using a practical approach. They make sense of the change program by carrying out new tasks, developing new skills and sharing best practices. The most noticeable conclusion was that sense making activities predominantly take place at an individual level in relation to change acceptance. Organisational members tend to create a mental equation in order to weigh the advantages against the disadvantages. They evaluate whether the concerning change program is beneficial to them or not. For future research a sense making scheme model is suggested that is based on two methods: an introspection and an action method.

Evaluation, Selection and Planning the Implementation of a Pavement Management Optimization Model: Optimization Recommendations, 1994

This document briefly summarizes the pavement management activities under the existing Iowa Department of Transportation (DOT) Pavement Management System. The second part of the document provides projected increase in use due to the implementation of the Iowa DOT Pavement Management Optimization System. All estimates of existing time devoted to the Pavement Management System and project increases in time requirements are estimates made by the appropriate Iowa DOT office director or function manager. Included is the new Pavement Management Optimization Structure for the three main offices which will work most closely with the Pavement Management Optimization System (Materials, Design, and Program Management).

The politics of negotiation and implementation: a reciprocal water access agreement in the Himalayan foothills, India

In this paper, we examine the on-the-ground realities of upstream-downstream negotiations and transactions over ecosystem services. We explore the engagement, negotiation, implementation, and postimplementation phases of a “reciprocal water access” (RWA) agreement between village communities and municipal water users at Palampur, Himachal Pradesh, India. We aim to highlight how external actors drove the payments for ecosystem services agenda through a series of facilitation and research engagements, which were pivotal to the RWA’s adoption, and how the agreement fared once external agents withdrew. In the postimplementation period, the RWA agreement continues to be upheld by upstream communities amidst evolving, competing land-use changes and claims. The introduction of cash payments for environmental services for forest-water relationships has given rise to multifaceted difficulties for the upstream hamlets, which has impeded the functionality of their forest management committee. Upstream communities’ formal rights and abilities to control and manage their resources are dynamic and need strengthening and assurance; these developments result in fluctuating transaction and opportunity costs not originally envisaged by the RWA agreement. The paper demonstrates the importance of an explicit understanding of the local politics of negotiation and implementation to determine the effectiveness of compensation-based mechanisms for the supply of ecosystem services.

Remolding a company through a compliance program : the case of Siemens

Abstract : Since at least the 1980's, a growing number of companies have set up an ethics or a compliance program within their organization. However, in the field of study of business management, there is a paucity of research studies concerning these management systems. This observation warranted the present investigation of one company's compliance program. Compliance programs are set up so that individuals working within an organization observe the laws and regulations which pertain to their work. This study used a constructivist grounded theory methodology to examine the process by which a specific compliance program, that of Siemens Canada Limited, was implemented throughout its organization. In conformity with this methodology, instead of proceeding with the investigation in accordance to a particular theoretical framework, the study established a number of theoretical constructs used strictly as reference points. The study's research question was stated as: what are the characteristics of the process by which Siemens' compliance program integrated itself into the existing organizational structure and gained employee acceptance? Data consisted of documents produced by the company and of interviews done with twenty-four managers working for Siemens Canada Limited. The researcher used QSR-Nvivo computer assisted software to code transcripts and to help with analyzing interviews and documents. Triangulation was done by using a number of analysis techniques and by constantly comparing findings with extant theory. A descriptive model of the implementation process grounded in the experience of participants and in the contents of the documents emerged from the data. The process was called "Remolding"; remolding being the core category having emerged. This main process consisted of two sub-processes identified as "embedding" and "appraising." The investigation was able to provide a detailed account of the appraising process. It identified that employees appraised the compliance program according to three facets: the impact of the program on the employee's daily activities, the relationship employees have with the local compliance organization, and the relationship employees have with the corporate ethics identity. The study suggests that a company who is entertaining the idea of implementing a compliance program should consider all three facets. In particular, it suggests that any company interested in designing and implementing a compliance program should pay particular attention to its corporate ethics identity. This is because employee's acceptance of the program is influenced by their comparison of the company's ethics identity to their local ethics identity. Implications of the study suggest that personnel responsible for the development and organizational support of a compliance program should understand the appraisal process by which employees build their relationship with the program. The originality of this study is that it points emphatically that companies must pay special attention in developing a corporate ethics identify which is coherent, well documented and well explained.

Sodium in School Lunches Before and After Implementation of the Healthy, Hunger Free Kids Act of 2010

Thesis (Master's)--University of Washington, 2016-08

The NumbersWithNames Program

We present the NumbersWithNames program which performs data-mining on the Encyclopedia of Integer Sequences to find interesting conjectures in number theory. The program forms conjectures by finding empirical relationships between a sequence chosen by the user and those in the Encyclopedia. Furthermore, it transforms the chosen sequence into another set of sequences about which conjectures can also be formed. Finally, the program prunes and sorts the conjectures so that themost plausible ones are presented first. We describe here the many improvements to the previous Prolog implementation which have enabled us to provide NumbersWithNames as an online program. We also present some new results from using NumbersWithNames, including details of an automated proof plan of a conjecture NumbersWithNames helped to discover.

Phobos: The design and implementation of embedded software for a low cost radar warning receiver

This portfolio thesis describes work undertaken by the author under the Engineering Doctorate program of the Institute for System Level Integration. It was carried out in conjunction with the sponsor company Teledyne Defence Limited. A radar warning receiver is a device used to detect and identify the emissions of radars. They were originally developed during the Second World War and are found today on a variety of military platforms as part of the platform’s defensive systems. Teledyne Defence has designed and built components and electronic subsystems for the defence industry since the 1970s. This thesis documents part of the work carried out to create Phobos, Teledyne Defence’s first complete radar warning receiver. Phobos was designed to be the first low cost radar warning receiver. This was made possible by the reuse of existing Teledyne Defence products, commercial off the shelf hardware and advanced UK government algorithms. The challenges of this integration are described and discussed, with detail given of the software architecture and the development of the embedded application. Performance of the embedded system as a whole is described and qualified within the context of a low cost system.

Implementing The KiVa Antibullying Program: What Does It Take?

There is variation in how teachers and schools implement bullying prevention programs. Although this variation has been discussed, there has been little empirical research concerning the relationship between implementation fidelity and program outcomes. This thesis contains three studies, each of them in the context of implementing the KiVa antibullying program, and examines teachers’ actions in preventing and intervening in school bullying. The first aim of this thesis is to examine implementation degree of the KiVa curriculum and its’ association with reductions in victimization and bullying perpetration (Study I). The second aim is to clarify why teachers displayed different degrees of adherence to the KiVa curriculum during a school year (Study II). Thirdly, it is investigated whether recognizing victimization can be difficult for school staff (Study III). In addition to these peer-reviewed studies, the thesis includes a qualitative analysis (unpublished) of the teachers’ open answers concerning their implementation experiences. The data were collected from elementary school teachers (Studies I–II; the unpublished study), elementary school students (Study I), and students on the elementary and middle school levels (Study III) during the evaluation of the effectiveness of KiVa antibullying program between 2007 and 2009. The findings demonstrate that a larger reduction in victimization can be achieved in classrooms where teachers display higher levels of adherence to the KiVa curriculum and invest more time for preparing the lessons. Bullying perpetration, however, was not equally affected by the level of curriculum implementation. With respect to the implementation process over one year, there was significant variation between individual teachers’ activity—ranging from systematic and high implementation to declining delivery from lesson to lesson. The sustained actions (high and moderate levels of implementation) were premised on principal support for antibullying work. Lesson preparation was associated with keeping implementation high throughout the school year. The findings also implied that the belief in the effectiveness of the program is important for a higher implementation degree at starting point of the process. Finally, there are severe flaws in teachers’ ability to identify students who are victimized. As it turns out, it is possible that only one-fourth of chronically victimized students are helped by the school staff. Especially when the victims are middle-school-aged girls, when they bully others themselves, or when they do not tell adults about bullying, reaching out for them is difficult. Implementation and dissemination of research-based interventions will take a good deal of time and effort. The findings demonstrate that active implementation is important for improving program outcomes. They also show how implementation can be sustained—there are both individual and interpersonal factors that facilitate or inhibit high-quality implementation. Thus, implications for future research regarding the implementation of school-based programs are suggested.

Socio-economic profile of the Philippine National Aquasilviculture Program (PNAP) beneficiaries in Jiabong, Samar, Philippines

A total of 37 beneficiaries under the Philippine National Aquasilviculture Program (PNAP) was interviewed using the structured survey questionnaire of Socioeconomic Monitoring Guidelines for Coastal Managers in Southeast Asia (SocMon SEA). Most of the members of the households are young and in-school. Household heads’ primary occupation is fishing, a shift from mussel farming- the town’s major industry in the past decades. Perceived threat by the beneficiaries is related to the environment specifically typhoon and the problems on waste disposal. It also identified law enforcement as weak leading to dwindling fish catch, mass mortality of mussel, red tide and other problems affecting their primary sources of income. However, they could not relate these phenomena to the most likely causes. The current occupation does not provide sufficient income for the family as they seek for alternative jobs. Garbage and poor implementation of laws are among the identified problems of the beneficiaries.