An examination of attitude toward change as a predictor of policy/program implementation

Policy/program implementation, e.g., the process of fulfilling policy/program directives, is fundamentally tied to change. Implementation studies have examined the process, identifying many critical organizational variables although individuals perform the activities.^ Many of the studies are predicated on the rational, goal oriented model of organizations and examine implementation, presenting only the goal-oriented view. Organizational change and its resistance, however, are not fully explained by the rational model of organizations. There are other schools of thought providing different views of organizations from which explanation may emerge. Bolman and Deal (1984, 1991a, 1994) provide a different perspective for examining organizations Bolman and Deal argue organizations should be viewed through four different frames or lenses. Framing and reframing organizational action captures the complexity of action and provides better understanding of organizational processes. Understanding of implementation of policies/programs also will benefit from the use of the four-frame approach.^ The goal of this research is to provide a better understanding of the implementation process by examining individual attitudes toward change, the dependent variable of this research, and studying the relationship between the dependent variable and frame. The research was conducted in two phases. In Phase One, a survey was sent to 306 school administrators and teachers in magnet programs in Dade County, Florida. The survey instrument was composed of 55 questions including six from Bolman and Deal's Leadership Orientation Survey (1988) and 38 questions about organizational change. In Phase Two, more in-depth analysis of four school was conducted, to further explore the relationship between frame and attitude toward change.^ The results revealed that frame was a factor in explaining differences in personal Attitude Toward Change and Comfort Level with Change. Individuals using the symbolic frame had more positive attitudes toward change and were also more comfortable with change. The results of Phase Two of the research partially supported this finding in that the most fully implemented program was the product of an administrator who had chosen the symbolic frame. ^

Moving toward change: Institutionalizing reform through implementation of the Learning Assistant model and Open Source Tutorials

Florida International University has undergone a reform in the introductory physics classes by focusing on the laboratory component of these classes. We present results from the secondary implementation of two research-based instructional strategies: the implementation of the Learning Assistant model as developed by the University of Colorado at Boulder and the Open Source Tutorial curriculum developed at the University of Maryland, College Park. We examine the results of the Force Concept Inventory (FCI) for introductory students over five years (n=872) and find that the mean raw gain of students in transformed lab sections was 0.243, while the mean raw gain of the traditional labs was 0.159, with a Cohen’s d effect size of 0.59. Average raw gains on the FCI were 0.243 for Hispanic students and 0.213 for women in the transformed labs, indicating that these reforms are not widening the gaps between underrepresented student groups and majority groups. Our results illustrate how research-based instructional strategies can be successfully implemented in a physics department with minimal department engagement and in a sustainable manner.

Understanding the dynamics of information technology implementation: The case of clinical information systems

The ultimate intent of this dissertation was to broaden and strengthen our understanding of IT implementation by emphasizing research efforts on the dynamic nature of the implementation process. More specifically, efforts were directed toward opening the "black box" and providing the story that explains how and why contextual conditions and implementation tactics interact to produce project outcomes. In pursuit of this objective, the dissertation was aimed at theory building and adopted a case study methodology combining qualitative and quantitative evidence. Precisely, it examined the implementation process, use and consequences of three clinical information systems at Jackson Memorial Hospital, a large tertiary care teaching hospital.^ As a preliminary step toward the development of a more realistic model of system implementation, the study proposes a new set of research propositions reflecting the dynamic nature of the implementation process.^ Findings clearly reveal that successful implementation projects are likely to be those where key actors envision end goals, anticipate challenges ahead, and recognize the presence of and seize opportunities. It was also found that IT implementation is characterized by the systems theory of equifinality, that is, there are likely several equally effective ways to achieve a given end goal. The selection of a particular implementation strategy appears to be a rational process where actions and decisions are largely influenced by the degree to which key actors recognize the mediating role of each tactic and are motivated to action. The nature of the implementation process is also characterized by the concept of "duality of structure," that is, context and actions mutually influence each other. Another key finding suggests that there is no underlying program that regulates the process of change and moves it form one given point toward a subsequent and already prefigured end. For this reason, the implementation process cannot be thought of as a series of activities performed in a sequential manner such as conceived in stage models. Finally, it was found that IT implementation is punctuated by a certain indeterminacy. Results suggest that only when substantial efforts are focused on what to look for and think about, it is less likely that unfavorable and undesirable consequences will occur. ^

The eye of the beholder: The impact of a district implementation plan of state mandates as perceived by the implementers

The purpose of this inquiry was to investigate the impact of a large, urban school district's experience in implementing a mandated school improvement plan and to examine how that plan was perceived, interpreted, and executed by those charged with the task. The research addressed the following questions: First, by whom was the district implementation plan designed, and what factors were considered in its construction? Second, what impact did the district implementation plan have on those charged with its implementation? Third, what impact did the district plan have on the teaching and learning practices of a particular school? Fourth, what aspects of the implemention plan were perceived as most and least helpful by school personnel in achieving stated goals? Last, what were the intended and unintended consequences of an externally mandated and directed plan for improving student achievement? The implementation process was measured against Fullan's model as expounded upon in The Meaning of Educational Change (1982) and The New Meaning of Educational Change (1990). The Banya implementation model (1993), because it added a dimension not adequately addressed by Fullan, was also considered.^ A case study was used as the methodological framework of this qualitative study. Sources of data used in this inquiry included document analysis, participant observations in situ, follow-up interviews, the "long" interview, and triangulation. The study was conducted over a twelve-month period. Findings were obtained from the content analysis of interview transcripts of multiple participants. Results were described and interpreted using the Fullan and Banya models as the descriptive framework. A cross-case comparison of the multiple perspectives of the same phenomena by various participants was constructed.^ The study concluded that the school district's implementation plan to improve student achievement was closely aligned to Fullan's model, although not intentionally. The research also showed that where there was common understanding at all levels of the organization as to the expectations for teachers, level of support to be provided, and availability of resources, successful implementation occured. The areas where successful implementation did not occur were those where the complexity of the changes were underestimated and processes for dealing with unintended consequences were not considered or adequately addressed. The unique perspectives of the various participants, from the superintendent to the classroom teacher, are described. Finally, recommendations for enhancement of implementation are offered and possible topics for further research studies are postulated. ^

Profile of planning: A study of a three-year project on the implementation of collaborative library media programs

The implementation of collaborative planning and teaching models in ten flexibly scheduled elementary and middle school library media centers was studied to determine which factors facilitated the collaborative planning process and to learn what occurs when library media specialists (LMSs) and classroom teachers (CTs) plan together. In this qualitative study, 61 principals, CTs, and LMSs were interviewed on a range of topics including the principal's role, school climate, the value of team planning, the importance of information literacy instruction, and the ideal learning environment. Other data sources were observations, videotapes of planning sessions, and documents. This three-year school reform effort was funded by the Library Power Project to improve library programs, to encourage collaborative planning, and to increase curricular integration of information literacy skills instruction. ^ The findings included a description of typical planning sessions and the identification of several major factors which impacted the success of collaborative planning: the individuals involved, school climate, time for planning, the organization of the school, the facility and collection, and training. Of these factors, the characteristics and actions of the people involved were most critical to the implementation of the innovation. The LMS was the pivotal player and, in the views of CTs, principals, and LMSs themselves, must be knowledgeable about curriculum, the library collection, and instructional design and delivery; must be open and welcoming to CTs and use good interpersonal skills; and must be committed to information literacy instruction and willing to act as a change agent. The support of the principal was vital; in schools with successful programs, the principal served as an advocate for collaborative planning and information literacy instruction, provided financial support for the library program including clerical staff, and arranged for LMSs and CTs to have time during the school day to plan together. ^ CTs involved in positive planning partnerships with LMSs were flexible, were open to change, used a variety of instructional materials, expected students to be actively involved in their own learning, and were willing to team teach with LMSs. Most CTs planning with LMSs made lesson plans in advance and preferred to plan with others. Also, most CTs in this study planned with grade level or departmental groups, which expedited the delivery of information literacy instruction and the effective use of planning time. ^ Implications of the findings of this research project were discussed for individual schools, for school districts, and for colleges and universities training LMSs, CTs, and administrators. Suggestions for additional research were also included. ^

A qualitative case study of teacher perceptions and concerns during the implementation of literacy folders in a select elementary school in Broward County, Florida

Classroom teachers are often required to implement new procedures or practices in response to local or federal education mandates. Attempts to implement innovations, often do not take into account the personal side of change; the perceptions, concerns and needs of those required to implement the innovation. One innovation that was required by the School Board of Broward County, Florida for all elementary classroom teachers was the implementation of Literacy Folders. ^ This study attempted to address the personal side of change by identifying teacher concerns during the implementation of Literacy Folders in a select elementary school in Broward County Florida. The Concerns Based Adoption model (CBAM) for change was used as the conceptual framework for this qualitative case study. ^ Sources of data for this study included participant interviews, observations and analysis of documents. Informal conversations with the participants and unscheduled classroom visits were also sources of data. Seven classroom teachers were interviewed using a predesigned interview guide developed based on the CBAM of change, specifically the Stages of Concern Dimension. Participant responses were coded into two categories, (a) recollections of past perceptions, and (b) present perceptions regarding the innovation. ^ Data analysis resulted in the emergence of one major theme and two subordinate themes. The themes were related to time and purpose of the innovation. The researcher also discovered that the participants exhibited responses typically representative of the CBAM for individuals who are in the process of adjusting to a new innovation. ^ Recommendations based on participant concerns are made for improving the implementation of the innovation. Recommendations for alternatives to the innovation and suggestions regarding areas for further research in the field of educational change are also made. ^

Eastern oysters (Crassostrea virginica) as an indicator for restoration of Everglades Ecosystems

The Comprehensive Everglades Restoration Plan (CERP) attempts to restore hydrology in the Northern and Southern Estuaries of Florida. Reefs of the Eastern oyster Crassostrea virginica are a dominant feature of the estuaries along the Southwest Florida coast. Oysters are benthic, sessile, filter-feeding organisms that provide ecosystem services by filtering the water column and providing food, shelter and habitat for associated organisms. As such, the species is an excellent sentinel organism for examining the impacts of restoration on estuarine ecosystems. The implementation of CERP attempts to improve: the hydrology and spatial and structural characteristics of oyster reefs, the recruitment and survivorship of C. virginica, and the reef-associated communities of organisms. This project links biological responses and environmental conditions relative to hydrological changes as a means of assessing positive or negative trends in oyster responses and population trends. Using oyster responses, we have developed a communication tool (i.e., Stoplight Report Card) based on CERP performance measures that can distinguish between responses to restoration and natural patterns. The Stoplight Report Card system is a communication tool that uses Monitoring and Assessment Program (MAP) performance measures to grade an estuary's response to changes brought about by anthropogenic input or restoration activities. The Stoplight Report Card consists of both a suitability index score for each organism metric as well as a trend score (− decreasing trend, +/− no change in trend, and + increasing trend). Based on these two measures, a component score (e.g., living density) is calculated by averaging the suitability index score and the trend score. The final index score is obtained by taking the geometric score of each component, which is then translated into a stoplight color for success (green), caution (yellow), or failure (red). Based on the data available for oyster populations and the responses of oysters in the Caloosahatchee Estuary, the system is currently at stage “caution.” This communication tool instantly conveys the status of the indicator and the suitability, while trend curves provide information on progress towards reaching a target. Furthermore, the tool has the advantage of being able to be applied regionally, by species, and collectively, in concert with other species, system-wide.

Retention and special education referral practices before and after the implementation of high -stakes testing

The rewards and sanctions associated with high-stakes testing may induce educators to participate in practices that will ensure the elimination of the scores of low-achieving students from the testing pool. Two ways in which scores may be eliminated is through retention or referral to special education. ^ This study examined the use of these practices at 179 elementary schools in Miami-Dade County Public Schools, the 4th largest school district in the country. Between- and within-subjects designs were analyzed using repeated measures analysis of variance to compare retention and referral to special education practices over a five-year period of time, two years prior to and two years after the implementation of Florida's high-stakes test, the Florida Comprehensive Assessment Test, FCAT. ^ Significant main effects for referral and retention over time were demonstrated. The use of retention steadily increased over the first three years, with its usage maintained during the fourth year. While the use of referral actually decreased from the first to second years, a significant change occurred after the implementation of the FCAT. ^ Examination of the use of these practices according to student and school characteristics revealed significant differences. Increases in the use of referral across time was significant for Black, non-Hispanic and Hispanic students, all limited English proficiency population categories, medium and low socioeconomic status category schools, all grade levels, and for schools with accountability grades of A. C, D and F with the most striking absolute increase occurring for F schools. Increases in the use of retention across time were significant for all ethnic groups, limited English proficiency categories, and socioeconomic status categories, for grades kindergarten through four and by gender. Significant increases occurred for schools with accountability performance grades of C, D and F; however the most dramatic increase occurred for the F schools. A direct relationship between performance category grade of school and their use of retention was demonstrated. The results suggest that schools changed their use of referral and retention in response to the implementation of the FCAT. ^

TEACHNJ: An Evaluation of Two Years Implementation

The Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act was adopted by the New Jersey legislature in August 2012 with the intent to raise student achievement by improving the overall quality of instruction. As a result of this act, new teacher evaluation systems are being introduced in school districts across the state in an effort to more accurately assess teacher performance. The new teacher evaluations will be based on multiple classroom observations as well as the academic achievement of their students as measured on standardized tests. In addition, professional development opportunities are likely to change under this legislation, with schools customizing professional development programs to more effectively meet the needs of their teachers. The overarching question that informs our research is what impact will TEACH NJ have on the overall value of teacher evaluations and the quality of professional development opportunities offered to teachers. Data collected through survey research presents the pre-implementation practices (2011-2012 school year) as well as one year post-implementation practices (2013-2014) taking place in school districts throughout New Jersey. The findings reflect teachers’ perceptions of the value of the current teacher evaluation practices, the quality of the current professional development opportunities and the value the school administration places on teacher evaluations.

Digital signal processing implementation for near real-time wavelet transformation system for binary images

Communication has become an essential function in our civilization. With the increasing demand for communication channels, it is now necessary to find ways to optimize the use of their bandwidth. One way to achieve this is by transforming the information before it is transmitted. This transformation can be performed by several techniques. One of the newest of these techniques is the use of wavelets. Wavelet transformation refers to the act of breaking down a signal into components called details and trends by using small waveforms that have a zero average in the time domain. After this transformation the data can be compressed by discarding the details, transmitting the trends. In the receiving end, the trends are used to reconstruct the image. In this work, the wavelet used for the transformation of an image will be selected from a library of available bases. The accuracy of the reconstruction, after the details are discarded, is dependent on the wavelets chosen from the wavelet basis library. The system developed in this thesis takes a 2-D image and decomposes it using a wavelet bank. A digital signal processor is used to achieve near real-time performance in this transformation task. A contribution of this thesis project is the development of DSP-based test bed for the future development of new real-time wavelet transformation algorithms.

Design and implementation of a web based shop floor control system to maintain schedule feasibility in a dynamic job shop environment

The effective control of production activities in dynamic job shop with predetermined resource allocation for all the jobs entering the system is a unique manufacturing environment, which exists in the manufacturing industry. In this thesis a framework for an Internet based real time shop floor control system for such a dynamic job shop environment is introduced. The system aims to maintain the schedule feasibility of all the jobs entering the manufacturing system under any circumstance. The system is capable of deciding how often the manufacturing activities should be monitored to check for control decisions that need to be taken on the shop floor. The system will provide the decision maker real time notification to enable him to generate feasible alternate solutions in case a disturbance occurs on the shop floor. The control system is also capable of providing the customer with real time access to the status of the jobs on the shop floor. The communication between the controller, the user and the customer is through web based user friendly GUI. The proposed control system architecture and the interface for the communication system have been designed, developed and implemented.

Retention and special education referral practices before and after the implementation of high-stakes testing

The rewards and sanctions associated with high-stakes testing may induce educators to participate in practices that will ensure the elimination of the scores of low-achieving students from the testing pool. Two ways in which scores may be eliminated is through retention or referral to special education. This study examined the use of these practices at 179 elementary schools in Miami-Dade County Public Schools, the 4th largest school district in the country. Between- and within-subjects designs were analyzed using repeated measures analysis of variance to compare retention and referral to special education practices over a five-year period of time, two years prior to and two years after the implementation of Florida's high-stakes test, the Florida Comprehensive Assessment Test, FCAT. Significant main effects for referral and retention over time were demonstrated. The use of retention steadily increased over the first three years, with its usage maintained during the fourth year. While the use of referral actually decreased from the first to second years, a significant change occurred after the implementation of the FCAT. Examination of the use of these practices according to student and school characteristics revealed significant differences. Increases in the use of referral across time was significant for Black, non-Hispanic and Hispanic students, all limited English proficiency population categories, medium and low socioeconomic status category schools, all grade levels, and for schools with accountability grades of A, C, D and F with the most striking absolute increase occurring for F schools. Increases in the use of retention across time were significant for all ethnic groups, limited English proficiency categories, and socioeconomic status categories, for grades kindergarten through four and by gender. Significant increases occurred for schools with accountability performance grades of C, D and F; however the most dramatic increase occurred for the F schools. A direct relationship between performance category grade of school and their use of retention was demonstrated. The results suggest that schools changed their use of referral and retention in response to the implementation of the FCAT.

Development and Application of a Multi-dimensional Strategy for Measuring Fidelity of Implementation of a Districtwide Intervention

This symposium describes a multi-dimensional strategy to examine fidelity of implementation in an authentic school district context. An existing large-district peer mentoring program provides an example. The presentation will address development of a logic model to articulate a theory of change; collaborative creation of a data set aligned with essential concepts and research questions; identification of independent, dependent, and covariate variables; issues related to use of big data that include conditioning and transformation of data prior to analysis; operationalization of a strategy to capture fidelity of implementation data from all stakeholders; and ways in which fidelity indicators might be used.