Local officials' preferences of performance measurements: A study of local police services

The purpose of this study is to identify the determinants of local officials' preferences of performance measures under the assumption that public officials' consensus on performance measures can enhance the accountability in public service delivery. This research consists of two steps: multiple case studies and a survey. The author conducted the case studies in five general-purpose municipalities in Florida, interviewing 25 local officials, attending community meetings, and reviewing relevant local documents. Based on the case studies and the relevant literature, a survey was developed and sent to 445 local officials in 67 general-purpose municipalities in Dade, Broward, and Palm Beach Counties, Florida. The findings of the case studies and the survey suggest that local officials' preferences of performance measures are influenced by their perception of utilities of performance measures and their desire to measure the achievement of organizational goals. The author concludes that a consensus among local officials for outcome-oriented performance measures is easier to achieve if a prospective performance measurement system is designed for reporting and management purposes rather than for budgeting purposes. ^

A comparison of the teacher efficacy and performance of traditionally and alternatively certified first -year teachers

The purpose of this study was to compare the efficacy and performance evaluations of alternatively certified first-year teachers to traditionally certified first-year teachers. The participants were 25 first-year teachers in the Broward County Public School District (FL) who completed the Transition to Teaching alternative certification program and a comparison group of 32 first-year teachers in the same school district who completed a traditional university teacher preparation program. ^ The study was a mixed methods design (Creswell, 2003; Tashakkori & Teddlie, 1998). The quantitative data were collected during the 2002–2003 school year using the Teachers' Sense of Efficacy Scale (Tschannen-Moran & Hoy, 2001) and the Florida Performance Measurement System formative and summative instruments. The qualitative data consisted of focus group interviews that were conducted at the end of the 2002–2003 school year. ^ Data were analyzed using independent samples t tests to compare the means of the two populations on their efficacy scores and performance evaluations. Paired samples t tests and analysis of covariance (ANCOVA) were used to compare the efficacy scores for each certification type at the beginning of the school year to the efficacy scores at the end of the school year. A repeated measures analysis of variance (ANOVA) was used to compare the change in the efficacy scores of the teachers from the beginning of the school year to the end of the school year. Focus group interviews were conducted and transcribed, and the content was analyzed and categorized based on the four sources of self-efficacy described by Bandura (1986, 1997). ^ The results of this study revealed that no statistically significant differences existed between the two groups of teachers in their teacher efficacy or performance evaluations and that they reported similar sources of their efficacy. These findings add to the research base that supports alternative certification as a viable and effective pathway into teaching. ^

Performance accountability in the federal-state transportation program: Factors affecting successful implementation

Governmental accountability is the requirement of government entities to be accountable to the citizenry in order to justify the raising and expenditure of public resources. The concept of service efforts and accomplishments measurement for government programs was introduced by the Governmental Accounting Standards Board (GASB) in Service Efforts and Accomplishments Reporting: Its Time Has Come (1990). This research tested the feasibility of implementing the concept for the Federal-aid highway construction program and identified factors affecting implementation with a case study of the District of Columbia. Changes in condition and performance ratings for specific highway segments in 15 projects, before and after construction expenditures, were evaluated using data provided by the Federal Highway Administration. The results of the evaluation indicated difficulty in drawing conclusions on the state program performance, as a whole. The state program reflects problems within the Federally administered program that severely limit implementation of outcome-oriented performance measurement. Major problems identified with data acquisition are: data reliability, availability, compatibility and consistency among states. Other significant factors affecting implementation are institutional barriers and political barriers. Institutional issues in the Federal Highway Administration include the lack of integration of the fiscal project specific database with the Highway Performance Monitoring System database. The Federal Highway Administration has the ability to resolve both of the data problems, however interviews with key Federal informants indicate this will not occur without external directives and changes to the Federal “stewardship” approach to program administration. ^ The findings indicate many issues must be resolved for successful implementation of outcome-oriented performance measures in the Federal-aid construction program. The issues are organizational and political in nature, however in the current environment resolution is possible. Additional research is desirable and would be useful in overcoming the obstacles to successful implementation. ^

Stated versus observed performance levels in patients with chronic low back pain

This study examined the relationship between chronic low back pain (CLBP) patients' perceived (stated) levels of function and their measured (observed) performance in squatting and stair climbing activities as compared to healthy volunteers. Twenty patients with CLBP and 20 healthy subjects were asked through an interview to self-assess their ability to comfortably perform stair climbing and squatting as well as other tolerances. The subjects were then asked to perform the activities and their performance levels were recorded. Results of the t-tests and Analysis of Variance (ANOVA) procedures revealed that patients' estimate of squatting and stair climbing abilities as well as their demonstrated levels were significantly lower (p < 0.001) than those of the healthy subjects. There was a significant difference between groups in terms of the time required to perform squatting but not stair climbing. Both healthy subjects and patients with CLBP underestimated their physical capabilities. Findings indicate that the use of actual performance measurement combined with self-report of functional abilities is needed when assessing performance levels of both healthy as well as patients with CLBP.

Team Evaluation: Solutions for Hotel Management and Productivity

Employee performance appraisal systems are controversial, especially when accomplished by a single rater. The authors, who have had experience with team evaluation systems, present evidence from that experience for over- coming obstacles to moving to a "less-biased" system of rating employees.

Leveraging symbiotic relationships for emulation of computer networks

The lack of analytical models that can accurately describe large-scale networked systems makes empirical experimentation indispensable for understanding complex behaviors. Research on network testbeds for testing network protocols and distributed services, including physical, emulated, and federated testbeds, has made steady progress. Although the success of these testbeds is undeniable, they fail to provide: 1) scalability, for handling large-scale networks with hundreds or thousands of hosts and routers organized in different scenarios, 2) flexibility, for testing new protocols or applications in diverse settings, and 3) inter-operability, for combining simulated and real network entities in experiments. This dissertation tackles these issues in three different dimensions. First, we present SVEET, a system that enables inter-operability between real and simulated hosts. In order to increase the scalability of networks under study, SVEET enables time-dilated synchronization between real hosts and the discrete-event simulator. Realistic TCP congestion control algorithms are implemented in the simulator to allow seamless interactions between real and simulated hosts. SVEET is validated via extensive experiments and its capabilities are assessed through case studies involving real applications. Second, we present PrimoGENI, a system that allows a distributed discrete-event simulator, running in real-time, to interact with real network entities in a federated environment. PrimoGENI greatly enhances the flexibility of network experiments, through which a great variety of network conditions can be reproduced to examine what-if questions. Furthermore, PrimoGENI performs resource management functions, on behalf of the user, for instantiating network experiments on shared infrastructures. Finally, to further increase the scalability of network testbeds to handle large-scale high-capacity networks, we present a novel symbiotic simulation approach. We present SymbioSim, a testbed for large-scale network experimentation where a high-performance simulation system closely cooperates with an emulation system in a mutually beneficial way. On the one hand, the simulation system benefits from incorporating the traffic metadata from real applications in the emulation system to reproduce the realistic traffic conditions. On the other hand, the emulation system benefits from receiving the continuous updates from the simulation system to calibrate the traffic between real applications. Specific techniques that support the symbiotic approach include: 1) a model downscaling scheme that can significantly reduce the complexity of the large-scale simulation model, resulting in an efficient emulation system for modulating the high-capacity network traffic between real applications; 2) a queuing network model for the downscaled emulation system to accurately represent the network effects of the simulated traffic; and 3) techniques for reducing the synchronization overhead between the simulation and emulation systems.

Leveraging Symbiotic Relationships for Emulation of Computer Networks

The lack of analytical models that can accurately describe large-scale networked systems makes empirical experimentation indispensable for understanding complex behaviors. Research on network testbeds for testing network protocols and distributed services, including physical, emulated, and federated testbeds, has made steady progress. Although the success of these testbeds is undeniable, they fail to provide: 1) scalability, for handling large-scale networks with hundreds or thousands of hosts and routers organized in different scenarios, 2) flexibility, for testing new protocols or applications in diverse settings, and 3) inter-operability, for combining simulated and real network entities in experiments. This dissertation tackles these issues in three different dimensions. First, we present SVEET, a system that enables inter-operability between real and simulated hosts. In order to increase the scalability of networks under study, SVEET enables time-dilated synchronization between real hosts and the discrete-event simulator. Realistic TCP congestion control algorithms are implemented in the simulator to allow seamless interactions between real and simulated hosts. SVEET is validated via extensive experiments and its capabilities are assessed through case studies involving real applications. Second, we present PrimoGENI, a system that allows a distributed discrete-event simulator, running in real-time, to interact with real network entities in a federated environment. PrimoGENI greatly enhances the flexibility of network experiments, through which a great variety of network conditions can be reproduced to examine what-if questions. Furthermore, PrimoGENI performs resource management functions, on behalf of the user, for instantiating network experiments on shared infrastructures. Finally, to further increase the scalability of network testbeds to handle large-scale high-capacity networks, we present a novel symbiotic simulation approach. We present SymbioSim, a testbed for large-scale network experimentation where a high-performance simulation system closely cooperates with an emulation system in a mutually beneficial way. On the one hand, the simulation system benefits from incorporating the traffic metadata from real applications in the emulation system to reproduce the realistic traffic conditions. On the other hand, the emulation system benefits from receiving the continuous updates from the simulation system to calibrate the traffic between real applications. Specific techniques that support the symbiotic approach include: 1) a model downscaling scheme that can significantly reduce the complexity of the large-scale simulation model, resulting in an efficient emulation system for modulating the high-capacity network traffic between real applications; 2) a queuing network model for the downscaled emulation system to accurately represent the network effects of the simulated traffic; and 3) techniques for reducing the synchronization overhead between the simulation and emulation systems.