Local officials' preferences of performance measurements: A study of local police services

The purpose of this study is to identify the determinants of local officials' preferences of performance measures under the assumption that public officials' consensus on performance measures can enhance the accountability in public service delivery. This research consists of two steps: multiple case studies and a survey. The author conducted the case studies in five general-purpose municipalities in Florida, interviewing 25 local officials, attending community meetings, and reviewing relevant local documents. Based on the case studies and the relevant literature, a survey was developed and sent to 445 local officials in 67 general-purpose municipalities in Dade, Broward, and Palm Beach Counties, Florida. The findings of the case studies and the survey suggest that local officials' preferences of performance measures are influenced by their perception of utilities of performance measures and their desire to measure the achievement of organizational goals. The author concludes that a consensus among local officials for outcome-oriented performance measures is easier to achieve if a prospective performance measurement system is designed for reporting and management purposes rather than for budgeting purposes. ^

Adult education directors' perceptions of performance indicators for adult education programs in the state of Florida

Current demands for accountability in education emphasize outcome-based program evaluation and tie program funding to individual student performance. As has been the case for elementary and secondary programs, demands for accountability have increased pressure on adult educators to show evidence of the benefits of their programs in order to justify their financial support. In Florida, recent legislation fundamentally changes the delivery of adult education in the state by establishing a performance-based funding system that is based on outcomes related to the retention, completion, and employment of program participants.^ A performance-based funding system requires an evaluation process that stresses outcome indicators over indicators that focus on program context or process. Although the state has adopted indicators of program quality to evaluate its adult education programs, these indicators focus mostly on program processes rather than student outcomes. In addition, the indicators are not specifically tied to workforce development outcomes, a priority to federal and local funding agents.^ Improving the accountability of adult education programs and defining the role of these programs in Florida's Workforce Development System has become a priority to policy makers across the state. Another priority has been to involve adult education practitioners in every step of this process.^ This study was conducted in order to determine what performance indicators, as judged by the directors and supervisors of adult education programs in the state of Florida, are important and feasible in measuring the quality and effectiveness of these programs. The results of the study indicated that, both statewide and by region, the respondents consistently gave the highest ratings on both importance and feasibility to the indicators of Program Context, which reflect the needs, composition, and structure of the programs, and to the indicators of Educational Gain, which reflect learner progress in the attainment of basic skills and competencies. In turn, the respondents gave the lowest ratings on both importance and feasibility to the indicators in the areas of Return on State's Investment, Efficiency, Retention, and Workforce Training. In general, the indicators that received high ratings for importance also received high ratings for feasibility. ^

When is personality a predictor of performance? The moderating role of autonomy

The study described herein examined personality as a predictor of task and contextual performance. The Big Five personality dimensions (i.e., Neuroticism, Extraversion, Agreeableness, Openness to Experience, and Conscientiousness) were studied in relation to both task and contextual performance within an organization in the service industry. The situational factor, autonomy, was examined as a potential moderator for the hypothesized personality-contextual performance relationship. Hierarchical regression analyses indicated that Conscientiousness was a valid predictor of task performance, Neuroticism was a valid predictor of contextual performance, and Extraversion was a valid predictor of delinquent performance. However, results did not yield support for the moderating role of autonomy on the personality-contextual performance relationship. Nevertheless, job satisfaction did moderate the Openness to Experience-delinquent performance relationship. Practical implications of these results and suggestions for future research are discussed. ^

Effect of performance feedback on perceived knowledge and likelihood to pursue continuing education

The purpose of this study was to assess the effect of performance feedback on Athletic Trainers’ (ATs) perceived knowledge (PK) and likelihood to pursue continuing education (CE). The investigation was grounded in the theories of “the definition of the situation” (Thomas & Thomas, 1928) and the “illusion of knowing,” (Glenberg, Wilkinson, & Epstein, 1982) suggesting that PK drives behavior. This investigation measured the degree to which knowledge gap predicted CE seeking behavior by providing performance feedback designed to change PK. A pre-test post-test control-group design was used to measure PK and likelihood to pursue CE before and after assessing actual knowledge. ATs (n=103) were randomly sampled and assigned to two groups, with and without performance feedback. Two independent samples t-tests were used to compare groups on the difference scores of the dependent variables. Likelihood to pursue CE was predicted by three variables using multiple linear regression: perceived knowledge, pre-test likelihood to pursue CE, and knowledge gap. There was a 68.4% significant difference (t101=2.72, p=0.01, ES=0.45) between groups in the change scores for likelihood to pursue CE because of the performance feedback (Experimental group=13.7% increase; Control group=4.3% increase). The strongest relationship among the dependent variables was between pre-test and post-test measures of likelihood to pursue CE (F2,102=56.80, p<0.01, r=0.73, R2=0.53). The pre- and post-test predictive relationship was enhanced when group was included in the model. In this model [YCEpost=0.76XCEpre-0.34 Xgroup+2.24+E], group accounted for a significant amount of unique variance in predicting CE while the pre-test likelihood to pursue CE variable was held constant (F3,102=40.28, p<0.01, r=0.74, R2=0.55). Pre-test knowledge gap, regardless of group allocation, was a linear predictor of the likelihood to pursue CE (F1,102=10.90, p=.01, r=.31, R2=.10). In this investigation, performance feedback significantly increased participants’ likelihood to pursue CE. Pre-test knowledge gap was a significant predictor of likelihood to pursue CE, regardless if performance feedback was provided. ATs may have self-assessed and engaged in internal feedback as a result of their test-taking experience. These findings indicate that feedback, both internal and external, may be necessary to trigger CE seeking behavior.

The Use of Performance Appraisal Systems in Restaurants

Do restaurant managers commonly use performance appraisals and, if so, how frequently anf for what purposes? The authors address these questions and review the restaurant industry in general.

Effect of Performance Feedback on Perceived Knowledge and Likelihood to Pursue Continuing Education

The purpose of this study was to assess the effect of performance feedback on Athletic Trainers’ (ATs) perceived knowledge (PK) and likelihood to pursue continuing education (CE). The investigation was grounded in the theories of “the definition of the situation” (Thomas & Thomas, 1928) and the “illusion of knowing,” (Glenberg, Wilkinson, & Epstein, 1982) suggesting that PK drives behavior. This investigation measured the degree to which knowledge gap predicted CE seeking behavior by providing performance feedback designed to change PK. A pre-test post-test control-group design was used to measure PK and likelihood to pursue CE before and after assessing actual knowledge. ATs (n=103) were randomly sampled and assigned to two groups, with and without performance feedback. Two independent samples t-tests were used to compare groups on the difference scores of the dependent variables. Likelihood to pursue CE was predicted by three variables using multiple linear regression: perceived knowledge, pre-test likelihood to pursue CE, and knowledge gap. There was a 68.4% significant difference (t101= 2.72, p=0.01, ES=0.45) between groups in the change scores for likelihood to pursue CE because of the performance feedback (Experimental group=13.7% increase; Control group= 4.3% increase). The strongest relationship among the dependent variables was between pre-test and post-test measures of likelihood to pursue CE (F2,102=56.80, p<0.01, r=0.73, R2=0.53). The pre- and post-test predictive relationship was enhanced when group was included in the model. In this model [YCEpost=0.76XCEpre-0.34 Xgroup+2.24+E], group accounted for a significant amount of unique variance in predicting CE while the pre-test likelihood to pursue CE variable was held constant (F3,102=40.28, p<0.01,: r=0.74, R2=0.55). Pre-test knowledge gap, regardless of group allocation, was a linear predictor of the likelihood to pursue CE (F1,102=10.90, p=.01, r=.31, R2=.10). In this investigation, performance feedback significantly increased participants’ likelihood to pursue CE. Pre-test knowledge gap was a significant predictor of likelihood to pursue CE, regardless if performance feedback was provided. ATs may have self-assessed and engaged in internal feedback as a result of their test-taking experience. These findings indicate that feedback, both internal and external, may be necessary to trigger CE seeking behavior.

International stock portfolio selection and performance measures recognizing higher moments of return distributions

Since the seminal works of Markowitz (1952), Sharpe (1964), and Lintner (1965), numerous studies on portfolio selection and performance measure have been based upon the mean-variance framework. However, several researchers (e.g., Arditti (1967, and 1971), Samuelson (1970), and Rubinstein (1973)) argue that the higher moments cannot be neglected unless there is reason to believe that: (i) the asset returns are normally distributed and the investor's utility function is quadratic, or (ii) the empirical evidence demonstrates that higher moments are irrelevant to the investor's decision. Based on the same argument, this dissertation investigates the impact of higher moments of return distributions on three issues concerning the 14 international stock markets.^ First, the portfolio selection with skewness is determined using: the Polynomial Goal Programming in which investor preferences for skewness can be incorporated. The empirical findings suggest that the return distributions of international stock markets are not normally distributed, and that the incorporation of skewness into an investor's portfolio decision causes a major change in the construction of his optimal portfolio. The evidence also indicates that an investor will trade expected return of the portfolio for skewness. Moreover, when short sales are allowed, investors are better off as they attain higher expected return and skewness simultaneously.^ Second, the performance of international stock markets are evaluated using two types of performance measures: (i) the two-moment performance measures of Sharpe (1966), and Treynor (1965), and (ii) the higher-moment performance measures of Prakash and Bear (1986), and Stephens and Proffitt (1991). The empirical evidence indicates that higher moments of return distributions are significant and relevant to the investor's decision. Thus, the higher moment performance measures should be more appropriate to evaluate the performances of international stock markets. The evidence also indicates that various measures provide a vastly different performance ranking of the markets, albeit in the same direction.^ Finally, the inter-temporal stability of the international stock markets is investigated using the Parhizgari and Prakash (1989) algorithm for the Sen and Puri (1968) test which accounts for non-normality of return distributions. The empirical finding indicates that there is strong evidence to support the stability in international stock market movements. However, when the Anderson test which assumes normality of return distributions is employed, the stability in the correlation structure is rejected. This suggests that the non-normality of the return distribution is an important factor that cannot be ignored in the investigation of inter-temporal stability of international stock markets. ^

The impact of bandwidth in structured interviewing and criterion stability in predicting and assessing manager performance across transition and maintenance stages

The current study examined the role of three important components in the use of structured employment interviewing in performance prediction: construct bandwidth, observed communication skill, and the stability/dynamicity of performance criteria over time. A matched sample of 242 hospitality managers was derived from a field data set provided by a large hospitality management organization. Interview data and two years of performance appraisal data were provided. Bandwidth analysis demonstrated only minimal differences in prediction between matched predictor-criterion pairs compared with predictor to overall aggregate ratings (unmatched). The communication skill analysis revealed that this interviewer rated observation significantly predicted a number of the individual performance dimensions as well as overall performance over time. Of the five interview items, the strongest overall predictor of performance was interviewer rated communication skill. The stability/dynamicity analyses demonstrated the performance criteria to be generally stable over the two year period examined, which provides support for the long held notion that performance criteria is stabile over time. However, there were two exceptions. The interview dimension customer service orientation had shifting relationships over time with four of the criteria over the two year period. The performance criteria employee development also demonstrated some instability in its relationships with predictors. Thus, some evidence of dynamicity in performance criteria was revealed. Interestingly, both of the most noteworthy findings in the study involved items that were rated differently than the others in the study. The rated interview item communication skill and the rated performance criteria client satisfaction were ratings that involved a more direct level of observation. Additional analyses also revealed evidence of a general factor of performance. These two themes are more fully covered in the discussion.

A comparative analysis of self-determined evaluations of work performance and support needs by adults with mental retardation in supported work and in sheltered workshop environments

The purpose of this study was to determine if there was a difference in the self-determined evaluations of work performance and support needs by adults with mental retardation in supported employment and in sheltered workshop environments. The instrument, Job Observation and Behavior Scale: Opportunity for Self-Determination (JOBS: OSD; Brady, Rosenberg, & Frain, 2006), was administered to 38 adults with mental retardation from sheltered workshops and 32 adults with mental retardation from supported employment environments. Cross-tabulations with Chi-square tests and independent samples t-tests were conducted to evaluate differences between the two groups, sheltered workshop and supported work. Two Multivariate Analyses of Variance (MANOVAs) were conducted to determine the effect of work environment on Quality of Performance (QP) and Types of Support (TS) test scores and their subscales. ^ This study found that there were significant differences between the groups on the QP Behavior and Job Duties subscales. The sheltered workshop group perceived themselves as performing significantly better on job duties than the supported work group. Conversely, the supported work group perceived themselves to have better behavior than the sheltered workshop group. However, there were no significant differences between groups in their perception of support needs for the three subscales. ^ The findings imply that work environment affects the self-determined evaluations of work performance by adults with mental retardation. Recommendations for further study include (a) detailing the characteristics of supported work and sheltered workshops that support and/or discourage self-determined behaviors, (b) exploring the behavior of adults with mental retardation in sheltered workshops and supported work environments, and (c) analysis of the support needs for and understanding of them by adults with mental retardation in sheltered workshops and in supported work environments. ^

Developing performance measures of mangrove wetlands using simulation models of hydrology, nutrient biogeochemistry, and community dynamics

The goal of mangrove restoration projects should be to improve community structure and ecosystem function of degraded coastal landscapes. This requires the ability to forecast how mangrove structure and function will respond to prescribed changes in site conditions including hydrology, topography, and geophysical energies. There are global, regional, and local factors that can explain gradients of regulators (e.g., salinity, sulfides), resources (nutrients, light, water), and hydroperiod (frequency, duration of flooding) that collectively account for stressors that result in diverse patterns of mangrove properties across a variety of environmental settings. Simulation models of hydrology, nutrient biogeochemistry, and vegetation dynamics have been developed to forecast patterns in mangroves in the Florida Coastal Everglades. These models provide insight to mangrove response to specific restoration alternatives, testing causal mechanisms of system degradation. We propose that these models can also assist in selecting performance measures for monitoring programs that evaluate project effectiveness. This selection process in turn improves model development and calibration for forecasting mangrove response to restoration alternatives. Hydrologic performance measures include soil regulators, particularly soil salinity, surface topography of mangrove landscape, and hydroperiod, including both the frequency and duration of flooding. Estuarine performance measures should include salinity of the bay, tidal amplitude, and conditions of fresh water discharge (included in the salinity value). The most important performance measures from the mangrove biogeochemistry model should include soil resources (bulk density, total nitrogen, and phosphorus) and soil accretion. Mangrove ecology performance measures should include forest dimension analysis (transects and/or plots), sapling recruitment, leaf area index, and faunal relationships. Estuarine ecology performance measures should include the habitat function of mangroves, which can be evaluated with growth rate of key species, habitat suitability analysis, isotope abundance of indicator species, and bird census. The list of performance measures can be modified according to the model output that is used to define the scientific goals during the restoration planning process that reflect specific goals of the project.

Integrated Performance Assessment of Engineering Projects at the Interface of Emergent Properties and Uncertainty

Investigation of the performance of engineering project organizations is critical for understanding and eliminating inefficiencies in today’s dynamic global markets. The existing theoretical frameworks consider project organizations as monolithic systems and attribute the performance of project organizations to the characteristics of the constituents. However, project organizations consist of complex interdependent networks of agents, information, and resources whose interactions give rise to emergent properties that affect the overall performance of project organizations. Yet, our understanding of the emergent properties in project organizations and their impact on project performance is rather limited. This limitation is one of the major barriers towards creation of integrated theories of performance assessment in project organizations. The objective of this paper is to investigate the emergent properties that affect the ability of project organization to cope with uncertainty. Based on the theories of complex systems, we propose and test a novel framework in which the likelihood of performance variations in project organizations could be investigated based on the environment of uncertainty (i.e., static complexity, dynamic complexity, and external source of disruption) as well as the emergent properties (i.e., absorptive capacity, adaptive capacity, and restorative capacity) of project organizations. The existence and significance of different dimensions of the environment of uncertainty and emergent properties in the proposed framework are tested based on the analysis of the information collected from interviews with senior project managers in the construction industry. The outcomes of this study provide a novel theoretical lens for proactive bottom-up investigation of performance in project organizations at the interface of emergent properties and uncertainty

Factors influencing university performance of associate in arts graduates transferring to the state university system

The purpose of this study was to examine the factorsbehind the failure rates of Associate in Arts (AA)graduates from Miami-Dade Community College (M-DCC) transferring to the Florida State University System (SUS). In M-DCC's largest disciplines, the university failure rate was 13% for Business & Management, 13% for Computer Science, and 14% for Engineering. Hypotheses tested were: Hypothesis 1 (H1): The lower division (LD) overall cumulative GPA and/or the LD major field GPA for AA graduates are predictive of the SUS GPA for the Business Management, Computer Science, and Engineering disciplines. Hypothesis 2 (H2): Demographic variables (age, race, gender) are predictive of performance at the university among M-DCC AA graduates in Engineering, Business & Management, and Computer Science. Hypothesis 3 (H3): Administrative variables (CLAST -College Level Academic Skills Test subtests) are predictive of university performance (GPA) for the Business/Management, Engineering, and Computer Science disciplines. Hypothesis 4 (H4): LD curriculum variables (course credits, course quality points) are predictive of SUS performance for the Engineering, Business/Management and Computer Science disciplines. Multiple Regression was the inferential procedureselected for predictions. Descriptive statistics weregenerated on the predictors. Results for H1 identified the LD GPA as the most significant variable in accounting for the variability of the university GPA for the Business & Management, Computer Science, and Engineering disciplines. For H2, no significant results were obtained for theage and gender variables, but the ethnic subgroups indicated significance at the .0001 level. However, differentials in GPA may not have been due directly to the race factor but, rather, to curriculum choices and performance outcomes while in the LD. The CLAST computation variable (H3) was a significant predictor of the SUS GPA. This is most likely due to the mathematics structure pervasive in these disciplines. For H4, there were two curriculum variables significant in explaining the variability of the university GPA (number of required critical major credits completed and quality of the student's performance for these credits). Descriptive statistics on the predictors indicated that 78% of those failing in the State University System had a LD major GPA (calculated with the critical required university credits earned and quality points of these credits) of less than 3.0; and 83% of those failing at the university had an overall community college GPA of less than 3.0.

Development of ``HealthServe'': A measure of customer service orientation in healthcare

An assessment tool designed to measure a customer service orientation among RN's and LPN's was developed using a content-oriented approach. Critical incidents were first developed by asking two samples of healthcare managers (n = 52 and 25) to identify various customer-contact situations. The critical incidents were then used to formulate a 121-item instrument. Patient-contact workers from 3 hospitals (n = 102) completed the instrument along with the NEO-FFI, a measure of the Big Five personality factors. Concurrently, managers completed a performance evaluation scale on the employees participating in the study in order to determine the predictive validity of the instrument.^ Through a criterion-keying approach, the instrument was scaled down to 38 items. The correlation between HealthServe and the supervisory ratings of performance evaluation data supported the instrument's criterion-related validity (r =.66, p $<$.0001). Incremental validity of HealthServe over the Big Five was found with HealthServe accounting for 46% of the variance.^ The NEO-FFI was used to assess the correlation between personality traits and HealthServe. A factor analysis of HealthServe suggested 4 factors which were correlated with the NEO-FFI scores. Results indicated that HealthServe was related to Extraversion, Openness to Experience, Agreeableness, Conscientiousness and negatively related to Neuroticism.^ The benefits of the test construction procedure used here over the use of broad-based measures of personality were discussed as well as the limitations of using a concurrent validation strategy. Recommendations for future studies were provided. ^

A comparative analysis of school satisfaction and dropout risk of middle school students attending programs for students with emotional handicaps, severe emotional disturbance and general education students attending center schools and satellite schools

This study evaluated school satisfaction as an indicator of dropout risk of students with Emotional Handicaps (EH) and students with Severe Emotional Disturbance (SED). The students attended two different kinds of middle schools in a largely urban school district in South Florida. One hundred eight students in grade 8 (ages 13-16) participated in this study. Participants were administered the National Dropout Prevention Assessment (NDPA). Forty participants with EH and SED attended a special center school. Thirty-one participants with EH and SED attended satellite programs in a regular middle school. Thirty-seven general education participants attended the same regular middle school. Overall school satisfaction scores were generated, as well as three primary factors (school, environment and personal) and 16 subscales (school atmosphere, future income, difficulty level of classwork, teacher relationships, peer relationships, intrinsic interest in classwork, school hours, classwork stress, general attitude towards school, family influence, perceived opportunity for career, future goals, travel distance, leisure time, self-appraisal of performance, and self-esteem).^ Comparison of students with EH and SED revealed that both groups of students were rated at "low risk" of becoming dropouts on the Environmental factor and the Difficulty of Schoolwork subscale. Students with EH were rated at "caution risk" risk on the Travel Distance subscale. Students with SED were rated at "high risk" on this subscale.^ There were no significant differences in school satisfaction and dropout risk between different program delivery models. There were also no significant differences for category of students (EH, SED) by school type (center school, satellite program). All students were rated at "low risk" of dropping out of school.^ There were significant differences between general education students and students with EH and SED attending satellite programs. Students with EH and SED were rated at "caution risk" for dropping out on the Travel Distance and the Leisure Time subscales. Discussion of results, implications for practice and recommendations for further research are included. ^

The state of emergency management 2000: The process of emergency management professionalization in the United States and Florida

This dissertation analyzes the current status of emergency management professionalization in the United States and Florida using a qualitative case study. I investigate the efforts of various organizations at the national and state levels in the private and public sectors to organize emergency management as a profession. I conceptualize emergency management professionalization as occurring in two phases: the indirect institutionalization of the occupation of emergency management and the formal advancement toward an emergency management profession. The legislative, organizational, and procedural developments that occurred between approximately 1900 and the late 1970s became the indirect institutionalization of the occupation of emergency management. Over time, as our society developed and became increasingly complex, more disasters affect the security of the population. In order to adapt to increasing risks and vulnerabilities the emergency management system emerged and with it the necessary elements upon which a future profession could be established providing the basis for the formal advancement toward an emergency management profession. ^ During approximately the last twenty years, the formal advancement toward an emergency management profession has encompassed two primary strategies—certification and accreditation—motivated by the objective to organize a profession. Certification applies to individual emergency managers and includes all training and education. Accreditation of state and local emergency management agencies is reached by complying to a minimum level of proficiency with established standards of performance. Certification and accreditation are the mechanisms used to create an emergency management profession and thus act as axes around which the field of emergency management is organizing. ^ The purpose of this research is to provide a frame of reference for whether or not the field of emergency management is a profession. Based on sociology of professions literature, emergency management can be considered to be professionalizing. The current emergency management professionalization efforts may or may not be sufficient to achieve the ultimate goal of becoming a legitimate profession based on legal and public support for the exclusive right to perform emergency management tasks (monopoly) as well as self-regulation of those tasks (autonomy). ^