Local officials' preferences of performance measurements: A study of local police services

The purpose of this study is to identify the determinants of local officials' preferences of performance measures under the assumption that public officials' consensus on performance measures can enhance the accountability in public service delivery. This research consists of two steps: multiple case studies and a survey. The author conducted the case studies in five general-purpose municipalities in Florida, interviewing 25 local officials, attending community meetings, and reviewing relevant local documents. Based on the case studies and the relevant literature, a survey was developed and sent to 445 local officials in 67 general-purpose municipalities in Dade, Broward, and Palm Beach Counties, Florida. The findings of the case studies and the survey suggest that local officials' preferences of performance measures are influenced by their perception of utilities of performance measures and their desire to measure the achievement of organizational goals. The author concludes that a consensus among local officials for outcome-oriented performance measures is easier to achieve if a prospective performance measurement system is designed for reporting and management purposes rather than for budgeting purposes. ^

Adult education directors' perceptions of performance indicators for adult education programs in the state of Florida

Current demands for accountability in education emphasize outcome-based program evaluation and tie program funding to individual student performance. As has been the case for elementary and secondary programs, demands for accountability have increased pressure on adult educators to show evidence of the benefits of their programs in order to justify their financial support. In Florida, recent legislation fundamentally changes the delivery of adult education in the state by establishing a performance-based funding system that is based on outcomes related to the retention, completion, and employment of program participants.^ A performance-based funding system requires an evaluation process that stresses outcome indicators over indicators that focus on program context or process. Although the state has adopted indicators of program quality to evaluate its adult education programs, these indicators focus mostly on program processes rather than student outcomes. In addition, the indicators are not specifically tied to workforce development outcomes, a priority to federal and local funding agents.^ Improving the accountability of adult education programs and defining the role of these programs in Florida's Workforce Development System has become a priority to policy makers across the state. Another priority has been to involve adult education practitioners in every step of this process.^ This study was conducted in order to determine what performance indicators, as judged by the directors and supervisors of adult education programs in the state of Florida, are important and feasible in measuring the quality and effectiveness of these programs. The results of the study indicated that, both statewide and by region, the respondents consistently gave the highest ratings on both importance and feasibility to the indicators of Program Context, which reflect the needs, composition, and structure of the programs, and to the indicators of Educational Gain, which reflect learner progress in the attainment of basic skills and competencies. In turn, the respondents gave the lowest ratings on both importance and feasibility to the indicators in the areas of Return on State's Investment, Efficiency, Retention, and Workforce Training. In general, the indicators that received high ratings for importance also received high ratings for feasibility. ^

When is personality a predictor of performance? The moderating role of autonomy

The study described herein examined personality as a predictor of task and contextual performance. The Big Five personality dimensions (i.e., Neuroticism, Extraversion, Agreeableness, Openness to Experience, and Conscientiousness) were studied in relation to both task and contextual performance within an organization in the service industry. The situational factor, autonomy, was examined as a potential moderator for the hypothesized personality-contextual performance relationship. Hierarchical regression analyses indicated that Conscientiousness was a valid predictor of task performance, Neuroticism was a valid predictor of contextual performance, and Extraversion was a valid predictor of delinquent performance. However, results did not yield support for the moderating role of autonomy on the personality-contextual performance relationship. Nevertheless, job satisfaction did moderate the Openness to Experience-delinquent performance relationship. Practical implications of these results and suggestions for future research are discussed. ^

Teachers' knowledge, awareness, and pedagogy of global education in secondary schools

In 1979, the Florida State Board of Education approved the teaching of global education in the state of Florida. The purpose of this study was to examine the factors that contributed to teachers' global knowledge, global mindedness, and pedagogy in global education. The Hanvey model of teaching from a global perspective was the theoretical framework for the study. ^ A total of 90 secondary teachers from Miami-Dade County Public Schools were randomly selected and placed in three groups: Globally Oriented Social Studies Program (GOSSE), Non-Globally Oriented Social Studies Program (non-GOSSE), and Teachers Who Teach Other Subjects (TWTOS). Seven teachers, two of whom team-taught a class, were selected for classroom observations and interviews. A mixed methods design that combined quantitative and qualitative data was used. ANOVA and Chi square techniques were used to determine whether the factors that contributed to teachers' global knowledge and global mindedness differ among groups. Classroom observations and interviews were conducted to determine whether the instructional strategies differ among the seven selected teachers. ^ The findings of the study show that teachers who were trained in teaching from a global perspective differed in their global knowledge and used more appropriate instructional strategies than teachers who were not trained in teaching global perspectives. There was no significant difference in the combined global knowledge of the non-GOSSE and TWTOS groups when compared with the GOSSE group. There was no significant difference in the combined global knowledge of the GOSSE and non-GOSSE groups when compared with the TWTOS group. There was no significant difference among the teachers in their global mindedness. Observation and interview data indicate that current events, role-playing, simulations, open-ended discussion, debates, and projects were the predominant instructional strategies used by globally trained teachers. Cable networks, Internet, magazines, and newspapers were found to be the dominant tools for teaching global education. ^ This study concluded that teachers who were trained in globally oriented programs had more global knowledge than teachers who were not. It is recommended that teacher education programs should incorporate a global perspective in the preparation of social studies teachers, with particular attention to developing their global attitudes. ^

Effect of performance feedback on perceived knowledge and likelihood to pursue continuing education

The purpose of this study was to assess the effect of performance feedback on Athletic Trainers’ (ATs) perceived knowledge (PK) and likelihood to pursue continuing education (CE). The investigation was grounded in the theories of “the definition of the situation” (Thomas & Thomas, 1928) and the “illusion of knowing,” (Glenberg, Wilkinson, & Epstein, 1982) suggesting that PK drives behavior. This investigation measured the degree to which knowledge gap predicted CE seeking behavior by providing performance feedback designed to change PK. A pre-test post-test control-group design was used to measure PK and likelihood to pursue CE before and after assessing actual knowledge. ATs (n=103) were randomly sampled and assigned to two groups, with and without performance feedback. Two independent samples t-tests were used to compare groups on the difference scores of the dependent variables. Likelihood to pursue CE was predicted by three variables using multiple linear regression: perceived knowledge, pre-test likelihood to pursue CE, and knowledge gap. There was a 68.4% significant difference (t101=2.72, p=0.01, ES=0.45) between groups in the change scores for likelihood to pursue CE because of the performance feedback (Experimental group=13.7% increase; Control group=4.3% increase). The strongest relationship among the dependent variables was between pre-test and post-test measures of likelihood to pursue CE (F2,102=56.80, p<0.01, r=0.73, R2=0.53). The pre- and post-test predictive relationship was enhanced when group was included in the model. In this model [YCEpost=0.76XCEpre-0.34 Xgroup+2.24+E], group accounted for a significant amount of unique variance in predicting CE while the pre-test likelihood to pursue CE variable was held constant (F3,102=40.28, p<0.01, r=0.74, R2=0.55). Pre-test knowledge gap, regardless of group allocation, was a linear predictor of the likelihood to pursue CE (F1,102=10.90, p=.01, r=.31, R2=.10). In this investigation, performance feedback significantly increased participants’ likelihood to pursue CE. Pre-test knowledge gap was a significant predictor of likelihood to pursue CE, regardless if performance feedback was provided. ATs may have self-assessed and engaged in internal feedback as a result of their test-taking experience. These findings indicate that feedback, both internal and external, may be necessary to trigger CE seeking behavior.

Towards a Pedagogy of Inferential Statistics in Graduate Education Programs: Insights from Cognitive and Educational Research

This study attempts to understand the nature of knowledge base that supports the ability to select statistical techniques for research situations. Findings showed that the largest component of such knowledge was related to research design. One implication is that techniques should be taught in relation to features of research design.

Teachers’ Knowledge, Awareness and Pedagogy of Global Education in Secondary Schools

For the last fifty years, social studies teachers have been prepared to teach from a global perspective, but since September 11, 2001 have faced a difficult challenge teaching from a global perspective. This study examines ninety secondary school teachers’ global knowledge and their disposition toward teaching from a global perspective.

The Use of Performance Appraisal Systems in Restaurants

Do restaurant managers commonly use performance appraisals and, if so, how frequently anf for what purposes? The authors address these questions and review the restaurant industry in general.

Teachers' knowledge, awareness, and pedagogy of global education in secondary schools

Professor Mohammed K. Farouk, Major Professor In 1979, the Florida State Board of Education approved the teaching of global education in the state of Florida. The purpose of this study was to examine the factors that contributed to teachers' global knowledge, global mindedness, and pedagogy in global education. The Hanvey model of teaching from a global perspective was the theoretical framework for the study. A total of 90 secondary teachers from Miami-Dade County Public Schools were randomly selected and placed in three groups: Globally Oriented Social Studies Program (GOSSE), Non-Globally Oriented Social Studies Program (non-GOSSE), and Teachers Who Teach Other Subjects (TWTOS). Seven teachers, two of whom team-taught a class, were selected for classroom observations and interviews. A mixed methods design that combined quantitative and qualitative data was used. ANOVA and Chi square techniques were used to determine whether the factors that contributed to teachers' global knowledge and global mindedness differ among groups. Classroom observations and interviews were conducted to determine whether the instructional strategies differ among the seven selected teachers. The findings of the study show that teachers who were trained in teaching from a global perspective differed in their global knowledge and used more appropriate instructional strategies than teachers who were not trained in teaching global perspectives. There was no significant difference in the combined global knowledge of the non-GOSSE and TWTOS groups when compared with the GOSSE group. There was no significant difference in the combined global knowledge of the GOSSE and non- GOSSE groups when compared with the TWTOS group. There was no significant difference among the teachers in their global mindedness. Observation and interview data indicate that current events, role-playing, simulations, open-ended discussion, debates, and projects were the predominant instructional strategies used by globally trained teachers. Cable networks, Internet, magazines, and newspapers were found to be the dominant tools for teaching global education. This study concluded that teachers who were trained in globally oriented programs had more global knowledge than teachers who were not. It is recommended that teacher education programs should incorporate a global perspective in the preparation of social studies teachers, with particular attention to developing their global attitudes.

Effect of Performance Feedback on Perceived Knowledge and Likelihood to Pursue Continuing Education

The purpose of this study was to assess the effect of performance feedback on Athletic Trainers’ (ATs) perceived knowledge (PK) and likelihood to pursue continuing education (CE). The investigation was grounded in the theories of “the definition of the situation” (Thomas & Thomas, 1928) and the “illusion of knowing,” (Glenberg, Wilkinson, & Epstein, 1982) suggesting that PK drives behavior. This investigation measured the degree to which knowledge gap predicted CE seeking behavior by providing performance feedback designed to change PK. A pre-test post-test control-group design was used to measure PK and likelihood to pursue CE before and after assessing actual knowledge. ATs (n=103) were randomly sampled and assigned to two groups, with and without performance feedback. Two independent samples t-tests were used to compare groups on the difference scores of the dependent variables. Likelihood to pursue CE was predicted by three variables using multiple linear regression: perceived knowledge, pre-test likelihood to pursue CE, and knowledge gap. There was a 68.4% significant difference (t101= 2.72, p=0.01, ES=0.45) between groups in the change scores for likelihood to pursue CE because of the performance feedback (Experimental group=13.7% increase; Control group= 4.3% increase). The strongest relationship among the dependent variables was between pre-test and post-test measures of likelihood to pursue CE (F2,102=56.80, p<0.01, r=0.73, R2=0.53). The pre- and post-test predictive relationship was enhanced when group was included in the model. In this model [YCEpost=0.76XCEpre-0.34 Xgroup+2.24+E], group accounted for a significant amount of unique variance in predicting CE while the pre-test likelihood to pursue CE variable was held constant (F3,102=40.28, p<0.01,: r=0.74, R2=0.55). Pre-test knowledge gap, regardless of group allocation, was a linear predictor of the likelihood to pursue CE (F1,102=10.90, p=.01, r=.31, R2=.10). In this investigation, performance feedback significantly increased participants’ likelihood to pursue CE. Pre-test knowledge gap was a significant predictor of likelihood to pursue CE, regardless if performance feedback was provided. ATs may have self-assessed and engaged in internal feedback as a result of their test-taking experience. These findings indicate that feedback, both internal and external, may be necessary to trigger CE seeking behavior.

International stock portfolio selection and performance measures recognizing higher moments of return distributions

Since the seminal works of Markowitz (1952), Sharpe (1964), and Lintner (1965), numerous studies on portfolio selection and performance measure have been based upon the mean-variance framework. However, several researchers (e.g., Arditti (1967, and 1971), Samuelson (1970), and Rubinstein (1973)) argue that the higher moments cannot be neglected unless there is reason to believe that: (i) the asset returns are normally distributed and the investor's utility function is quadratic, or (ii) the empirical evidence demonstrates that higher moments are irrelevant to the investor's decision. Based on the same argument, this dissertation investigates the impact of higher moments of return distributions on three issues concerning the 14 international stock markets.^ First, the portfolio selection with skewness is determined using: the Polynomial Goal Programming in which investor preferences for skewness can be incorporated. The empirical findings suggest that the return distributions of international stock markets are not normally distributed, and that the incorporation of skewness into an investor's portfolio decision causes a major change in the construction of his optimal portfolio. The evidence also indicates that an investor will trade expected return of the portfolio for skewness. Moreover, when short sales are allowed, investors are better off as they attain higher expected return and skewness simultaneously.^ Second, the performance of international stock markets are evaluated using two types of performance measures: (i) the two-moment performance measures of Sharpe (1966), and Treynor (1965), and (ii) the higher-moment performance measures of Prakash and Bear (1986), and Stephens and Proffitt (1991). The empirical evidence indicates that higher moments of return distributions are significant and relevant to the investor's decision. Thus, the higher moment performance measures should be more appropriate to evaluate the performances of international stock markets. The evidence also indicates that various measures provide a vastly different performance ranking of the markets, albeit in the same direction.^ Finally, the inter-temporal stability of the international stock markets is investigated using the Parhizgari and Prakash (1989) algorithm for the Sen and Puri (1968) test which accounts for non-normality of return distributions. The empirical finding indicates that there is strong evidence to support the stability in international stock market movements. However, when the Anderson test which assumes normality of return distributions is employed, the stability in the correlation structure is rejected. This suggests that the non-normality of the return distribution is an important factor that cannot be ignored in the investigation of inter-temporal stability of international stock markets. ^

The impact of bandwidth in structured interviewing and criterion stability in predicting and assessing manager performance across transition and maintenance stages

The current study examined the role of three important components in the use of structured employment interviewing in performance prediction: construct bandwidth, observed communication skill, and the stability/dynamicity of performance criteria over time. A matched sample of 242 hospitality managers was derived from a field data set provided by a large hospitality management organization. Interview data and two years of performance appraisal data were provided. Bandwidth analysis demonstrated only minimal differences in prediction between matched predictor-criterion pairs compared with predictor to overall aggregate ratings (unmatched). The communication skill analysis revealed that this interviewer rated observation significantly predicted a number of the individual performance dimensions as well as overall performance over time. Of the five interview items, the strongest overall predictor of performance was interviewer rated communication skill. The stability/dynamicity analyses demonstrated the performance criteria to be generally stable over the two year period examined, which provides support for the long held notion that performance criteria is stabile over time. However, there were two exceptions. The interview dimension customer service orientation had shifting relationships over time with four of the criteria over the two year period. The performance criteria employee development also demonstrated some instability in its relationships with predictors. Thus, some evidence of dynamicity in performance criteria was revealed. Interestingly, both of the most noteworthy findings in the study involved items that were rated differently than the others in the study. The rated interview item communication skill and the rated performance criteria client satisfaction were ratings that involved a more direct level of observation. Additional analyses also revealed evidence of a general factor of performance. These two themes are more fully covered in the discussion.

A comparative analysis of self-determined evaluations of work performance and support needs by adults with mental retardation in supported work and in sheltered workshop environments

The purpose of this study was to determine if there was a difference in the self-determined evaluations of work performance and support needs by adults with mental retardation in supported employment and in sheltered workshop environments. The instrument, Job Observation and Behavior Scale: Opportunity for Self-Determination (JOBS: OSD; Brady, Rosenberg, & Frain, 2006), was administered to 38 adults with mental retardation from sheltered workshops and 32 adults with mental retardation from supported employment environments. Cross-tabulations with Chi-square tests and independent samples t-tests were conducted to evaluate differences between the two groups, sheltered workshop and supported work. Two Multivariate Analyses of Variance (MANOVAs) were conducted to determine the effect of work environment on Quality of Performance (QP) and Types of Support (TS) test scores and their subscales. ^ This study found that there were significant differences between the groups on the QP Behavior and Job Duties subscales. The sheltered workshop group perceived themselves as performing significantly better on job duties than the supported work group. Conversely, the supported work group perceived themselves to have better behavior than the sheltered workshop group. However, there were no significant differences between groups in their perception of support needs for the three subscales. ^ The findings imply that work environment affects the self-determined evaluations of work performance by adults with mental retardation. Recommendations for further study include (a) detailing the characteristics of supported work and sheltered workshops that support and/or discourage self-determined behaviors, (b) exploring the behavior of adults with mental retardation in sheltered workshops and supported work environments, and (c) analysis of the support needs for and understanding of them by adults with mental retardation in sheltered workshops and in supported work environments. ^

Developing performance measures of mangrove wetlands using simulation models of hydrology, nutrient biogeochemistry, and community dynamics

The goal of mangrove restoration projects should be to improve community structure and ecosystem function of degraded coastal landscapes. This requires the ability to forecast how mangrove structure and function will respond to prescribed changes in site conditions including hydrology, topography, and geophysical energies. There are global, regional, and local factors that can explain gradients of regulators (e.g., salinity, sulfides), resources (nutrients, light, water), and hydroperiod (frequency, duration of flooding) that collectively account for stressors that result in diverse patterns of mangrove properties across a variety of environmental settings. Simulation models of hydrology, nutrient biogeochemistry, and vegetation dynamics have been developed to forecast patterns in mangroves in the Florida Coastal Everglades. These models provide insight to mangrove response to specific restoration alternatives, testing causal mechanisms of system degradation. We propose that these models can also assist in selecting performance measures for monitoring programs that evaluate project effectiveness. This selection process in turn improves model development and calibration for forecasting mangrove response to restoration alternatives. Hydrologic performance measures include soil regulators, particularly soil salinity, surface topography of mangrove landscape, and hydroperiod, including both the frequency and duration of flooding. Estuarine performance measures should include salinity of the bay, tidal amplitude, and conditions of fresh water discharge (included in the salinity value). The most important performance measures from the mangrove biogeochemistry model should include soil resources (bulk density, total nitrogen, and phosphorus) and soil accretion. Mangrove ecology performance measures should include forest dimension analysis (transects and/or plots), sapling recruitment, leaf area index, and faunal relationships. Estuarine ecology performance measures should include the habitat function of mangroves, which can be evaluated with growth rate of key species, habitat suitability analysis, isotope abundance of indicator species, and bird census. The list of performance measures can be modified according to the model output that is used to define the scientific goals during the restoration planning process that reflect specific goals of the project.

Integrated Performance Assessment of Engineering Projects at the Interface of Emergent Properties and Uncertainty

Investigation of the performance of engineering project organizations is critical for understanding and eliminating inefficiencies in today’s dynamic global markets. The existing theoretical frameworks consider project organizations as monolithic systems and attribute the performance of project organizations to the characteristics of the constituents. However, project organizations consist of complex interdependent networks of agents, information, and resources whose interactions give rise to emergent properties that affect the overall performance of project organizations. Yet, our understanding of the emergent properties in project organizations and their impact on project performance is rather limited. This limitation is one of the major barriers towards creation of integrated theories of performance assessment in project organizations. The objective of this paper is to investigate the emergent properties that affect the ability of project organization to cope with uncertainty. Based on the theories of complex systems, we propose and test a novel framework in which the likelihood of performance variations in project organizations could be investigated based on the environment of uncertainty (i.e., static complexity, dynamic complexity, and external source of disruption) as well as the emergent properties (i.e., absorptive capacity, adaptive capacity, and restorative capacity) of project organizations. The existence and significance of different dimensions of the environment of uncertainty and emergent properties in the proposed framework are tested based on the analysis of the information collected from interviews with senior project managers in the construction industry. The outcomes of this study provide a novel theoretical lens for proactive bottom-up investigation of performance in project organizations at the interface of emergent properties and uncertainty