Statistical Tests for Joint Analysis of Performance Measures

Recently there has been an increasing interest in the development of new methods using Pareto optimality to deal with multi-objective criteria (for example, accuracy and architectural complexity). Once one has learned a model based on their devised method, the problem is then how to compare it with the state of art. In machine learning, algorithms are typically evaluated by comparing their performance on different data sets by means of statistical tests. Unfortunately, the standard tests used for this purpose are not able to jointly consider performance measures. The aim of this paper is to resolve this issue by developing statistical procedures that are able to account for multiple competing measures at the same time. In particular, we develop two tests: a frequentist procedure based on the generalized likelihood-ratio test and a Bayesian procedure based on a multinomial-Dirichlet conjugate model. We further extend them by discovering conditional independences among measures to reduce the number of parameter of such models, as usually the number of studied cases is very reduced in such comparisons. Real data from a comparison among general purpose classifiers is used to show a practical application of our tests.

Expectancy effects in tennis: The impact of body language and playing record on impressions of a tennis player and ratings of performance

This study examined the impact that pre-event body language and knowledge of a performer’s playing record had on ratings of tennis performance. Participants (N = 123) were allocated to one of four experimental groups (good body language/bad body language vs. positive playing record/negative playing record) and viewed a live player warming up and completing a series of tennis shots. Information outlining the player’s recent win/loss record was coupled with body language condition during a period of warm-up footage. Likert-type scales were employed to record impressions of the player and judgements as to the quality of the play. ANCOVA revealed that the player was viewed more favourably having displayed positive as opposed to negative body language (p<.001). Participants presented with a positive playing record (p = .001) formed a more favourable impression and rated the players performance more positively (p = 0.001). The study corroborates and extends the findings of recent work incorporating live models in expectancy effects investigations.

The Influence of Performance Level, Age and Gender on Pacing Strategy During a 100-km Ultramarathon

The aim of this study is to analyse the influence of performance level, age and gender on pacing during a 100-km ultramarathon. Results of a 100-km race incorporating the World Masters Championships were used to identify differences in relative speeds in each 10-km segment between participants finishing in the first, second, third and fourth quartiles of overall positions (Groups 1, 2, 3 and 4, respectively). Similar analyses were performed between the top and bottom 50% of finishers in each age category, as well as within male and female categories. Pacing varied between athletes achieving different absolute performance levels. Group 1 ran at significantly lower relative speeds than all other groups in the first three 10-km segments (all P < 0.01), and significantly higher relative speeds than Group 4 in the 6th and 10th (both P < 0.01), and Group 2 in the 8th (P = 0.04). Group 4 displayed significantly higher relative speeds than Group 2 and 3 in the first three segments (all P < 0.01). Overall strategies remained consistent across age categories, although a similar phenomenon was observed within each category whereby ‘top’ competitors displayed lower relative speeds than ‘bottom’ competitors in the early stages, but higher relative speeds in the later stages. Females showed lower relative starting speeds and higher finishing speeds than males. ‘Top’ and ‘bottom’ finishing males displayed differing strategies, but this was not the case within females. Although pacing remained consistent across age categories, it differed with level of performance within each, possibly suggesting strategies are anchored on direct competitors. Strategy differs between genders and differs depending on performance level achieved in males but not females.

Elite Rugby Union Players Perceptions of Performance Analysis

This study provides an in depth insight into the current views and opinions of elite level rugby union players regarding the use of performance analysis as a tool for improving their own playing performance and in highlighting the strengths and weaknesses of upcoming opponents. A total of seventy-three elite level rugby union players from two clubs in Great Britain completed a semi-structured questionnaire. Additionally, four players completed a semi-structured interview and following inductive content analysis, four key themes emerged: (1) the use of video for player development, (2) preparing for a match, (3) using video for player reflection in addition to other psychological tools and (4) players suggestions for improvements to the clubs current performance analysis programme. The main finding of the study concludes that players viewed performance analysis as a beneficial and useful tool to support their development and preparation. As a result the study provides an insight into the use of performance analysis within professional rugby union, enabling rugby coaches and practitioners to gain an understanding and appreciation of the players views towards the clubs current provision. Additionally, the findings help build and strengthen the on-going knowledge coaches, analysts and researchers currently have regarding how players perceive performance analysis.

An assessment of manager/subordinate perceptions of performance appraisal effectiveness

This study postulates that performance appraisal will be effective to the extent that managers and subordinates have a shared perception of its purpose and function and the degree to which it meets the needs of both groups. A two part research project was conducted to: 1) identify manager/subordinate perceptions of the purposes served by the formal performance appraisal process; 2) determine the extent to which these purposes are being satisfied in organizational practice; and 3) assess if managers and subordinates have a shared perception of the effectiveness of the appraisal process. The sample for the study included 36 managers and 143 subordinates from a division of a large Midwest service organization. The results were mixed with regard to the appraisal system effectively accomplishing its diverse goals. However, in general, there was support for the notion that both managers and subordinates find the appraisal process to be a worthwhile organizational practice. Approximately 70% of the respondents indicated that they would participate in the appraisal program whether they were required to do so or not.

Electrophysiological correlates of performance monitoring in middle and late adolescence

The ability to monitor and evaluate the consequences of ongoing behaviors and coordinate behavioral adjustments seems to rely on networks including the anterior cingulate cortex (ACC) and phasic changes in dopamine activity. Activity (and presumably functional maturation) of the ACC may be indirectly measured using the error-related negativity (ERN), an event-related potential (ERP) component that is hypothesized to reflect activity of the automatic response monitoring system. To date, no studies have examined the measurement reliability of the ERN as a trait-like measure of response monitoring, its development in mid- and late- adolescence as well as its relation to risk-taking and empathic ability, two traits linked to dopaminergic and ACC activity. Utilizing a large sample of 15- and 18-year-old males, the present study examined the test-retest reliability of the ERN, age-related changes in the ERN and other components of the ERP associated with error monitoring (the Pe and CRN), and the relations of the error-related ERP components to personality traits of risk propensity and empathy. Results indicated good test-retest reliability of the ERN providing important validation of the ERN as a stable and possibly trait-like electrophysiological correlate of performance monitoring. Ofthe three components, only the ERN was of greater amplitude for the older adolescents suggesting that its ACC network is functionally late to mature, due to either structural or neurochemical changes with age. Finally, the ERN was smaller for those with high risk propensity and low empathy, while other components associated with error monitoring were not, which suggests that poor ACe function may be associated with the desire to engage in risky behaviors and the ERN may be influenced by the extent of individuals' concern with the outcome of events.

Autonomic and electrocortical indices of performance monitoring and source memory discrimination in older and younger adults

Reduced capacity for executive cognitive function and for the autonomic control of cardiac responsivity are both concomitants of the aging process. These may be linked through their mutual dependence on medial prefrontal function, but the specifics ofthat linkage have not been well explored. Executive functions associated with medial prefrontal cortex involve various aspects ofperformance monitoring, whereas centrally mediated autonomic functions can be observed as heart rate variability (HRV), i.e., variability in the length of intervals between heart beats. The focus for this thesis was to examine the degree to which the capacity for phasic autonomic adjustments to heart rate relates to performance monitoring in younger and older adults, using measures of electrocortical and autonomic activity. Behavioural performance and attention allocation during two age-sensitive tasks could be predicted by various aspects of autonomic control. For young adults, greater influence of the parasympathetic system on HRV was beneficial for learning unfamiliar maze paths; for older adults, greater sympathetic influence was detrimental to these functions. Further, these relationships were primarily evoked when the task required the construction and use of internalized representations of mazes rather than passive responses to feedback. When memory for source was required, older adults made three times as many source errors as young adults. However, greater parasympathetic influence on HRV in the older group was conducive to avoiding source errors and to reduced electrocortical responses to irrelevant information. Higher sympathetic predominance, in contrast, was associated with higher rates of source error and greater electrocortical responses tq non-target information in both groups. These relations were not seen for 11 errors associated with a speeded perceptual task, irrespective of its difficulty level. Overall, autonomic modulation of cardiac activity was associated with higher levels of performance monitoring, but differentially across tasks and age groups. With respect to age, those older adults who had maintained higher levels of autonomic cardiac regulation appeared to have also maintained higher levels of executive control over task performance.

A biochemical predictor of performance during mesophilic anaerobic fermentation of starch wastewater

The aim of this study was to determine the potential of biochemical parameters, such as enzyme activity and adenosine triphosphate (ATP) levels, as monitors of process performance in the Upflow Anaerobic Sludge Blanket (UASB) reactor utilizing a starch wastewater. The acid and alkaline phosphatase activity and the ATP content of the UASB sludge were measured in response to changes in flow rate and nutrient loading. Conventional parameters of process performance, such as gas production, acetic acid production, COD, phosphorus, nitrogen and suspended solids loadings and % COD removal were also monitored. The response of both biochemical and conventional parameters to changing process conditions was then compared. Alkaline phosphatase activity exhibited the highest activity over the entire study perioda A high suspended solids loading was observed to upset the system in terms of gas production, acetic acid production and % COD removala The initial rate of increase in alkaline phosphatase activity following an increase in loading was four times as great during process upset than under conditions of good performance. The change in enzyme actiVity was also more sensitive to process upset than changes in acetic acid production. The change in ATP content of the sludge with time suggested that enzyme actiVity was changing independently of the actual viable biomass present. The bacterial composition of the anaerobic sludge granules was similar to that of other sludge bed systems, at the light and scanning electron microscope level. Isolated serum bottle cultures produced several acids involved in anaerobic carbohydrate metabolism. The overall performance of the UASB system indicated that higher loadings of soluble nutrients could have been tolerated by the system.

CID alumni from 1986-1990: relation of performance at graduation to present class placement

This paper discusses a study to determine the relationship between the performance of a child prior to leaving CID and their performance in the current school setting.

Perceptual grouping ability in Williams syndrome: evidence for deviant patterns of performance

Williams syndrome (WS) is a rare genetic disorder. At a cognitive level, this population display poor visuo-spatial cognition when compared to verbal ability. Within the visuo-spatial domain, it is now accepted that individuals with WS are able to perceive both local and global aspects of an image, albeit at a low level. The present study examines the manner in which local elements are grouped into a global whole in WS. Fifteen individuals with WS and 15 typically developing controls, matched for non-verbal ability, were presented with a matrix of local elements and asked whether these elements were perceptually grouped horizontally or vertically. The WS group was at the same level as the control group when grouping by luminance, closure, and alignment. However, their ability to group by shape, orientation and proximity was significantly poorer than controls. This unusual profile of grouping abilities in WS suggests that these individuals do not form a global percept in a typical manner. (c) 2004 Published by Elsevier Ltd.

The effect of the year of wheat variety release on productivity and stability of performance on two organic and two non-organic farms

Nineteen wheat cultivars, released from 1934 to 2000, were grown at two organic and two non-organic sites in each of 3 years. Assessments included grain yield, grain protein concentration, protein yield, disease incidence and green leaf area. The superiority of each cultivar (the sum of the squares of the differences between its mean in each environment and the mean of the best cultivar there, divided by twice the number of environments; CS) was calculated for yield, grain protein concentration and protein yield, and ranked in each environment. The yield and grain protein concentration CS were more closely correlated with cultivar release date at the non-organic sites than at organic sites. This difference may be attributed to higher yield levels with larger differences among cultivars at the non-organic sites, rather than to improved stability (i.e. similar ranks) across sites. The significant difference in the correlation of protein yield CS and cultivar age between organic and non-organic sites would support evidence that the ability to take up mineral nitrogen (N) compared to soil N has been a component of the selection conditions of more modern cultivars (released after 1989). This is supported by assessment of green leaf area (GLA), where more modern cultivars in the non-organic systems had greater late-season GLA, a trend that was not identified in organic conditions. This effect could explain the poor correlation between age and protein yield CS in organic compared to non-organic conditions where modern cultivars are selected to benefit from later nitrogen (N) availability which includes the spring nitrogen applications tailored to coincide with peak crop demand. Under organic management, N release is largely based on the breakdown of fertility-building crops incorporated (ploughed-in) in the previous autumn. The release of nutrients from these residues is dependent on the soil conditions, which includes temperature and microbial populations, in addition to the potential leaching effect of high winter rainfall in the UK. In organic cereal crops, early resource capture is a major advantage for maximizing the utilization of nutrients from residue breakdown. It is concluded that selection of cultivars under conditions of high agrochemical inputs selects for cultivars that yield well under maximal conditions in terms of nutrient availability and pest, disease and weed control. The selection conditions for breeding have a tendency to select cultivars which perform relatively better in non-organic compared to organic systems.

Are informed citizens more trusting? Transparency of performance data and trust towards a British police force

In Britain, substantial cuts in police budgets alongside controversial handling of incidents such as politically sensitive enquiries, public disorder and relations with the media have recently triggered much debate about public knowledge and trust in the police. To date, however, little academic research has investigated how knowledge of police performance impacts citizens’ trust. We address this long-standing lacuna by exploring citizens’ trust before and after exposure to real performance data in the context of a British police force. The results reveal that being informed of performance data affects citizens’ trust significantly. Furthermore, direction and degree of change in trust are related to variations across the different elements of the reported performance criteria. Interestingly, the volatility of citizens’ trust is related to initial performance perceptions (such that citizens with low initial perceptions of police performance react more significantly to evidence of both good and bad performance than citizens with high initial perceptions), and citizens’ intentions to support the police do not always correlate with their cognitive and affective trust towards the police. In discussing our findings, we explore the implications of how being transparent with performance data can both hinder and be helpful in developing citizens’ trust towards a public organisation such as the police. From our study, we pose a number of ethical challenges that practitioners face when deciding what data to highlight, to whom, and for what purpose.

Separation of performance-approach and performance-avoidance achievement goals: A broader analysis

In the literature on achievement goals, performance-approach goals (striving to do better than others) and performance-avoidance goals (striving to avoid doing worse than others) tend to exhibit a moderate to high correlation, raising questions about whether the 2 goals represent distinct constructs. In the current article, we sought to examine the separability of these 2 goals using a broad factor-analytic approach that attended to issues that have been overlooked or underexamined in prior research. Five studies provided strong evidence for the separation of these 2 goal constructs: Separation was observed not only with exploratory factor analysis across different age groups and countries (Studies 1a and 1b) but also with change analysis (Study 2), ipsative factor analysis (Study 3), within-person analysis (Study 4), and behavioral genetics analysis (Study 5). We conclude by discussing the implications of the present research for the achievement goal literature, as well as the psychological literature in general.