The use of scoring rubrics to determine clinical performance in the operating suite

Summary : This research evolved out of the need to examine the validity and inter-rater reliability of a set of performance-based scoring rubrics designed to measure competencies within the operating suite.

Method : Both holistic and analytical rubrics were developed aligned to the ACORN Standard [Australian College of Operating Room Nurses Standard NR4, 2004. ACORN Competency Standards for Perioperative Nurses: Standard NR4: The Instrument Nurse in the Perioperative Environment. Australian College of Operating Room Nurses Ltd, Adelaide] and underpinned by the Dreyfus model (1981). Three video clips that captured varying performance of nurses performing as instrument nurses in the operating suite were recorded and used as prompts by expert raters, who judged the performance using the rubrics.

Results : The study found that the holistic rubrics led to more consistent judgments than the analytical rubrics, yet the latter provided more diagnostic information for intervention purposes. Despite less consistency, the Analytical Observation Form had sufficient construct validity to satisfy the requirements of criterion referencing as determined by the Item Separation Index (Rasch, 1960), including high internal consistency and greater inter-rater reliability when average ratings were used.

Conclusion : The study was an empirical investigation of the use of concomitant Analytical and Holistic Rubrics to determine various levels of performance in the operating suite including inter-rater reliability. The methodology chosen was theoretically sound and sufficiently flexible to be used to develop other competencies within the operating suite.

The cooling steam of the Polar Express : historical origins, properties and implications of performance capture

As the first academically rigorous interrogation of the generation of performance within the global frame of the motion capture volume, this research presents a historical contextualisation and develops and tests a set of first principles through an original series of theoretically informed, practical exercises to guide those working in the emergent space of performance capture. It contributes a new understanding of the framing of performance in The Omniscient Frame, and initiates and positions performance capture as a new and distinct interdisciplinary discourse in the fields of theatre, animation, performance studies and film.

Directional performance in motion transparency

Motion transparency provides a challenging test case for our understanding of how visual motion, and other attributes, are computed and represented in the brain. However, previous studies of visual transparency have used subjective criteria which do not confirm the existence of independent representations of the superimposed motions. We have developed measures of performance in motion transparency that require observers to extract information about two motions jointly, and therefore test the information that is simultaneously represented for each motion. Observers judged whether two motions were at 90 to one another; the base direction was randomized so that neither motion taken alone was informative. The precision of performance was determined by the standard deviations (S.D.s) of probit functions fitted to the data. Observers also made judgments of orthogonal directions between a single motion stream and a line, for one of two transparent motions against a line and for two spatially segregated motions. The data show that direction judgments with transparency can be made with comparable accuracy to segregated (non-transparent) conditions, supporting the idea that transparency involves the equivalent representation of two global motions in the same region. The precision of this joint direction judgment is, however, 2–3 times poorer than that for a single motion stream. The precision in directional judgment for a single stream is reduced only by a factor of about 1.5 by superimposing a second stream. The major effect in performance, therefore, appears to be associated with the need to compute and compare two global representations of motion, rather than with interference between the dot streams per se. Experiment 2tested the transparency of motions separated by a range of angles from 5 to 180 by requiring subjects to set a line matching the perceived direction of each motion. The S.D.s of these settings demonstrated that directions of transparent motions were represented independently for separations over 20. Increasing dot speeds from 1 to 10 deg/s improved directional performance but had no effect on transparency perception. Transparency was also unaffected by variations of density between 0.1 and 19 dots/deg2

Contextual, but not auditory, fear conditioning is disrupted by neurotoxic selective lesion of the basal nucleus of amygdala in rats

The basolateral amygdala complex (BLA) is involved in acquisition of contextual and auditory fear conditioning. However, the BLA is not a single structure but comprises a group of nuclei, including the lateral (LA), basal (BA) and accessory basal (AB) nuclei. While it is consensual that the LA is critical for auditory fear conditioning, there is controversy on the participation of the BA in fear conditioning. Hodological and neurophysiological findings suggest that each of these nuclei processes distinct information in parallel; the BA would deal with polymodal or contextual representations, and the LA would process unimodal or elemental representations. Thus, it seems plausible to hypothesize that the BA is required for contextual, but not auditory, fear conditioning. This hypothesis was evaluated in Wistar rats submitted to multiple-site ibotenate-induced damage restricted to the BA and then exposed to a concurrent contextual and auditory fear conditioning training followed by separated contextual and auditory conditioning testing. Differing from electrolytic lesion and lidocaine inactivation, this surgical approach does not disturb fibers of passage originating in other brain areas, restricting damage to the aimed nucleus. Relative to the sham-operated controls, rats with selective damage to the BA exhibited disruption of performance in the contextual, but not the auditory, component of the task. Thus, while the BA seems required for contextual fear conditioning, it is not critical for both an auditory-US association, nor for the expression of the freezing response. (C) 2009 Elsevier Inc. All rights reserved.

Improved 2000-meter rowing performance in competitive oarswomen after caffeine ingestion

Eight competitive oarswomen (age, 22 ± 3 years; mass, 64.4 ± 3.8 kg) performed three simulated 2,000-m time trials on a rowing ergometer. The trials, which were preceded by a 24-hour dietary and training control and 72 hours of caffeine abstinence, were conducted 1 hour after ingesting caffeine (6 or 9 mg · kg-1 body mass) or placebo. Plasma free fatty acid concentrations before exercise were higher with caffeine than placebo (0.67 ± 0.34 vs. 0.72 ± 0.36 vs. 0.30 ± 0.10 mM for 6 and 9 mg · kg-1caffeine and placebo, respectively; p < .05). Performance time improved 0.7% (95% confidence interval [CI] 0 to 1.5%) with 6 mg · kg-1 caffeine and 1.3% (95% CI 0.5 to 2.0%) with 9 mg · kg-1 caffeine. The first 500 m of the 2,000 m was faster with the higher caffeine dose compared with placebo or the lower dose (1.53 ± 0.52 vs. 1.55 ± 0.62 and 1.56 ± 0.43 min; p = .02). We concluded that caffeine produces a worthwhile enhancement of performance in a controlled laboratory setting, primarily by improving the first 500 m of a 2,000-m row.

The World Trade Organization at Work: Performance in a Member-Driven Milieu

This article discusses performance in the context of the World Trade Organization (WTO). Applying the framework by Gutner and Thompson and inspired by principal-agent theory, it is argued that existing studies have underspecified the institutional milieu that affects performance. The WTO represents a member-driven organization where Members are part of the international organization (IO) (e.g., through rule-making) and at the same time act outside the IO (e.g., through implementation). Thus, a narrow reading of the IO (focusing on the civil servants and the Director-General and his staff) will not suffice to understand IO performance in the WTO context. Selected evidence is presented to illustrate aspects of the WTO’s inner-working and the institutional milieu of performance. In addition, the article discusses a number of performance parameters, including the relationship between Secretariat autonomy and performance, the role of information, and the mechanisms of performance aggregation. The article ends by cautioning against quick fixes to the system to improve performance.

The role of specialisation in the promotion of young football talents: A person-oriented study

This paper investigates the controversial question whether it is more effective to promote specialisation in a specific sport at the beginning of a career or whether to encourage a broad range of sports when promoting competitive sports talents in order for them to achieve a high level of performance in adulthood. The issue of promoting talents depends on human developmental processes and therefore raises developmental scientific questions. Based on recent, dynamic-interactionist concepts of development, we assume a person-oriented approach focussing on the person as a whole rather than individual features. Theoretical considerations lead to four interacting factors being summarised to form a subsystem: childhood training. The relative weights of these factors lead to patterns. By relating these to a performance criterion at the age of peak performance, particularly promising developmental patterns may be identified. One hundred fifty-nine former Swiss football talents were retrospectively interviewed about their career and the data analysed using the LICUR method. Two early career patterns were identified as having a favourable influence on adult performance. Both are characterised by an above-average amount of in-club training. One pattern also exhibits an above-average amount of informal football played outside the club, the other above-average scores for activity in other sports. Hence, comprehensive training and practice inside and outside the club form the basis for subsequent football expertise.

Ego depletion and persistent performance in a cycling task

We tested the assumption that persistent performance in an exhausting indoor cycling task would depend on momentarily available self-control strength (N = 20 active participants). In a within-subjects design (two points of measurement, exactly seven days apart), participants’ self-control strength was experimentally manipulated (depletion: yes vs. no; order counterbalanced) via the Stroop test before the participants performed a cycling task. In line with our hypothesis, hierarchical linear modelling (HLM) revealed that participants consistently performed worse over a period of 18 minutes when they were ego depleted. In addition, HLM analysis revealed that depleted participants invested less effort in the cycling task, as indicated by their lower heart rate. This effect escalated over time, as indicated by a time × condition interaction. These results indicate that self-control strength is necessary to obtain an optimal level of performance in endurance tasks requiring high levels of persistence. Practical implications are discussed.

Relationships between gifted selection criteria and performance in sixth -grade gifted science

This study examined the relationships between gifted selection criteria used in the Dade County Public Schools of Miami, Florida and performance in sixth grade gifted science classes.^ The goal of the study was to identify significant predictors of performance in sixth grade gifted science classes. Group comparisons of performance were also made. Performance in sixth grade gifted science was defined as the numeric average of nine weeks' grades earned in sixth grade gifted science classes.^ The sample consisted of 100 subjects who were formerly enrolled in sixth grade gifted science classes over two years at a large, multiethnic public middle school in Dade County.^ The predictors analyzed were I.Q. score (all scales combined), full scale I.Q. score, verbal scale I.Q. score, performance scale I.Q. score, combined Stanford Achievement Test (SAT) score (Reading Comprehension plus Math Applications), SAT Reading Comprehension score, and SAT Math Applications score. Combined SAT score and SAT Math Applications score were significantly positively correlated to performance in sixth grade gifted science. Performance scale I.Q. score was significantly negatively correlated to performance in sixth grade gifted science. The other predictors examined were not significantly correlated to performance.^ Group comparison results showed the mean average of nine weeks grades for the full scale I.Q. group was greater than the verbal and performance scale I.Q. groups. Females outperformed males to a highly significant level. Mean g.p.a. for ethnic groups was greatest for Asian students, followed by white non-Hispanic, Hispanic, and black. Students not receiving a lunch subsidy outperformed those receiving subsidies.^ Comparisons of performance based on gifted qualification plan showed the mean g.p.a. for traditional plan and Plan B groups were not different. Mean g.p.a. for students who qualified for gifted using automatic Math Applications criteria was highest, followed by automatic Reading Comprehension criteria and Plan B Matrix score. Both automatic qualification groups outperformed the traditional group. The traditional group outperformed the Plan B Matrix group. No significant differences in mean g.p.a. between the Plan B subgroups and the traditional plan group were found. ^

Assessment of driving-related performance in chronic whiplash using an advanced driving simulator

Driving is often nominated as problematic by individuals with chronic whiplash associated disorders (WAD), yet driving-related performance has not been evaluated objectively. The purpose of this study was to test driving-related performance in persons with chronic WAD against healthy controls of similar age, gender and driving experience to determine if driving-related performance in the WAD group was sufficiently impaired to recommend fitness to drive assessment. Driving-related performance was assessed using an advanced driving simulator during three driving scenarios; freeway, residential and a central business district (CBD). Total driving duration was approximately 15 min. Five driving tasks which could cause a collision (critical events) were included in the scenarios. In addition, the effect of divided attention (identify red dots projected onto side or rear view mirrors) was assessed three times in each scenario. Driving performance was measured using the simulator performance index (SPI) which is calculated from 12 measures. z-Scores for all SPI measures were calculated for each WAD subject based on mean values of the control subjects. The z-scores were then averaged for the WAD group. A z-score of ≤−2 indicated a driving failing grade in the simulator. The number of collisions over the five critical events was compared between the WAD and control groups as was reaction time and missed response ratio in identifying the red dots. Seventeen WAD and 26 control subjects commenced the driving assessment. Demographic data were comparable between the groups. All subjects completed the freeway scenario but four withdrew during the residential and eight during the CBD scenario because of motion sickness. All scenarios were completed by 14 WAD and 17 control subjects. Mean z-scores for the SPI over the three scenarios was statistically lower in the WAD group (−0.3 ± 0.3; P < 0.05) but the score was not below the cut-off point for safe driving. There were no differences in the reaction time and missed response ratio in divided attention tasks between the groups (All P > 0.05). Assessment of driving in an advanced driving simulator for approximately 15 min revealed that driving-related performance in chronic WAD was not sufficiently impaired to recommend the need for fitness to drive assessment.

The effects of alcohol on performance in a driving simulator of alcoholics and social drinkers. Final report.

Federal Highway Administration, Washington, D.C.

The effect of prolonged reading on visual functions and reading performance in students with low vision

This study is the first to investigate the effect of prolonged reading on reading performance and visual functions in students with low vision. The study focuses on one of the most common modes of achieving adequate magnification for reading by students with low vision, their close reading distance (proximal or relative distance magnification). Close reading distances impose high demands on near visual functions, such as accommodation and convergence. Previous research on accommodation in children with low vision shows that their accommodative responses are reduced compared to normal vision. In addition, there is an increased lag of accommodation for higher stimulus levels as may occur at close reading distance. Reduced accommodative responses in low vision and higher lag of accommodation at close reading distances together could impact on reading performance of students with low vision especially during prolonged reading tasks. The presence of convergence anomalies could further affect reading performance. Therefore, the aims of the present study were 1) To investigate the effect of prolonged reading on reading performance in students with low vision 2) To investigate the effect of prolonged reading on visual functions in students with low vision. This study was conducted as cross-sectional research on 42 students with low vision and a comparison group of 20 students with normal vision, aged 7 to 20 years. The students with low vision had vision impairments arising from a range of causes and represented a typical group of students with low vision, with no significant developmental delays, attending school in Brisbane, Australia. All participants underwent a battery of clinical tests before and after a prolonged reading task. An initial reading-specific history and pre-task measurements that included Bailey-Lovie distance and near visual acuities, Pelli-Robson contrast sensitivity, ocular deviations, sensory fusion, ocular motility, near point of accommodation (pull-away method), accuracy of accommodation (Monocular Estimation Method (MEM)) retinoscopy and Near Point of Convergence (NPC) (push-up method) were recorded for all participants. Reading performance measures were Maximum Oral Reading Rates (MORR), Near Text Visual Acuity (NTVA) and acuity reserves using Bailey-Lovie text charts. Symptoms of visual fatigue were assessed using the Convergence Insufficiency Symptom Survey (CISS) for all participants. Pre-task measurements of reading performance and accuracy of accommodation and NPC were compared with post-task measurements, to test for any effects of prolonged reading. The prolonged reading task involved reading a storybook silently for at least 30 minutes. The task was controlled for print size, contrast, difficulty level and content of the reading material. Silent Reading Rate (SRR) was recorded every 2 minutes during prolonged reading. Symptom scores and visual fatigue scores were also obtained for all participants. A visual fatigue analogue scale (VAS) was used to assess visual fatigue during the task, once at the beginning, once at the middle and once at the end of the task. In addition to the subjective assessments of visual fatigue, tonic accommodation was monitored using a photorefractor (PlusoptiX CR03™) every 6 minutes during the task, as an objective assessment of visual fatigue. Reading measures were done at the habitual reading distance of students with low vision and at 25 cms for students with normal vision. The initial history showed that the students with low vision read for significantly shorter periods at home compared to the students with normal vision. The working distances of participants with low vision ranged from 3-25 cms and half of them were not using any optical devices for magnification. Nearly half of the participants with low vision were able to resolve 8-point print (1M) at 25 cms. Half of the participants in the low vision group had ocular deviations and suppression at near. Reading rates were significantly reduced in students with low vision compared to those of students with normal vision. In addition, there were a significantly larger number of participants in the low vision group who could not sustain the 30-minute task compared to the normal vision group. However, there were no significant changes in reading rates during or following prolonged reading in either the low vision or normal vision groups. Individual changes in reading rates were independent of their baseline reading rates, indicating that the changes in reading rates during prolonged reading cannot be predicted from a typical clinical assessment of reading using brief reading tasks. Contrary to previous reports the silent reading rates of the students with low vision were significantly lower than their oral reading rates, although oral and silent reading was assessed using different methods. Although the visual acuity, contrast sensitivity, near point of convergence and accuracy of accommodation were significantly poorer for the low vision group compared to those of the normal vision group, there were no significant changes in any of these visual functions following prolonged reading in either group. Interestingly, a few students with low vision (n =10) were found to be reading at a distance closer than their near point of accommodation. This suggests a decreased sensitivity to blur. Further evaluation revealed that the equivalent intrinsic refractive errors (an estimate of the spherical dioptirc defocus which would be expected to yield a patient’s visual acuity in normal subjects) were significantly larger for the low vision group compared to those of the normal vision group. As expected, accommodative responses were significantly reduced for the low vision group compared to the expected norms, which is consistent with their close reading distances, reduced visual acuity and contrast sensitivity. For those in the low vision group who had an accommodative error exceeding their equivalent intrinsic refractive errors, a significant decrease in MORR was found following prolonged reading. The silent reading rates however were not significantly affected by accommodative errors in the present study. Suppression also had a significant impact on the changes in reading rates during prolonged reading. The participants who did not have suppression at near showed significant decreases in silent reading rates during and following prolonged reading. This impact of binocular vision at near on prolonged reading was possibly due to the high demands on convergence. The significant predictors of MORR in the low vision group were age, NTVA, reading interest and reading comprehension, accounting for 61.7% of the variances in MORR. SRR was not significantly influenced by any factors, except for the duration of the reading task sustained; participants with higher reading rates were able to sustain a longer reading duration. In students with normal vision, age was the only predictor of MORR. Participants with low vision also reported significantly greater visual fatigue compared to the normal vision group. Measures of tonic accommodation however were little influenced by visual fatigue in the present study. Visual fatigue analogue scores were found to be significantly associated with reading rates in students with low vision and normal vision. However, the patterns of association between visual fatigue and reading rates were different for SRR and MORR. The participants with low vision with higher symptom scores had lower SRRs and participants with higher visual fatigue had lower MORRs. As hypothesized, visual functions such as accuracy of accommodation and convergence did have an impact on prolonged reading in students with low vision, for students whose accommodative errors were greater than their equivalent intrinsic refractive errors, and for those who did not suppress one eye. Those students with low vision who have accommodative errors higher than their equivalent intrinsic refractive errors might significantly benefit from reading glasses. Similarly, considering prisms or occlusion for those without suppression might reduce the convergence demands in these students while using their close reading distances. The impact of these prescriptions on reading rates, reading interest and visual fatigue is an area of promising future research. Most importantly, it is evident from the present study that a combination of factors such as accommodative errors, near point of convergence and suppression should be considered when prescribing reading devices for students with low vision. Considering these factors would also assist rehabilitation specialists in identifying those students who are likely to experience difficulty in prolonged reading, which is otherwise not reflected during typical clinical reading assessments.