A Path Forward: Evidence-Based Approaches to Educational Policy and Practice

In the complex landscape of public education, participants at all levels are searching for policy and practice levers that can raise overall performance and close achievement gaps. The collection of articles in this edition of the Journal of Applied Research on Children takes a big step toward providing the tools and tactics needed for an evidence-based approach to educational policy and practice.

Influence of experience and training on dental students’ examination performance regarding panoramic images

Physician training has greatly benefitted from insights gained in understanding the manner in which experts search medical images for abnormalities. The aims of this study were to compare the search patterns of 30 fourth-year dental students and 15 certified oral and maxillofacial radiologists (OMRs) over panoramic images and to determine the most robust variables for future studies involving image visualization. Eye tracking was used to capture the eye movement patterns of both subject groups when examining 20 panoramic images classified as normal or abnormal. Abnormal images were further subclassified as having an obvious, intermediate, or subtle abnormality. The images were presented in random order to each participant, and data were collected on duration of the participants’ observations and total distance tracked, time to first eye fixation, and total duration and numbers of fixations on and off the area of interest (AOI). The results showed that the OMRs covered greater distances than the dental students (p<0.001) for normal images. For images of pathosis, the OMRs required less total time (p<0.001), made fewer eye fixations (p<0.01) with fewer saccades (p<0.001) than the students, and required less time before making the first fixation on the AOI (p<0.01). Furthermore, the OMRs covered less distance (p<0.001) than the dental students for obvious pathoses. For investigations of images of pathosis, time to first fixation is a robust parameter in predicting ability. For images with different levels of subtlety of pathoses, the number of fixations, total time spent, and numbers of revisits are important parameters to analyze when comparing observer groups with different levels of experience.

Influence of experience and training on dental students’ examination performance regarding panoramic images.

Physician training has greatly benefitted from insights gained in understanding the manner in which experts search medical images for abnormalities. The aims of this study were to compare the search patterns of 30 fourth-year dental students and 15 certified oral and maxillofacial radiologists (OMRs) over panoramic images and to determine the most robust variables for future studies involving image visualization. Eye tracking was used to capture the eye movement patterns of both subject groups when examining 20 panoramic images classified as normal or abnormal. Abnormal images were further subclassified as having an obvious, intermediate, or subtle abnormality. The images were presented in random order to each participant, and data were collected on duration of the participants’ observations and total distance tracked, time to first eye fixation, and total duration and numbers of fixations on and off the area of interest (AOI). The results showed that the OMRs covered greater distances than the dental students (p<0.001) for normal images. For images of pathosis, the OMRs required less total time (p<0.001), made fewer eye fixations (p<0.01) with fewer saccades (p<0.001) than the students, and required less time before making the first fixation on the AOI (p<0.01). Furthermore, the OMRs covered less distance (p<0.001) than the dental students for obvious pathoses. For investigations of images of pathosis, time to first fixation is a robust parameter in predicting ability. For images with different levels of subtlety of pathoses, the number of fixations, total time spent, and numbers of revisits are important parameters to analyze when comparing observer groups with different levels of experience.

The Levels of mathematics achievement : initial performance standards for the 1990 NAEP mathematics assessment /

"November 1991"--Vol. 3.

Illinois school report cards performance profiles, 1986-1991 /

"Louis Mervis, Chairman, State Board of Education, Robert Leininger, State Superintendent of Education."

Tips and techniques : ability grouping and performance evaluation in physical education.

Bibliography: p. 11.

Title I program : stronger accountability needed for performance of disadvantaged students : report to Congressional requesters /

"B-282653"--P. 5.

Understanding professional practice: investigations before and after an educational programme

During preparation for professional practice, the professional skill being developed is typically measured in the form of specific knowledge and skills. This study proposes an alternative to such measures, drawing upon research which demonstrates that our understanding of professional practice is central to how we both perform and develop that practice. The study investigates understanding of medical practice prior to and following a pre-medical programme. On commencing the programme, students showed substantial variation in their understanding of medical practice. At the end of the programme much of this variation remained, indicating the students had developed varying forms of professional skill. The study calls into question the adequacy of a focus on detailed knowledge and skills as a base for professional practice. In line with previous research, an important implication of the study is that developing skilful practice requires focusing on understanding of that practice in and through its performance.

A pragmatic 2 × 2 × 2 factorial cluster randomized controlled trial of educational outreach visiting and case conferencing in palliative care—methodology of the Palliative Care Trial [ISRCTN 81117481]

The demand for palliative care is increasing, yet there are few data on the best models of care nor well-validated interventions that translate current evidence into clinical practice. Supporting multidisciplinary patient-centered palliative care while successfully conducting a large clinical trial is a challenge. The Palliative Care Trial (PCT) is a pragmatic 2 x 2 x 2 factorial cluster randomized controlled trial that tests the ability of educational outreach visiting and case conferencing to improve patient-based outcomes such as performance status and pain intensity. Four hundred sixty-one consenting patients and their general practitioners (GPs) were randomized to the following: (1) GP educational outreach visiting versus usual care, (2) Structured patient and caregiver educational outreach visiting versus usual care and (3) A coordinated palliative care model of case conferencing versus the standard model of palliative care in Adelaide, South Australia (3:1 randomization). Main outcome measures included patient functional status over time, pain intensity, and resource utilization. Participants were followed longitudinally until death or November 30, 2004. The interventions are aimed at translating current evidence into clinical practice and there was particular attention in the trial's design to addressing common pitfalls for clinical studies in palliative care. Given the need for evidence about optimal interventions and service delivery models that improve the care of people with life-limiting illness, the results of this rigorous, high quality clinical trial will inform practice. Initial results are expected in mid 2005. (c) 2005 Elsevier Inc. All rights reserved.

An examination of the dynamic relationship between self-efficacy and performance across levels of analysis and levels of specificity

This research used resource allocation theory to generate predictions regarding dynamic relationships between self-efficacy and task performance from 2 levels of analysis and specificity. Participants were given multiple trials of practice on an air traffic control task. Measures of task-specific self-efficacy and performance were taken at repeated intervals. The authors used multilevel analysis to demonstrate differential and dynamic effects. As predicted, task-specific self-efficacy was negatively associated with task performance at the within-person level. On the other hand, average levels of task-specific self-efficacy were positively related to performance at the between-persons level and mediated the effect of general self-efficacy. The key findings from this research relate to dynamic effects - these results show that self-efficacy effects can change over time, but it depends on the level of analysis and specificity at which self-efficacy is conceptualized. These novel findings emphasize the importance of conceptualizing self-efficacy within a multilevel and multispecificity framework and make a significant contribution to understanding the way this construct relates to task performance.

Benefits of all work and no play: The relationship between neuroticism and performance as a function of resource allocation

The authors evaluate a model suggesting that the performance of highly neurotic individuals, relative to their stable counterparts, is more strongly influenced by factors relating to the allocation of attentional resources. First, an air traffic control simulation was used to examine the interaction between effort intensity and scores on the Anxiety subscale of Eysenck Personality Profiler Neuroticism in the prediction of task performance. Overall effort intensity enhanced performance for highly anxious individuals more so than for individuals with low anxiety. Second, a longitudinal field study was used to examine the interaction between office busyness and Eysenck Personality Inventory Neuroticism in the prediction of telesales performance. Changes in office busyness were associated with greater performance improvements for highly neurotic individuals compared with less neurotic individuals. These studies suggest that highly neurotic individuals outperform their stable counterparts in a busy work environment or if they are expending a high level of effort.

Assessing pupil and school performance by non-parametric and parametric techniques

Often observations are nested within other units. This is particularly the case in the educational sector where school performance in terms of value added is the result of school contribution as well as pupil academic ability and other features relating to the pupil. Traditionally, the literature uses parametric (i.e. it assumes a priori a particular function on the production process) Multi-Level Models to estimate the performance of nested entities. This paper discusses the use of the non-parametric (i.e. without a priori assumptions on the production process) Free Disposal Hull model as an alternative approach. While taking into account contextual characteristics as well as atypical observations, we show how to decompose non-parametrically the overall inefficiency of a pupil into a unit specific and a higher level (i.e. a school) component. By a sample of entry and exit attainments of 3017 girls in British ordinary single sex schools, we test the robustness of the non-parametric and parametric estimates. We find that the two methods agree in the relative measures of the scope for potential attainment improvement. Further, the two methods agree on the variation in pupil attainment and the proportion attributable to pupil and school level.

The effects of faking on non-cognitive predictors of academic performance in University students

This study examined the extent to which students could fake responses on personality and approaches to studying questionnaires, and the effects of such responding on the validity of non-cognitive measures for predicting academic performance (AP). University students produced a profile of an ‘ideal’ student using the Big-Five personality taxonomy, which yielded a stereotype with low scores for Neuroticism, and high scores for the other four traits. A sub-set of participants were allocated to a condition in which they were instructed to fake their responses as University applicants, portraying themselves as positively as possible. Scores for these participants revealed higher scores than those in a control condition on measures of deep and strategic approaches to studying, but lower scores on the surface approach variable. Conscientiousness was a significant predictor of AP in both groups, but the predictive effect of approaches to studying variables and Openness to Experience identified in the control group was lower in the group who faked their responses. Non-cognitive psychometric measures can be valid predictors of AP, but scores on these measures can be affected by instructional set. Further implications for psychometric measurement in educational settings are discussed.