The Comprehensive Assessment of Leadership for Learning: A Next Generation Formative Evaluation and Feedback System

Recent developments in federal policy have prompted the creation of state evaluation frameworks for principals and teachers that hold educators accountable for effective practices and student outcomes. These changes have created a demand for formative evaluation instruments that reflect current accountability pressures and can be used by schools to focus school improvement and leadership development efforts. The Comprehensive Assessment of Leadership for Learning (CALL) is a next generation, 360-degree on-line assessment and feedback system that reflect best practices in feedback design. Some unique characteristics of CALL include a focus on: leadership distributed throughout the school rather than as carried out by an individual leader; assessment of leadership tasks rather than perceptions of leadership practice; a focus on larger complex systems of middle and high school; and transparency of assessment design. This paper describes research contributing to the design and validation of the CALL survey instrument.

A Step in the Right Direction: Development of the Computerized Assessment for Preschool Social Emotional Learning (CAPSEL)

Invited commentary on "Computerizing Social-Emotional Assessment for School Readiness".

Assessing the Influence of Brain-based Instructional Methods and Its Impact on Systemic Change for Learning Communities

Background: As scholars who prepare future school leaders to be innovative instructional leaders for their learning communities, we are on the verge of a curriculum design revolution. The application of brain research findings promotes educational reform efforts to systemically change the way in which children experience school. However, most educators, school leaders, board members, and policy makers are ill prepared to reconsider the implications for assessment, pedagogy, school climate, daily schedules, and use of technology. This qualitative study asked future school leaders to reconsider how school leadership preparedness programs prepared them to become instructional leaders for the 21st century. The findings from this study will enhance the field of school leadership, challenging the current emphasis placed on standardized testing, traditional school calendars, assessments, monocultural instructional methods, and meeting the needs of diverse learning communities. [See PDF for complete abstract]

Assessment of anastomotic leakage: A Novel System for the Training of Surgeons to Perform a Tubular Anastomosis and Objectively Evaluate Anastomotic Leak

Introduction: Dehiscence of the suture line of an anastomosis can lead to reoperation, temporary or permanent stoma, and even sepsis or death. Few techniques for the laboratory training of tubular anastomosis use ex-vivo animal tissues. We describe a novel model that can be used in the laboratory for the training of anastomosis in tubular tissues and objectively assess any anastomotic leak. [See PDF for complete abstract]

Self-Assessment in a Competency-Based Curriculum: Preliminary Findings

Introduction: The introduction of the ACGME core competency framework brought challenges of developing appropriate evaluation tools (i.e. self assessment) to provide evidence of competency. Baylor College of Medicine has 43 competency goals organized within the 6 ACGME domains, each domain having 4-10 goals. [See PDF for complete abstract]

Use of instructional video to prepare parents for learning infant cardiopulmonary resuscitation.

Parents of premature infants often receive infant cardiopulmonary resuscitation (CPR) training prior to discharge from the hospital, but one study showed that 27.5% of parents could not demonstrate adequate CPR skills after completing an instructor-led class. We hypothesized that parents who viewed an instructional video on infant CPR before attending the class would perform better on a standardized skills test than parents who attended the class with no preparation. Parents randomized to the intervention (video) group viewed the video within 48 hours of the CPR class. Parents in the control group attended the class with no special preparation. All parents completed the CPR skills checklist test, usually within 7 days after class and before the infant's hospital discharge. The test rated subjects' skills in the areas of assessment, ventilation, and chest compressions; each section was rated as good, fair, or fail. In this pass/fail test, students had to be rated good or fair on all three sections to pass. All 10 subjects in the video group passed the test versus only 9 of 13 in the control group, but this difference was not significant (P = 0.08). However, 8 of 10 (80%) subjects in the video group were rated as good on all three sections, versus only 3 of 13 (18.7%) in the control group, and this was a significant difference (P = 0.012). We conclude that preparation of students using an instructional video prior to infant CPR class is associated with improvement in skills performance as measured by a standardized skills test. Video preparation is relatively inexpensive, eliminates the barrier of reading ability for preparation, and can be done at the convenience of the parent.

Assessment of readiness to initiate antiretroviral therapy

An important factor in determining a patient's adherence to antiretroviral therapy is the patient's commitment to follow the regimen. This suggests that therapy should be initiated when the patient is willing to commit to the regimen. Starting when the patient is ready may be more important than the laboratory values suggested by various guidelines. In order to increase understanding of patient readiness for antiretroviral therapy HIV infected patients were surveyed to determine the factors that influenced their decision to initiate antiretroviral therapy and to continue to adhere to therapy once started. A sample of 83 HIV infected patients who were currently on antiretroviral regimens completed a 25-item investigator-developed questionnaire. The questionnaire sought information on the length of time from learning of HIV positive status and readiness to initiate therapy. The questionnaire also addressed demographic, psychological and social factors thought to be associated with readiness for adhering to therapy. (Abstract shortened by UMI.)^

Computerizing Social-Emotional Assessment for School Readiness: First Steps toward an Assessment Battery for Early Childhood Settings

The transition into formal schooling is a crucial foundation that can set children on a cycle of success or failure in both academic and social domains. A child’s abilities to express healthy emotions, understand emotions of self and others, regulate emotion, attention, and behavior, make good decisions regarding social problems, and engage in a range of prosocial behaviors, all work together to promote a successful school experience. However, many children have deficits in these skills by school entry, and educators lack the requisite tools to identify, track and assess skills these children need to learn. Thus, because social-emotional learning (SEL) is so crucial, assessment tools to pinpoint children’s skills and progress are vitally necessary. Previous work by the authors and other researchers has led to the development of strong assessment tools; however, these tools are often developed solely for research use, not practitioner application. In the following, using our assessment battery as an example, we will discuss the steps necessary to adapt SEL assessment for computer-based administration and optimal utility in early childhood education programs.

Comparison of machine learning approaches and statistical methods for estimation of airborne chemical exposures

Accurate quantitative estimation of exposure using retrospective data has been one of the most challenging tasks in the exposure assessment field. To improve these estimates, some models have been developed using published exposure databases with their corresponding exposure determinants. These models are designed to be applied to reported exposure determinants obtained from study subjects or exposure levels assigned by an industrial hygienist, so quantitative exposure estimates can be obtained. ^ In an effort to improve the prediction accuracy and generalizability of these models, and taking into account that the limitations encountered in previous studies might be due to limitations in the applicability of traditional statistical methods and concepts, the use of computer science- derived data analysis methods, predominantly machine learning approaches, were proposed and explored in this study. ^ The goal of this study was to develop a set of models using decision trees/ensemble and neural networks methods to predict occupational outcomes based on literature-derived databases, and compare, using cross-validation and data splitting techniques, the resulting prediction capacity to that of traditional regression models. Two cases were addressed: the categorical case, where the exposure level was measured as an exposure rating following the American Industrial Hygiene Association guidelines and the continuous case, where the result of the exposure is expressed as a concentration value. Previously developed literature-based exposure databases for 1,1,1 trichloroethane, methylene dichloride and, trichloroethylene were used. ^ When compared to regression estimations, results showed better accuracy of decision trees/ensemble techniques for the categorical case while neural networks were better for estimation of continuous exposure values. Overrepresentation of classes and overfitting were the main causes for poor neural network performance and accuracy. Estimations based on literature-based databases using machine learning techniques might provide an advantage when they are applied to other methodologies that combine `expert inputs' with current exposure measurements, like the Bayesian Decision Analysis tool. The use of machine learning techniques to more accurately estimate exposures from literature-based exposure databases might represent the starting point for the independence from the expert judgment.^