An ecologic comparison study of the impact of economic disadvantage on Texas Assessment of Knowledge and Skills performance, graduation rates, and readiness for higher education for students attending public and charter schools in Texas from 2004 to 2006

Purpose. No Child Left Behind aimed to "improve the academic achievement of the disadvantaged." The primary research question considered how academic achievement of those from economic disadvantage compared to those not from disadvantage? ^ Economically disadvantaged students can potentially have added academic disadvantage. Research shows low academic achievement can potentially result in drug abuse, youth violence, and teen pregnancy. ^ Methods. To compare the student populations, measures included TAKS results and academic indicator data collected by the Texas Education Agency. ^ Results. T-test analyses showed a significant difference between the economically and non-economically disadvantaged student populations in meeting the TAKS passing standard, graduation, and preparation for higher education.^ Conclusions. The achievement gap between students remained as indicated by the Texas testing program. More research and time are needed to observe if the desired impact on those from economic disadvantage will be reflected by academic achievement data.^

Affect and cognition measures in preference-based decisions: Validity testing of the Ottawa Decisional Conflict Scale and a decision-specific anxiety measure with men eligible for prostate cancer screening

Background. At present, prostate cancer screening (PCS) guidelines require a discussion of risks, benefits, alternatives, and personal values, making decision aids an important tool to help convey information and to help clarify values. Objective: The overall goal of this study is to provide evidence of the reliability and validity of a PCS anxiety measure and the Decisional Conflict Scale (DCS). Methods. Using data from a randomized, controlled PCS decision aid trial that measured PCS anxiety at baseline and DCS at baseline (T0) and at two-weeks (T2), four psychometric properties were assessed: (1) internal consistency reliability, indicated by factor analysis intraclass correlations and Cronbach's α; (2) construct validity, indicated by patterns of Pearson correlations among subscales; (3) discriminant validity, indicated by the measure's ability to discriminate between undecided men and those with a definite screening intention; and (4) factor validity and invariance using confirmatory factor analyses (CFA). Results. The PCS anxiety measure had adequate internal consistency reliability and good construct and discriminant validity. CFAs indicated that the 3-factor model did not have adequate fit. CFAs for a general PCS anxiety measure and a PSA anxiety measure indicated adequate fit. The general PCS anxiety measure was invariant across clinics. The DCS had adequate internal consistency reliability except for the support subscale and had adequate discriminate validity. Good construct validity was found at the private clinic, but was only found for the feeling informed subscale at the public clinic. The traditional DCS did not have adequate fit at T0 or at T2. The alternative DCS had adequate fit at T0 but was not identified at T2. Factor loadings indicated that two subscales, feeling informed and feeling clear about values, were not distinct factors. Conclusions. Our general PCS anxiety measure can be used in PCS decision aid studies. The alternative DCS may be appropriate for men eligible for PCS. Implications: More emphasis needs to be placed on the development of PCS anxiety items relating to testing procedures. We recommend that the two DCS versions be validated in other samples of men eligible for PCS and in other health care decisions that involve uncertainty. ^

Commentary on "Alternative Strategies for Identifying High-Performing Charter Schools in Texas"

In the last few years policy makers and practitioners nationally have shown much interest in identifying, recognizing, and replicating successful charter schools, many of which are showing that they can educate low-income and otherwise at-risk students remarkably well. However past efforts to identify high performing schools have been problematic. Using these systematic, rigorous value-added methods, the authors identify 44 Open Enrollment charter schools that merit a “high-performer” rating. Nearly all of those campuses identified serve a disadvantaged student population. The article also finds that most of those high performers are highly cost-effective, earning high ratings on the cost-efficiency measures. The authors argue for more widespread use of value-added modeling in the state accountability system. The approach taken to identifying high-performers is sensible and fair, but any formulaic approach to school labels comes with some limitations.

Alternative Strategies for Identifying High-Performing Charter Schools in Texas

The Obama administration's recurring policy emphasis on high-performing charter schools begs the obvious question: how do you identify a high-performing charter school? That is a crucially important policy question because any evaluation strategy that incorrectly identifies charter school performance could have negative effects on the economically and/or academically disadvantaged students who frequently attend charter schools. If low-performing schools are mislabeled and allowed to persist or encouraged to expand, then students may be harmed directly. If high-performing schools are driven from the market by misinformation, then students will lose access to programs and services that can make a difference in their lives. Most of the scholarly analysis to date has focused on comparing the performance of students in charter schools to that of similar students in traditional public schools (TPS). By design, that research measures charter school performance only in relative terms. Charter schools that outperform similarly situated, but low performing, TPSs have positive effects, even if the charter schools are mediocre in an absolute sense. This analysis describes strategies for identifying high-performing charter schools by comparing charter schools with one another. We begin by describing salient characteristics of Texas charter schools. We follow that discussion with a look at how other researchers across the country have compared charter school effectiveness with TPS effectiveness. We then present several metrics that can be used to identify high-performing charter schools. Those metrics are not mutually exclusive—one could easily justify using multiple measures to evaluate school effectiveness—but they are also not equally informative. If the goal is to measure the contributions that schools are making to student knowledge and skills, then a value-added approach like the ones highlighted in this report is clearly superior to a levels-based approach like that taken under the current accountability system.