The effects of school mobility in pre -assessment grade levels on student performance and school accountability in urban Title I schools

This study examined the effects of student mobility and educational enrollment experiences on academic achievement. The educational progress, school enrollments and transfers of inner-city elementary students were tracked over a four-year period. Student achievement was measured by criterion-referenced reading tests administered in the second semester of the third grade. It further analyzed the degree to which the switch to different basal reading textbooks interrupted the continuity of education thereby contributing to the detrimental effects of intra-district mobility. ^ Mobility histories of 2,913 third grade students were collected to evaluate the number of times each student entered or withdrew from a Miami-Dade County Public School beginning in August 2000 through March 2004, and distinguished between transfers that occurred during the academic school year and those that occurred during summer months. Data were analyzed using Pearson correlations and multiple regressions to determine if school mobility contributed to performance on the Florida Comprehensive Assessment Third Grade Reading Test (FCAT). Transferring from one school to another was found to have a significant negative impact on student test scores. Transfers within the academic school year were more detrimental than transfers that occurred during the summer months. Third grade students who transferred into schools that used the same reading textbook series were found to have significantly higher FCAT reading scores than third graders who transferred into schools that used different reading textbooks. ^ The effects of mobility rates on overall school performance were also examined. Data was collected on 124 Title I elementary schools to determine the degree to which mobility affected school accountability scores. Title I schools with high student mobility rates had significantly lower accountability scores than schools with lower student mobility rates. ^ The results of this study highlight the impact of education and housing policy and imply a need for programs and practices that promote stability in the early elementary years. ^

The impact of standards -based practices in mathematics on the achievement of low -performing students

This study examined standards-based mathematics reform initiatives to determine if they would improve student achievement on the part of low-performing students. New curricula, the Carnegie Learning Cognitive Tutor®, were provided for algebra and geometry students. The new instructional strategy relied on both the teacher-led instruction and the use of computers to differentiate instruction for individual students. Mathematics teachers received ongoing professional development to help them implement the new curricula. In addition, teachers were provided with ongoing support to assist them with the transformation of the learning environments for students using standards-based practices. This quasi-experimental (nonrandomized) study involved teachers in two matched urban high schools. Analyses (ANCOVAs) revealed that the experimental group with an appropriately implemented program had significantly higher learning gains than the comparison group as determined by the students' 2007 mathematics Developmental Scale Score (DSS). In addition, the experimental group's adjusted mean for the second interim mathematics assessment was significantly higher than the comparison group's mean. The findings support the idea that if the traditional curriculum is replaced with standards-based curriculum, and the curriculum is implemented as intended, low-performing students may make significant learning gains. With respect to the teaching practices as observed with the Classroom Observation Protocol (COP), t-tests were conducted on four constructs. The results for both the algebra and geometry teachers on the constructs were not significant. The COP indicated that teachers in both the experimental and comparison groups used traditional instruction strategies in their classrooms. The analyses of covariance (ANCOVA) on the use of technology revealed no significant main effects for computer use.

Effects of sex, third grade reading achievement and motivation as predictors of fourth grade reading achievement of Hispanic students: A path analysis

This study explored the topic of motivation for intermediate students combining both an objective criterion measure (i.e., standardized test scores) and the self-report of students on self-concept and value of reading. The purpose of this study was to examine how third grade reading achievement correlated with the motivation of fourth grade boys and girls, and, in turn, how motivation related to fourth grade reading achievement. The participants were fourth grade students (n=207) attending two public, elementary schools in Miami-Dade County who were of primarily Hispanic origin or descent. Data were collected using the Reading Survey portion of the Motivation to Read Profile (1996) which measures self-concept and value of reading in order to measure motivation and the Third and Fourth Grade Reading Florida Comprehensive Assessment Tests 2.0 (FCAT 2.0) to assess achievement. First, a one way Analysis of Variance (ANOVA) was conducted to determine whether motivation differed significantly between fourth grade boys and girls. Second, a path analysis was used to determine whether motivation mediated or moderated the association between FCAT 2.0 third and fourth grade scores. Results of the ANOVA indicated that motivation, as measured by the Motivation to Read Profile did not differ significantly by sex. Results from the path analysis indicated that the model was significant and that third grade FCAT 2.0 scores accounted for a significant amount of the variance in fourth grade FCAT 2.0 scores once motivation was entered. Results of the study demonstrated that motivation partially mediates, but does not moderate the relationship between FCAT 2.0 third and fourth grade scores. In conclusion, it can be determined that past student achievement for fourth grade students plays a role in current student achievement when motivation is also considered. It is therefore important in order to improve the quality of fourth grade student's current performance to take into account a student's motivation and past achievement. An effort must be made to address students' motivational needs whether through school wide programs or at the classroom level in addition or in conjunction with cognition. Future research on the effect of self-concept in reading achievement is recommended.

The impact of standards-based practices in mathematics on the achievement of low-performing students

This study examined standards-based mathematics reform initiatives to determine if they would improve student achievement on the part of low-performing students. New curricula, the Carnegie Learning Cognitive Tutor®, were provided for algebra and geometry students. The new instructional strategy relied on both the teacher-led instruction and the use of computers to differentiate instruction for individual students. Mathematics teachers received ongoing professional development to help them implement the new curricula. In addition, teachers were provided with ongoing support to assist them with the transformation of the learning environments for students using standards-based practices. This quasi-experimental (nonrandomized) study involved teachers in two matched urban high schools. Analyses (ANCOVAs) revealed that the experimental group with an appropriately implemented program had significantly higher learning gains than the comparison group as determined by the students' 2007 mathematics Developmental Scale Score (DSS). In addition, the experimental group's adjusted mean for the second interim mathematics assessment was significantly higher than the comparison group's mean. The findings support the idea that if the traditional curriculum is replaced with standards-based curriculum, and the curriculum is implemented as intended, low-performing students may make significant learning gains. With respect to the teaching practices as observed with the Classroom Observation Protocol (COP), t-tests were conducted on four constructs. The results for both the algebra and geometry teachers on the constructs were not significant. The COP indicated that teachers in both the experimental and comparison groups used traditional instruction strategies in their classrooms. The analyses of covariance (ANCOVA) on the use of technology revealed no significant main effects for computer use.

EXAMINING THE IMPACT OF TEACHER PRACTICE ON STUDENT LEARNING IN INTERACTIVE RADIO INSTRUCTION (IRI) CLASSROOMS: LESSONS FROM NEW DELHI AND RAJASTHAN (INDIA)

This quantitative study examines the impact of teacher practices on student achievement in classrooms where the English is Fun Interactive Radio Instruction (IRI) programs were being used. A contemporary IRI design using a dual-audience approach, the English is Fun IRI programs delivered daily English language instruction to students in grades 1 and 2 in Delhi and Rajasthan through 120 30-minute programs via broadcast radio (the first audience) while modeling pedagogical techniques and behaviors for their teachers (the second audience). Few studies have examined how the dual-audience approach influences student learning. Using existing data from 32 teachers and 696 students, this study utilizes a multivariate multilevel model to examine the role of the primary expectations for teachers (e.g., setting up the IRI classroom, following instructions from the radio characters and ensuring students are participating) and the role of secondary expectations for teachers (e.g., modeling pedagogies and facilitating learning beyond the instructions) in promoting students’ learning in English listening skills, knowledge of vocabulary and use of sentences. The study finds that teacher practice on both sets of expectations mattered, but that practice in the secondary expectations mattered more. As expected, students made the smallest gains in the most difficult linguistic task (sentence use). The extent to which teachers satisfied the primary and secondary expectations was associated with gains in all three skills – confirming the relationship between students’ English proficiency and teacher practice in a dual-audience program. When it came to gains in students’ scores in sentence use, a teacher whose focus was greater on primary expectations had a negative effect on student performance in both states. In all, teacher practice clearly mattered but not in the same way for all three skills. An optimal scenario for teacher practice is presented in which gains in all three skills are maximized. These findings have important implications for the way the classroom teacher is cast in IRI programs that utilize a dual-audience approach and in the way IRI programs are contracted insofar as the role of the teacher in instruction is minimized and access is limited to instructional support from the IRI lessons alone.

Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)

THE EFFECT OF SCHOOL CLIMATE (STUDENT AND TEACHER ENGAGEMENT) ON STUDENT PERFORMANCE

Title of Dissertation: THE EFFECT OF SCHOOL CLIMATE (STUDENT AND TEACHER ENGAGEMENT) ON STUDENT PERFORMANCE Kenneth L. Marcus, Doctor of Education, 2016 Directed By: Dr. Thomas Davis, Assistant Professor, Education Policy and Leadership, Department of Teaching and Learning, Policy and Leadership This quantitative research study was designed to compute correlations/relationships of student engagement and student achievement of fifth grade students. Secondary information was collected on the relationship of FARMS, type of school, hope, and well-being on student achievement. School leaders are charged with ensuring that students achieve academically and demonstrate their ability by meeting identified targets on state and district mandated assessments. Due to increased pressure to meet targets, principals implement academic interventions to improve student learning and overlook the benefits of a positive school climate. This study has provided information on the impact of school climate on student achievement. To conduct this study, the researcher collected two sets of public fifth grade data (Gallup Survey student engagement scores and DSA reading, mathematics, and science scores) to determine the relationship of student performance and school climate. Secondary data were also collected on teacher engagement and the percentage of students receiving FARMS to determine the effect on students. The findings from this study reinforced the belief that school climate can have a positive effect on student achievement. This study contributed quantitative data about the relationship between school climate and school achievement.

Governing the transition to higher levels of education and differences between achievement and school grades by gender

The author will explore the performance of boys and girls in external examinations in Slovenia at the beginning of upper secondary and tertiary education. These are critical points in students’ educational career at which he/she has to choose a school/university. Since both transitions are managed centrally by appropriate authorities, this is also a question of Educational Governance. Transitions between levels of education should, above all, assure fairness in selection procedures. At the point of transition to upper secondary schools we will explore differences between students’ achievements in various school subjects tested at the national assessment of knowledge (NA), and their school grades by gender. Since only school grades are used as admission criteria to upper secondary schools, this comparison of school grades with external and more objective measure of students’ achievement will show possible bias. In Slovenia admission to tertiary education usually consists of (externally assessed) Matura results and school grades in the last two years of upper secondary school. The author will compare the effects of both most commonly used measures of academic achievement on admission in view of gender differences. Study courses where selection procedure was actually applied will be of specific interest since they can show signs of (un)fairness. Results show signs of bias and build case for better Educational Governance. (DIPF/Orig.)

THE EFFECTS OF MODELING INSTRUCTION ON STUDENT LEARNING OF A NEWTONIAN FORCE CONCEPT

This study explores the effects of modeling instruction on student learning in physics. Multiple representations grounded in physical contexts were employed by students to analyze the results of inquiry lab investigations. Class whiteboard discussions geared toward a class consensus following Socratic dialogue were implemented throughout the modeling cycle. Lab investigations designed to address student preconceptions related to Newton’s Third Law were implemented. Student achievement was measured based on normalized gains on the Force Concept Inventory. Normalized FCI gains achieved by students in this study were comparable to those achieved by students of other novice modelers. Physics students who had taken a modeling Intro to Physics course scored significantly higher on the FCI posttest than those who had not. The FCI results also provided insight into deeply rooted student preconceptions related to Newton’s Third Law. Implications for instruction and the design of lab investigations related to Newton’s Third Law are discussed.

Moderation as judgement practice: Reconciling system level accountability and local level practice

Internationally, recognition of the role of assessment to inform the learning process has received much attention in recent years. Assessment for learning, not just of learning is being supported by an increasing body of literature providing strategies that teachers and their students can incorporate to support the learning process (Assessment Reform Group, 2002; Broadfoot & Black, 2004; James, 2006). Concurrently there has been an increase internationally in systemic accountability requirements of schools in terms of student results. The convergence of these two movements has resulted in some education systems promoting standards-driven reform involving authentic assessment and a re-examination of the relationship between the teacher and the student in the learning process. In this context standards are intended to be used as the basis for judgements of student achievement; while the results from assessment tasks are meant to both inform the teaching/learning process, and to report and track student progress. In such system, the role and reliability of teacher judgement takes centre stage.

Assessment for learning in the accountability era : Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers' assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.

Developing a social justice framework to ensure good practice in higher education

The concept of student engagement is a key factor in student achievement and retention and Australasian universities have a range of initiatives aimed at monitoring and intervening with students who are at risk of disengaging. Given the aspirations about widening participation, it is absolutely critical that these initiatives are designed to enable success for all students, particularly those for whom social and cultural disadvantage have been a barrier. Consequently, these types of initiatives must be consistent with the concept of social justice and a set of principles would provide this philosophical foundation for the sector. An Australian Learning and Teaching Council (ALTC) project that involves ten Australasian universities, is designing of a suite of resources for the sector which will include: (1) a set of principles for good practice in MSLE, (2) a good practice guide for the design and implementation of institutional MSLE policy and practice, and (3) a collection of resources for and exemplars of good practice to be taken up by the sector. This workshop session will provide an opportunity for participants to examine the draft set of principles and to discuss their potential value for the participants’ institutional contexts. Australian Learning and Teaching Council Competitive Grant CG10-1730 2010-2012: Good practice for safeguarding student learning engagement in higher education institutions.

Reasonable adjustment and the assessment of students with disabilities: Australian legal issues and trends

Student assessment is particularly important, and particularly controversial, because it is the means by which student achievement is determined. Reasonable adjustment to student assessment is of equal importance as the means of ensuring the mitigation, or even elimination, of disability related barriers to the demonstration of student achievement. The significance of reasonable adjustment is obvious in the later years of secondary school, and in the tertiary sector, because failure to adjust assessment may be asserted as the reason a student did not achieve as well as anticipated or as the reason a student was excluded from a course and, as a result, from future study and employment opportunities. Even in the early years of schooling, however, assessment and its management are a critical issue for staff and students, especially in an education system like Australia’s with an ever increasing emphasis on national benchmarks testing. This paper will explain the legislation which underpins the right to reasonable adjustment in education in Australian schools. It will give examples of the kinds of adjustment which may be made to promote equality of opportunity in the area of assessment. It will also consider some of the controversies which have confronted, or which, it may be speculated, are likely to confront Australian education institutions as they work towards compliance with reasonable adjustment laws.

A formative evaluation of the Stronger Smarter Learning Communities Project. 2011 report.

This report is a formative evaluation of the operations of the DEEWR funded Stronger Smarter Learning Community (SSLC) project from September 2009 to July 2011. It is undertaken by an independent team of researchers from Queensland University of Technology, the University of Newcastle and Harvard University. It reports on findings from: documentary analysis; qualitative case studies of SSLC Hub schools; descriptive, multivariate and multilevel analysis of survey data from school leaders and teachers from SSLC Hub and Affiliate schools and from a control group of non-SSLC schools; and multilevel analysis of school-level data on SSLC Hubs, Affiliates and ACARA like-schools. Key findings from this work are that: • SSLC school leaders and teachers are reporting progress in changing school ethos around issues of: recognition of Indigenous identity, Indigenous leadership, innovative approaches to staffing and school models, Indigenous community engagement and high expectations leadership; • Many Stronger Smarter messages are reportedly having better uptake in schools with high percentages of Indigenous students; • There are no major or consistent patterns of differences between SSLC and non-SSLC schools in teacher and school leader self-reports of curriculum and pedagogy practices; and • There is no evidence to date that SSLC Hubs and Affiliates have increased attendance or increased achievement gains compared to ACARA like-schools. Twenty-one months is relatively early in this school reform project. Hence the major focus of subsequent reports will be on the documentation of comparative longitudinal gains in achievement tests and improved attendance. The 2011 and 2012 research also will model the relationships between change in school ethos/climate, changed Indigenous community relations, improved curriculum/pedagogy, and gains in Indigenous student achievement, attendance and outcomes. The key challenge for SSLC and the Stronger Smarter approach will be whether it can systematically generate change and reform in curriculum and pedagogy practices that can be empirically linked to improved student outcomes.

Learning communities learning series

In 2008 the introduction of the National Assessment Program – Literacy and Numeracy (NAPLAN), combined with the publication of the international comparative analyses of student achievement data (such as the Programme of International Student Assessment (PISA) developed by the Organisation for Economic Co-operation and Development (OECD) and the Trends in International Mathematics and Science Study (TIMSS) of the International Association for the Evaluation of Educational Achievement (IEA)) highlighted a significant priority for Australian education by identifying low levels of equity.