How Can Teachers Alleviate Parental Anxiety in High Stakes Testing?

In Florida, third and tenth graders are required to take the Florida Comprehensive Assessment Test (FCAT), a high stakes test. Third graders must score a Level 2 or higher on the Sunshine States Standards portion of the FCAT or fifty-one percent or higher on the Normreference portion of the FCAT in order to be promoted. In 2003, the Florida Department of Education reported 31 percent of third graders in Miami-Dade County were retained (2003). The purpose of the study is to investigate how third grade teachers can decrease the level of parental anxiety for this high stakes test and determine if there are different levels of parental anxiety based upon certain variables. Parent workshops will be offered to families focusing on FCAT strategies and relaxation techniques designed to increase parental efficacy and decrease parental anxiety related to high stakes testing.

Retention and special education referral practices before and after the implementation of high -stakes testing

The rewards and sanctions associated with high-stakes testing may induce educators to participate in practices that will ensure the elimination of the scores of low-achieving students from the testing pool. Two ways in which scores may be eliminated is through retention or referral to special education. ^ This study examined the use of these practices at 179 elementary schools in Miami-Dade County Public Schools, the 4th largest school district in the country. Between- and within-subjects designs were analyzed using repeated measures analysis of variance to compare retention and referral to special education practices over a five-year period of time, two years prior to and two years after the implementation of Florida's high-stakes test, the Florida Comprehensive Assessment Test, FCAT. ^ Significant main effects for referral and retention over time were demonstrated. The use of retention steadily increased over the first three years, with its usage maintained during the fourth year. While the use of referral actually decreased from the first to second years, a significant change occurred after the implementation of the FCAT. ^ Examination of the use of these practices according to student and school characteristics revealed significant differences. Increases in the use of referral across time was significant for Black, non-Hispanic and Hispanic students, all limited English proficiency population categories, medium and low socioeconomic status category schools, all grade levels, and for schools with accountability grades of A. C, D and F with the most striking absolute increase occurring for F schools. Increases in the use of retention across time were significant for all ethnic groups, limited English proficiency categories, and socioeconomic status categories, for grades kindergarten through four and by gender. Significant increases occurred for schools with accountability performance grades of C, D and F; however the most dramatic increase occurred for the F schools. A direct relationship between performance category grade of school and their use of retention was demonstrated. The results suggest that schools changed their use of referral and retention in response to the implementation of the FCAT. ^

Retention and special education referral practices before and after the implementation of high-stakes testing

The rewards and sanctions associated with high-stakes testing may induce educators to participate in practices that will ensure the elimination of the scores of low-achieving students from the testing pool. Two ways in which scores may be eliminated is through retention or referral to special education. This study examined the use of these practices at 179 elementary schools in Miami-Dade County Public Schools, the 4th largest school district in the country. Between- and within-subjects designs were analyzed using repeated measures analysis of variance to compare retention and referral to special education practices over a five-year period of time, two years prior to and two years after the implementation of Florida's high-stakes test, the Florida Comprehensive Assessment Test, FCAT. Significant main effects for referral and retention over time were demonstrated. The use of retention steadily increased over the first three years, with its usage maintained during the fourth year. While the use of referral actually decreased from the first to second years, a significant change occurred after the implementation of the FCAT. Examination of the use of these practices according to student and school characteristics revealed significant differences. Increases in the use of referral across time was significant for Black, non-Hispanic and Hispanic students, all limited English proficiency population categories, medium and low socioeconomic status category schools, all grade levels, and for schools with accountability grades of A, C, D and F with the most striking absolute increase occurring for F schools. Increases in the use of retention across time were significant for all ethnic groups, limited English proficiency categories, and socioeconomic status categories, for grades kindergarten through four and by gender. Significant increases occurred for schools with accountability performance grades of C, D and F; however the most dramatic increase occurred for the F schools. A direct relationship between performance category grade of school and their use of retention was demonstrated. The results suggest that schools changed their use of referral and retention in response to the implementation of the FCAT.

Investigation of escape and negative student behaviors related to Florida state high stakes test preparation in Miami-Dade County Public High Schools

The purpose of this study was to determine whether there was a relationship between pressure to perform on state mandated, high-stakes tests and the rate of student escape behavior defined as the number of school suspensions and absences. The state assigned grade of a school was used as a surrogate measure of pressure with the assumption that pressure increased as the school grade decreased. Student attendance and suspension data were gathered from all 33 of the regular public high schools in Miami-Dade County Public Schools. The research questions were: Is the number of suspensions highest in the third quarter, when most FCAT preparation takes place for each of the 3 school years 2007-08 through 2009-10? How accurately does the high school's grade predict the number of suspensions and number of absences during each of the 4 school years 2005-06 through 2008-09? The research questions were answered using repeated measures analysis of variance for research question #1 and non-linear multiple regression for research question #2. No significant difference could be found between the numbers of suspensions in each of the grading periods nor was there a relationship between the number of suspensions and school grade. A statistically significant relationship was found between student attendance and school grade. When plotted, this relationship was found to be quadratic in nature and formed a loose inverted U for each of the four years during which data were collected. This indicated that students in very high and very low performing schools had low levels of absences while those in the midlevel of the distribution of school performance (C schools) had the greatest rates of absence. Identifying a relationship between the pressures associated with high stakes testing and student escape behavior suggests that it might be useful for building administrators to reevaluate test preparation activities and procedures being used in their building and to include anxiety reducing strategies. As a relationship was found, it sets the foundation for future studies to identify whether testing related activities are impacting some students emotionally and are causing unintended consequences of testing mandates.

Investigation of Escape and Negative Student Behaviors Related to Florida State High Stakes Test Preparation in Miami-Dade County Public High Schools, having been approved in respect to style and intellectual content, is referred to you for judgment

The purpose of this study was to determine whether there was a relationship between pressure to perform on state mandated, high-stakes tests and the rate of student escape behavior defined as the number of school suspensions and absences. The state assigned grade of a school was used as a surrogate measure of pressure with the assumption that pressure increased as the school grade decreased. Student attendance and suspension data were gathered from all 33 of the regular public high schools in Miami-Dade County Public Schools. The research questions were: Is the number of suspensions highest in the third quarter, when most FCAT preparation takes place for each of the 3 school years 2007-08 through 2009-10? How accurately does the high school’s grade predict the number of suspensions and number of absences during each of the 4 school years 2005-06 through 2008-09? The research questions were answered using repeated measures analysis of variance for research question #1 and non-linear multiple regression for research question #2. No significant difference could be found between the numbers of suspensions in each of the grading periods nor was there a relationship between the number of suspensions and school grade. A statistically significant relationship was found between student attendance and school grade. When plotted, this relationship was found to be quadratic in nature and formed a loose inverted U for each of the four years during which data were collected. This indicated that students in very high and very low performing schools had low levels of absences while those in the midlevel of the distribution of school performance (C schools) had the greatest rates of absence. Identifying a relationship between the pressures associated with high stakes testing and student escape behavior suggests that it might be useful for building administrators to reevaluate test preparation activities and procedures being used in their building and to include anxiety reducing strategies. As a relationship was found, it sets the foundation for future studies to identify whether testing related activities are impacting some students emotionally and are causing unintended consequences of testing mandates.

High Stakes and No Takers: The Impact of Florida Comprehensive Assessment Test (FCAT) Writing on Students’ and Teachers’ Perceptions of Writing

This ethnographic case study of ten students and their teachers concludes that the state writing test had a negative impact on students’ and teachers’ perceptions of writing in four categories: strengths and weaknesses in student writing, self-assessment of writing skills, factors impacting test scores, and motivation and attitudes toward writing.

The relationship between prekindergarten social and emotional development and academic success among Hispanic children from low-income families

Social and emotional development has been considered an important factor in child development which has been placed at the end of the learning spectrum due to high stakes testing. Social and emotional development consists of the relationships an individual has with others, the level of self-control, and the motivation and perseverance a person has during an activity (Bandura, 1989). This study examined the relationship between Hispanic children’s prekindergarten social and emotional development and their academic success. Hispanic children from a large southeastern city whose parents were receiving subsidized child-care were followed from their prekindergarten year through third grade (N=1,978). Several hierarchical regressions were run to determine the relationship between children’s social and emotional development, during their prekindergarten year using the DECA (Devereaux Early Childhood Assessment), and the their academic success, as measured by kindergarten through third grade end of the year reading and mathematics academic grades, second grade SAT (Stanford Achievement Test) scores, and third grade FCAT (Florida Comprehensive Assessment Test) and NRT (Norm Referenced Test) scores. Hierarchical regressions were conducted for each grade and subject in order to control for demographics and prior achievement. The results of this study revealed that for Hispanic children from low-income families, the best predictor for academic success was the children’s prior academic achievement. Social and emotional development showed no significant predictive value for the third grade criterion variables as well as end of the year academic grades in second grade and kindergarten reading. Evidence did suggest that for first grade end of the year academic grades and kindergarten math, social and emotional development had a small predictive value. Further research must be conducted as to why social and emotional development, after controlling for demographics and previous academic achievement, bears such a small predictive value when it is clear that many professionals feel it is the most important factor for school readiness.

Deprofessionalization of curriculum decision -making

The purpose of this study was to analyze the evolution of Florida state level policy efforts and to assess the responding educational policy development and implementation at the local school district level. The focus of this study was the secondary language arts curriculum in Miami-Dade County Public Schools. ^ Data was collected using document analysis as a source of meaning making out of the language sets proffered by agencies at each level. A matrix was created based on Klein's levels of curriculum decision-making and Functional Process Theory categories of policy formation. The matrix allowed the researcher to code and classify specific information in terms accountability/high-stakes testing; authority; outside influences; and operational/structural organization. ^ Federal policy documents provided a background and impetus for much of what originated at the State level. The State then produced policy directives which were accepted by the District and specific policy directives and guidelines for practice. No evidence was found indicating the involvement of any other agencies in the development, transmission or implementation of the State level initiated policies. ^ After analyzing the evolutionary process, it became clear that state policy directives were never challenged or discussed. Rather, they were accepted as standards to be met and as such, school districts complied. Policy implementation is shown to be a top-down phenomenon. No evidence was found indicating a dialogue between state and local systems, rather the state, as the source of authority, issued specifically worded policy directives and the district complied. Finally, this study recognizes that outside influences play an important role in shaping the education reform policy in the state of Florida. The federal government, through NCLB and other initiatives created a climate which led almost naturally to the creation of the Florida A+ Plan. Similarly, the concern of the business community, always interested in the production of competent workers, continued to support efforts at raising the minimum skill level of Florida high school graduates. ^ Suggestions are made for future research including the examination of local school sites in order to assess the overall nature of the school experience rather than rely upon performance indicators mandated by state policy. ^

The effects on students' self-efficacy beliefs regarding their comprehension of American literature when aesthetic reading and reader response strategy are implemented

High-stakes testing and accountability have infiltrated the education system in the United States; the top priority for all teachers must be student progress on standardized tests. This has resulted in the predominance of reading for test-taking, (efferent reading), in the English, language arts, and reading classrooms. Authentic uses of print activities, like aesthetic reading, that encourage students to engage individually with a text, have been pushed aside. ^ During a 3-week time period, regular level, English 3/American literature students in a Title I magnet high school, participated in this quasi-experimental study (N = 62). It measured the effects of an intervention of reading American literature texts aesthetically and writing aesthetically-evoked reader responses on students' self-efficacy beliefs regarding their comprehension of American literature. One trained teacher and the researcher participated in the study: student participants were pre- and post- tested using the Confidence in Reading American Literature Survey which examined their self-efficacy beliefs regarding their comprehension of American literature. Several statistical analyses were performed. The results of the linear regression analyses partially supported a positive relationship between aesthetically-evoked reader responses and students' self-efficacy beliefs regarding their comprehension of American literature. Additionally, the results of the 2 (sex) x 2 (treatment) ANCOVAs conducted to test group differences in self-efficacy beliefs regarding the comprehension of American literature between treatment and control groups indicated a main effect for treatment (but not sex; nor was there a significant sex x treatment interaction), suggesting the treatment was partially effective in increasing students' self-efficacy beliefs. Seven of the twelve ANCOVAs indicated a statistically significant increase in the treatment group's adjusted group mean self-efficacy belief scores as a result of being exposed to the intervention. In six of these seven analyses, increases in self-efficacy beliefs occurred in tasks that required three or more higher-order levels of thinking/learning. The results are discussed in terms of theoretical, empirical and practical significance. Future research is recommended to extend the intervention beyond the narrow confines of a Title I magnet school to settings where the intervention could be tested longitudinally, e. g., honors and gifted students, elementary and middle schools.^

Deprofessionalization of curriculum decision-making

The purpose of this study was to analyze the evolution of Florida state level policy efforts and to assess the responding educational policy development and implementation at the local school district level. The focus of this study was the secondary language arts curriculum in Miami-Dade County Public Schools. Data was collected using document analysis as a source of meaning making out of the language sets proffered by agencies at each level. A matrix was created based on Klein's levels of curriculum decision-making and Functional Process Theory categories of policy formation. The matrix allowed the researcher to code and classify specific information in terms accountability/high-stakes testing; authority; outside influences; and operational/structural organization. Federal policy documents provided a background and impetus for much of what originated at the State level. The State then produced policy directives which were accepted by the District and specific policy directives and guidelines for practice. No evidence was found indicating the involvement of any other agencies in the development, transmission or implementation of the State level initiated policies. After analyzing the evolutionary process, it became clear that state policy directives were never challenged or discussed. Rather, they were accepted as standards to be met and as such, school districts complied. Policy implementation is shown to be a top-down phenomenon. No evidence was found indicating a dialogue between state and local systems, rather the state, as the source of authority, issued specifically worded policy directives and the district complied. Finally, this study recognizes that outside influences play an important role in shaping the education reform policy in the state of Florida. The federal government, through NCLB and other initiatives created a climate which led almost naturally to the creation of the Florida A+ Plan. Similarly, the concern of the business community, always interested in the production of competent workers, continued to support efforts at raising the minimum skill level of Florida high school graduates. Suggestions are made for future research including the examination of local school sites in order to assess the overall nature of the school experience rather than rely upon performance indicators mandated by state policy.

The Effects on Students' Self-Efficacy Beliefs Regarding Their Comprehension of American Literature When Aesthetic Reading and Reader Response Strategy are Implemented

High-stakes testing and accountability have infiltrated the education system in the United States; the top priority for all teachers must be student progress on standardized tests. This has resulted in the predominance of reading for test-taking, (efferent reading), in the English, language arts, and reading classrooms. Authentic uses of print activities, like aesthetic reading, that encourage students to engage individually with a text, have been pushed aside. During a 3-week time period, regular level, English 3/American literature students in a Title I magnet high school, participated in this quasi-experimental study (N = 62). It measured the effects of an intervention of reading American literature texts aesthetically and writing aesthetically-evoked reader responses on students’ self-efficacy beliefs regarding their comprehension of American literature. One trained teacher and the researcher participated in the study: student participants were pre- and post- tested using the Confidence in Reading American Literature Survey which examined their self-efficacy beliefs regarding their comprehension of American literature. Several statistical analyses were performed. The results of the linear regression analyses partially supported a positive relationship between aesthetically-evoked reader responses and students’ self-efficacy beliefs regarding their comprehension of American literature. Additionally, the results of the 2 (sex) x 2 (treatment) ANCOVAs conducted to test group differences in self-efficacy beliefs regarding the comprehension of American literature between treatment and control groups indicated a main effect for treatment (but not sex; nor was there a significant sex x treatment interaction), suggesting the treatment was partially effective in increasing students’ self-efficacy beliefs. Seven of the twelve ANCOVAs indicated a statistically significant increase in the treatment group’s adjusted group mean self-efficacy belief scores as a result of being exposed to the intervention. In six of these seven analyses, increases in self-efficacy beliefs occurred in tasks that required three or more higher-order levels of thinking/learning. The results are discussed in terms of theoretical, empirical and practical significance. Future research is recommended to extend the intervention beyond the narrow confines of a Title I magnet school to settings where the intervention could be tested longitudinally, e. g., honors and gifted students, elementary and middle schools.

English language learners and standardized testing in an urban senior high school

The primary purpose of this study was to examine the influences of literacy variables on high-stakes test performance including: (a) student achievement on the Metropolitan Achievement Test, Seventh Edition (MAT-7) as correlated to the high-stakes test such as the FCAT examination and (b) the English language proficiency attained by English Language Learners (ELL) students when participating in, or exiting from English Speakers of Other Languages (ESOL) program as determined by the Limited English Proficient (LEP) committee. ^ Two one-sample Chi-square tests were conducted to investigate the relationship between passing the MAT-7 Reading and Language examinations and the FCAT-SSS Reading Comprehension and FCAT-NRT examinations. In addition, 2x2 Analyses of Variance (ANOVAs) were conducted to address the relationship between the time ELL students spent in the ESOL program and the level of achievement on MAT-7 Reading and Language examinations and the FCAT-SSS Reading Comprehension and FCAT-NRT. ^ Findings of this study indicated that more ELL students exit the program based on the LEP committee decisions than by passing the MAT-7. The majority of ELL students failed the 10th grade FCAT, the passing of which is needed for graduation. A significant number of ELL students failed, even when passing the MAT-7 or being duly exited through the decision of the LEP committee. The data also indicated that ELL students who exited the ESOL program in six semesters or fewer had higher FCAT scores than those who exited the program in seven semesters or more. The MAT-7 and the decision of the LEP committee were shown to be ineffective as predictors of success on the FCAT. ^ Further research to determine the length of time a student in the ESOL program uses English to read, write, and speak should be conducted. Additionally, the development of a new assessment instrument to better predict student success should be considered. However, it should be noted that the results of this study are limited to the context in which it was conducted and does not warrant generalizations beyond that context. ^

Factors associated with prompt difficulty in automated essay scoring

This study explores factors related to the prompt difficulty in Automated Essay Scoring. The sample was composed of 6,924 students. For each student, there were 1-4 essays, across 20 different writing prompts, for a total of 20,243 essays. E-rater® v.2 essay scoring engine developed by the Educational Testing Service was used to score the essays. The scoring engine employs a statistical model that incorporates 10 predictors associated with writing characteristics of which 8 were used. The Rasch partial credit analysis was applied to the scores to determine the difficulty levels of prompts. In addition, the scores were used as outcomes in the series of hierarchical linear models (HLM) in which students and prompts constituted the cross-classification levels. This methodology was used to explore the partitioning of the essay score variance.^ The results indicated significant differences in prompt difficulty levels due to genre. Descriptive prompts, as a group, were found to be more difficult than the persuasive prompts. In addition, the essay score variance was partitioned between students and prompts. The amount of the essay score variance that lies between prompts was found to be relatively small (4 to 7 percent). When the essay-level, student-level-and prompt-level predictors were included in the model, it was able to explain almost all variance that lies between prompts. Since in most high-stakes writing assessments only 1-2 prompts per students are used, the essay score variance that lies between prompts represents an undesirable or "noise" variation. Identifying factors associated with this "noise" variance may prove to be important for prompt writing and for constructing Automated Essay Scoring mechanisms for weighting prompt difficulty when assigning essay score.^

The will to write: Students' and teachers' perceptions of writing

This study investigated the perceptions of writing among secondary and post-secondary students and their teachers. The focus was on students' writing philosophy and influences, perceptions of the writing process, and perceptions of student writing skills, high stakes assessment tests, and writing across the curriculum. ^ An ethnographic case study was used to investigate the perceptions of writing among ten students and their English teachers in two high schools, a community college, and a university. To establish balance and ethnic plurality, seven females and three males representing the four large ethnic groups in South Florida—African American, Haitian American, European American and Latino—participated. During one four-month term, data from written samples of students' writing, formal and informal interviews, a student focus group, field notes, classroom observations, and a “think-aloud” protocol were collected. ^ Four themes emerged. First, Florida's writing assessment test has a negative influence on students' perceptions of writing. Students' motivation and attitudes as well as their confidence in their abilities were affected by practice and preparation in “recital writing.” Second, writing is a vehicle of social and personal transformation. Students believed that writing is a mean to connect to others and to create change in schools and communities. Third, students lacked the ability to connect writing, thinking and learning. Although students and teachers agree with statements about this connection, students failed to see the relevance of thinking and learning through writing in current or future courses, or in their future careers. Finally, writing context, teachers, schools, peers and gender influenced writing perceptions. Students believed that their writing philosophy, writing process, and perceptions of writing in academia and in the workplace are connected to these five factors. ^ The effect of the Florida writing test pervades students' and teachers' writing perceptions, making a stronger case for writing across the curriculum than previous research. Writing should help students see knowledge as interrelated, honor students' interests and values, and build relationships between and among students, schools and communities. In designing and implementing methods that support and sustain student writing, teachers should provide students with multiple opportunities to expand knowledge, learning, and connection through writing. ^

Making the grade: The perceived impact of Florida's A+ Plan on the learning environment of one elementary school

The purpose of this study was to ascertain the perceptions of educators at one elementary school regarding the changes in the teaching and learning environment and their related effects following the implementation of Florida's A+ high-stakes accountability system. This study also assessed whether these changes were identified by participants as meaningful and enduring, in terms of the definition by Lieberman and Miller (1999). Twenty-one educators, including 17 teachers and four administrators, at Blue Ribbon Elementary school were interviewed. Data were inductively coded and categorized into four major themes: (a) teaching and learning environment consistency, (b) changes in the teaching and learning environment since the implementation of A+, (c) effects of the changes, and (d) significant and enduring change. Findings fell into three categories (a) identified changes since A+ implementation, (b) effects of changes, and (c) what participants believed was significant and long term change, which included those characteristics of the school that had been identified as consistent in the teaching and learning environment. Statements of the participants explained their perceptions about what instructional decisions where made in response to the A+ Plan including the modification of curriculum, the addition or omission of subject matter taught, and the positive or negative impact these decisions had on the teaching and learning environment. It was found that study participants felt all changes and their effects were a direct result of the A+ Plan and viewed many of the changes as being neither significant nor long term Analysis of the educators' perceptions of the changes they experienced revealed the overall feeling that the changes were not indicative of what was necessary to make a school successful. For the participants, the changes lacked the characteristics that they had described as vital in what constituted success. This led to the conclusion that, by Lieberman and Miller's definition, the majority of changes and effects that were implemented at the school as a result of the mandated A+ Plan, were not meaningful and enduring for effective school reform. ^