Retention and special education referral practices before and after the implementation of high -stakes testing

The rewards and sanctions associated with high-stakes testing may induce educators to participate in practices that will ensure the elimination of the scores of low-achieving students from the testing pool. Two ways in which scores may be eliminated is through retention or referral to special education. ^ This study examined the use of these practices at 179 elementary schools in Miami-Dade County Public Schools, the 4th largest school district in the country. Between- and within-subjects designs were analyzed using repeated measures analysis of variance to compare retention and referral to special education practices over a five-year period of time, two years prior to and two years after the implementation of Florida's high-stakes test, the Florida Comprehensive Assessment Test, FCAT. ^ Significant main effects for referral and retention over time were demonstrated. The use of retention steadily increased over the first three years, with its usage maintained during the fourth year. While the use of referral actually decreased from the first to second years, a significant change occurred after the implementation of the FCAT. ^ Examination of the use of these practices according to student and school characteristics revealed significant differences. Increases in the use of referral across time was significant for Black, non-Hispanic and Hispanic students, all limited English proficiency population categories, medium and low socioeconomic status category schools, all grade levels, and for schools with accountability grades of A. C, D and F with the most striking absolute increase occurring for F schools. Increases in the use of retention across time were significant for all ethnic groups, limited English proficiency categories, and socioeconomic status categories, for grades kindergarten through four and by gender. Significant increases occurred for schools with accountability performance grades of C, D and F; however the most dramatic increase occurred for the F schools. A direct relationship between performance category grade of school and their use of retention was demonstrated. The results suggest that schools changed their use of referral and retention in response to the implementation of the FCAT. ^

The impact of the Florida state -mandated Basic Skills Exit Tests at Miami -Dade Community College

The purpose of this study was to explore the impact of the Florida State-mandated Basic Skills Exit Tests (BSET) on the effectiveness of remedial instruction programs to adequately serve the academically underprepared student population. The primary research question concerned whether the introduction of the BSET has resulted in remedial completers who are better prepared for college-level coursework. ^ This study consisted of an ex post facto research design to examine the impact of the BSET on student readiness for subsequent college-level coursework at Miami-Dade Community College. Two way analysis of variance was used to compare the performance of remedial and college-ready students before and after the introduction of the BSET requirement. Chi-square analysis was used to explore changes in the proportion of students completing and passing remedial courses. Finally, correlation analysis was used to explore the utility of the BSET in predicting subsequent college-level course performance. Differences based on subject area and race/ethnicity were explored. ^ The introduction of the BSET did not improve the performance of remedial completers in subsequent college-level courses in any of the subject areas. The BSET did have a negative impact on the success rate of students in remedial reading and mathematics courses. There was a significant decrease in minority students' likelihood of passing remedial reading and mathematics courses after the BSET was introduced. The reliability of the BSET is unacceptably low for all subject areas, based on estimates derived from administrations at M-DCC. Nevertheless, there was a significant positive relationship between BSET score and grade point average in subsequent college-level courses. This relationship varied by subject area and ethnicity, with the BSET reading score having no relationship with subsequent course performance for Black non-Hispanic students. ^ The BSET had no discernable positive effect on remedial student performance in subsequent college-level courses. In other words, the BSET has not enhanced the effectiveness of the remedial programs to prepare students for later coursework at M-DCC. The BSET had a negative impact on the progress and success of students in remedial reading and mathematics. ^

A comparison of a distance education and locally based course in an urban university setting

The purpose of this research was to compare the academic performance and attitudes of students at the instructor-based site of a televised course and the distant site. An earlier pilot program indicated the need for certain technical and structural interventions at the distant site such as multiple "press-to-touch" microphones, a site-administrator and participative seating arrangements. At the beginning of the class, demographic data were collected from the students at both sites through a questionnaire and supplemented with information from students' records. Factors such as age, gender, ethnicity, marital status, number of children, current class status, major, work status and CLAST scores (achievement tests) were examined. There were no significant differences between the students at the sites except ethnicity and reading CLAST scores. The instructor-based site had a higher percentage of Hispanic students and the distant site had a larger percentage of Caucasian and Black Americans. The distant site scored significantly better on the reading section of the CLAST achievement test. An evaluation instrument was distributed to both sites, at the midpoint of the semester, measuring their attitude toward the organizational, technical, and pedagogical factors of the course. A second evaluation instrument, measuring similar factors, but more in-depth, was distributed to both sites near the end of the term. Nine students at the distant site were interviewed along with the site administrator to collect additional information.^ Course completion rates, dropout rates, pass rates and final grades of students at both sites were compared. There were no significant differences in academic performance between the students at both sites, however, there were significant differences in their attitudes. Those at the instructor-based site gave better ratings to most of items in the evaluation instruments. Problems at the distant site included audio and visual clarity, lack of available assistance, too much nonrelated talking, not enough opportunities to ask questions or to interact with the instructor during class. ^

An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

The effect of the advanced placement examination for credit policy by the Florida State universities on the acceleration of a student's postsecondary education

The purpose of this research study was to determine if the Advanced Placement program as it is recognized by the universities in the Florida State University System (SUS) truly serves as an acceleration mechanism for those students who enter an SUS institution with passing AP scores. Despite mandates which attempt to control uniformity of policy, each public university in Florida determines which courses will be exempted and the number of credits they will grant for passing Advanced Placement courses.^ This is a descriptive study in which the AP policies of each of the SUS institutions were compared. Additionally, the college attendance and graduation data on members of a cohort of 593 Broward County high school graduates of the class of June, 1992 were compared. Approximately 28% of the cohort members entered university with passing Advanced Placement scores.^ The rate of early and on time graduation was significantly dependent on the Advanced Placement standing of the students in the cohort. Given the financial and human cost involved, it is recommended that all state universities bring their Advanced Placement policies into line with each other and implement a uniform Advanced Placement policy. It is also recommended that a follow-up study be conducted with a new cohort bound under the current 120 credit limitation for graduation. ^

A distance education case study: A comparison of instructional delivery methods practiced by higher education faculty and emerging standards

The purpose of this research was to compare the delivery methods as practiced by higher education faculty teaching distance courses with recommended or emerging standard instructional delivery methods for distance education. Previous research shows that traditional-type instructional strategies have been used in distance education and that there has been no training to distance teach. Secondary data, however, appear to suggest emerging practices which could be pooled toward the development of standards. This is a qualitative study based on the constant comparative analysis approach of grounded theory.^ Participants (N = 5) of this study were full-time faculty teaching distance education courses. The observation method used was unobtrusive content analysis of videotaped instruction. Triangulation of data was accomplished through one-on-one in-depth interviews and from literature review. Due to the addition of non-media content being analyzed, a special time-sampling technique was designed by the researcher--influenced by content analyst theories of media-related data--to sample portions of the videotape instruction that were observed and counted. A standardized interview guide was used to collect data from in-depth interviews. Coding was done based on categories drawn from review of literature, and from Cranton and Weston's (1989) typology of instructional strategies. The data were observed, counted, tabulated, analyzed, and interpreted solely by the researcher. It should be noted however, that systematic and rigorous data collection and analysis led to credible data.^ The findings of this study supported the proposition that there are no standard instructional practices for distance teaching. Further, the findings revealed that of the emerging practices suggested by proponents and by faculty who teach distance education courses, few were practiced even minimally. A noted example was the use of lecture and questioning. Questioning, as a teaching tool was used a great deal, with students at the originating site but not with distance students. Lectures were given, but were mostly conducted in traditional fashion--long in duration and with no interactive component.^ It can be concluded from the findings that while there are no standard practices for instructional delivery for distance education, there appears to be sufficient information from secondary and empirical data to initiate some standard instructional practices. Therefore, grounded in this research data is the theory that the way to arrive at some instructional delivery standards for televised distance education is a pooling of the tacitly agreed-upon emerging practices by proponents and practicing instructors. Implicit in this theory is a need for experimental research so that these emerging practices can be tested, tried, and proven, ultimately resulting in formal standards for instructional delivery in television education. ^

Development and validation of an instrument to predict online student success using faculty perceptions

Distance learning is growing and transforming educational institutions. The increasing use of distance learning by higher education institutions and particularly community colleges coupled with the higher level of student attrition in online courses than in traditional classrooms suggests that increased attention should be paid to factors that affect online student course completion. The purpose of the study was to develop and validate an instrument to predict community college online student course completion based on faculty perceptions, yielding a prediction model of online course completion rates. Social Presence and Media Richness theories were used to develop a theoretically-driven measure of online course completion. This research study involved surveying 311 community college faculty who taught at least one online course in the past 2 years. Email addresses of participating faculty were provided by two south Florida community colleges. Each participant was contacted through email, and a link to an Internet survey was given. The survey response rate was 63% (192 out of 303 available questionnaires). Data were analyzed through factor analysis, alpha reliability, and multiple regression. The exploratory factor analysis using principal component analysis with varimax rotation yielded a four-factor solution that accounted for 48.8% of the variance. Consistent with Social Presence theory, the factors with their percent of variance in parentheses were: immediacy (21.2%), technological immediacy (11.0%), online communication and interactivity (10.3%), and intimacy (6.3%). Internal consistency of the four factors was calculated using Cronbach's alpha (1951) with reliability coefficients ranging between .680 and .828. Multiple regression analysis yielded a model that significantly predicted 11% of the variance of the dependent variable, the percentage of student who completed the online course. As indicated in the literature (Johnson & Keil, 2002; Newberry, 2002), Media Richness theory appears to be closely related to Social Presence theory. However, elements from this theory did not emerge in the factor analysis.

GRE as a predictor of graduate student success at a Hispanic serving institution of higher education

Accurately predicting the success of graduate students is an important aspect of determining which students should be admitted into graduate programs. The GRE is a pivotal factor to examine since it is one of the most widely used criteria for graduate school admission. Even though the GRE is advertised as an accurate tool for predicting first year graduate GPA, there is a lack of research on long term success factors such as time to degree and graduate rate (Luthy, 1996; Powers, 2004). Furthermore, since most studies have low minority sample sizes, the validity of the GRE may not be the same across all groups (ETS, 2008b; Kuncel, Hezlett, & Ones, 2001). Another gap in GRE studies is that few researchers analyze student characteristics, which may alter or moderate the prediction validity of the GRE. Thus, student characteristics such as degree of academic involvement, mentorship interactions, and other academic and social experiences have not been widely examined in this context. These gaps in the analysis of GRE validity are especially relevant given the high attrition rates within of some graduate programs (e.g., an estimated 68% of doctoral student never complete their programs in urban universities; Lovitts, 2001). A sequential mixed methods design was used to answer the research questions in two phases. The quantitative phase used student data files to analyze the relationship of two success variables (graduation rate and graduate GPA) to the GRE scores as well as other academic and demographic graduate student characteristics. The qualitative phase served to complement the first phase by describing a wider range of characteristics from the 11 graduate students who were interviewed. Both proximal and distal moderators influence student behaviors and success in graduate school. In the first phase of the study, the GRE was the distal facilitator under analysis. Findings suggested that both the GRE Quantitative and the GRE Verbal were predictors of success for master’s students, but the GRE Quantitative was not predictive of success for doctoral students. Other student characteristics such as demographic variables and disciplinary area were also predictors of success for the population of students studied. In the second phase of the study, it was inconclusive whether the GRE was predictive of graduate student success; though it did influence access to graduate programs. Furthermore, proximal moderators such as student involvement, faculty/peer interactions, motivational factors, and program structure were perceived to be facilitators and/or detractors for success.

Characteristics of the Commission on Accreditation of Allied Health Education Programs or National Athletic Trainers' Association -accredited athletic training programs associated with first -attempt passing rates on the NATABOC examination

Athletic training is an allied health profession recognized by the American Medical Association requiring certification by examination. There are two routes towards certification as an athletic trainer: attending a university with an accredited athletic training program or with an internship program By 2004, the only route towards certification will be by attending a Commission on Accreditation of Allied Health Education Programs (CAAHEP) or National Athletic Trainers' Association (NATA) accredited athletic training program. CAAHEP looks at passing rates on the NATA Board of Certification (NATABOC) examination when granting accreditation. This study examined characteristics of programs associated with first time passing rates. ^ Directors from 39 CAAHEP or NATA accredited athletic training programs completed a descriptive 17-question survey regarding academic characteristics, faculty characteristics, and program characteristics. Analysis used Spearman's rho correlation coefficient, with significance of p = <.05. Four program directors were interviewed to gather additional insight. ^ There were three program characteristics that showed a significant positive association with first attempt passing rates: the number of full-time and part-time approved clinical instructors (ACIs), and the number of students in the program. Further investigation found a statistically significant association between a low ratio of ACIs to athletic training students and first time passing rates. ACIs are certified athletic trainers (ATCs) who have received special training in order to supervise athletic training students. CAAHEP mandates a 1:8 ratio of ATCs to athletic training student. This study showed that a smaller ratio of ATC to student in combination with ACI training was significantly associated with higher first time passing rates. The number of courses above the required 13 delineated by the Education Council showed a significant negative association with first attempt passing rates. ^ Universities seeking or maintaining accreditation should incorporate characteristics associated with a higher passing rate on the NATABOC examination. Characteristics include utilizing a large number of full-time and part-time ACIs, admitting a large number of students into the program while maintaining a low ACI to athletic training student ratio, and offering curricula that focuses on the 13 courses that have been deemed relevant to the athletic training curriculum by the Education Council. ^

Self-esteem and job satisfaction of adults with mild mental retardation in sheltered workshops and supported employment programs

A sample of 200 adults with mild mental retardation were assessed on overall job satisfaction and self-esteem using the Vocational Program Evaluation Profile and the Coopersmith Self-esteem Inventory. The subjects worked either in a sheltered workshop or in a supported employment setting. Results indicated that there was a significant relationship between self-esteem and job satisfaction for both groups of subjects. In addition, subjects who worked in supported employment reported significantly higher levels of job satisfaction also. There was also an interaction between place of residence and place of employment when looking at self-esteem; those who live in a semi-independent home and work in supported employment reported the highest levels of self-esteem. These results are discussed in terms of the social validity of supported-employment for persons with mild mental retardation. ^

The impact of the New University Code on the physical education curriculum of four-year colleges and universities in Taiwan, Republic of China

With the establishment of The New University Code in 1994, Taiwan's colleges and universities were mandated to shift physical education from a required course to an elective. The four-year colleges and universities are now responsible for either developing new physical education programs or removing existing programs from their curriculum. Planned change and curriculum leadership are considered in light of policy changes regarding required physical education programs enacted by the Ministry of Education. ^ This study compared the organizational structure and the curriculum of physical education at accredited colleges and universities in Taiwan. Chairpersons of physical education departments from 60 four-year colleges and universities were surveyed using a modified version of the Hensley's Basic Instruction Program (BIP) Questionnaire. Results were analyzed using analysis of variance (ANOVA) and crosstabs. The findings confirmed that physical education programs were effected by declining enrollment and administrative decisions to eliminate them. However, at the same time, chairpersons expressed strong support for the maintenance of the traditional physical education curriculum. ^

Adolescent readers' self-perceptions of affective factors related to performance on standardized tests

The purpose of this study was to investigate which affective factors of adolescent high school readers were related to high-level readers, middle-level readers and low-level readers. The research problem was to determine the relationship between adolescent high school students' self-perceived reading self-efficacy factors and the students' reading performance on a standardized reading assessment considering demographic factors of age, gender and socio-economic status as covariates. The research design was ex post facto making inferences without direct intervention. The sample was obtained from one large, diverse, urban high school, consisting of 9th and 10th grade adolescent students (N = 176). Students voluntarily completed a self-report, reading self-efficacy survey. School records were used to obtain standardized reading level scores, age, gender, and socio-economic status data. An exploratory factor analysis of the self-efficacy survey responses resulted in the identification of 7 underlying factors. The striving (low-level) readers had significantly lower self-perceptions on 5 of the 7 affective factors than the middle-level readers, and strong (high-level) readers, p < .05. The 5 affective factors on which the striving readers had significantly lower self-perceptions were: (a) Observational Comparison, (b) Progress, (c) Lack of Progress, (d) Lack of Anxiety, and (e) Positive Social Feedback. The 2 affective factors which were not significantly different for reader level were Anxiety and Negative Social Feedback. Girls had significantly less anxiety than boys for both of the factors in the Anxiety category. Statistical results showed that none of the demographic covariates tested; age, gender, or socio-economic status, moderated the relationship between affective reader self-efficacy factors and reader level. This study concluded that there were distinguishable differences for striving, middle, and strong readers' self-efficacy factors. Determining affective factors related to reading can be used to create better instructional environments and instruction for adolescent students.

Stereotype threat and the standardized testing experiences of African American children at an urban elementary school

Stereotype threat (Steele & Aronson, 1995) refers to the risk of confirming a negative stereotype about one’s group in a particular performance domain. The theory assumes that performance in the stereotyped domain is most negatively affected when individuals are more highly identified with the domain in question. As federal law has increased the importance of standardized testing at the elementary level, it can be reasonably hypothesized that the standardized test performance of African American children will be depressed when they are aware of negative societal stereotypes about the academic competence of African Americans. This sequential mixed-methods study investigated whether the standardized testing experiences of African American children in an urban elementary school are related to their level of stereotype awareness. The quantitative phase utilized data from 198 African American children at an urban elementary school. Both ex-post facto and experimental designs were employed. Experimental conditions were diagnostic and non-diagnostic testing experiences. The qualitative phase utilized data from a series of six focus group interviews conducted with a purposefully selected group of 4 African American children. The interview data were supplemented with data from 30 hours of classroom observations. Quantitative findings indicated that the stereotype threat condition evoked by diagnostic testing depresses the reading test performance of stereotype-aware African American children (F[1, 194] = 2.21, p < .01). This was particularly true of students who are most highly domain-identified with reading (F[1, 91] = 19.18, p < .01). Moreover, findings indicated that only stereotype-aware African American children who were highly domain-identified were more likely to experience anxiety in the diagnostic condition (F[1, 91] = 5.97, p < .025). Qualitative findings revealed 4 themes regarding how African American children perceive and experience the factors related to stereotype threat: (1) a narrow perception of education as strictly test preparation, (2) feelings of stress and anxiety related to the state test, (3) concern with what “others” think (racial salience), and (4) stereotypes. A new conceptual model for stereotype threat is presented, and future directions including implications for practice and policy are discussed.

The effects of the use of technology in mathematics instruction on student achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

The impact of eliminating extraneous sound and light on students' achievement: An empirical study

The impact of eliminating extraneous sound and light on students’ achievement was investigated under four conditions: Light and Sound controlled, Sound Only controlled, Light Only controlled and neither Light nor Sound controlled. Group, age and gender were the control variables. Four randomly selected groups of high school freshmen students with different backgrounds were the participants in this study. Academic achievement was the dependent variable measured on a pretest, a posttest and a post-posttest, each separated by an interval of 15 days. ANOVA was used to test the various hypotheses related to the impact of eliminating sound and light on student learning. Independent sample T tests on the effect of gender indicated a significant effect while age was non- significant. Follow up analysis indicated that sound and light are not potential sources of extraneous load when tested individually. However, the combined effect of sound and light seems to be a potential source of extrinsic load. The findings revealed that the performance of the Sound and Light controlled group was greater during the posttest and post-posttest. The overall performance of boys was greater than that of girls. Results indicated a significant interaction effect between group and gender on treatment subjects. However gender alone was non-significant. Performance of group by age had no significant interaction and age alone was non-significant in the posttest and post-posttest. Based on the results obtained sound and light combined seemed to be the potential sources of extraneous load in this type of learning environment. This finding supports previous research on the effect of sound and light on learning. The findings of this study show that extraneous sound and light have an impact on learning. These findings can be used to design better learning environments. Such environments can be achieved with different electric lighting and sound systems that provide optimal color rendering, low glare, low flicker, low noise and reverberation. These environments will help people avoid unwanted distraction, drowsiness, and photosensitive behavior.