An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

The impact of the Florida state -mandated Basic Skills Exit Tests at Miami -Dade Community College

The purpose of this study was to explore the impact of the Florida State-mandated Basic Skills Exit Tests (BSET) on the effectiveness of remedial instruction programs to adequately serve the academically underprepared student population. The primary research question concerned whether the introduction of the BSET has resulted in remedial completers who are better prepared for college-level coursework. ^ This study consisted of an ex post facto research design to examine the impact of the BSET on student readiness for subsequent college-level coursework at Miami-Dade Community College. Two way analysis of variance was used to compare the performance of remedial and college-ready students before and after the introduction of the BSET requirement. Chi-square analysis was used to explore changes in the proportion of students completing and passing remedial courses. Finally, correlation analysis was used to explore the utility of the BSET in predicting subsequent college-level course performance. Differences based on subject area and race/ethnicity were explored. ^ The introduction of the BSET did not improve the performance of remedial completers in subsequent college-level courses in any of the subject areas. The BSET did have a negative impact on the success rate of students in remedial reading and mathematics courses. There was a significant decrease in minority students' likelihood of passing remedial reading and mathematics courses after the BSET was introduced. The reliability of the BSET is unacceptably low for all subject areas, based on estimates derived from administrations at M-DCC. Nevertheless, there was a significant positive relationship between BSET score and grade point average in subsequent college-level courses. This relationship varied by subject area and ethnicity, with the BSET reading score having no relationship with subsequent course performance for Black non-Hispanic students. ^ The BSET had no discernable positive effect on remedial student performance in subsequent college-level courses. In other words, the BSET has not enhanced the effectiveness of the remedial programs to prepare students for later coursework at M-DCC. The BSET had a negative impact on the progress and success of students in remedial reading and mathematics. ^