An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

Effectiveness of skills- versus metacognitive strategy-based approaches on reading comprehension of college developmental students

This study explored the relative value of behavioral and cognitive psychology as the basis of instruction for underprepared college students enrolled in developmental reading courses. Specifically this study examined the effects of a metacognitive strategy-based instructional approach (MSIA) modeling a metacognitive self-questioning technique (MSQT) versus a traditional skills-based instructional approach (SIA) on the Nelson-Denny reading comprehension scores of college developmental readers and whether there were significant differences in achievement based on instructional method used and on the sex of students. The sample consisted of 100 college developmental reading students who were enrolled in six intact sections of a reading course (REA0002). Participants completed a pretest of the comprehension subtest of the Nelson-Denny Reading Test (Form G). Three of these classes (n = 49) were taught using metacognitive-strategy instruction and three classes (n = 51) were instructed using skills-based instruction. They then received a semester of instruction intended to improve their reading comprehension. At the end of the semester, participants completed a post-test of the Nelson-Denny Reading Comprehension Test (Form H). A two (Between) x one (Within) Repeated Measures Analysis of Variance (ANOVA) was utilized to test each of the hypotheses of this study. Results showed that there were no significant differences in reading comprehension between the groups receiving the different instructional treatments and no differences in reading comprehension between the men and women participants. Based on the findings, implications for research and recommendations for future research were discussed.