An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

A comparison of the academic performance of students with General Educational Development credentials and high school diplomas at a selected community college

This study compared the performance of students who earned GED credentials in Florida with that of graduates of Florida high schools, when members of both groups enrolled for the first time in fall 1992 at an urban multicultural community college in south Florida. GED's and HSD's were matched on gender, race, age range, placement levels, and enrollment in college preparatory courses (reading, English, mathematics). The paired samples t-test compared course grades, first semester GPA, and total college GPA for the groups and subgroups of matched students at a probability level of .05. The McNemar test compared how many students in each group and subgroup re-enrolled for a second and third term, or ever; how many were placed on special academic status during their college enrollment; and how many graduated within 16 semesters. Differences between groups were found only for placement on probation—with HSD's on probation in significantly higher proportion than GED's. ^ Additional findings among subgroups revealed that male and Caucasian HSD subjects earned higher math grades than their GED counterparts. Male HSD's were more likely than male GED's to return to the college at some point after the first term. However, male HSD's were placed on probation in greater proportion than the GED's with whom they were matched. ^ Female GED's earned higher English grades and higher first semester and cumulative GPA's and returned to the college in greater proportion than their HSD counterparts. Black GED's earned higher first-semester GPA's, re-enrolled in terms 2 and 3 and graduated from the college in higher percentages than Black HSD's. Black HSD's were placed on probation in higher proportion than Black GED's. Lastly, greater percentages of HSD than GED subjects in the lowest age range (16–19) were placed on probation. ^ Results connected to the performance of Black GED subjects are likely to have been affected by the fact that 50% of Black study subjects had been born in Jamaica. The place of the GED in the constellation of methods for earning credit by examination is explored, future implications are discussed, and further study is recommended. ^

The effect of instruction on the study behaviors and academic achievement of community college students

The purpose of this study was twofold. It was designed to determine (a) the efficacy of an intervention designed to increase the frequencies of appropriate study behaviors on the part of community college students who were preparing for academic mathematics activities and (b) whether any increase in appropriate study behavior frequency was accompanied by increased academic achievement in college preparatory mathematics classes. A total of 126 Miami Dade College students participated in this study. Two developmental (remedial) mathematics classes were randomly assigned as the experimental group, and two others were assigned as the control group. All students also took a College Survival (SLS) class. The Study Behavior Inventory (SBI) and the Computerized Placement Test (CPT) were administered to the four classes. The SBI was used as a pre- and post-test. The SLS curriculum and classroom time were the same for both groups. However, students in the treatment groups received instruction designed to increase the frequency of effective study behaviors associated with the three factors identified in the SBI, while the students in the control group participated in activities that did not emphasize study behaviors. A series of analysis of covariance procedures were used to analyze four hypotheses. The first three hypotheses proposed that students who were instructed in the use of appropriate study behaviors would score higher on the three factors of the Study Behavior Inventory than those who were not. The fourth hypothesis proposed that a greater proportion of mathematics students who were instructed in the use of appropriate study behaviors would receive a passing grade in their course than students who were in the control group. The four hypotheses were tested at the .05 level of significance. This study revealed that students who received instruction in appropriate study behaviors scored higher in the use of appropriate study behaviors and in mathematics achievement than students who did not. Additional research is needed to investigate whether these effects would persist over time, or be found in subjects other than mathematics.

Engagement experiences of Hispanic Generation 1.5 English language learners at a Massachusetts community college

Hispanic Generation 1.5 students are foreign-born, U.S. high school graduates who are socialized in the English dominant K-12 school system while still maintaining the native language and culture at home (Allison, 2006; Blumenthal, 2002; Harklau, Siegal, & Losey, 1999; Rumbault & Ima, 1988). When transitioning from high school to college, these students sometimes assess into ESL courses based on their English language abilities, and because of this ESL placement, Hispanic Generation 1.5 students might have different engagement experiences than their mainstream peers. Engagement is a critical factor in student success and long-term retention because students’ positive and negative engagement experiences affect their membership and sense of belonging at the institution. The purpose of this study was to describe the engagement and membership experiences of Hispanic Generation 1.5 students’ at a Massachusetts community college. This study employed naturalistic inquiry within an embedded descriptive case study design that included three units of analysis: the students’ engagement experiences in (a) ESL courses, (b) developmental courses, and (c) mainstream courses. The main source of data was in-depth interviews with Hispanic Generation 1.5 students at Commonwealth of Massachusetts Community College. Criterion sampling was used to select the interview participants, ensuring that all participants were native Spanish speakers and were taking or had taken at least one ESL course at the institution. The study findings show that these Hispanic Generation 1.5 students at the college did not perceive peer engagement as critical to academic success. Most times the participants avoided peer engagement outside of the classroom, especially with fellow Hispanic students, who they felt would deter them from their English language development and general academic work. Engagement with ESL faculty and ESL academic support staff played the most critical role in the participants’ sense of belonging and success, and students who were required to engage with faculty and academic support staff outside of the classroom were the most satisfied with their educational experiences. While the participants were all disappointed with some aspect of their ESL placement, they valued the ESL engagement experiences more than the engagement experiences while completing developmental and credit coursework.

A comparison of the self -esteem of freshman community college students enrolled in remedial and regular academic programs

This study examined relationships among self-esteem, remedial academic placement, ethnicity, gender, and enrollment status, using a nonexperimental, ex post facto research design. Participants were 113 freshman community college students attending Broward Community College in South Florida. The Coopersmith Self-Esteem Inventory (Adult Form) was used to measure the self-esteem of the participants. The results of this study indicate a significant difference between the mean self-esteem levels of the students enrolled in remedial academic classes (m = 66.08) and those enrolled in regular academic classes (m = 73.97). An independent samples t-test at the.05 significance level indicated that regular students were found to have higher levels of self-esteem than remedial students (t(112) = 2.14, p =.03). Two-way analyses of variance of placement status by ethnicity, of placement status by gender, and of placement status by enrollment status on self-esteem were also conducted. Interactions between placement status and the other factors were not found to be significant (p $>$.05). However, a significant main effect for ethnicity was found (p $<$.05). The results indicated that white students had a mean self-esteem level (m = 75.30) significantly higher than non-white students (m = 62.76, p =.002).^ The results of this study suggests that many community college students have problems related to self-esteem. Further research should be conducted on remedial and minority college students using a larger sample size and additional variables, such as socio-economic status. ^

Initial placement methods for Haitian adult ESOL students : the NYS place test plus profile data compared to subjective assessment

Few valid and reliable placement procedures are available to assess the English language proficiency of adults who enroll in English for Speakers of Other Languages (ESOL) programs. Whereas placement material exists for children and university ESOL students, the needs of students in adult community education programs have not been adequately addressed. Furthermore, the research suggests that a number of variables, such as, native language, age, prior schooling, length of residence, and employment are related to second language acquisition. Numerous studies contribute to our understanding of the relationship of these factors to second language acquisition of Spanish-speaking students. Again, there is a void in the research investigating the factors affecting second language acquisition and consequently, appropriate placement of Haitian Creole-speaking students. This study compared a standardized instrument, the NYS Place Test, used alone and in combination with a writing sample in English, to subjective judgement of a department coordinator for initial placement of Haitian adult ESOL students in a community education program. The study also investigated whether or not consideration of student profile data improved the accuracy of the test. Finally, the study sought to determine if a relationship existed between student profile data and those who withdrew from the program or did not enter a class after registering. Analysis of the data by crosstabulation and chi-square revealed that the standardized NYS Place Test was at least as accurate as subjective department coordinator placement and that one procedure could be substituted for li other. Although the writing sample in English improved accuracy of placement by the NYS test, the results were not significant. Of the profile variables, only length of residence was found to be significantly related to accuracy of placement using the NYS Place Test. The number of incorrect placements was higher for those students who lived in the host country from twenty-five to one hundred ten months. A post hoc analysis of NYS test scores according to level showed that those learners who placed in level three also had a significantly higher incidence of incorrect placements. No significant relationship was observed between the profile variables and those who withdrew from the program or registered but did not enter a class.