An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

An Examination of the Validity of English Language Achievement Test Scores in a LEP Student Population

Approximately 1,700 limited English proficient (LEP) and recently exited LEP students in grades 4 and 10 were tested using both an English and a comparable Spanish language achievement test. Many LEP and former LEP students performed better in math taking the test in Spanish compared to taking it in English.

English Language Learners: A Correlational Study of the Relationship Between A Proficiency Level Assessment and End of Course Test Scores at one Georgia High School

Understanding the language of one’s cultural environment is important for effective communication and function. As such, students entering U.S. schools from foreign countries are given access to English to Speakers of Other Languages (ESOL) programs and they are referred to as English Language Learner (ELL) students. This dissertation examined the correlation of ELL ACCESS Composite Performance Level (CPL) score to the End of Course tests (EOCTs) and the Georgia High School Graduation Tests (GHSGTs) in the four content courses (language arts, mathematics, science, and social studies). A premise of this study was that English language proficiency is critical in meeting or exceeding state and county assessment standards. A quantitative descriptive research design was conducted using Cross-sectional archival data from a secondary source. There were 148 participants from school years 2011-2012 to 2013- 2014 from Grades 9-12. A Pearson product moment correlation was run to assess the relationship between the ACCESS CPL (independent variable) and the EOCT scores and the GHSGT scores (dependent variables). The findings showed that there was a positive correlation between ACCESS CPL scores and the EOCT scores where language arts showed a strong positive correlation and mathematics showed a positive weak correlation. Also, there was a positive correlation between ACCESS CPL scores and GHSGT scores where language arts showed a weak positive correlation. The results of this study indicated that that there is a relationship between the stated variables, ACCESS CPL, EOCT and GHSGT. Also, the results of this study showed that there were positive correlations at varying degrees for each grade levels. While the null hypothesis for Research Question 1 and Research Question 2 were rejected, there was a slight relationship between the variables.

An investigation of mathematics and science instruction in English and Spanish for English language learners

The contextual demands of language in content area are difficult for ELLS. Content in the native language furthers students' academic development and native language skills, while they are learning English. Content in English integrates pedagogical strategies for English acquisition with subject area instruction. The following models of curriculum content are provided in most Miami Dade County Public Schools: (a) mathematics instruction in the native language with science instruction in English or (b) science instruction in the native language with mathematics instruction in English. The purpose of this study was to investigate which model of instruction is more contextually supportive for mathematics and science achievement. ^ A pretest and posttest, nonequivalent group design was used with 94 fifth grade ELLs who received instruction in curriculum model (a) or (b). This allowed for statistical analysis that detected a difference in the means of .5 standard deviations with a power of .80 at the .05 level of significance. Pretreatment and post-treatment assessments of mathematics, reading, and science achievement were obtained through the administration of Aprenda-Segunda Edición and the Florida Comprehensive Achievement Test. ^ The results indicated that students receiving mathematics in English and Science in Spanish scored higher on achievement tests in both Mathematics and Science than the students who received Mathematics in Spanish and Science in English. In addition, the mean score of students on the FCAT mathematics examination was higher than their mean score on the FCAT science examination regardless of the language of instruction. ^

English language learners and standardized testing in an urban senior high school

The primary purpose of this study was to examine the influences of literacy variables on high-stakes test performance including: (a) student achievement on the Metropolitan Achievement Test, Seventh Edition (MAT-7) as correlated to the high-stakes test such as the FCAT examination and (b) the English language proficiency attained by English Language Learners (ELL) students when participating in, or exiting from English Speakers of Other Languages (ESOL) program as determined by the Limited English Proficient (LEP) committee. ^ Two one-sample Chi-square tests were conducted to investigate the relationship between passing the MAT-7 Reading and Language examinations and the FCAT-SSS Reading Comprehension and FCAT-NRT examinations. In addition, 2x2 Analyses of Variance (ANOVAs) were conducted to address the relationship between the time ELL students spent in the ESOL program and the level of achievement on MAT-7 Reading and Language examinations and the FCAT-SSS Reading Comprehension and FCAT-NRT. ^ Findings of this study indicated that more ELL students exit the program based on the LEP committee decisions than by passing the MAT-7. The majority of ELL students failed the 10th grade FCAT, the passing of which is needed for graduation. A significant number of ELL students failed, even when passing the MAT-7 or being duly exited through the decision of the LEP committee. The data also indicated that ELL students who exited the ESOL program in six semesters or fewer had higher FCAT scores than those who exited the program in seven semesters or more. The MAT-7 and the decision of the LEP committee were shown to be ineffective as predictors of success on the FCAT. ^ Further research to determine the length of time a student in the ESOL program uses English to read, write, and speak should be conducted. Additionally, the development of a new assessment instrument to better predict student success should be considered. However, it should be noted that the results of this study are limited to the context in which it was conducted and does not warrant generalizations beyond that context. ^

Examining argumentative coherence in essays by undergraduate students of English as a foreign language in Mainland China and their English speaking peers in the United States

I conducted this study to provide insights toward deepening understanding of association between culture and writing by building, assessing, and refining a conceptual model of second language writing. To do this, I examined culture and coherence as well as the relationship between them through a mixed methods research design. Coherence has been an important and complex concept in ESL/EFL writing. I intended to study the concept of coherence in the research context of contrastive rhetoric, comparing the coherence quality in argumentative essays written by undergraduates in Mainland China and their U.S. peers. In order to analyze the complex concept of coherence, I synthesized five linguistic theories of coherence: Halliday and Hasan's cohesion theory, Carroll's theory of coherence, Enkvist's theory of coherence, Topical Structure Analysis, and Toulmin's Model. Based upon the synthesis, 16 variables were generated. Across these 16 variables, Hotelling t-test statistical analysis was conducted to predict differences in argumentative coherence between essays written by two groups of participants. In order to complement the statistical analysis, I conducted 30 interviews of the writers in the studies. Participants' responses were analyzed with open and axial coding. By analyzing the empirical data, I refined the conceptual model by adding more categories and establishing associations among them. The study found that U.S. students made use of more pronominal reference. Chinese students adopted more lexical devices of reiteration and extended paralleling progression. The interview data implied that the difference may be associated with the difference in linguistic features and rhetorical conventions in Chinese and English. As far as Toulmin's Model is concerned, Chinese students scored higher on data than their U.S. peers. According to the interview data, this may be due to the fact that Toulmin's Model, modified as three elements of arguments, have been widely and long taught in Chinese writing instruction while U.S. interview participants said that they were not taught to write essays according to Toulmin's Model. Implications were generated from the process of textual data analysis and the formulation of structural model defining coherence. These implications were aimed at informing writing instruction, assessment, peer-review, and self-revision.

The effect of dual -language instruction on academic achievement as measured by the SAT: An evaluation of the "International Studies Program" of Miami -Dade County Public Schools

This study investigated the influence that receiving instruction in two languages, English and Spanish, had on the performance of students enrolled in the International Studies Program (delayed partial immersion model) of Miami Dade County Public Schools on a standardized test in English, the Stanford Achievement Test, eighth edition, for three of its sections, Reading Comprehension, Mathematics Computations, and Mathematics Applications.^ The performance of the selected IS program/Spanish section cohort of students (N = 55) on the SAT Reading Comprehension, Mathematics Computation, and Mathematics Application along four consecutive years was contrasted with that of a control group of comparable students selected within the same feeder pattern where the IS program is implemented (N = 21). The performance of the group was also compared to the cross-sectional achievement patterns of the school's corresponding feeder pattern, region, and district.^ The research model for the study was a variation of the "causal-comparative" or "ex post facto design" sometimes referred to as "prospective". After data were collected from MDCPS, t-tests were performed to compare IS-Spanish students SAT performance for grades 3 to 6 for years 1994 to 1997 to control group, feeder pattern, region and district norms for each year for Reading Comprehension, Mathematics Computation, and Mathematics Applications. Repeated measures ANOVA and Tukey's tests were calculated to compare the mean percentiles of the groups under study and the possible interactions of the different variables. All tests were performed at the 5% significance level.^ From the analyses of the tests it was deduced that the IS group performed significantly better than the control group for all the three measures along the four years. The IS group mean percentiles on the three measures were also significantly higher than those of the feeder pattern, region, and district. The null hypotheses were rejected and it was concluded that receiving instruction in two languages did not negatively affect the performance of IS program students on tests taken in English. It was also concluded that the particular design the IS program enhances the general performance of participant students on Standardized tests.^ The quantitative analyses were coupled with interviews from teachers and administrators of the IS program to gain additional insight about different aspects of the implementation of the program at each particular school. ^

Factors affecting the alignment of *grades and reading scores for third-grade students on the Florida Comprehensive Assessment Test

The purpose of this study was to aid in understanding the relationship between current Reading report card grading practices and standards-based state standardized testing results in Reading and factors associated with the alignment of this relationship. Report card and Florida Comprehensive Assessment Test (FLAT) data for 2004 were collected for 1064 third grade students in nine schools of one feeder pattern in Florida's Miami-Dade County Public Schools. A Third Grade Teacher Questionnaire was administered to 48 Reading teachers. The questionnaire contained items relating to teachers' education, teaching experience, grading practices, and beliefs about the FCAT, instructional Reading activities, methods, and materials. ^ Findings of this study support a strong relationship between report card grades and FCAT Reading achievement levels. However, individual school correlational analysis showed significant differences among schools' alignment measures. Higher teacher alignment between grades and FCAT levels was associated with teachers spending more time on individualized methods of Reading instruction and to teachers feeling there was not enough time to teach and help individual students. Lower teacher alignment of grades and achievement levels was associated with teachers taking homework into account in the final Reading grade. Teacher alignment of grades and achievement levels was not associated with teacher beliefs concerning the FCAT, instructional activities in Reading and Language Arts, the Reading program used, the model of delivery of the Reading program, instruction or type of instructional planning done by the teachers. ^ This study highlights the need for further investigations related to determining additional teacher factors that may affect the alignment relationship between report card grades and standards-based state standardized testing results. ^

Effects of real -time captioning and sign language interpreting on the learning of college students who are deaf or hard of hearing

College personnel are required to provide accommodations for students who are deaf and hard of hearing (D/HoH), but few empirical studies have been conducted on D/HoH students as they learn under the various accommodation conditions (sign language interpreting, SLI, real-time captioning, RTC, and both). Guided by the experiences of students who are D/HoH at Miami-Dade College (MDC) who requested RTC in addition to SLI as accommodations, the researcher adopted Merten’s transformative-emancipatory theoretical framework that values perceptions and voice of students who are D/HoH. A mixed methods design addressed two research questions: Did student learning differ for each accommodation? What did students experience while learning through accommodations? Participants included 30 students who were D/HoH (60% women). They represented MDC’s majority minority population: 10% White (non-Hispanic), 20% Black (non-Hispanic, including Haitian/Caribbean), 67% Hispanic, and 3% other. Hearing loss, ranged from severe-profound (70%) to mild-moderate (30%). All were able to communicate with American Sign Language: Learning was measured while students who were D/HoH viewed three lectures under three accommodation conditions (SLI, RTC, SLI+RTC). The learning measure was defined as the difference in pre- and post-test scores on tests of the content presented in the lectures. Using repeated measure ANOVA and ANCOVA, confounding variables of fluency in American Sign Language and literacy skills were treated as covariates. Perceptions were obtained through interviews and verbal protocol analysis that were signed, videotaped, transcribed, coded, and examined for common themes and metacognitive strategies. No statistically significant differences were found among the three accommodations on the learning measure. Students who were D/HoH expressed thoughts about five different aspects of their learning while they viewed lectures: (a) comprehending the information, (b) feeling a part of the classroom environment, (c) past experiences with an accommodation, (d) individual preferences for an accommodation, (e) suggestions for improving an accommodation. They exhibited three metacognitive strategies: (a) constructing knowledge, (b) monitoring comprehension, and (c) evaluating information. No patterns were found in the types of metacognitive strategies used for any particular accommodation. The researcher offers recommendations for flexible applications of the standard accommodations used with students who are D/HoH.

The relationship between the use of Academic Text Talk and the comprehension of scientific academic language for diverse second graders

Changing demographics impact our schools as children come from more linguistically and culturally diverse backgrounds. The various social, cultural, and economic backgrounds of the students affect their early language learning experiences which expose them to the academic language needed to succeed in school. Teachers can help students acquire academic language by introducing words that are within their Zone of Proximal Development and increasing exposure to and use of academic language. This study investigated the effects of increasing structured activities for students to orally interact with informational text on their scientific academic language development and comprehension of expository text. ^ The Academic Text Talk activities, designed to scaffold verbalization of new words and ideas, included discussion, retelling, games, and sentence walls. This study also evaluated if there were differences in scientific language proficiency and comprehension between boys and girls, and between English language learners and native English speakers. ^ A quasi-experimental design was used to determine the relationship between increasing students' oral practice with academic language and their academic language proficiency. Second graders (n = 91) from an urban public school participated in two science units over an 8 week period and were pre and post tested using the Woodcock Muñoz Language Survey-Revised and vocabulary tests from the National Energy Education Project. Analysis of covariance was performed on the pre to post scores by treatment group to determine differences in academic language proficiency for students taught using Academic Text Talk compared to students taught using a text-centered method, using the initial Florida Assessment for Instruction in Reading test as a covariate. Students taught using Academic Text Talk multimodal strategies showed significantly greater increases in their pre to posttest means on the Woodcock Muñoz Language Survey-Revised Oral Language Totals and National Energy Education Development Project Vocabulary tests than students taught using the text-centered method, ps < .05. Boys did not show significantly greater increases than girls, nor did English language learners show significantly greater increases than the native English speakers. ^ This study informs the field of reading research by evaluating the effectiveness of a multimodal combination of strategies emphasizing discourse to build academic language.^

The effects of trained teachers' integration of dialogic reading discourse on Hispanic English Language Learners' literacy skills in kindergarten

This quasi-experimental Analysis of Covariance (ANCOVA) study explored whether the vocabulary and reading comprehension mean scores of Hispanic Kindergarten ELs whose teachers were trained to utilize Dialogic Reading (DR) discourse were higher than the mean scores of Hispanic ELs in kindergarten whose teachers were not trained to utilize DR discourse strategies. Sixty-three self-identified Hispanic, English Language Kindergarten students and four teachers participated in the study. The teachers were randomly assigned to either the experimental group (DR trained) or control group by drawing names from a hat. Student assignment to experimental versus comparison group was based on the teacher's assignment to either the experimental or comparison group. Thirty-one were assigned to the control group and 32 to the experimental group. The teachers were instructed to read the story to a group of six students (maximum) at a time, utilizing the DR discourse strategies they had been trained to implement. Subjects were read a story each week during the 8-week duration of the study. Teachers in the experimental group collaboratively selected 10 words each week from the Read Together Talk Together (RTTT) instructional stories that were utilized for vocabulary instruction. A test of homogeneity was conducted to evaluate whether the variance among the dependent variables was the same across the groups. An Analyses of Covariance (ANCOVA) was applied to analyze students' vocabulary and comprehension mean scores in the experimental group and the comparison group. The results of the study demonstrated a significant increase in the vocabulary and reading comprehension mean scores for the students whose teachers had been trained in DR discourse strategies. When comparing the two groups, the results revealed a statistically significant difference (p < 0.05). In conclusion, this study was conducted to explore how DR discourse may be an effective technique to teach literacy skills. The findings of this study showed that vocabulary knowledge and reading comprehension of Hispanic ELs were positively affected by the teachers' inclusion of dialogue during storybook reading. Its outcomes accentuated the need for teachers to provide assistance to ELs as they develop vocabulary knowledge and reading comprehension skills.

Initial placement methods for Haitian adult ESOL students : the NYS place test plus profile data compared to subjective assessment

Few valid and reliable placement procedures are available to assess the English language proficiency of adults who enroll in English for Speakers of Other Languages (ESOL) programs. Whereas placement material exists for children and university ESOL students, the needs of students in adult community education programs have not been adequately addressed. Furthermore, the research suggests that a number of variables, such as, native language, age, prior schooling, length of residence, and employment are related to second language acquisition. Numerous studies contribute to our understanding of the relationship of these factors to second language acquisition of Spanish-speaking students. Again, there is a void in the research investigating the factors affecting second language acquisition and consequently, appropriate placement of Haitian Creole-speaking students. This study compared a standardized instrument, the NYS Place Test, used alone and in combination with a writing sample in English, to subjective judgement of a department coordinator for initial placement of Haitian adult ESOL students in a community education program. The study also investigated whether or not consideration of student profile data improved the accuracy of the test. Finally, the study sought to determine if a relationship existed between student profile data and those who withdrew from the program or did not enter a class after registering. Analysis of the data by crosstabulation and chi-square revealed that the standardized NYS Place Test was at least as accurate as subjective department coordinator placement and that one procedure could be substituted for li other. Although the writing sample in English improved accuracy of placement by the NYS test, the results were not significant. Of the profile variables, only length of residence was found to be significantly related to accuracy of placement using the NYS Place Test. The number of incorrect placements was higher for those students who lived in the host country from twenty-five to one hundred ten months. A post hoc analysis of NYS test scores according to level showed that those learners who placed in level three also had a significantly higher incidence of incorrect placements. No significant relationship was observed between the profile variables and those who withdrew from the program or registered but did not enter a class.

Language Learning Motivation

This study aimed to measure how authentic material motivates students to perform well and have positive attitudes toward foreign language learning. Participants were 32 eighth grade students at Aquinas College in Nassau the Bahamas. Attitude/Motivation Test Battery (adapted Gardner, 2004), interviews, and open ended discussions were used.