An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

Development and validation of an instrument to predict online student success using faculty perceptions

Distance learning is growing and transforming educational institutions. The increasing use of distance learning by higher education institutions and particularly community colleges coupled with the higher level of student attrition in online courses than in traditional classrooms suggests that increased attention should be paid to factors that affect online student course completion. The purpose of the study was to develop and validate an instrument to predict community college online student course completion based on faculty perceptions, yielding a prediction model of online course completion rates. Social Presence and Media Richness theories were used to develop a theoretically-driven measure of online course completion. This research study involved surveying 311 community college faculty who taught at least one online course in the past 2 years. Email addresses of participating faculty were provided by two south Florida community colleges. Each participant was contacted through email, and a link to an Internet survey was given. The survey response rate was 63% (192 out of 303 available questionnaires). Data were analyzed through factor analysis, alpha reliability, and multiple regression. The exploratory factor analysis using principal component analysis with varimax rotation yielded a four-factor solution that accounted for 48.8% of the variance. Consistent with Social Presence theory, the factors with their percent of variance in parentheses were: immediacy (21.2%), technological immediacy (11.0%), online communication and interactivity (10.3%), and intimacy (6.3%). Internal consistency of the four factors was calculated using Cronbach's alpha (1951) with reliability coefficients ranging between .680 and .828. Multiple regression analysis yielded a model that significantly predicted 11% of the variance of the dependent variable, the percentage of student who completed the online course. As indicated in the literature (Johnson & Keil, 2002; Newberry, 2002), Media Richness theory appears to be closely related to Social Presence theory. However, elements from this theory did not emerge in the factor analysis.

Investigation of escape and negative student behaviors related to Florida state high stakes test preparation in Miami-Dade County Public High Schools

The purpose of this study was to determine whether there was a relationship between pressure to perform on state mandated, high-stakes tests and the rate of student escape behavior defined as the number of school suspensions and absences. The state assigned grade of a school was used as a surrogate measure of pressure with the assumption that pressure increased as the school grade decreased. Student attendance and suspension data were gathered from all 33 of the regular public high schools in Miami-Dade County Public Schools. The research questions were: Is the number of suspensions highest in the third quarter, when most FCAT preparation takes place for each of the 3 school years 2007-08 through 2009-10? How accurately does the high school's grade predict the number of suspensions and number of absences during each of the 4 school years 2005-06 through 2008-09? The research questions were answered using repeated measures analysis of variance for research question #1 and non-linear multiple regression for research question #2. No significant difference could be found between the numbers of suspensions in each of the grading periods nor was there a relationship between the number of suspensions and school grade. A statistically significant relationship was found between student attendance and school grade. When plotted, this relationship was found to be quadratic in nature and formed a loose inverted U for each of the four years during which data were collected. This indicated that students in very high and very low performing schools had low levels of absences while those in the midlevel of the distribution of school performance (C schools) had the greatest rates of absence. Identifying a relationship between the pressures associated with high stakes testing and student escape behavior suggests that it might be useful for building administrators to reevaluate test preparation activities and procedures being used in their building and to include anxiety reducing strategies. As a relationship was found, it sets the foundation for future studies to identify whether testing related activities are impacting some students emotionally and are causing unintended consequences of testing mandates.

Self-esteem and job satisfaction of adults with mild mental retardation in sheltered workshops and supported employment programs

A sample of 200 adults with mild mental retardation were assessed on overall job satisfaction and self-esteem using the Vocational Program Evaluation Profile and the Coopersmith Self-esteem Inventory. The subjects worked either in a sheltered workshop or in a supported employment setting. Results indicated that there was a significant relationship between self-esteem and job satisfaction for both groups of subjects. In addition, subjects who worked in supported employment reported significantly higher levels of job satisfaction also. There was also an interaction between place of residence and place of employment when looking at self-esteem; those who live in a semi-independent home and work in supported employment reported the highest levels of self-esteem. These results are discussed in terms of the social validity of supported-employment for persons with mild mental retardation. ^

Equity policy, educational practice, and limited English proficient (LEP) students in two high schools in Miami

Most studies of language minority students' performance focus on students' characteristics. This study uses qualitative methodology to examine instead how educational policies and practices affect the tracking of language minority students who are classified as limited English proficient (LEP). The placement of LEP students in core courses (English, Math, Social Studies, and Science) is seen as resulting from the interaction between school context and student characteristics. The school context includes factors such as equity policy requirements, overcrowding, attitudes regarding immigrants' academic potential, tracking, and testing practices. Interaction among these factors frequently leads to placement in lower track courses. It was found that the absence of formal tracks could be misleading to immigrant students, particularly those with high aspirations who do not understand the implications of the informal tracking system. Findings are discussed in relation to current theoretical explanations for minority student performance. ^

Factors associated with prompt difficulty in automated essay scoring

This study explores factors related to the prompt difficulty in Automated Essay Scoring. The sample was composed of 6,924 students. For each student, there were 1-4 essays, across 20 different writing prompts, for a total of 20,243 essays. E-rater® v.2 essay scoring engine developed by the Educational Testing Service was used to score the essays. The scoring engine employs a statistical model that incorporates 10 predictors associated with writing characteristics of which 8 were used. The Rasch partial credit analysis was applied to the scores to determine the difficulty levels of prompts. In addition, the scores were used as outcomes in the series of hierarchical linear models (HLM) in which students and prompts constituted the cross-classification levels. This methodology was used to explore the partitioning of the essay score variance.^ The results indicated significant differences in prompt difficulty levels due to genre. Descriptive prompts, as a group, were found to be more difficult than the persuasive prompts. In addition, the essay score variance was partitioned between students and prompts. The amount of the essay score variance that lies between prompts was found to be relatively small (4 to 7 percent). When the essay-level, student-level-and prompt-level predictors were included in the model, it was able to explain almost all variance that lies between prompts. Since in most high-stakes writing assessments only 1-2 prompts per students are used, the essay score variance that lies between prompts represents an undesirable or "noise" variation. Identifying factors associated with this "noise" variance may prove to be important for prompt writing and for constructing Automated Essay Scoring mechanisms for weighting prompt difficulty when assigning essay score.^

English language learners and standardized testing in an urban senior high school

The primary purpose of this study was to examine the influences of literacy variables on high-stakes test performance including: (a) student achievement on the Metropolitan Achievement Test, Seventh Edition (MAT-7) as correlated to the high-stakes test such as the FCAT examination and (b) the English language proficiency attained by English Language Learners (ELL) students when participating in, or exiting from English Speakers of Other Languages (ESOL) program as determined by the Limited English Proficient (LEP) committee. ^ Two one-sample Chi-square tests were conducted to investigate the relationship between passing the MAT-7 Reading and Language examinations and the FCAT-SSS Reading Comprehension and FCAT-NRT examinations. In addition, 2x2 Analyses of Variance (ANOVAs) were conducted to address the relationship between the time ELL students spent in the ESOL program and the level of achievement on MAT-7 Reading and Language examinations and the FCAT-SSS Reading Comprehension and FCAT-NRT. ^ Findings of this study indicated that more ELL students exit the program based on the LEP committee decisions than by passing the MAT-7. The majority of ELL students failed the 10th grade FCAT, the passing of which is needed for graduation. A significant number of ELL students failed, even when passing the MAT-7 or being duly exited through the decision of the LEP committee. The data also indicated that ELL students who exited the ESOL program in six semesters or fewer had higher FCAT scores than those who exited the program in seven semesters or more. The MAT-7 and the decision of the LEP committee were shown to be ineffective as predictors of success on the FCAT. ^ Further research to determine the length of time a student in the ESOL program uses English to read, write, and speak should be conducted. Additionally, the development of a new assessment instrument to better predict student success should be considered. However, it should be noted that the results of this study are limited to the context in which it was conducted and does not warrant generalizations beyond that context. ^

Adolescent readers' self-perceptions of affective factors related to performance on standardized tests

The purpose of this study was to investigate which affective factors of adolescent high school readers were related to high-level readers, middle-level readers and low-level readers. The research problem was to determine the relationship between adolescent high school students' self-perceived reading self-efficacy factors and the students' reading performance on a standardized reading assessment considering demographic factors of age, gender and socio-economic status as covariates. The research design was ex post facto making inferences without direct intervention. The sample was obtained from one large, diverse, urban high school, consisting of 9th and 10th grade adolescent students (N = 176). Students voluntarily completed a self-report, reading self-efficacy survey. School records were used to obtain standardized reading level scores, age, gender, and socio-economic status data. An exploratory factor analysis of the self-efficacy survey responses resulted in the identification of 7 underlying factors. The striving (low-level) readers had significantly lower self-perceptions on 5 of the 7 affective factors than the middle-level readers, and strong (high-level) readers, p < .05. The 5 affective factors on which the striving readers had significantly lower self-perceptions were: (a) Observational Comparison, (b) Progress, (c) Lack of Progress, (d) Lack of Anxiety, and (e) Positive Social Feedback. The 2 affective factors which were not significantly different for reader level were Anxiety and Negative Social Feedback. Girls had significantly less anxiety than boys for both of the factors in the Anxiety category. Statistical results showed that none of the demographic covariates tested; age, gender, or socio-economic status, moderated the relationship between affective reader self-efficacy factors and reader level. This study concluded that there were distinguishable differences for striving, middle, and strong readers' self-efficacy factors. Determining affective factors related to reading can be used to create better instructional environments and instruction for adolescent students.

Stereotype threat and the standardized testing experiences of African American children at an urban elementary school

Stereotype threat (Steele & Aronson, 1995) refers to the risk of confirming a negative stereotype about one’s group in a particular performance domain. The theory assumes that performance in the stereotyped domain is most negatively affected when individuals are more highly identified with the domain in question. As federal law has increased the importance of standardized testing at the elementary level, it can be reasonably hypothesized that the standardized test performance of African American children will be depressed when they are aware of negative societal stereotypes about the academic competence of African Americans. This sequential mixed-methods study investigated whether the standardized testing experiences of African American children in an urban elementary school are related to their level of stereotype awareness. The quantitative phase utilized data from 198 African American children at an urban elementary school. Both ex-post facto and experimental designs were employed. Experimental conditions were diagnostic and non-diagnostic testing experiences. The qualitative phase utilized data from a series of six focus group interviews conducted with a purposefully selected group of 4 African American children. The interview data were supplemented with data from 30 hours of classroom observations. Quantitative findings indicated that the stereotype threat condition evoked by diagnostic testing depresses the reading test performance of stereotype-aware African American children (F[1, 194] = 2.21, p < .01). This was particularly true of students who are most highly domain-identified with reading (F[1, 91] = 19.18, p < .01). Moreover, findings indicated that only stereotype-aware African American children who were highly domain-identified were more likely to experience anxiety in the diagnostic condition (F[1, 91] = 5.97, p < .025). Qualitative findings revealed 4 themes regarding how African American children perceive and experience the factors related to stereotype threat: (1) a narrow perception of education as strictly test preparation, (2) feelings of stress and anxiety related to the state test, (3) concern with what “others” think (racial salience), and (4) stereotypes. A new conceptual model for stereotype threat is presented, and future directions including implications for practice and policy are discussed.

Development of an instrument to measure high school students' global awareness and attitudes: Looking through the lens of social sciences

The purpose of this study was to develop an instrument to measure high school students’ perspectives on global awareness and attitudes toward social issues. The research questions that guided this study were: (a) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' global awareness? (b) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' attitudes towards global social issues? (c) What is the relationship between high school students’ GPA, race/ethnicity, gender, socio-economic status, parents’ education, getting the news, reading and listening habits, the number of classes taken in the social sciences, whether they speak a second language, and have experienced living in or visiting other countries, and their perception of global awareness and attitudes toward global social issues. ^ An ex post facto research design was used and the data were collected using a 4-part Likert-type survey. It was administered to 14 schools in the Miami-Dade County, Florida area to 704 students. A factor analysis with an orthogonal varimax rotation was vii used to select the factors that best represented the three constructs – global education, global citizenship, and global workforce. This was done to establish construct validity. Cronbach’s alpha was used to determine the reliability of the instrument. Descriptive statistics and a hierarchical multiple regression were used for the demographics to establish their relationship, if any, to the findings. ^ Key findings of the study were that reliable and valid estimates can be developed for the instrument. The multiple regression analysis for model 1 and 2 accounted for a variance of 3% and 5% for self-perceptions of global awareness (factor 1). The regression model also accounted for a 5% and 13% variance in the two models for attitudes toward global social issues (factor 2). The demographics that were statistically significant were: ethnicity, gender, SES, parents’ education, listening to music, getting the news, speaking a second language, GPA, classes taken in the social sciences, and visiting other countries. An important finding for the study was those attending public schools (as opposed to private schools) had more positive attitudes towards global social issues (factor 2) The statistics indicated that these students had taken history, economics, and social studies – a curriculum infused with global perspectives.^

A study of the relationship between educational placement and the achievement of urban low socioeconomic Hispanic middle school students with and without specific learning disabilities

Public schools traditionally have been held accountable for educating the majority of the nation’s school children, and through the years, these schools have been evaluated in a variety of ways. Currently, evaluation measures for accountability purposes consist solely of standardized test scores. In the past, only test scores of general education students were analyzed. Laws governing the education of students with disabilities, however, have extended accountability measures not only to include those students, but to report their scores in a disaggregated form (No Child Left Behind Act, 2001). The recent emphasis on accountability and compliance has resulted in the need for schools to carefully examine how programs, services, and policies impact student achievement (Bowers & Figgers, 2003). ^ Standard-based school reform and accountability systems have raised expectations about student learning outcomes for all students, including those with disabilities and minority students. Yet, overall, racial/ethnic minority students are performing well below their White non-Hispanic peers in most academic areas. Additionally, with respect to special education, there exists an enduring problem of disproportionate representation of racial/ethnic minority students (National Research Council, 2000). ^ This study examined classroom placement (inclusive versus non-inclusive) relative to academic performance of urban, low socioeconomic Hispanic students with and without disabilities in secondary content area classrooms. A mixed method research design was used to investigate this important issue using data from a local school district and results from field observations. The study compared performance levels of four middle school Hispanic student subgroups (students with disabilities in inclusive settings, students without disabilities in inclusive settings, students with disabilities in resource settings, and student without disabilities in general education settings) each in their respective placements for two consecutive years, exploring existing practices within authentic settings. ^ Significant differences were found in the relationship of educational placement and achievement between grade level and disability in the areas of math and reading. Additionally, clear and important differences were observed in student-teacher interactions. Recommendations for further researchers and stakeholders include soliciting responses from teams at the schools composed of general education and special education teachers, administrative personnel, and students as well as broadening the study across grade levels and exceptionalities. ^

The relationship between staff perceptions of principal leadership and school performance

The climate of a school can be defined as the set of internal characteristics that distinguishes one school from another and influences the behavior of its members (Hoy & Hannum, 1997). Schools with a positive climate have been shown to positively impact students (Hoy, 1972). A principal’s leadership style influences the climate that, in turn, impacts student performance. ^ In this work, the researcher investigated Miami-Dade County Public Schools in order to determine if there was a relationship between instructional staff members’ perceptions of their school’s principals, a derivative of the district’s school climate studies, and their schools’ grades. ^ Eight School Climate Survey items were inter-correlated. The smallest intercorrelation was .83, which is still a large intercorrelation, and the largest intercorrelation was .96. Pearson’s correlation analysis (Healey, 2004) was run to determine the relationship between schools’ earned points and averaged survey responses. Survey items 8, 9, 12 and 13 had weak (less than .30) positive correlations to schools’ earned points. Survey items 7, 10, 11 and 14 had moderate (above .30) positive correlations to schools’ earned points. ^ The researcher created a composite variable (Pallant, 2007) from all the School Climate Survey responses. This composite variable, titled Principal Leadership Score, allowed the researcher to determine that approximately 9% of the variance in the points earned by schools in 2009 can be accounted for by how teachers in this study perceived the leadership of their principals. ^ This study’s findings of a moderate positive correlation between teachers’ perceptions of principal leadership and school performance supports earlier research linking school climate and school performance. Due to the fact that the leadership of the principal affects, either positively or negatively, the learning and working environment of students and teachers, it is recommended that principals use the eight School Climate Survey items examined within this study as guides (Pepper & Thomas, 2002). Through focusing on these survey items, principals may be propelled to self-identify their leadership strengths as well as leadership weaknesses.^

School Segregation, Educational Disparities, and Impacts on Haitian Youth in South Florida

This paper examines the ways in which the legacy of school segregation in South Florida has affected the education of Haitian students and continues to limit their prospects. The high schools that serve neighborhoods with concentrated Haitian populations achieve shockingly poor academic results, which negatively affect Haitian student academic achievement.

A study of the implementation of junior college *evaluation system in Taiwan

Since the establishment of the evaluation system in 1975, the junior colleges in the Republic of China (Taiwan), have gone through six formal evaluations. We know that evaluation in schooling, like quality control in businesses, should be a systematic, formal, and a continual process. It can doubtless serve as a strategy to refine the quality of education. The purpose of this research is to explore the current practice of junior college evaluation in Taiwan. This provides insight into the development of and quality of the current evaluation system. Moreover, this study also identified the source of problems with the current evaluation system and provided suggestion for improvements.^ In order to attain the above purposes, this research was undertaken in both theoretical and practical ways. First, theoretically, on the basis of a literature review, the theories of educational evaluation and, according to the course and principles of development, a view of the current practice in Taiwan. Secondly, in practice, by means of questionnaires, an analysis of the views of evaluation committeemen, junior college presidents, and administrators were obtained on evaluation models, methods, contents, organization, functions, criteria, grades reports, and others with suggestions for improvement. The summary of findings concludes that most evaluators and evaluatees think the purpose of evaluation can help the colleges explore their difficulties and problems. In addition, it was found that there is significant difference between the two groups regarding the evaluation methods, contents, organization, functions, criteria, grades reports and others, while analyzing these objective data forms the basis for an improved method of evaluation for Junior Colleges in Taiwan. ^

Relationships between gifted selection criteria and performance in sixth -grade gifted science

This study examined the relationships between gifted selection criteria used in the Dade County Public Schools of Miami, Florida and performance in sixth grade gifted science classes.^ The goal of the study was to identify significant predictors of performance in sixth grade gifted science classes. Group comparisons of performance were also made. Performance in sixth grade gifted science was defined as the numeric average of nine weeks' grades earned in sixth grade gifted science classes.^ The sample consisted of 100 subjects who were formerly enrolled in sixth grade gifted science classes over two years at a large, multiethnic public middle school in Dade County.^ The predictors analyzed were I.Q. score (all scales combined), full scale I.Q. score, verbal scale I.Q. score, performance scale I.Q. score, combined Stanford Achievement Test (SAT) score (Reading Comprehension plus Math Applications), SAT Reading Comprehension score, and SAT Math Applications score. Combined SAT score and SAT Math Applications score were significantly positively correlated to performance in sixth grade gifted science. Performance scale I.Q. score was significantly negatively correlated to performance in sixth grade gifted science. The other predictors examined were not significantly correlated to performance.^ Group comparison results showed the mean average of nine weeks grades for the full scale I.Q. group was greater than the verbal and performance scale I.Q. groups. Females outperformed males to a highly significant level. Mean g.p.a. for ethnic groups was greatest for Asian students, followed by white non-Hispanic, Hispanic, and black. Students not receiving a lunch subsidy outperformed those receiving subsidies.^ Comparisons of performance based on gifted qualification plan showed the mean g.p.a. for traditional plan and Plan B groups were not different. Mean g.p.a. for students who qualified for gifted using automatic Math Applications criteria was highest, followed by automatic Reading Comprehension criteria and Plan B Matrix score. Both automatic qualification groups outperformed the traditional group. The traditional group outperformed the Plan B Matrix group. No significant differences in mean g.p.a. between the Plan B subgroups and the traditional plan group were found. ^