An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a Second Language students: The Computerized Placement Test and holistically scored essay exams

This dissertation describes the findings and implications of a correlational analysis. Scores earned on the Computerized Placement Test (CPT), sentence skills, were compared to essay scores of advanced English as a Second Language (ESL) students. As the CPT is designed for native speakers of English, it was hypothesized that it could be an invalid or unreliable instrument for non-native speakers. Florida community college students are mandated to take the CPT to determine preparedness, as are students at many other U.S. and Canadian colleges. If incoming students score low on the CPT, they may be required to take up to three semesters of remedial coursework. It is essential that scores earned by non-native speakers of English accurately reflect their ability level. They constitute a large and growing body of non-traditional students enrolled at community colleges.^ The study was conducted at Miami-Dade Community College, Wolfson Campus, fall 1997. Participants included 106 advanced ESL students who took both the CPT sentence skills test and wrote final essay exams. The essay exams were holistically scored by trained readers. Also, the participants took the Placement Articulation Software Service (PASS) exam, an alternative form of the CPT. Scores on the CPT and essays were compared by means of a Pearson product-moment correlation to validate the CPT. Scores on the CPT and the PASS exam were compared in the same manner to verify reliability. A percentage of appropriate placements was determined by comparing essay scores to CPT cutoff score ranges. Finally, the instruments were evaluated by means of independent-samples t-tests for performance differences between gender, age, and first language groups.^ The results indicate that the CPT sentence skills test is a valid and reliable placement instrument for advanced- level ESL students who intend to pursue community college degrees. The correlations demonstrated a substantial relationship between CPT and essay scores and a marked relationship between CPT and PASS scores. Appropriate placements were made in 86% of the cases. Furthermore, the CPT was found to discriminate equally among the gender, age, and first language groups included in this study. ^

The relationship between selected standardized test scores and performance in advanced placement math and science exams: Analyzing the differential effectiveness of scores for course identification and placement

There is a national need to increase the STEM-related workforce. Among factors leading towards STEM careers include the number of advanced high school mathematics and science courses students complete. Florida's enrollment patterns in STEM-related Advanced Placement (AP) courses, however, reveal that only a small percentage of students enroll into these classes. Therefore, screening tools are needed to find more students for these courses, who are academically ready, yet have not been identified. The purpose of this study was to investigate the extent to which scores from a national standardized test, Preliminary Scholastic Assessment Test/ National Merit Qualifying Test (PSAT/NMSQT), in conjunction with and compared to a state-mandated standardized test, Florida Comprehensive Assessment Test (FCAT), are related to selected AP exam performance in Seminole County Public Schools. An ex post facto correlational study was conducted using 6,189 student records from the 2010 - 2012 academic years. Multiple regression analyses using simultaneous Full Model testing showed differential moderate to strong relationships between scores in eight of the nine AP courses (i.e., Biology, Environmental Science, Chemistry, Physics B, Physics C Electrical, Physics C Mechanical, Statistics, Calculus AB and BC) examined. For example, the significant unique contribution to overall variance in AP scores was a linear combination of PSAT Math (M), Critical Reading (CR) and FCAT Reading (R) for Biology and Environmental Science. Moderate relationships for Chemistry included a linear combination of PSAT M, W (Writing) and FCAT M; a combination of FCAT M and PSAT M was most significantly associated with Calculus AB performance. These findings have implications for both research and practice. FCAT scores, in conjunction with PSAT scores, can potentially be used for specific STEM-related AP courses, as part of a systematic approach towards AP course identification and placement. For courses with moderate to strong relationships, validation studies and development of expectancy tables, which estimate the probability of successful performance on these AP exams, are recommended. Also, findings established a need to examine other related research issues including, but not limited to, extensive longitudinal studies and analyses of other available or prospective standardized test scores.

Effectiveness of peer counseling on high school students who failed two or more classes in a nine week quarter

The purpose of this study was to examine the effectiveness of peer counseling on high school students who have previously failed two or more classes in a nine week quarter.^ This study was constructed by comparing students who previously failed and were subsequently given peer counseling with a matched group of students who failed and did not receive peer counseling.^ To test the proposed research question, 324 students from a large urban school system were randomly chosen from a computer generated list of students who failed courses, matched on variables of number of classes failed, grade level and gender. One student from each matched pair was randomly placed in either the experimental or control group. 162 students from Group 1 (experimental) were assigned a peer counselor with their pair assigned to Group 2 (control). Group 1 received peer counseling at least 4 times during the third nine week academic quarter (Quarter 3) while Group 2 did not.^ The Grade Point Averages (GPA) for all students were collected both at the end of Quarter 2 and Quarter 3, at which time peer counseling was terminated. GPA's were also collected nine weeks after counseling was terminated.^ Results were determined by multiple regression, analysis of covariance and t-test. A level of significance was set at.05. There was significant increase in the GPA's of those counseled students immediately after peer counseling and also nine weeks after counseling was terminated, while the group not receiving peer counseling showed no increase. It was noted that there were significantly more school drop-outs from the non-counseled group than the counseled group. The number of classes failed, high school attended, grade level and gender were not found to be significant.^ The conclusion from this study was that peer counseling does impact significantly on the GPA's of students experiencing academic failure. Recommendations from this study were to implement and expand peer counseling programs with more failing students, continue counseling for longer than one quarter, include students in drop-out programs and students from different socio-economic and racial backgrounds, and conduct subsequent evaluation. ^

The effectiveness of training educators on their ability to identify function of problem behavior

The purpose of this study was to investigate the effectiveness of training educators in the pre-behavioral intervention process of functional behavioral assessment. An original evaluation instrument was developed entitled, The Survey for Students Exhibiting Challenging Behavior. The instrument included measures of participating educators, knowledge of function of problem behavior and their ability to generate recommendations for a behavior intervention plan. The instrument was distributed to schools in a large urban district and completed by special educators. Educators trained and untrained in the functional behavioral assessment process were compared in the study. ^ The study incorporated a post-test only design. All instruments were analyzed using a factorial ANOVA. Those educators who were trained in the district functional behavioral assessment program answered general questions related to function of problem behavior significantly better than those who did not receive training. There is no significant difference between educators on their ability to generate recommendations for behavior intervention plans. It is important that educators receive training in functional behavioral assessment to gain an understanding of the basic notions being function of problem behavior. Current training does not translate into educators' ability to make strong recommendations for behavior intervention plans. ^

Individual differences influencing context effects in responding to items assessing conscientiousness in a personality test

Context effects in a personality scale were examined by determining if conscientiousness scale (C) scores were significantly different when administered alone vs. part of a Five Factor Model inventory (Big5). The effectiveness of individual difference variables (IDVs) as predictors of the context effect was also examined. The experiment compared subjects who completed the full Big5 once and the C alone once (Big5/C or C/Big5) to subjects who complete either the Big5 inventory twice (Big5/Big5) or the C twice (C/C). No significant differences were found. When Big5/C and C/Big5 groups were combined, IDVs were tested, and only the field dependence variable (R2 = .06) was found to significantly predict the context effect. However, the small R2 minimized concerns of context effects in Big5 inventories. ^

Effectiveness of skills- versus metacognitive strategy-based approaches on reading comprehension of college developmental students

This study explored the relative value of behavioral and cognitive psychology as the basis of instruction for underprepared college students enrolled in developmental reading courses. Specifically this study examined the effects of a metacognitive strategy-based instructional approach (MSIA) modeling a metacognitive self-questioning technique (MSQT) versus a traditional skills-based instructional approach (SIA) on the Nelson-Denny reading comprehension scores of college developmental readers and whether there were significant differences in achievement based on instructional method used and on the sex of students. The sample consisted of 100 college developmental reading students who were enrolled in six intact sections of a reading course (REA0002). Participants completed a pretest of the comprehension subtest of the Nelson-Denny Reading Test (Form G). Three of these classes (n = 49) were taught using metacognitive-strategy instruction and three classes (n = 51) were instructed using skills-based instruction. They then received a semester of instruction intended to improve their reading comprehension. At the end of the semester, participants completed a post-test of the Nelson-Denny Reading Comprehension Test (Form H). A two (Between) x one (Within) Repeated Measures Analysis of Variance (ANOVA) was utilized to test each of the hypotheses of this study. Results showed that there were no significant differences in reading comprehension between the groups receiving the different instructional treatments and no differences in reading comprehension between the men and women participants. Based on the findings, implications for research and recommendations for future research were discussed.

Emotional intelligence and leadership in organizations: A meta-analytic test of process mechanisms

The present study—employing psychometric meta-analysis of 92 independent studies with sample sizes ranging from 26 to 322 leaders—examined the relationship between EI and leadership effectiveness. Overall, the results supported a linkage between leader EI and effectiveness that was moderate in nature (ρ = .25). In addition, the positive manifold of the effect sizes presented in this study, ranging from .10 to .44, indicate that emotional intelligence has meaningful relations with myriad leadership outcomes including effectiveness, transformational leadership, LMX, follower job satisfaction, and others. Furthermore, this paper examined potential process mechanisms that may account for the EI-leadership effectiveness relationship and showed that both transformational leadership and LMX partially mediate this relationship. However, while the predictive validities of EI were moderate in nature, path analysis and hierarchical regression suggests that EI contributes less than or equal to 1% of explained variance in leadership effectiveness once personality and intelligence are accounted for. ^

The effectiveness of a conceptually-based health and wellness course in developing health related factors, exercise self-efficacy and knowledge of health issues and exercise performance among diverse college students

The purpose of the study was to investigate the physiological and psychological benefits provided by a self-selected health and wellness course on a racially and ethnically diverse student population. It was designed to determine if students from a 2-year Hispanic serving institution (HIS) from a large metropolitan area would enhance their capacity to perform physical activities, increase their knowledge of health topics and raise their exercise self-efficacy after completing a course that included educational and activity components for a period of 16 weeks. A total of 185 students voluntarily agreed to participate in the study. An experimental group was selected from six sections of a health and wellness course, and a comparison group from students in a student life skills course. All participants were given anthropometric tests of physical fitness, a knowledge test, and an exercise self-efficacy scale was given at the beginning and at the conclusion of the semester. An ANCOVA analyses with the pretest scores being the covariate and the dependent variable being the difference score, indicated a significant improvement of the experimental group in five of the seven anthropometric tests over the comparison group. In addition, the experimental group increased in two of the three sections of the exercise self-efficacy scale indicating greater confidence to participate in physical activities in spite of barriers over the comparison group. The experimental group also increased in knowledge of health related topics over the comparison group at the .05 significance level. Results indicated beneficial outcomes gained by students enrolled in a 16-week health and wellness course. The study has several implications for practitioners, faculty members, educational policy makers and researchers in terms of implementation of strategies to promote healthy behaviors in college students and, to encourage them to engage in regular physical activities throughout their college years.

The effectiveness of direct -instruction and student -centered teaching methods on students' functional understanding of plagiarism

In an attempt to improve students' functional understanding of plagiarism a variety of approaches were tried within the context of a more comprehensive information literacy program. Sessions were taught as a one hour "module" inside a required communications skills class at a small private university. Approaches taken included control sessions (a straightforward PowerPoint presentation of the material), direct instruction sessions (featuring mostly direct lecture but with some seatwork as well), and student-centered sessions (utilizing role playing and group exercises). Students were taught basic content and definitions regarding plagiarism, what circumstances or instances constitute plagiarism, where to go for help in avoiding plagiarism, and what constitutes appropriate paraphrasing and citation. Pre-test and post-test scores determined students' functional understanding primarily by their ability to recognize properly and improperly paraphrased text, content understanding by their combined total score on a multiple choice quiz, and their attitude and conceptual understanding by their ability to recognize circumstances which would constitute plagiarism. While students improved across all methods the study was unable to identify one that performed significantly better than the others. The results supported the need for more education with regard to plagiarism and suggested a need for perhaps more time on task and/or a mixed approach towards conveying the content.

Emotional Intelligence and Leadership in Organization: A Meta-analytic Test of Process Mechanisms

The present study – employing psychometric meta-analysis of 92 independent studies with sample sizes ranging from 26 to 322 leaders – examined the relationship between EI and leadership effectiveness. Overall, the results supported a linkage between leader EI and effectiveness that was moderate in nature (ρ = .25). In addition, the positive manifold of the effect sizes presented in this study, ranging from .10 to .44, indicate that emotional intelligence has meaningful relations with myriad leadership outcomes including effectiveness, transformational leadership, LMX, follower job satisfaction, and others. Furthermore, this paper examined potential process mechanisms that may account for the EI-leadership effectiveness relationship and showed that both transformational leadership and LMX partially mediate this relationship. However, while the predictive validities of EI were moderate in nature, path analysis and hierarchical regression suggests that EI contributes less than or equal to 1% of explained variance in leadership effectiveness once personality and intelligence are accounted for.

The impact of the Florida state-mandated basic skills exit test at Miami-Dade Community College

The purpose of this study was to explore the impact of the Florida State-mandated Basic Skills Exit Tests (BSET) on the effectiveness of remedial instruction programs to adequately serve the academically underprepared student population. The primary research question concerned whether the introduction of the BSET has resulted in remedial completers who are better prepared for college-level coursework. This study consisted of an ex post facto research design to examine the impact of the BSET on student readiness for subsequent college-level coursework at Miami- Dade Community College. Two way analysis of variance was used to compare the performance of remedial and college-ready students before and after the introduction of the BSET requirement. Chi-square analysis was used to explore changes in the proportion of students completing and passing remedial courses. Finally, correlation analysis was used to explore the utility of the BSET in predicting subsequent college-level course performance. Differences based on subject area and race/ethnicity were explored.