Effectiveness of skills- versus metacognitive strategy-based approaches on reading comprehension of college developmental students

This study explored the relative value of behavioral and cognitive psychology as the basis of instruction for underprepared college students enrolled in developmental reading courses. Specifically this study examined the effects of a metacognitive strategy-based instructional approach (MSIA) modeling a metacognitive self-questioning technique (MSQT) versus a traditional skills-based instructional approach (SIA) on the Nelson-Denny reading comprehension scores of college developmental readers and whether there were significant differences in achievement based on instructional method used and on the sex of students. The sample consisted of 100 college developmental reading students who were enrolled in six intact sections of a reading course (REA0002). Participants completed a pretest of the comprehension subtest of the Nelson-Denny Reading Test (Form G). Three of these classes (n = 49) were taught using metacognitive-strategy instruction and three classes (n = 51) were instructed using skills-based instruction. They then received a semester of instruction intended to improve their reading comprehension. At the end of the semester, participants completed a post-test of the Nelson-Denny Reading Comprehension Test (Form H). A two (Between) x one (Within) Repeated Measures Analysis of Variance (ANOVA) was utilized to test each of the hypotheses of this study. Results showed that there were no significant differences in reading comprehension between the groups receiving the different instructional treatments and no differences in reading comprehension between the men and women participants. Based on the findings, implications for research and recommendations for future research were discussed.

The mathematics anxiety of bilingual community college students

Math anxiety levels and performance outcomes were compared for bilingual and monolingual community college Intermediate Algebra students attending a culturally diverse urban commuter college. Participants (N = 618, 250 men, 368 women; 361 monolingual, 257 bilingual) completed the Abbreviated Math Anxiety Scale (AMAS) and a demographics instrument. Bilingual and monolingual students reported comparable mean AMAS scores (20.6 and 20.7, respectively) and comparable proportions of math anxious individuals (50% and 48%, respectively). Factor analysis of AMAS scores, using principal component analysis by varimax rotation, yielded similar two-factor structures for both populations -- assessment and learning content -- accounting for 65.6% of the trace for bilingual AMAS scores. Statistically significant predictor variables for levels of math anxiety for the bilingual participants included (a) preparatory course enrollment (β = .236, p = .041) with those enrolled in prior preparatory courses scoring higher, (b) education major (β = .285, p = .018) with education majors scoring higher, and (c) business major (β = .252, p = .032) with business majors scoring higher. One statistically significant predictor variable emerged for monolingual students, gender (β = -.085, p = .001) with females ranking higher. Age, income, race, ethnicity, U.S. origin, science or health science majors did not emerge as statistically significant predictor variables for either group.^ Similarities between monolingual and bilingual participants included statistically significant negative linear correlations between AMAS scores and course grades for both bilingual (r = -.178, p = .017) and monolingual participants (r = -.203, p = .001). Differences included a statistically significant linear correlation between AMAS scores and final exam grades for monolingual participants only (r = -.253, p < .0009) despite no statistically significant difference in the strength the linear relationship of the AMAS scores and the final exam scores between groups, z = 1.35, p = .1756.^ The findings show that bilingual and monolingual students report math anxiety similarly and that math anxiety has similar associations with performance measures, despite differences between predictor variables. One of the first studies on the math anxiety of bilingual community college students, the results suggest recommendations for researchers and practitioners.^

The effects of the use of technology in mathematics instruction on student achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

Development of a new student evaluation instrument of instructor effectiveness in online courses

The purpose of this study was to (a) develop an evaluation instrument capable of rating students' perceptions of the instructional quality of an online course and the instructor’s performance, and (b) validate the proposed instrument with a study conducted at a major public university. The instrument was based upon the Seven Principles of Good Practice for Undergraduate Education (Chickering & Gamson, 1987). The study examined four specific questions. 1. Is the underlying factor structure of the new instrument consistent with Chickering and Gamson's Seven Principles? 2. Is the factor structure of the new instrument invariant for male and female students? 3. Are the scores on the new instrument related students’ expected grades? 4. Are the scores on the new instrument related to the students' perceived course workload? ^ The instrument was designed to measure students’ levels of satisfaction with their instruction, and also gathered information concerning the students’ sex, the expected grade in the course, and the students’ perceptions of the amount of work required by the course. A cluster sample consisting of an array of online courses across the disciplines yielded a total 297 students who responded to the online survey. The students for each course selected were asked to rate their instructors with the newly developed instrument. ^ Question 1 was answered using exploratory factor analysis, and yielded a factor structure similar to the Seven Principles.^ Question 2 was answered by separately factor-analyzing the responses of male and female students and comparing the factor structures. The resulting factor structures for men and women were different. However, 14 items could be realigned under five factors that paralleled some of the Seven Principles. When the scores of only those 14 items were entered in two principal components factor analyses using only men and only women, respectively and restricting the factor structure to five factors, the factor structures were the same for men and women.^ A weak positive relationship between students’ expected grades and their scores on the instrument was found (Question 3). There was no relationship between students’ perceived workloads for the course and their scores on the instrument (Question 4).^

The development of rubrics to measure undergraduate students' global awareness and global perspective: A validity study

Higher education institutions across the United States have developed global learning initiatives to support student achievement of global awareness and global perspective, but assessment options for these outcomes are extremely limited. A review of research for a global learning initiative at a large, Hispanic-serving, urban, public, research university in South Florida found a lack of instruments designed to measure global awareness and global perspective in the context of an authentic performance assessment. This quasi-experimental study explored the development of two rubrics for the global learning initiative and the extent to which evidence supported the rubrics' validity and reliability. One holistic rubric was developed to measure students' global awareness and the second to measure their global perspective. The study utilized a pretest/posttest nonequivalent group design. Multiple linear regression was used to ascertain the rubrics' ability to discern and compare average learning gains of undergraduate students enrolled in two global learning courses and students enrolled in two non-global learning courses. Parallel pretest/posttest forms of the performance task required students to respond to two open-ended questions, aligned with the learning outcomes, concerning a complex case narrative. Trained faculty raters read responses and used the rubrics to measure students' global awareness and perspective. Reliability was tested by calculating the rates of agreement among raters. Evidence supported the finding that the global awareness and global perspective rubrics yielded scores that were highly reliable measures of students' development of these learning outcomes. Chi-square tests of frequency found significant rates of inter-rater agreement exceeding the study's .80 minimum requirement. Evidence also supported the finding that the rubrics yielded scores that were valid measures of students' global awareness and global perspective. Regression analyses found little evidence of main effects; however, post hoc analyses revealed a significant interaction between global awareness pretest scores and the treatment, the global learning course. Significant interaction was also found between global perspective pretest scores and the treatment. These crossover interactions supported the finding that the global awareness and global perspective rubrics could be used to detect learning differences between the treatment and control groups as well as differences within the treatment group.

Examining argumentative coherence in essays by undergraduate students of English as a foreign language in Mainland China and their English speaking peers in the United States

I conducted this study to provide insights toward deepening understanding of association between culture and writing by building, assessing, and refining a conceptual model of second language writing. To do this, I examined culture and coherence as well as the relationship between them through a mixed methods research design. Coherence has been an important and complex concept in ESL/EFL writing. I intended to study the concept of coherence in the research context of contrastive rhetoric, comparing the coherence quality in argumentative essays written by undergraduates in Mainland China and their U.S. peers. In order to analyze the complex concept of coherence, I synthesized five linguistic theories of coherence: Halliday and Hasan's cohesion theory, Carroll's theory of coherence, Enkvist's theory of coherence, Topical Structure Analysis, and Toulmin's Model. Based upon the synthesis, 16 variables were generated. Across these 16 variables, Hotelling t-test statistical analysis was conducted to predict differences in argumentative coherence between essays written by two groups of participants. In order to complement the statistical analysis, I conducted 30 interviews of the writers in the studies. Participants' responses were analyzed with open and axial coding. By analyzing the empirical data, I refined the conceptual model by adding more categories and establishing associations among them. The study found that U.S. students made use of more pronominal reference. Chinese students adopted more lexical devices of reiteration and extended paralleling progression. The interview data implied that the difference may be associated with the difference in linguistic features and rhetorical conventions in Chinese and English. As far as Toulmin's Model is concerned, Chinese students scored higher on data than their U.S. peers. According to the interview data, this may be due to the fact that Toulmin's Model, modified as three elements of arguments, have been widely and long taught in Chinese writing instruction while U.S. interview participants said that they were not taught to write essays according to Toulmin's Model. Implications were generated from the process of textual data analysis and the formulation of structural model defining coherence. These implications were aimed at informing writing instruction, assessment, peer-review, and self-revision.

Use of the DACUM process in the identification and verification of competencies for the medical administrative assistant

Medicine has changed in recent years. Medicare will all of its rules and regulations, worker's compensation laws, managed care and the trend toward more and larger group practices all contributed to the creation of an extremely structured regulatory environment which in turn demanded highly trained medical administrative assistants.^ The researcher noted three primary problems in the identification of competencies for the medical administrative assistant position: A lack of curricula, diverse roles, and a complex environment which has undergone radical change in recent years and will continue to evolve. Therefore, the purposes of the study were to use the DACUM process to develop a relevant list of competencies required by the medical administrative assistant practicing in physicians' offices in South Florida; determine the rank order of importance of each competency using a scale of one to five; cross-validate the DACUM group scores with a second population who did not participate in the DACUM process; and establish a basis for a curriculum framework for an occupational program.^ The DACUM process of curriculum development was selected because it seemed best suited to the need to develop a list of competencies for an occupation for which no programs existed. A panel of expert medical office administrative staff was selected to attend a 2-day workshop to describe their jobs in great detail. The panel, led by a trained facilitator, listed major duties and the respective tasks of their job. Brainstorming techniques were used to develop a consensus.^ Based upon the DACUM workshop, a survey was developed listing the 8 major duties and 71 tasks identified by the panel. The survey was mailed to the DACUM group and a second, larger population who did not participate in the DACUM. The survey results from the two groups were then compared. The non-DACUM group validated all but 3 of the 71 tasks listed by the DACUM panel. Because the three tasks were rated by the second group as at least "somewhat important" and rated "very important" by the DACUM group, the researcher recommended the inclusion of all 71 tasks in program development for this occupation. ^

Universal Design for Learning and Differentiated Instruction: Resolving Competing Mandates of the Individuals with Disabilities Education Act and No Child Left Behind

Recent federal mandates require accountability for providing students with disabilities access to the general education curriculum. In this paper, the authors recommend that principles of Universal Design for Learning and Differentiated Instruction can help school personnel tailor their teaching to meet the various strengths and needs of individual students.

Shifting Our Gaze to the Strengths of Alternative Education Students

This study addresses the need for educators to understand what matters for alternative education students. Three male alternative education students were interviewed about their educational memories, realities and aspirations. Results revealed family influences prevailed over inhospitable socioeconomic factors in students’ educational choices. Findings supported recommendations for alternative education teacher development.

Can Executive Skills Help Underachieving Bilingual Students? Pedagogical Implications

The author explores solutions for bilingual students’ underachievement by embedding elements of executive functioning into bilingual education. Based on analysis of theoretical perspectives, the author recommends teaching executive functions to bilingual students. Implications indicate the importance of embedding executive functions in curriculum development, textbook compiling, and instruction.

Sustainable Development: The Search for the Tipping Point

The United Nations recently launched the Decade of Education for Sustainable Development. Literature indicates the need for an authoritative definition of sustainable development. Sustainable Human Development is analyzed through the lens of Gladwell’s The Tipping Point as a framework for guiding ethical development practice and instigating changes in human behavior.

Developing a process to create and validate an instrument assessing student attainment of competencies at an intercultural university in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students' attainment of competencies in one of the IU's majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students' research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as "functional capabilities" (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric's validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study's instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

A comparison of the effects of classroom and Multi-User Virtual Environments on the perceived speaking anxiety of adult post-secondary English Language Learners

The population of English Language Learners (ELLs) globally has been increasing substantially every year. In the United States alone, adult ELLs are the fastest growing portion of learners in adult education programs (Yang, 2005). There is a significant need to improve the teaching of English to ELLs in the United States and other English-speaking dominant countries. However, for many ELLs, speaking, especially to Native English Speakers (NESs), causes considerable language anxiety, which in turn plays a vital role in hindering their language development and academic progress (Pichette, 2009; Woodrow, 2006). ^ Task-based Language Teaching (TBLT), such as simulation activities, has long been viewed as an effective approach for second-language development. The current advances in technology and rapid emergence of Multi-User Virtual Environments (MUVEs) have provided an opportunity for educators to consider conducting simulations online for ELLs to practice speaking English to NESs. Yet to date, empirical research on the effects of MUVEs on ELLs' language development and speaking is limited (Garcia-Ruiz, Edwards, & Aquino-Santos, 2007). ^ This study used a true experimental treatment control group repeated measures design to compare the perceived speaking anxiety levels (as measured by an anxiety scale administered per simulation activity) of 11 ELLs (5 in the control group, 6 in the experimental group) when speaking to Native English Speakers (NESs) during 10 simulation activities. Simulations in the control group were done face-to-face, while those in the experimental group were done in the MUVE of Second Life. ^ The results of the repeated measures ANOVA revealed after the Huynh-Feldt epsilon correction, demonstrated for both groups a significant decrease in anxiety levels over time from the first simulation to the tenth and final simulation. When comparing the two groups, the results revealed a statistically significant difference, with the experimental group demonstrating a greater anxiety reduction. These results suggests that language instructors should consider including face-to-face and MUVE simulations with ELLs paired with NESs as part of their language instruction. Future investigations should investigate the use of other multi-user virtual environments and/or measure other dimensions of the ELL/NES interactions.^

Gaining insight into teaching: A phenomenological exploration of the lived experience of Teachers of the Year

What qualities, skills, and knowledge produce quality teachers? Many stake-holders in education argue that teacher quality should be measured by student achievement. This qualitative study shows that good teachers are multi-dimensional; their effectiveness cannot be represented by students' test scores alone. The purpose of this phenomenological study was to gain a deeper understanding of quality in teaching by examining the lived experiences of 10 winners or finalists of the Teacher of the Year (ToY) Award. Phenomenology describes individuals' daily experiences of phenomena, examines how these experiences are structured, and focuses analysis on the perspectives of the persons having the experience (Moustakas, 1994). This inquiry asked two questions: (a) How is teaching experienced by recognized as outstanding Teachers of the Year? and (b) How do ToYs feelings and perceptions about being good teachers provide insight, if any, about concepts such as pedagogical tact, teacher selfhood, and professional dispositions? Ten participants formed the purposive sample; the major data collection tool was semi-structured interviews (Patton, 1990; Seidman, 2006). Sixty to 90-minute interviews were conducted with each participant. Data also included the participants' ToY application essays. Data analysis included a three-phase process: description, reduction, interpretation. Findings revealed that the ToYs are dedicated, hard-working individuals. They exhibit behaviors, such as working beyond the school day, engaging in lifelong learning, and assisting colleagues to improve their practice. Working as teachers is their life's compass, guiding and wrapping them into meaningful and purposeful lives. Pedagogical tact, teacher selfhood, and professional dispositions were shown to be relevant, offering important insights into good teaching. Results indicate that for these ToYs, good teaching is experienced by getting through to students using effective and moral means; they are emotionally open, have a sense of the sacred, and they operate from a sense of intentionality. The essence of the ToYs teaching experience was their being properly engaged in their craft, embodying logical, psychological, and moral realms. Findings challenge current teacher effectiveness process-product orthodoxy which makes a causal connection between effective teaching and student test scores, and which assumes that effective teaching arises solely from and because of the actions of the teacher.

The use of the Dade County student assistance profile in the identification of at -risk students at a minority senior high school

Current high school completion rates in Dade County and across the nation are considered to be unacceptable. This has led to the development of student assistance profiles to aid in the early identification of students considered to be at risk to allow for some form of intervention. The purpose of this research was to examine the current Dade County Public Schools profile as applied to one specific high school in which most of the students are Hispanic (mostly of Mexican descent) and Black (African-Americans, as well as recent Haitian immigrants). Additionally, the effectiveness of the alternative intervention program provided at this high school--a school within a school--were evaluated. School records of the 1992 in-coming ninth grade class became the initial data base. The individual student records of this cohort were then examined over a four-year period until their expected date or graduation. The DCPS profile used to identify potential dropouts from this group was evaluated, using chi-square and multivariate analysis, to determine its overall effectiveness, as well as the effectiveness of the individual indicators which comprise the profile. The Student Assistance Profile was found to an effective predictor, but it over-identified students from this cohort, particularly minorities, to the extent that it became largely ineffective, especially considering the limited resources available for intervention. The intervention program was found to be ineffective in reducing the dropout rate. Further analysis of the individual indicators used in the DCPS profile as they applied to this school population resulted in the development of an improved profile. By reducing the number of indicators to those found to be most highly associated with failure to graduate--academic performance and absences--a simpler student assistance profile was developed which appears to be better suited to high schools with similar demographics and budget restraints. ^