Developing a process to create and validate an instrument assessing student attainment of competencies at an intercultural university in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students' attainment of competencies in one of the IU's majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students' research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as "functional capabilities" (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric's validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study's instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

Toward an understanding of how individuals overcome challenges to development: A phenomenological study of an inner -city student's attitude toward academic orientation and life

The purpose of this qualitative case study was to gain an understanding of the phenomenon of academic orientation by seeking the insights into an inner-city Haitian-American middle school student's attitudes and world view toward education and life. A phenomenological approach was used in order to explore the way in which Cindy, a minority student, gives meaning to her lived-experiences in terms of her desire to meet academic expectations and her ability to overcome social adversity and/or other risk factors.^ The study attempted to answer the following two research questions: (1) What provides the focus for Cindy's (the subject's) approach to her school work and/or life? (2) What are the processes that give meaning and direction to academic orientation and life for Cindy? In-depth interviewing was the primary method of data collection. In addition, journal and sketchbook entries and school district records were used and classroom observations made.^ The nature of the study to understand lived-experience facilitated the use of the case study method and a phenomenological method of description. Data analysis was conducted by means of an adapted form of the constant comparative approach. Patterns in the data which emerged were coded and categorized according to underlying generative themes. Phenomenological reflection and analysis were used to grasp the experiential structures of Cindy's experience. The following textural themes were identified and confirmed to be essential themes to Cindy's experience: personal challenge to do her best, personal challenge to want to learn, having a sense of determination, being able to think for self, having a disposition to like self, achieving self-respect through performance, seeing a need to help others, being intrinsically motivated, being an independent learner, attending more to academic pressure and less to peer pressure, having motivational catalysts in her life, learning and support opportunities, and having a self-culture. Using Mahrer's humanistic theory of experiencing, Cindy's development was interpreted in terms of her progression through a sequence of developmental plateaus: externalized self, internalized self, and integrating and actualizing self.^ The findings of this study were that Cindy's desire to meet academic expectations is guided by a meaning construction internal frame of reference. High expectations of self in conjunction with other protective factors found in Cindy's home and school environments were also found to be linked to her educational resilience and success. Cindy's lived-experiences were also found to be related to Mahrer's theory of human development. In addition, it was concluded that "minority" students do not all fit into social categories and labels. ^

The effects of cross -age peer tutoring on writing and reading comprehension skills and attitudes and self -perceptions as writers of third and fourth grade students

The purpose of this study was to investigate the effects of cross-age peer writing response groups on the writing and reading achievement of third and fourth grade students. Students' attitudes about writing and their perceptions of themselves as writers were also measured at the end of the study. ^ One hundred and twenty-two third and fourth grade students enrolled in a public school in a middle-class, multi-cultural neighborhood participated in the study. Four existing classes of students were randomly assigned to either the experimental condition (EC) or the control condition (CC). Both groups were pretested and posttested for writing and reading achievement. The intervention, cross-age peer writing groups, met for eleven weeks. ^ Three hypotheses were examined in this study: (a) writing improvement score, (b) reading comprehension improvement score, and (c) students' attitudes toward writing and their perception of themselves as writers based on the five scales measured on the Writer Self-Perception Scale. ^ ANOVAs were done on the pretests and posttests for writing and the Stanford Achievement Test reading comprehension subtest scores for the year of the study and the previous year. ANOVAs were also done for the five areas of the Writer Self-Perception Scale. Cross-tabulations were also used to compare improvement level verses treatment group, and grade level. ^ Analysis of the data revealed that there was no evidence that the tutoring (EC) groups made more progress than the non-tutoring (CC) groups in writing and reading. There was evidence of growth in writing, especially by the fourth graders. Most importantly, the fourth grade tutors, the experimental group, had the most positive feelings about writing and themselves as writers. ^

Self -regulated learning: The role of a journal in the learning process for students and teachers

A fundamental goal of education is to equip students with self-regulatory capabilities that enable them to educate themselves. Self directedness not only contributes to success in formal instruction but also promotes lifelong learning (Bandura, 1997). The area of research on self-regulated learning is well grounded within the framework of psychological literature attributed to motivation, metacognition, strategy use and learning. This study explored past research and established the purpose of teaching students to self-regulate their learning and highlighted the fact that teachers are expected to assume a major role in the learning process. A student reflective writing journal activity was sustained for a period of two semesters in two fourth-grade mathematics classrooms. The reflective writing journal was analyzed in search of identifying strategies reported by students. Research questions were analyzed using descriptive statistics, frequency counts, cross-tabs and chi-square analyses. ^ Results based on student-use of the journals and teacher interviews indicated that the use of a reflective writing journal does promote self-regulated learning strategies to the extent which the student is engaged in the journaling process. Those students identified as highly self-regulated learners on the basis of their strategy use, were shown to consistently claim to learn math “as well or better than planned” on a weekly basis. Furthermore, good self-regulators were able to recognize specific strategies that helped them do well and change their strategies across time based on the planned learning objectives. The perspectives of the participating teachers were examined in order to establish the context in which the students were working. The effect of “planned change” and/or the resistance to change as established in previous research, from the teachers point of view, was also explored. The analysis of the journal data did establish a significant difference between students who utilized homework as a strategy. ^ Based on the journals and interviews, this study finds that the systematic use of metacognitive, motivational and/or learning strategies can have a positive effect on student's responsiveness to their learning environment. Furthermore, it reflects that teaching students “how to learn” can be a vital part of the effectiveness of any curriculum. ^

The performance of high -ability Black upper elementary grade students in an International Baccalaureate program

The purpose of this study was to investigate the common factors and experiences that contribute to the success of high ability Black students enrolled in Frank C. Martin Elementary School, the first school in Florida authorized to offer the International Baccalaureate (IB) Primary Years Programme (PYP). The study further sought to determine ways in which educators and stakeholders assisted in maintaining and in increasing Black students' achievement that motivated and encouraged them to pursue similar programs at the middle and high school levels. ^ Three sources of data were used: (a) individual interviews with fourth and fifth grade high ability Black students using a semi-structured format elicited discussion of their perceptions of the PYP and factors contributing to their success; (b) individual interviews with their fourth and fifth grade teachers elicited discussion of teacher expectations and effective instructional strategies; and (c) a questionnaire asked parents of the participating students their reasons for choosing the PYP, their perceptions of the program, and their own level of involvement in their child's learning. Three separate focus groups gathered further data. ^ The results revealed that the factors contributing to the success of high ability Black elementary school students are consistent with those of students in other racial groups. These are a challenging program, high teacher and parental expectations, strong parental involvement and support, a celebration of culture and diversity in a caring and nurturing environment, and the development and internalization of positive attitudes. ^ Implications for future studies might include a longitudinal study conducted over seven years to trace the achievements of Black students throughout the entire IB Program. ^

A qualitative study of selected fourth -grade teachers' perceptions of the Sunshine State Standards

Despite a history of grappling with educational standards, never before has the federal government attempted to establish explicit national standards for what American children should learn in school. Recently, U.S. educators have developed voluntary national content standards, or explicit expectations of what students should know and be able to do. Not surprisingly, this major curriculum reform has provoked considerable debate. Today, teachers face difficult challenges working towards the implementation of standards. The objective of this study was to describe and explain the perceptions of a selected team of fourth-grade teachers regarding the language arts component of their state's Sunshine State Standards (SSS). The exploratory questions that guided this qualitative study were: (a) How are the SSS perceived by these fourth-grade teachers? (b) In what ways do the SSS affect teachers' self-perceptions? and, (c) To what extent and how do the SSS affect the participants' professional classroom behavior? ^ Direct observations, interviews, analysis of relevant documents and the researcher's critical reflective journal served as the methods of inquiry employed in this qualitative study. Bandura's Teacher Self-Efficacy Scale was used as a tool to help categorize the data specifically related to self-perception. ^ Analysis of the data suggests that participants perceived the SSS as a useful guideline as they taught. The SSS were a decisive factor in teachers' planning. They were the actual guide lines used by teachers to plan their lessons. However, participants did not believe the SSS were attainable by all students or were fair to students with special needs. They also believed there was not sufficient time allocated for the effective implementation of the SSS. This lack of time created pressure among some of the participants and others even felt disempowered regarding the curriculum and the instructional focus implemented during the test preparation time. The SSS negatively affected the participants when they felt constraints during this time, which led to their inability to carry out important activities in their classrooms. Thus, the SSS directly affected the participants' behavior in their classrooms. ^

The *validation of an instrument for the assessment of study behaviors of high school students

The purpose of this study is to validate the Study Behavior Inventory-High School, an instrument designed to measure study behaviors of high school students and to determine the stability of its scores across populations and across grades. Numerous studies have shown the relationship between the level of students' use of appropriate study behaviors and their levels of academic achievement and this is particularly relevant at a time of increasing demands for school and teacher accountability for their students' academic achievement. ^ The instrument was administered to 3,336 students in grades 9 through 12 in four high schools in diverse parts of the United States. Factor analysis yielded a four factor structure for the instrument and evidence for its construct validity was obtained using convergent and discriminant methods. The four factors include academic self-perception and feelings of low self-efficacy, academic preparation behaviors, time management, and the social nature of taking tests and studying. Internal consistency reliability for the scores on each of the four factors was calculated and found to range between .68 and .87. Finally, confirmatory factor analysis indicated acceptable levels of fit between the factor structure obtained in this study and an earlier one obtained during a pilot study using 800 participants. ^ The SBI-HS appears to be a valid and reliable instrument for the measure of study behaviors in high school students. ^

Differential outcomes of two -way and transitional programs on English language learners at different entry levels

This study investigated the effects of two types of bilingual education programs (two-way and transitional) on the academic performance, attitudes, and metacognitive awareness of 5th grade students who entered kindergarten or first grade with different levels of English proficiency. The multi-stage sample consisted of students who had participated in each program for a period of at least five years. A mixed model design allowed for the collection of quantitative and qualitative data that were analyzed accordingly and integrated. ^ The findings indicated no significant differences between the two groups on measures of academic achievement in English. Significant differences were found in the number of semesters required for the students to become proficient English speakers. An important conclusion, based on these findings, was that the students enrolled in the two-way bilingual education (TWBE) programs learned English faster. Moreover, they maintained a high level of proficiency in Spanish, scoring significantly higher than the transitional bilingual education group on measures of Spanish reading ability.^ Questionnaire and interview data indicated that the students in the two-way bilingual education programs tended to use more Spanish for recreational purposes and tended to rate themselves as more proficient Spanish speakers than their peers. Conversely, the students enrolled in the transitional bilingual education programs tended to rate themselves as more proficient in English than their peers. ^ The level of English language proficiency upon entering school (five years later) was found to make a difference in academic achievement, as measured by standardized tests. Five years of schooling did not fully eliminate the gap in academic performance between students with different ESOL entry levels at kindergarten. However, entry level did not have an effect on attitudes towards bilingualism. ^ It is concluded that, although there was no significant difference between the two groups on measures of academic achievement in English, TWBE and transitional programs have differential effects. Students in the TWBE programs acquired oral language at a faster rate, developed literacy skills in their native language, and acquired more positive attitudes towards bilingualism. Theoretical, methodological, and policy implications of the findings are discussed. ^

Deprofessionalization of curriculum decision -making

The purpose of this study was to analyze the evolution of Florida state level policy efforts and to assess the responding educational policy development and implementation at the local school district level. The focus of this study was the secondary language arts curriculum in Miami-Dade County Public Schools. ^ Data was collected using document analysis as a source of meaning making out of the language sets proffered by agencies at each level. A matrix was created based on Klein's levels of curriculum decision-making and Functional Process Theory categories of policy formation. The matrix allowed the researcher to code and classify specific information in terms accountability/high-stakes testing; authority; outside influences; and operational/structural organization. ^ Federal policy documents provided a background and impetus for much of what originated at the State level. The State then produced policy directives which were accepted by the District and specific policy directives and guidelines for practice. No evidence was found indicating the involvement of any other agencies in the development, transmission or implementation of the State level initiated policies. ^ After analyzing the evolutionary process, it became clear that state policy directives were never challenged or discussed. Rather, they were accepted as standards to be met and as such, school districts complied. Policy implementation is shown to be a top-down phenomenon. No evidence was found indicating a dialogue between state and local systems, rather the state, as the source of authority, issued specifically worded policy directives and the district complied. Finally, this study recognizes that outside influences play an important role in shaping the education reform policy in the state of Florida. The federal government, through NCLB and other initiatives created a climate which led almost naturally to the creation of the Florida A+ Plan. Similarly, the concern of the business community, always interested in the production of competent workers, continued to support efforts at raising the minimum skill level of Florida high school graduates. ^ Suggestions are made for future research including the examination of local school sites in order to assess the overall nature of the school experience rather than rely upon performance indicators mandated by state policy. ^

The relationship of immigrant status to perceptions of reading and reading literacy among young Black students: A test of the Cultural -Ecological Theory of School Performance

This study tests Ogbu and Simons' Cultural-Ecological Theory of School Performance using data from the Progress in International Reading Literacy Study of 2001 (PIRLS), a large-scale international survey and reading assessment involving fourth grade students from 35 countries, including the United States. This theory argues that Black immigrant students outperform their non-immigrant counterparts, academically, and that achievement differences are attributed to stronger educational commitment in Black immigrant families. Four hypotheses are formulated to test this theory: Black immigrant students have (a) more receptive attitudes toward reading; (b) a more positive reading self-concept; and (c) a higher level of reading literacy. Furthermore, (d) the relationship of immigrant status to reading perceptions and literacy persists after including selected predictors. These hypotheses are tested separately for girls and boys, while also examining immigrant students' generational status (i.e., foreign-born or second-generation). ^ PIRLS data from a subset of Black students (N=525) in the larger U.S. sample of 3,763 are analyzed to test the hypotheses, using analysis of variance, correlation and multiple regression techniques. Findings reveal that hypotheses a and b are not confirmed (contradicting the Cultural-Ecological Theory) and c and d are partially supported (lending partial support to the theory). Specifically, immigrant and non-immigrant students did not differ in attitudes toward reading or reading self-concept; second-generation immigrant boys outperformed both non-immigrant and foreign-born immigrant boys in reading literacy, but no differences were found among girls; and, while being second-generation immigrant had a relatively stronger relationship to reading literacy for boys, among girls, selected socio-cultural predictors, number of books in the home and length of U.S. residence, had relatively stronger relationship to reading self-concept than did immigrant status. This study, therefore, indicates that future research employing the Cultural-Ecological Theory should: (a) take gender and generational status into account (b) identify additional socio-cultural predictors of Black children's academic perceptions and performance; and (c) continue to build on this body of evidence-based knowledge to better inform educational policy and school personnel in addressing needs of all children. ^

A comparison study of the English III/American Literature success of African American high school students and that of students whose home language is Haitian Creole

The purpose of the study was to compare the English III success of students whose home language is Haitian Creole (SWHLIHC) with that of the more visible African American high school students in the Miami Dade County Public Schools System, in an effort to offer insight that might assist educators in facilitating the educational success of SWHLIHC in American Literature class.^ The study was guided by two important theories on how students interact with and learn from literature. They are Reader Response Theory which advocates giving students the opportunity to become involved in the literature experience (Rosenblatt, 1995), and Critical Literacy, a theory developed by Paolo Freire and Henry Giroux, which espouses a critical approach to analysis of society that enables people to analyze social problems through lenses that would reveal social inequities and assist in transforming society into a more equitable entity.^ Data for the study: 10th grade reading FCAT scores, English III/American Literature grades, and Promotion to English IV records for the school year 2010-2011 were retrieved from the records division of the Miami Dade County Public Schools System. The study used a quantitative methods approach, the central feature of which was an ex post facto design with hypotheses (Newman, Newman, Brown, & McNeely, 2006). The ex post facto design with hypotheses was chosen because the researcher postulated hypotheses about the relationships that might exist between the performances of SWHLIHC and those of African American students on the three above mentioned variables. This type of design supported the researcher's purpose of comparing these performances.^ One way analysis of variance (ANOVA), two way ANOVAs, and chi square tests were used to examine the two groups' performances on the 10th grade reading FCAT, their English III grades, and their promotion to English IV. ^ The study findings show that there was a significant difference in the performance of SWHLIHC and African American high school students on all three independent variables. SWHLIHC performed significantly higher on English III success and promotion to English IV. African American high school students performed significantly higher on the reading FCAT.^

Effects of sex, third grade reading achievement and motivation as predictors of fourth grade reading achievement of Hispanic students: A path analysis

This study explored the topic of motivation for intermediate students combining both an objective criterion measure (i.e., standardized test scores) and the self-report of students on self-concept and value of reading. The purpose of this study was to examine how third grade reading achievement correlated with the motivation of fourth grade boys and girls, and, in turn, how motivation related to fourth grade reading achievement. The participants were fourth grade students (n=207) attending two public, elementary schools in Miami-Dade County who were of primarily Hispanic origin or descent. Data were collected using the Reading Survey portion of the Motivation to Read Profile (1996) which measures self-concept and value of reading in order to measure motivation and the Third and Fourth Grade Reading Florida Comprehensive Assessment Tests 2.0 (FCAT 2.0) to assess achievement. First, a one way Analysis of Variance (ANOVA) was conducted to determine whether motivation differed significantly between fourth grade boys and girls. Second, a path analysis was used to determine whether motivation mediated or moderated the association between FCAT 2.0 third and fourth grade scores. Results of the ANOVA indicated that motivation, as measured by the Motivation to Read Profile did not differ significantly by sex. Results from the path analysis indicated that the model was significant and that third grade FCAT 2.0 scores accounted for a significant amount of the variance in fourth grade FCAT 2.0 scores once motivation was entered. Results of the study demonstrated that motivation partially mediates, but does not moderate the relationship between FCAT 2.0 third and fourth grade scores. In conclusion, it can be determined that past student achievement for fourth grade students plays a role in current student achievement when motivation is also considered. It is therefore important in order to improve the quality of fourth grade student's current performance to take into account a student's motivation and past achievement. An effort must be made to address students' motivational needs whether through school wide programs or at the classroom level in addition or in conjunction with cognition. Future research on the effect of self-concept in reading achievement is recommended.

A visual critical ethnography of youth develoment in a Rio de Janeiro favela

Favelas are Brazilian informal housing settlements that are areas of concentrated poverty. In Rio de Janeiro, favelas are perceived as areas of heightened criminal activity and violence, and residents experience discrimination, and little access to quality education and employment opportunities. In this context, hundreds of non-formal educational arts and leisure programs work to build the self-esteem and identity of youth in Rio's favelas as a way of preventing the youth from negative local influences. The Morrinho organization, located in the Pereira da Silva favela in Rio, uses art as a way for the local male youth to communicate their lived reality. This study used a visual critical ethnographic methodology to describe the way in which the Morrinho participants interpret living in a favela. Seventeen semi-structured interviews with young men aged 15 to 29, the feature-length documentary film on the organization, 206 researcher produced documentary style photographs of the Morrinho artwork, and the researcher's field notes were analyzed. Truth claims, ways of seeing as communicated through words and actions, were induced through a cyclical process of reconstructive horizon analysis that incorporated the societal context and critical theory. The participants communicated their concerns about life in a favela; however, they did not describe their societal positions in terms of complete marginalization. They named multiple benefits of living in Pereira da Silva, discussed positive and negative experiences in school, and described ways they circumvented discrimination. Morrinho as an organization was described as an enthralling game and a social project that benefited dozens of local youth. Character development was a valuable result of participation at Morrinho. The Morrinho artwork communicates a nuanced vision of both benevolent and violent social actors, and counters the overwhelmingly negative dominant characterization of Rio de Janeiro's favelas. This study has implications for an inclusive critical pedagogy and the use of art as a means to facilitate a transformative education. Further research is recommended to explore terminology used to refer to favelas, and perceptions that favela residents have of their experiences in public education.

English Language Learners: A Correlational Study of the Relationship Between A Proficiency Level Assessment and End of Course Test Scores at one Georgia High School

Understanding the language of one’s cultural environment is important for effective communication and function. As such, students entering U.S. schools from foreign countries are given access to English to Speakers of Other Languages (ESOL) programs and they are referred to as English Language Learner (ELL) students. This dissertation examined the correlation of ELL ACCESS Composite Performance Level (CPL) score to the End of Course tests (EOCTs) and the Georgia High School Graduation Tests (GHSGTs) in the four content courses (language arts, mathematics, science, and social studies). A premise of this study was that English language proficiency is critical in meeting or exceeding state and county assessment standards. A quantitative descriptive research design was conducted using Cross-sectional archival data from a secondary source. There were 148 participants from school years 2011-2012 to 2013- 2014 from Grades 9-12. A Pearson product moment correlation was run to assess the relationship between the ACCESS CPL (independent variable) and the EOCT scores and the GHSGT scores (dependent variables). The findings showed that there was a positive correlation between ACCESS CPL scores and the EOCT scores where language arts showed a strong positive correlation and mathematics showed a positive weak correlation. Also, there was a positive correlation between ACCESS CPL scores and GHSGT scores where language arts showed a weak positive correlation. The results of this study indicated that that there is a relationship between the stated variables, ACCESS CPL, EOCT and GHSGT. Also, the results of this study showed that there were positive correlations at varying degrees for each grade levels. While the null hypothesis for Research Question 1 and Research Question 2 were rejected, there was a slight relationship between the variables.

The Response to an ESL Population Boom in the Beaufort County, South Carolina School System: A Case Study

The purpose of this case study was to examine the why the English language learners (ELLs) in the Beaufort County, South Carolina school system have been so successful. This school system has recently experienced a boom in its ESL student population, and this population has performed very well on standardized tests. This study used critical theory as its theoretical framework and examined why the students have been successful rather than marginalized in Beaufort County schools. This phenomenon was investigated using semi-structured interviews with the ESOL Coordinator for Beaufort County, 4 ESL-lead teachers, and 6 mainstream teachers. Data were collected using semi-structured interviews with Sarah Owen, the Beaufort County ESOL, Gifted and Talented, and World Languages coordinator. Based on the results of her interview, 4 themes emerged that were used for the semi-structured interviews with ESOL and mainstream teachers. The interviews centered on the themes of ESL policy, ESL leadership, and teacher training. The ESL and mainstream teacher interviews also revealed several subthemes that included teacher attitude, why Beaufort County has been successful with the ELLs, and the teachers’ recommendations for other schools systems trying to successfully accommodate a large ESL student population in mainstream classrooms. The findings from the teachers’ interviews revealed that additional training for the teachers without ESL experience helped them become comfortable instructing ELLs. This training should be conducted by the ESOL teachers for those without ESOL certification or endorsement. As the teachers had more training, they had better attitudes about teaching ESOL students in their classes. Finally, those who utilized the additional ESOL training and ESOL accommodations saw better student achievement in their classes. Based on the finding of this study, the researcher proposed a model for other school systems to follow in order to replicate the success of Beaufort County’s ELLs. The implications of this study focus on other schools systems and why ELLs are not obtaining the same level of success as those in Beaufort County’s schools. Finally, recommendations for further research are provided.