Developing a process to create and validate an instrument assessing student attainment of competencies at an intercultural university in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students' attainment of competencies in one of the IU's majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students' research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as "functional capabilities" (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric's validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study's instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

Developing a Process to Create and Validate an Instrument Assessing Student Attainment of Competencies at an Intercultural University in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students’ attainment of competencies in one of the IU’s majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students’ research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as “functional capabilities” (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric’s validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study’s instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

Recreational Foodservice management: A Delphi study of needed competencies

The purpose of this study was to identify the needed competencies of a Recreational Foodservice manager. A three round Delphi method of iteration was used. Delphi is a research method that utilizes iterating rounds to elicit the opinion of a panel of experts regarding a specific subject.^ A nominating committee of 22 industry leaders was consulted to establish a panel of 40 management experts, of which 35 (87.5%) completed all three rounds of the Delphi study.^ Round One of the study identified 17 specific job functions of a Recreational Foodservice manager. The researcher prepared an instrument detailing 60 competencies derived from an analysis of Round One results and distributed it as a Round Two instrument requesting the panel opinion regarding the relative importance of each listed competency on a five point Likert scale.^ The results of Round Two were tabulated and analyzed to ascertain areas of consensus. A Round Three instrument was prepared advising panelists of all areas of consensus, their dissenting opinions, if any, and a request for a revised opinion.^ A final report was prepared listing the 60 competencies and the panel opinion that eight were of highest priority, 29 of above average priority, and 23 of average priority. No item received two other available ratings, below average priority and lowest priority.^ The implications of these findings suggest necessary areas of curriculum development and industry management development to implement professionalism for Recreational Foodservice managers. ^

Perceptions of beginning teachers in Florida regarding their preparation as it relates to the Florida Essential Generic Competencies

The purpose of the study is to investigate how beginning teachers in the state of Florida perceive their preparation to demonstrate the 27 Florida Essential Generic Competencies.^ The basic research question of this study was: How do beginning teachers perceive their level of preparation regarding their implementation of the Florida Essential Generic Competencies? This study identified and categorized the perceived degree of preparation for each of the competencies. Also, elementary, middle, and high school beginning teachers were compared to find significant differences and similarities in their perception of their preparation. A comparison was also done for graduates from in-state versus out-of-state and private versus public institutions.^ A survey developed in collaboration with the Department of Education, Florida State University, members of the Professional Orientation Program (POP) Coordinators, and the Project Director of Program Review in the College of Education at the University of South Florida, was sent to 5,076 beginning teachers. A total of 1,995 returned the survey in February of 1993. The Multivariate Analysis of Variance (MANOVA) procedure was used (Alpha =.05). Statistical analysis of the data involved a comparison of the different groups of beginning teachers by school level and kind of graduating institutions. The dependent variables analyzed were the responses to all items representing the generic competencies.^ The study identified and categorized the degree of preparation for each competency. The competencies receiving the lowest ratings for degree of preparation were: integrate computers in instruction; manage situations involving child abuse and/or neglect; severe emotional stress; alcohol and drug abuse.^ The Wilkes lambda and the Hotellings multivariate tests of significance were used to examine the differences among the groups. The competency items were further analyzed by a univariate F test. Results indicated that: (1) significant differences were found in nine competency items in which elementary teachers felt better prepared than middle and high school beginning teachers, (2) graduates from a Florida teacher education program felt they were better prepared in demonstrating the competencies than those from out-of-state schools, and (3) no significant difference was found in the perceptions of those who graduated from public versus private institutions.^ Based on the findings of this study, the following recommendations are made: (1) Florida's institutions responsible for teacher preparation programs need to focus on those competencies receiving the lowest ratings, (2) Districts should provide an orientation program for out-of-state beginning teachers, and (3) The survey instrument should be used annually to evaluate teacher education programs. ^

Making Life Choices Program: A psychoeducational intervention for promoting critical cognitive and affective competencies in adolescents at-risk for problem behaviors

The long term goal of the work described is to contribute to the emerging literature of prevention science in general, and to school-based psychoeducational interventions in particular. The psychoeducational intervention reported in this study used a main effects prevention intervention model. The current study focused on promoting optimal cognitive and affective functioning. The goal of this intervention was to increase potential protective factors such as critical cognitive and communicative competencies (e.g., critical problem solving and decision making) and affective competencies (e.g., personal control and responsibility) in middle adolescents who have been identified by the school system as being at-risk for problem behaviors. The current psychoeducational intervention draws on an ongoing program of theory and research (Berman, Berman, Cass Lorente, Ferrer Wreder, Arrufat, & Kurtines 1996; Ferrer Wreder, 1996; Kurtines, Berman, Ittel, & Williamson, 1995) and extends it to include Freire's (1970) concept of transformative pedagogy in developing school-based psychoeducational programs that target troubled adolescents. The results of the quantitative and qualitative analyses indicated trends that were generally encouraging with respect to the effects of the intervention on increasing critical cognitive and affective competencies. ^

Use of the DACUM process in the identification and verification of competencies for the medical administrative assistant

Medicine has changed in recent years. Medicare will all of its rules and regulations, worker's compensation laws, managed care and the trend toward more and larger group practices all contributed to the creation of an extremely structured regulatory environment which in turn demanded highly trained medical administrative assistants.^ The researcher noted three primary problems in the identification of competencies for the medical administrative assistant position: A lack of curricula, diverse roles, and a complex environment which has undergone radical change in recent years and will continue to evolve. Therefore, the purposes of the study were to use the DACUM process to develop a relevant list of competencies required by the medical administrative assistant practicing in physicians' offices in South Florida; determine the rank order of importance of each competency using a scale of one to five; cross-validate the DACUM group scores with a second population who did not participate in the DACUM process; and establish a basis for a curriculum framework for an occupational program.^ The DACUM process of curriculum development was selected because it seemed best suited to the need to develop a list of competencies for an occupation for which no programs existed. A panel of expert medical office administrative staff was selected to attend a 2-day workshop to describe their jobs in great detail. The panel, led by a trained facilitator, listed major duties and the respective tasks of their job. Brainstorming techniques were used to develop a consensus.^ Based upon the DACUM workshop, a survey was developed listing the 8 major duties and 71 tasks identified by the panel. The survey was mailed to the DACUM group and a second, larger population who did not participate in the DACUM. The survey results from the two groups were then compared. The non-DACUM group validated all but 3 of the 71 tasks listed by the DACUM panel. Because the three tasks were rated by the second group as at least "somewhat important" and rated "very important" by the DACUM group, the researcher recommended the inclusion of all 71 tasks in program development for this occupation. ^

A Study of Intercultural Adjustment Regarding Time Orientation of Russian Students in the U.S. Academic Environment

The study investigates intercultural adjustment (IA) of Russian students to the U.S. academic environment. IA is examined through the lens of the Time orientation (T orientation) of Kluckhohn and Strodtbeck’s (1961) theory of value orientations. The study reveals students’ T orientation and degrees, perceived difficulties, and strategies of adjustment.

Digital Literacy: Definition, Theoretical Framework, and Competencies

This paper offers an overview of existing definitions and theoretical frameworks for digital literacy. The researcher makes recommendations for an agreed upon definition and theoretical framework and discusses implications for a relationship between digital and visual literacy skills.

Intercultural Education and Intercultural Competence in Higher Education in Ukraine

The establishment of independent Ukraine in 1991 created a political and social climate that entailed a need and possibility for democratic educational reforms in Ukraine. An integration of Ukraine in multicultural European and global society can be supported academically by infusing intercultural education in primary, secondary, and higher education curricula.

Unity and Diversity: High School Students’ Perceptions on Multiculturalism and the Intercultural University of the State of Guerrero, Mexico

This is a mixed methods study conducted in Guerrero, Mexico, at the end of the academic year 2005-2006. The purpose of this study was to capture the perceptions held by high school students, of both indigenous and non-indigenous background, regarding the intercultural university, as well as their conceptualization of multiculturalism.

Hotel and Restaurant Entry-Level Job Competencies: Comparisons of Management and Worker Perceptions

This article presents the findings of a central Florida study of lodging and restaurant managers as well as entry-level workers who were graduates of hospitality management programs. It provides a theoretical construct as a basis of the methodology employed. The article then reports the findings of perceptions of desired knowledge, skills and abilities, and attitudes associated with entry-level employees. It further compares desired levels of preparation for entry-level positions in the industry as reported by respondents of both groups. Finally, the authors present conclusions and implications for central Florida practitioners and educators.

Competencies of a Recreational Food Service Manager

Recreational food service is a newly-identified industry segment. It represents over 3 percent of the total industry and has its own specific competency requirements, in addition to core food service management competency needs. The education, training, and development needs for professionals in this industry segment have not as yet been ascertained. This article is an effort to establish a benchmark for future research in this area.

Establishing a baseline of psychometric estimates of measurement of intercultural competence of Ukrainian faculty: Setting the stage for domestic and global intercultural understanding

Post-Soviet Ukraine is in a time of upheaval and transition. Internal relations between pro-Western and pro-Russian supporters have deteriorated in the light of recent political events of Euro Revolution, Russia's occupation of the Crimean peninsula, and the militant confrontations in the southeastern regions of the country. In the light of these developments, intercultural competence is greatly needed to alleviate domestic tensions and enable effective intercultural communication with the representatives of different cultures within the country and beyond its borders.^ This study established a baseline of psychometric estimates of intercultural competence of Ukrainian higher education faculty. A sample of 276 professors of different academic majors from one university in Western Ukraine participated in the research. The Global Perspective Inventory (GPI; Merrill, Braskamp, & Braskamp, 2012) was chosen as a research instrument to measure intercultural competence of the faculty members. The GPI takes into account cognitive, intrapersonal, and interpersonal domains, each of which contains two scales reflective of theories of cultural development and intercultural communication – Cognitive-Knowing, Cognitive-Knowledge, Intrapersonal-Identity, Intrapersonal-Affect, Interpersonal-Social Responsibility, and Interpersonal-Social Interaction. Because the research instrument has neither been previously used as a measure of intercultural competence, nor administered in Ukraine, it was cross-validated using a Table of Specification (Newman, Lim, & Pineda, 2013) and two sets of factor analyses. As a result, a modified version of the GPI was created for use in Ukraine.^ Multiple linear regression analyses were used to test relationships between the participants' GPI scores on intercultural competence, and several independent variables that consisted of academic discipline, intercultural experience, and how long the participants taught at the university. The analyses determined a positive relationship between the scores on three out of six scales of the original version and two out of five scales of the modified version of the GPI and all the independent variables simultaneously. The relationship between the faculty responses on the six scales of both GPI versions and the independent variables controlling for each other produced mixed results. A unique role of intercultural professional development in predicting intercultural competence was discussed.^