Assessing the effectiveness of five-year mechanical engineering technology programs of junior colleges in Taiwan, R.O.C.: An application of the CIPP evaluation model

The purpose of this study was to evaluate the mechanical engineering technology curriculum effectiveness at the junior college in Taiwan by using the CIPP evaluation model. The study concerned the areas of the curriculum, curriculum materials, individualized instruction, support services, teaching effectiveness, student achievement, and job performance. A descriptive survey method was used with questionnaires for data collection from faculty, students, graduates, and employers.^ All categories of respondents tended to agree that the curriculum provides appropriate occupational knowledge and skills. Students, graduates, and faculty tended to be satisfied with the curriculum; faculty tended to be satisfied with student achievement; graduates tended to be satisfied with their job preparation; and employers were most satisfied with graduates' job performance.^ Conclusions were drawn in the context, input, process, and product of the CIPP model. In Context area: Students were dissatisfied with curriculum flexibility in students characteristics. Graduates were dissatisfied with curriculum design for student's adaptability in new economic and industrial conditions; practicum flexibility in student characteristics; and course overlap. Both students and graduates were dissatisfied with practicum credit hours. Both faculty and students were dissatisfied with the number of required courses.^ In Input area: Students, faculty, and graduates perceived audiovisuals and manipulative aids positively. Faculty and students perceive CAI implementation positively. Students perceived textbooks negatively.^ In Process area: Faculty, students, and graduates perceived all support service negatively. Faculty tended to perceive the ratios of graduates who enter advanced study and related occupation, and who passed the professional skills certification, negatively. Students tended to perceive teaching effectiveness in terms of instructional strategies, the quality of instruction, overall suitability, and receivable, negatively. Graduates also tended to identify the instructional strategies as a negative perception. Faculty and students perceived curriculum objectives and practicum negatively. Both faculty and students felt that instructors should be more interested in making the courses a useful learning experience.^ In Product area: Employers were satisfied with graduates' academic preparation and job performance, adaptability, punctuality, and their ability to communicate, cooperate, and meet organization needs. Graduates were weak in terms of equipment familiarity and supervisory ability.^ In sum, the curriculum of the five-year mechanical engineering technology programs of junior college in Taiwan has served adequately up to this time in preparing a work force to enter industry. It is now time to look toward the future and adapt the curriculum and instruction for the future needs of this high-tech society. ^

Mindmapping as an adult learning notetaking strategy to increase the encoding of information in a corporate training course

A study was conducted to investigate the effectiveness, as measured by performance on course posttests, of mindmapping versus traditional notetaking in a corporate training class. The purpose of this study was to increase knowledge concerning the effectiveness of mindmapping as an information encoding tool to enhance the effectiveness of learning. Corporations invest billions of dollars, annually, in training programs. Given this increased demand for effective and efficient workplace learning, continual reliance on traditional notetaking is questionable for the high-speed and continual learning required on workers.^ An experimental, posttest-only control group design was used to test the following hypotheses: (1) there is no significant difference in posttest scores on an achievement test, administered immediately after the course, between adult learners using mindmapping versus traditional notetaking methods in a training lecture, and (2) there is no significant difference in posttest scores on an achievement test, administered 30 days after the course, between adult learners using mindmapping versus traditional notetaking methods in a training lecture. After a 1.5 hour instruction on mindmapping, the treatment group used mindmapping throughout the course. The control group used traditional notetaking. T-tests were used to determine if there were significant differences between mean posttest scores between the two groups. In addition, an attitudinal survey, brain hemisphere dominance survey, course dynamics observations, and course evaluations were used to investigate preference for mindmapping, its perceived effect on test performance, and the effectiveness of mindmapping instruction.^ This study's principal finding was that although the mindmapping group did not perform significantly higher on posttests administered immediately and 30 days after the course, than the traditional notetaking group, the mindmapping group did score higher on both posttests and reported higher ratings of the course on every evaluation criteria. Lower educated, right brain dominant learners reported a significantly positive learning experience. These results suggest that mindmapping enhances and reinforces the preconditions of learning. Recommendations for future study are provided. ^

An evaluation of English language instruction in universities/colleges in Taiwan

The purpose of this study is about to survey the effectiveness of English teaching in universities/colleges in Taiwan and provide suggestions to the educational authorities for upgrading or improving the English language teaching techniques or methods currently in use. On the one hand, the suggestions of English teachers in universities/colleges are the main concerns in this study. On the other hand, equal attention is given to the opinions and learning attitudes of the students, including the interaction between the teachers and the students.^ A social investigation methodology, consisting of questionnaire and data analysis, is devoted to this evaluation and analysis of teaching effectiveness. Among the significant findings reported in this study is the fact that both students and teachers consider evaluation of teaching effectiveness as a very important aspect of English Language programs at the university/college level. Another significant finding is that students are less concerned about the grades earned or awarded in English Language courses and more concerned about how much they learned in these classes.^ The analysis and suggestions based on the results for English teaching evaluation of universities/colleges in this dissertation can help teachers modify their teaching techniques and methods, the students to adjust their learning attitudes, and the authorities to schematize the English teaching plan that can facilitate the teaching goals to be realized. ^

A study of the effects of a service-learning experience on student success at an urban community college

The purpose of this study was to explore the effects of a service-learning experience on student success as measured by class attendance, course completion, final course grades, and end-of-term evaluation data.^ Though many outcomes of service-learning experiences have been studied, including ethical values, self-esteem, student personal development, and career preparation, relatively few studies have been conducted on the effects of such experiences on academic achievement, and the studies that have been done have primarily studied students at traditional, four-year, residential universities.^ The study consisted of 286 students enrolled in six paired courses taught by five instructors at a community college in the Fall term 1996. One section of each pair (the control group) was taught using traditional subject matter and course materials and the other section of each pair (the treatment group) participated in a 20-hour required service-learning activity in addition to the regular course curriculum. The courses in the study included American History, Sociology, College Preparatory English, and Introduction to English Composition.^ The results of this study indicate that, overall, students who participated in a class in which service-learning was a requirement, achieved higher final course grades and reported greater satisfaction with the course, the instructor, the reading assignments, and the grading system, and the treatment section of one course pair had fewer absences. In addition, the faculty members reported that, in the treatment sections, class discussions were more stimulating, the sections seemed more vital in terms of student involvement, the students seemed more challenged academically, more motivated to learn, and seemed to exert more effort in the course. ^

Planning and evaluation of Business English course in compliance with internationalization in Taiwan: A case study of Tainan Women's College of Arts & Technology

In compliance with the economic internationalization movement and the development of Asia-Pacific Regional Operation Center (APROC) in Taiwan, international business has become more and more important. To sustain favorable trade balances every year and the promotion of APROC in Taiwan, more and more talent with knowledge and skills of Business English are needed. As a consequence, it is necessary to make Business English curriculum appropriate to meet the emerging needs.^ Two groups, experimental and control, received the revised or traditional Business English course to answer the question, "Does the Business English curriculum at Tainan Woman's College of Arts & Technology (TWCAT) meet the needs of students?" Ninety-five subjects were randomly selected from the commercial departments at TWCAT and then randomly assigned to the two groups. In addition, the Business English scores of the subjects' previous semester were collected and analyzed to justify the random selection and assignment. The finding was that their initial equivalence was proved.^ A questionnaire for students and another one for the business community were administered to facilitate data collection and analysis. The results of the questionnaires were used to modify the curriculum content of Business English.^ A final-term examination was given to the subjects at the end of the pilot study of Business English in early May of 1998. The resulting scores of the examination were used to determine if there was a significant difference in learning achievement between the students of the two groups.^ Using Independent Samples Test, significant results indicated that the experimental group had higher level of learning Business English than the control group. The finding supports the hypothesis of this study.^ Recommendations based on these results are that the revised curriculum be adapted and used by TWCAT because it better meets student needs. ^

The effect of an enriched learning community on success and retention in chemistry courses

Since the mid-1990s, the United States has experienced a shortage of scientists and engineers, declining numbers of students choosing these fields as majors, and low student success and retention rates in these disciplines. Learning theorists, educational researchers, and practitioners believe that learning environments can be created so that an improvement in the numbers of students who complete courses successfully could be attained (Astin, 1993; Magolda & Terenzini, n.d.; O'Banion, 1997). Learning communities do this by providing high expectations, academic and social support, feedback during the entire educational process, and involvement with faculty, other students, and the institution (Ketcheson & Levine, 1999). ^ A program evaluation of an existing learning community of science, mathematics, and engineering majors was conducted to determine the extent to which the program met its goals and was effective from faculty and student perspectives. The program provided laptop computers, peer tutors, supplemental instruction with and without computer software, small class size, opportunities for contact with specialists in selected career fields, a resource library, and Peer-Led Team Learning. During the two years the project has existed, success, retention, and next-course continuation rates were higher than in traditional courses. Faculty and student interviews indicated there were many affective accomplishments as well. ^ Success and retention rates for one learning community class ( n = 27) and one traditional class (n = 61) in chemistry were collected and compared using Pearson chi square procedures ( p = .05). No statistically significant difference was found between the two groups. Data from an open-ended student survey about how specific elements of their course experiences contributed to success and persistence were analyzed by coding the responses and comparing the learning community and traditional classes. Substantial differences were found in their perceptions about the lecture, the lab, other supports used for the course, contact with other students, helping them reach their potential, and their recommendation about the course to others. Because of the limitation of small sample size, these differences are reported in descriptive terms. ^

Team Primacy Concept-based employee evaluation and job performance

This qualitative case study explored how employees learn from Team Primacy Concept (TPC)-based employee evaluation and how they apply the knowledge in their job performance. Kolb's experiential learning model (1974) served as a conceptual framework for the study to reveal the process of how employees learn from TPC evaluation, namely, how they experience, reflect, conceptualize and act on performance feedback. TPC based evaluation is a form of multirater evaluation that consists of three components: self-feedback, supervisor's feedback, and peer feedback. The distinctive characteristic of TPC based evaluation is the team evaluation component during which the employee's professional performance is discussed by one's peers in a face-to-face team setting, while other forms of multirater evaluation are usually conducted in a confidential and anonymous manner.^ Case study formed the methodological framework. The case was the Southeastern Virginia (SEVA) region of the Institute for Family Centered Services, and the participants were eight employees of the SEVA region. Findings showed that the evaluation process was anxiety producing for employees, especially the process of peer evaluation in a team setting. Preparation was found to be an important phase of TPC evaluation. Overall, the positive feedback delivered in a team setting made team members feel acknowledged. The study participants felt that honesty in providing feedback and openness to hearing challenges were significant prerequisites to the TPC evaluation process. Further, in the planning phase, employees strove to develop goals for themselves that were meaningful. Also, the catalyst for feedback implementation appeared to stem from one's accountability to self and to the client or community. Generally, the participants identified a number of performance improvement goals that they attained during their employment with IFCS, which were supported by their developmental plans.^ In conclusion, the study identified the process by which employees learned from TPC-based employee evaluation and the ways in which they used the knowledge to improve their job performance. Specifically, the study examined how participants felt and what they thought about TPC-based feedback, in what ways they reflected and made meaning of the feedback, and how they used the feedback to improve their job performance.^

An empirical study of Kirkpatrick's evaluation model in the hospitality industry

This study examined Kirkpatrick’s training evaluation model (Kirkpatrick & Kirkpatrick, 2006) by assessing a sales training program conducted at an organization in the hospitality industry. The study assessed the employees’ training outcomes of knowledge and skills, job performance, and the impact of the training upon the organization. By assessing these training outcomes and their relationships, the study demonstrated whether Kirkpatrick’s theories are supported and the lower evaluation levels can be used to predict organizational impact. The population for this study was a group of reservations sales agents from a leading luxury hotel chain’s reservations center. During the study period from January 2005 to May 2007, there were 335 reservations sales agents employed in this Global Reservations Center (GRC). The number of reservations sales agents who had completed a sales training program/intervention during this period and had data available for at least two months pre and post training composed the sample for this study. The number of agents was 69 ( N = 69). Four hypotheses were tested through paired-samples t tests, correlation, and hierarchical regression analytic procedures. Results from the analyses supported the hypotheses in this study. The significant improvement in the call score supported hypothesis one that the reservations sales agents who completed the training improved their knowledge of content and required skills in handling calls (Level 2). Hypothesis two was accepted in part as there was significant improvement in call conversion, but there was no significant improvement of time usage. The significant improvement in the sales per call supported hypothesis three that the reservations agents who completed the training contributed to increased organizational impact (Level 4), i.e., made significantly more sales. Last, findings supported hypothesis four that Level 2 and Level 3 variables can be used for predicting Level 4 organizational impact. The findings supported the theory of Kirkpatrick’s evaluation model that in order to expect organizational results, a positive change in behavior (job performance) and learning must occur. The examinations of Levels 2 and 3 helped to partially explain and predict Level 4 results.

An incremental multilinear system for human face learning and recognition

This dissertation establishes a novel system for human face learning and recognition based on incremental multilinear Principal Component Analysis (PCA). Most of the existing face recognition systems need training data during the learning process. The system as proposed in this dissertation utilizes an unsupervised or weakly supervised learning approach, in which the learning phase requires a minimal amount of training data. It also overcomes the inability of traditional systems to adapt to the testing phase as the decision process for the newly acquired images continues to rely on that same old training data set. Consequently when a new training set is to be used, the traditional approach will require that the entire eigensystem will have to be generated again. However, as a means to speed up this computational process, the proposed method uses the eigensystem generated from the old training set together with the new images to generate more effectively the new eigensystem in a so-called incremental learning process. In the empirical evaluation phase, there are two key factors that are essential in evaluating the performance of the proposed method: (1) recognition accuracy and (2) computational complexity. In order to establish the most suitable algorithm for this research, a comparative analysis of the best performing methods has been carried out first. The results of the comparative analysis advocated for the initial utilization of the multilinear PCA in our research. As for the consideration of the issue of computational complexity for the subspace update procedure, a novel incremental algorithm, which combines the traditional sequential Karhunen-Loeve (SKL) algorithm with the newly developed incremental modified fast PCA algorithm, was established. In order to utilize the multilinear PCA in the incremental process, a new unfolding method was developed to affix the newly added data at the end of the previous data. The results of the incremental process based on these two methods were obtained to bear out these new theoretical improvements. Some object tracking results using video images are also provided as another challenging task to prove the soundness of this incremental multilinear learning method.

A study of the relationship between educational placement and the achievement of urban low socioeconomic Hispanic middle school students with and without specific learning disabilities

Public schools traditionally have been held accountable for educating the majority of the nation’s school children, and through the years, these schools have been evaluated in a variety of ways. Currently, evaluation measures for accountability purposes consist solely of standardized test scores. In the past, only test scores of general education students were analyzed. Laws governing the education of students with disabilities, however, have extended accountability measures not only to include those students, but to report their scores in a disaggregated form (No Child Left Behind Act, 2001). The recent emphasis on accountability and compliance has resulted in the need for schools to carefully examine how programs, services, and policies impact student achievement (Bowers & Figgers, 2003). ^ Standard-based school reform and accountability systems have raised expectations about student learning outcomes for all students, including those with disabilities and minority students. Yet, overall, racial/ethnic minority students are performing well below their White non-Hispanic peers in most academic areas. Additionally, with respect to special education, there exists an enduring problem of disproportionate representation of racial/ethnic minority students (National Research Council, 2000). ^ This study examined classroom placement (inclusive versus non-inclusive) relative to academic performance of urban, low socioeconomic Hispanic students with and without disabilities in secondary content area classrooms. A mixed method research design was used to investigate this important issue using data from a local school district and results from field observations. The study compared performance levels of four middle school Hispanic student subgroups (students with disabilities in inclusive settings, students without disabilities in inclusive settings, students with disabilities in resource settings, and student without disabilities in general education settings) each in their respective placements for two consecutive years, exploring existing practices within authentic settings. ^ Significant differences were found in the relationship of educational placement and achievement between grade level and disability in the areas of math and reading. Additionally, clear and important differences were observed in student-teacher interactions. Recommendations for further researchers and stakeholders include soliciting responses from teams at the schools composed of general education and special education teachers, administrative personnel, and students as well as broadening the study across grade levels and exceptionalities. ^

Content Analysis of Outcome Assessment of Global Learning Foundations Courses: A Case Study

This study used content analysis to interpret and evaluate outcome evaluation matrices of undergraduate Global Learning foundations courses. The findings revealed a lack of uniformity in the faculty members’ interpretation and implementation of global learning components in the coursework. Successful teaching practices and challenges were identified and classified.

Two -way direction of influence in mother-infant interaction as denoted by concurrent reciprocal learning processes

This series of 5 single-subject studies used the operant conditioning paradigm to investigate, within the two-way influence process, how (a) contingent infant attention can reinforce maternal verbal behaviors during a period of mother-infant interaction and under subsequent experimental manipulation. Differential reinforcement was used to determine if it is possible that an infant attending to the mother (denoted by head-turns towards the image of the mother plus eye contact) increases (reinforces) the mother's verbal response (to a cue from the infant) upon which the infant behavior is contingent. There was also (b) an evaluation during the contrived parent-infant interaction for concurrent operant learning of infant vocal behavior via contingent verbal responding (reinforcement) implemented by the mother. Further, it was noted (c) whether or not the mother reported being aware that her responses were influenced by the infant's behavior. Findings showed: the operant conditioning of the maternal verbal behaviors were reinforced by contingent infant attention; and the operant conditioning of infant vocalizations was reinforced by contingent maternal verbal behaviors. No parent reported (1) being aware of the increase in their verbal response reinforced during operant conditioning of parental behavior nor a decrease in those responses during the DRA reversal phase, or (2) noticing a contingency between infant's and mother's response. By binomial 1-tail tests, the verbal-behavior patterns of the 5 mothers were conditioned by infant reinforcement (p < 0.02) and, concurrently, the vocal-response patterns of the 5 infants were conditioned by maternal reinforcement (p < 0.02). A program of systematic empirical research on the determinants of concurrent conditioning within mother-child interaction may provide a way to evaluate the differential effectiveness of interventions aimed at improving parent-child interactions. The work conducted in the present study is one step in this direction. ^

Moving toward change: Institutionalizing reform through implementation of the Learning Assistant model and Open Source Tutorials

Florida International University has undergone a reform in the introductory physics classes by focusing on the laboratory component of these classes. We present results from the secondary implementation of two research-based instructional strategies: the implementation of the Learning Assistant model as developed by the University of Colorado at Boulder and the Open Source Tutorial curriculum developed at the University of Maryland, College Park. We examine the results of the Force Concept Inventory (FCI) for introductory students over five years (n=872) and find that the mean raw gain of students in transformed lab sections was 0.243, while the mean raw gain of the traditional labs was 0.159, with a Cohen’s d effect size of 0.59. Average raw gains on the FCI were 0.243 for Hispanic students and 0.213 for women in the transformed labs, indicating that these reforms are not widening the gaps between underrepresented student groups and majority groups. Our results illustrate how research-based instructional strategies can be successfully implemented in a physics department with minimal department engagement and in a sustainable manner.

A study of the effects of a service-learning experience on student success at an urban community college

The purpose of this study was to explore the effects of a service-learning experience on student success as measured by class attendance, course completion, final course grades, and end-of-term evaluation data. Though many outcomes of service-learning experiences have been studied, including ethical values, self-esteem, student personal development, and career preparation, relatively few studies have been conducted on the effects of such experiences on academic achievement, and the studies that have been done have primarily studied students at traditional, four-year, residential universities. The study consisted of 286 students enrolled in six paired courses taught by five instructors at a community college in the Fall term 1996. One section of each pair (the control group) was taught using traditional subject matter and course materials and the other section of each pair (the treatment group) participated in a 20-hour required service- learning activity in addition to the regular course curriculum. The courses in the study included American History, Sociology, College Preparatory English, and Introduction to English Composition. The results of this study indicate that, overall, students who participated in a class in which service-learning was a requirement, achieved higher final course grades and reported greater satisfaction with the course, the instructor, the reading assignments, and the grading system, and the treatment section of one course pair had fewer absences. In addition, the faculty members reported that, in the treatment sections, class discussions were more stimulating, the sections seemed more vital in terms of student involvement, the students seemed more challenged academically, more motivated to learn, and seemed to exert more effort in the course.