Assessing the effectiveness of five-year mechanical engineering technology programs of junior colleges in Taiwan, R.O.C.: An application of the CIPP evaluation model

The purpose of this study was to evaluate the mechanical engineering technology curriculum effectiveness at the junior college in Taiwan by using the CIPP evaluation model. The study concerned the areas of the curriculum, curriculum materials, individualized instruction, support services, teaching effectiveness, student achievement, and job performance. A descriptive survey method was used with questionnaires for data collection from faculty, students, graduates, and employers.^ All categories of respondents tended to agree that the curriculum provides appropriate occupational knowledge and skills. Students, graduates, and faculty tended to be satisfied with the curriculum; faculty tended to be satisfied with student achievement; graduates tended to be satisfied with their job preparation; and employers were most satisfied with graduates' job performance.^ Conclusions were drawn in the context, input, process, and product of the CIPP model. In Context area: Students were dissatisfied with curriculum flexibility in students characteristics. Graduates were dissatisfied with curriculum design for student's adaptability in new economic and industrial conditions; practicum flexibility in student characteristics; and course overlap. Both students and graduates were dissatisfied with practicum credit hours. Both faculty and students were dissatisfied with the number of required courses.^ In Input area: Students, faculty, and graduates perceived audiovisuals and manipulative aids positively. Faculty and students perceive CAI implementation positively. Students perceived textbooks negatively.^ In Process area: Faculty, students, and graduates perceived all support service negatively. Faculty tended to perceive the ratios of graduates who enter advanced study and related occupation, and who passed the professional skills certification, negatively. Students tended to perceive teaching effectiveness in terms of instructional strategies, the quality of instruction, overall suitability, and receivable, negatively. Graduates also tended to identify the instructional strategies as a negative perception. Faculty and students perceived curriculum objectives and practicum negatively. Both faculty and students felt that instructors should be more interested in making the courses a useful learning experience.^ In Product area: Employers were satisfied with graduates' academic preparation and job performance, adaptability, punctuality, and their ability to communicate, cooperate, and meet organization needs. Graduates were weak in terms of equipment familiarity and supervisory ability.^ In sum, the curriculum of the five-year mechanical engineering technology programs of junior college in Taiwan has served adequately up to this time in preparing a work force to enter industry. It is now time to look toward the future and adapt the curriculum and instruction for the future needs of this high-tech society. ^

Assessing the effectiveness of two-year banking and insurance technology programs of junior colleges in Taiwan, R.O.C.: An application of the Context Input Process Product (CIPP) evaluation model

The purpose of this descriptive study was to evaluate the banking and insurance technology curriculum at ten junior colleges in Taiwan. The study focused on curriculum, curriculum materials, instruction, support services, student achievement and job performance. Data was collected from a diverse sample of faculty, students, alumni, and employers. ^ Questionnaires on the evaluation of curriculum at technical junior colleges were developed for use in this specific case. Data were collected from the sample described above and analyzed utilizing ANOVA, T-Tests and crosstabulations. Findings are presented which indicate that there is room for improvement in terms of meeting individual students' needs. ^ Using Stufflebeam's CIPP model for curriculum evaluation it was determined that the curriculum was adequate in terms of the knowledge and skills imparted to students. However, students were dissatisfied with the rigidity of the curriculum and the lack of opportunity to satisfy the individual needs of students. Employers were satisfied with both the academic preparation of students and their on the job performance. ^ In sum, the curriculum of the two-year banking and insurance technology programs of junior college in Taiwan was shown to have served adequately preparing a work force to enter businesses. It is now time to look toward the future and adapt the curriculum and instruction for the future needs of the ever evolving high-tech society. ^

Evaluation of a six-week professional education curriculum designed to retain registered psychiatric nurses

During the past few years there has been a drastic shortage of registered nurses in the field. The shortage appears to have affected the field of psychiatric mental health nursing most intensely. The psychiatric nursing shortage is a multifaceted problem grounded in decreasing federal funds for advanced clinical training, inadequate undergraduate psychiatric experiences, lack of a well prepared articulate role model, the integrated curriculum and the confusion and blurring associated with the roles and functions of the psychiatric mental health nurse.^ This dissertation will describe the current nursing shortage; the decline in enrollment to nursing programs; the history of psychiatric nursing as a discipline; the shortage of psychiatric mental health nurses; factors contributing to the psychiatric nursing shortage and a plan for a solution to the nursing shortage in psychiatry.^ The paper focuses on an evaluation conducted on an internship curriculum designed to facilitate effective nursing care in the treatment of clients who exhibit emotional problems. The purpose of this study was to attract and retain nurses to employment opportunities in four Hospital Corporation of America (HCA) facilities, using a six week internship program.^ The study will yield an analysis of the effect of combining psychodynamic principles and knowledge with skills in the clinical area. The demands of educational practice have been merged with the discipline of psychiatric nursing in the development of this curriculum. ^

Self-esteem and job satisfaction of adults with mild mental retardation in sheltered workshops and supported employment programs

A sample of 200 adults with mild mental retardation were assessed on overall job satisfaction and self-esteem using the Vocational Program Evaluation Profile and the Coopersmith Self-esteem Inventory. The subjects worked either in a sheltered workshop or in a supported employment setting. Results indicated that there was a significant relationship between self-esteem and job satisfaction for both groups of subjects. In addition, subjects who worked in supported employment reported significantly higher levels of job satisfaction also. There was also an interaction between place of residence and place of employment when looking at self-esteem; those who live in a semi-independent home and work in supported employment reported the highest levels of self-esteem. These results are discussed in terms of the social validity of supported-employment for persons with mild mental retardation. ^

An evaluation of English language instruction in universities/colleges in Taiwan

The purpose of this study is about to survey the effectiveness of English teaching in universities/colleges in Taiwan and provide suggestions to the educational authorities for upgrading or improving the English language teaching techniques or methods currently in use. On the one hand, the suggestions of English teachers in universities/colleges are the main concerns in this study. On the other hand, equal attention is given to the opinions and learning attitudes of the students, including the interaction between the teachers and the students.^ A social investigation methodology, consisting of questionnaire and data analysis, is devoted to this evaluation and analysis of teaching effectiveness. Among the significant findings reported in this study is the fact that both students and teachers consider evaluation of teaching effectiveness as a very important aspect of English Language programs at the university/college level. Another significant finding is that students are less concerned about the grades earned or awarded in English Language courses and more concerned about how much they learned in these classes.^ The analysis and suggestions based on the results for English teaching evaluation of universities/colleges in this dissertation can help teachers modify their teaching techniques and methods, the students to adjust their learning attitudes, and the authorities to schematize the English teaching plan that can facilitate the teaching goals to be realized. ^

Adult education directors' perceptions of performance indicators for adult education programs in the state of Florida

Current demands for accountability in education emphasize outcome-based program evaluation and tie program funding to individual student performance. As has been the case for elementary and secondary programs, demands for accountability have increased pressure on adult educators to show evidence of the benefits of their programs in order to justify their financial support. In Florida, recent legislation fundamentally changes the delivery of adult education in the state by establishing a performance-based funding system that is based on outcomes related to the retention, completion, and employment of program participants.^ A performance-based funding system requires an evaluation process that stresses outcome indicators over indicators that focus on program context or process. Although the state has adopted indicators of program quality to evaluate its adult education programs, these indicators focus mostly on program processes rather than student outcomes. In addition, the indicators are not specifically tied to workforce development outcomes, a priority to federal and local funding agents.^ Improving the accountability of adult education programs and defining the role of these programs in Florida's Workforce Development System has become a priority to policy makers across the state. Another priority has been to involve adult education practitioners in every step of this process.^ This study was conducted in order to determine what performance indicators, as judged by the directors and supervisors of adult education programs in the state of Florida, are important and feasible in measuring the quality and effectiveness of these programs. The results of the study indicated that, both statewide and by region, the respondents consistently gave the highest ratings on both importance and feasibility to the indicators of Program Context, which reflect the needs, composition, and structure of the programs, and to the indicators of Educational Gain, which reflect learner progress in the attainment of basic skills and competencies. In turn, the respondents gave the lowest ratings on both importance and feasibility to the indicators in the areas of Return on State's Investment, Efficiency, Retention, and Workforce Training. In general, the indicators that received high ratings for importance also received high ratings for feasibility. ^

Tobacco use prevention education (TUPE) programs in the state of Florida: Teachers' perceptions of program structure and effectiveness

This study described teacher perceptions of TUPE program effectiveness in Florida in an attempt to improve programs by identifying factors that might influence teacher motivation and performance. Very little work has been done to examine how teachers' perceptions are related to the effectiveness of TUPE programs. A statewide survey provided information about how teachers' perceptions of program effectiveness are affected by variables such as: program structure, barriers, tobacco use norms, and training variables. Data were obtained from a telephone survey conducted in Florida as part of the Tobacco Pilot Project (TPP). The sample included 296 middle school teachers and 282 high school teachers as well as 193 middle school principals and 190 high school principals. Correlational and hierarchical regression analyses identified correlates and predictors of teachers' ratings of effectiveness. Results suggest that use of peer leaders, more frequent evaluations, a higher degree of parent involvement, fewer barriers, greater student interest, and lower tolerance for tobacco use were correlated with higher ratings of program effectiveness. Furthermore, student interest, peer, staff, and community tolerance norms, peer leaders, program evaluation, and parent involvement predicted middle school teachers' perceptions. Parent tolerance, student interest, number of barriers, and more frequent program evaluation predicted high school teachers' perceptions. In addition, middle school teachers who reported a lower number of factors negatively associated with teacher receptivity were more likely to view TUPE programs more favorably than teachers who reported a greater number of these risk factors. This relationship was not as robust among the high school teacher sample. Differences between the middle and high school sample were found in the magnitude and number of significant correlations, the proportion of variance accounted for by predictor variables, and the strength of the relationship between the number of factors negatively associated with teacher receptivity and teachers' perceptions of TUPE effectiveness. These findings highlighted the importance of the timing, program features, and the external environment for enhancing or minimizing teachers' ratings of TUPE program effectiveness. In conclusion, significant increases in TUPE teachers' self-efficacy will occur through the participation of peers, parents, staff, and community leaders in different aspects of TUPE programs. ^

A follow-up outcome evaluation of independent living services for foster care youth

This study aimed to evaluate the effectiveness of the Independent Living (IL) program targeting foster youths to prepare them for effective adulthood. The study employed a pre-post, two-group comparative research design. The IL group was composed of 49 young adults who participated in the IL or SIL (subsidized IL) program prior to their emancipation from foster care (mean age, 20.6 years). The comparison was made up of 18 young adults who experienced foster care but never participated in the IL or SIL programs (mean age, 20.2 years). Data were collected via a mailed survey that included the Daniel Memorial Independent Living Assessment (DMILA) and an additional questionnaire developed by the researcher. The study also examined: (1) why youth in foster care do not participate in IL programs, (2) how participating youth evaluate IL services and what recommendations they make to improve services, and (3) the internal consistency of the DMILA. Results suggest that the DMILA assessment has mediocre reliability. IL program participation is associated with better educational, employment, income, housing, early parenting-prevention, transportation, anger control, criminal-prevention, and self-evaluation outcomes. However, IL participation is not associated with better social support, perceived parenting competence, substance abuse-prevention, sexual risk-prevention outcomes, increased knowledge in money management skills, job seeking and job maintenance skills, interpersonal skills, or lower depression. Results also suggest that the outreach activities of the IL program may be flawed. IL participants reported the IL program was doing best in educational preparation, criminal involvement prevention, and money management preparation and least well in parenting preparation, housing preparation, employment preparation, and substance abuse prevention. To improve services, youths recommended primarily that IL counselors develop closer relationships with youths, that IL training better address organizational skills, and that monthly subsidy be raised and SIL eligibility requirements softened. The study's political context and limitations are also discussed and implications are derived regarding prevention, intervention, outreach, mentorship, empowerment, cross-systems collaboration, and future research. ^

Toward understanding the study experience of culturally sensitive graduate students in *American distance education programs

The purpose of this research was to gain an understanding of the study experience of non-American graduate students living outside of the United States and formally engaged in graduate studies in an American Distance Education (DE) Program. These students have been labeled “culturally sensitive.” The nature of this study dictated a qualitative case study methodology using in-depth interviews to collect the data and the hermeneutic approach to understanding and description. This study aims at generating questions and hypotheses that will lead to further investigations that explore the need for cultural and contextual sensitivity in order to provide more equitable and accessible higher education for all. ^ The study attempted to answer the question: What is the study experience of “culturally sensitive” graduate students in American DE Programs? The underlying issue in this study is whether education designed and provided by educators of different socio-cultural backgrounds from that of the students could be content relevant and instructionally appropriate, resulting in educational enhancement and/or prepare students to function adequately in their own communities. ^ Participants in this study (n = 12) were engaged in Master's level (n = 2) and Doctoral level (n = 10) DE programs at American Universities, and were interviewed by E-mail, face-to-face, or using a combination of the two. Data analysis compared interviews and highlighted repetitive patterns. Interview data was triangulated with recent related literature and data from document reviews of archived E-mail conversations between students and their professors. The patterns that emerged were coded and categorized according to generative themes. The following themes were identified in order to analyze the data and confirmed through participant check-back: program benefits, communication, technology, culture and methodology, and reflectivity. ^ Major findings in this study indicate that culture plays an important role in cross-cultural encounters for students in American DE programs vis-à-vis student perceptions as to whether their study needs were being met. Most notably, it was found that the coupling of cultural perceptual differences with transactional distance created a potential barrier to communication that could affect short-term success in American DE programs. To overcome this barrier, students cited good communication as essential in meeting student's needs, especially those communications that were supportive and full of detail and context and from a primary source (ex. directly from the professor). Evaluation was a particularly sensitive issue, especially when students were unaware of their professor's cultural and contextual intricacies and therefore were uncertain about expectations and intended meaning. CSGS were aware of their position and the American rather than global context in which they were participating. Students appear to have developed “extended identities”, meaning that they acculturated in varying degrees in order to be successful in their program but that their local cultural identity was not compromised in any way. For participants from Venezuela access to higher DE has been a limiting factor to participation, due to the high cost of technology and telephone lines for communication. ^

TEACHNJ: An Evaluation of Two Years Implementation

The Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act was adopted by the New Jersey legislature in August 2012 with the intent to raise student achievement by improving the overall quality of instruction. As a result of this act, new teacher evaluation systems are being introduced in school districts across the state in an effort to more accurately assess teacher performance. The new teacher evaluations will be based on multiple classroom observations as well as the academic achievement of their students as measured on standardized tests. In addition, professional development opportunities are likely to change under this legislation, with schools customizing professional development programs to more effectively meet the needs of their teachers. The overarching question that informs our research is what impact will TEACH NJ have on the overall value of teacher evaluations and the quality of professional development opportunities offered to teachers. Data collected through survey research presents the pre-implementation practices (2011-2012 school year) as well as one year post-implementation practices (2013-2014) taking place in school districts throughout New Jersey. The findings reflect teachers’ perceptions of the value of the current teacher evaluation practices, the quality of the current professional development opportunities and the value the school administration places on teacher evaluations.

What factors influence persistence rates in active older adult group exercise programs?

The purpose of this research is to determine factors that influence the persistence rates of active older adults participating in group exercise classes. During the study, group participants and instructors in a Florida facility were asked to respond to surveys ascertaining motivational factors regarding participation in active older adult classes. Utilizing participant data, instructors were given a professional development course as part of the treatment. Data indicates participants prefer working in group settings to prevent health related illness, for socialization, and for instructors. Research demonstrates that the instructor plays a critical role in advancing exercise understanding and providing motivation that encourages participants to attend classes. Instructor response included a heightened awareness of motivational factors and a determination to improve standards.

Program evaluation primer: A review of three evaluations

Program evaluation—a “tool used to assess the implementation and outcomes of a program, to increase a program’s efficiency and impact over time, and to demonstrate accountability” (MacDonald et. al, 2001, p. 1)—is an essential process to program assessment and improvement. This paper overviews three published program evaluations and considers important aspects of program evaluation more broadly.