Fourth generation evaluation revisited: Testing a revised pause model

This research provides data which investigates the feasibility of using fourth generation evaluation during the process of instruction. A semester length course entitled "Multicultural Communications", (PUR 5406/4934) was designed and used in this study, in response to the need for the communications profession to produce well-trained culturally sensitive practitioners for the work force and the market place. A revised pause model consisting of three one-on-one indepth interviews conducted outside of the class, three reflections periods during the class and a self-reflective essay prepared one week before the end of the course was analyzed. Narrative and graphic summaries of participant responses produced significant results. The revised pause model was found to be an effective evaluation method for use in multicultural education under certain conditions as perceived by the participants in the study. participant self-perceived behavior change and knowledge acquisition was identified through use of the revised pause model. Study results suggest that by using the revised pause model of evaluation, instructors teaching multicultural education in schools of journalism and mass communication is yet another way of enhancing their ability to become both the researcher and the research subject. In addition, the introduction of a qualitative model has been found to be a more useful way of generating participant involvement and introspection. Finally, the instructional design of the course used in the study provides communication educators with a practical way of preparing their students be effective communicators in a multicultural world.

Assessing the effectiveness of five-year mechanical engineering technology programs of junior colleges in Taiwan, R.O.C.: An application of the CIPP evaluation model

The purpose of this study was to evaluate the mechanical engineering technology curriculum effectiveness at the junior college in Taiwan by using the CIPP evaluation model. The study concerned the areas of the curriculum, curriculum materials, individualized instruction, support services, teaching effectiveness, student achievement, and job performance. A descriptive survey method was used with questionnaires for data collection from faculty, students, graduates, and employers.^ All categories of respondents tended to agree that the curriculum provides appropriate occupational knowledge and skills. Students, graduates, and faculty tended to be satisfied with the curriculum; faculty tended to be satisfied with student achievement; graduates tended to be satisfied with their job preparation; and employers were most satisfied with graduates' job performance.^ Conclusions were drawn in the context, input, process, and product of the CIPP model. In Context area: Students were dissatisfied with curriculum flexibility in students characteristics. Graduates were dissatisfied with curriculum design for student's adaptability in new economic and industrial conditions; practicum flexibility in student characteristics; and course overlap. Both students and graduates were dissatisfied with practicum credit hours. Both faculty and students were dissatisfied with the number of required courses.^ In Input area: Students, faculty, and graduates perceived audiovisuals and manipulative aids positively. Faculty and students perceive CAI implementation positively. Students perceived textbooks negatively.^ In Process area: Faculty, students, and graduates perceived all support service negatively. Faculty tended to perceive the ratios of graduates who enter advanced study and related occupation, and who passed the professional skills certification, negatively. Students tended to perceive teaching effectiveness in terms of instructional strategies, the quality of instruction, overall suitability, and receivable, negatively. Graduates also tended to identify the instructional strategies as a negative perception. Faculty and students perceived curriculum objectives and practicum negatively. Both faculty and students felt that instructors should be more interested in making the courses a useful learning experience.^ In Product area: Employers were satisfied with graduates' academic preparation and job performance, adaptability, punctuality, and their ability to communicate, cooperate, and meet organization needs. Graduates were weak in terms of equipment familiarity and supervisory ability.^ In sum, the curriculum of the five-year mechanical engineering technology programs of junior college in Taiwan has served adequately up to this time in preparing a work force to enter industry. It is now time to look toward the future and adapt the curriculum and instruction for the future needs of this high-tech society. ^

Assessing the effectiveness of two-year banking and insurance technology programs of junior colleges in Taiwan, R.O.C.: An application of the Context Input Process Product (CIPP) evaluation model

The purpose of this descriptive study was to evaluate the banking and insurance technology curriculum at ten junior colleges in Taiwan. The study focused on curriculum, curriculum materials, instruction, support services, student achievement and job performance. Data was collected from a diverse sample of faculty, students, alumni, and employers. ^ Questionnaires on the evaluation of curriculum at technical junior colleges were developed for use in this specific case. Data were collected from the sample described above and analyzed utilizing ANOVA, T-Tests and crosstabulations. Findings are presented which indicate that there is room for improvement in terms of meeting individual students' needs. ^ Using Stufflebeam's CIPP model for curriculum evaluation it was determined that the curriculum was adequate in terms of the knowledge and skills imparted to students. However, students were dissatisfied with the rigidity of the curriculum and the lack of opportunity to satisfy the individual needs of students. Employers were satisfied with both the academic preparation of students and their on the job performance. ^ In sum, the curriculum of the two-year banking and insurance technology programs of junior college in Taiwan was shown to have served adequately preparing a work force to enter businesses. It is now time to look toward the future and adapt the curriculum and instruction for the future needs of the ever evolving high-tech society. ^

An empirical study of Kirkpatrick's evaluation model in the hospitality industry

This study examined Kirkpatrick’s training evaluation model (Kirkpatrick & Kirkpatrick, 2006) by assessing a sales training program conducted at an organization in the hospitality industry. The study assessed the employees’ training outcomes of knowledge and skills, job performance, and the impact of the training upon the organization. By assessing these training outcomes and their relationships, the study demonstrated whether Kirkpatrick’s theories are supported and the lower evaluation levels can be used to predict organizational impact. The population for this study was a group of reservations sales agents from a leading luxury hotel chain’s reservations center. During the study period from January 2005 to May 2007, there were 335 reservations sales agents employed in this Global Reservations Center (GRC). The number of reservations sales agents who had completed a sales training program/intervention during this period and had data available for at least two months pre and post training composed the sample for this study. The number of agents was 69 ( N = 69). Four hypotheses were tested through paired-samples t tests, correlation, and hierarchical regression analytic procedures. Results from the analyses supported the hypotheses in this study. The significant improvement in the call score supported hypothesis one that the reservations sales agents who completed the training improved their knowledge of content and required skills in handling calls (Level 2). Hypothesis two was accepted in part as there was significant improvement in call conversion, but there was no significant improvement of time usage. The significant improvement in the sales per call supported hypothesis three that the reservations agents who completed the training contributed to increased organizational impact (Level 4), i.e., made significantly more sales. Last, findings supported hypothesis four that Level 2 and Level 3 variables can be used for predicting Level 4 organizational impact. The findings supported the theory of Kirkpatrick’s evaluation model that in order to expect organizational results, a positive change in behavior (job performance) and learning must occur. The examinations of Levels 2 and 3 helped to partially explain and predict Level 4 results.

Evaluation of the ECOSSE model for simulating soil organic carbon under Miscanthus and short rotation coppice-willow crops in Britain

Acknowledgements This work contributes to the ELUM (Ecosystem Land Use Modelling & Soil Carbon GHG Flux Trial) project, which was commissioned and funded by the Energy Technologies Institute (ETI). We acknowledge the E-OBS data set from the EU-FP6 project ENSEMBLES (http://ensembles-eu.metoffice.com) and the data providers in the ECA&D project (http://www.ecad.eu).

Communities of practice as professional and organizational development strategy in local public health organizations in Québec, Canada : an evaluation model

Communities of practice (CoPs) are among the professional development strategies most widely used in such fields as management and education. Though the approach has elicited keen interest, knowledge pertaining to its conceptual underpinnings is still limited, thus hindering proper assessment of CoPs' effects and the processes generating the latter. To address this shortcoming, this paper presents a conceptual model that was developed to evaluate an initiative based on a CoP strategy: Health Promotion Laboratories are a professional development intervention that was implemented in local public health organizations in Montreal (Quebec, Canada). The model is based on latest theories on work-group effectiveness and organizational learning and can be usefully adopted by evaluators who are increasingly called upon to illuminate decision-making about CoPs. Ultimately, validation of this conceptual model will help advance knowledge and practice pertaining to CoPs as well as professional and organizational development strategies in public health.

Performance Evaluation of a Statistical and a Neural Network Model for Nonrigid Shape-Based Registration

Shape-based registration methods frequently encounters in the domains of computer vision, image processing and medical imaging. The registration problem is to find an optimal transformation/mapping between sets of rigid or nonrigid objects and to automatically solve for correspondences. In this paper we present a comparison of two different probabilistic methods, the entropy and the growing neural gas network (GNG), as general feature-based registration algorithms. Using entropy shape modelling is performed by connecting the point sets with the highest probability of curvature information, while with GNG the points sets are connected using nearest-neighbour relationships derived from competitive hebbian learning. In order to compare performances we use different levels of shape deformation starting with a simple shape 2D MRI brain ventricles and moving to more complicated shapes like hands. Results both quantitatively and qualitatively are given for both sets.

Cytotoxicity Evaluation of Si-Diatom Frustules in a Mouse Model

Silica additives in bone substitute materials are topical, clinically interesting and have significant support in the Orthopaedic field. Biosilica, e.g isolated from diatoms, has many advantages over its synthetic counterparts, e.g. it is amorphous, thus will be absorbed by the body, however, issues such as purity, presence of endotoxins and cytotoxicity need to be addressed before it can be further exploited. Biosilica isolated from Cyclotella Meneghiniana was then tested in a mouse model, to test the immunological response, organ toxicity (kidney, spleen, liver) and route of metabolism/excretion of silica. Five-week-old Balb-c mice were injected subcutaneously with a single high dose (50mg/ml) of Si-frustules, Si-frustules + organic linker and vehicle only control. Animals were sacrificed at 1d and 28d. The animal studies were conducted under an ethically approved protocol at Queen’s University, Belfast. The animals showed no adverse stress during the experiment and remained healthy until sacrifice. Blood results using ICP-OES analysis suggest the frustules were metabolized between comparator groups at different rates, and clearly showed elevated levels of silicon in groups injected with frustules relative to control. The histology of organs showed no variation in morphology of mice injected frustules relative compared to the control group.
Acknowledgements: The authors would like to thank Marie Curie International Outgoing Fellowships from the EU and Beaufort Marine Biodiscovery Award as part of the Marine Biotechnology Ireland Programme for providing financial support to this project.

Evaluation, Selection and Planning the Implementation of a Pavement Management Optimization Model: Optimization Recommendations, 1994

This document briefly summarizes the pavement management activities under the existing Iowa Department of Transportation (DOT) Pavement Management System. The second part of the document provides projected increase in use due to the implementation of the Iowa DOT Pavement Management Optimization System. All estimates of existing time devoted to the Pavement Management System and project increases in time requirements are estimates made by the appropriate Iowa DOT office director or function manager. Included is the new Pavement Management Optimization Structure for the three main offices which will work most closely with the Pavement Management Optimization System (Materials, Design, and Program Management).

Evaluation, Selection and Planning the Implementation of a Pavement Management Optimization Model, Phase II Report, 1994

The missions of the research are to assist the Iowa Department of Transortation (Iowa DOT) to: Define pavement management (PM) optimization; Identify the characteristics of PM optimization systems being developed or implemented; Identify specific and achievable objectives for the Iowa DOT pavement management optimization; Evaluate different PM optimization methodologies; Identify a methodology to perform PM optimization that best satisfies the Iowa DOT's objectives; Develop a plan for the implementation of the PM optimization selected. The project is divided into three (3) phases. The first phase has been completed and accomplished the first three missions (identified above). The second phase has been completed and accomplished the next two missions. Phase three will accomplish the last mission.

Nonparametric Evaluation of Quantitative Traits in Population-Based Association Studies when the Genetic Model is Unknown

Statistical association between a single nucleotide polymorphism (SNP) genotype and a quantitative trait in genome-wide association studies is usually assessed using a linear regression model, or, in the case of non-normally distributed trait values, using the Kruskal-Wallis test. While linear regression models assume an additive mode of inheritance via equi-distant genotype scores, Kruskal-Wallis test merely tests global differences in trait values associated with the three genotype groups. Both approaches thus exhibit suboptimal power when the underlying inheritance mode is dominant or recessive. Furthermore, these tests do not perform well in the common situations when only a few trait values are available in a rare genotype category (disbalance), or when the values associated with the three genotype categories exhibit unequal variance (variance heterogeneity). We propose a maximum test based on Marcus-type multiple contrast test for relative effect sizes. This test allows model-specific testing of either dominant, additive or recessive mode of inheritance, and it is robust against variance heterogeneity. We show how to obtain mode-specific simultaneous confidence intervals for the relative effect sizes to aid in interpreting the biological relevance of the results. Further, we discuss the use of a related all-pairwise comparisons contrast test with range preserving confidence intervals as an alternative to Kruskal-Wallis heterogeneity test. We applied the proposed maximum test to the Bogalusa Heart Study dataset, and gained a remarkable increase in the power to detect association, particularly for rare genotypes. Our simulation study also demonstrated that the proposed non-parametric tests control family-wise error rate in the presence of non-normality and variance heterogeneity contrary to the standard parametric approaches. We provide a publicly available R library nparcomp that can be used to estimate simultaneous confidence intervals or compatible multiplicity-adjusted p-values associated with the proposed maximum test.

The natural pilot model for flight proficiency evaluation

Cover title.

Evaluation of the conductor-like screening model for real solvents for the prediction of the water activity coefficient at infinite dilution in ionic liquids

Ionic liquids (ILs) have attracted great attention, from both industry and academia, as alternative fluids for very different types of applications. The large number of cations and anions allow a wide range of physical and chemical characteristics to be designed. However, the exhaustive measurement of all these systems is impractical, thus requiring the use of a predictive model for their study. In this work, the predictive capability of the conductor-like screening model for real solvents (COSMO-RS), a model based on unimolecular quantum chemistry calculations, was evaluated for the prediction water activity coefficient at infinite dilution, gamma(infinity)(w), in several classes of ILs. A critical evaluation of the experimental and predicted data using COSMO-RS was carried out. The global average relative deviation was found to be 27.2%, indicating that the model presents a satisfactory prediction ability to estimate gamma(infinity)(w) in a broad range of ILs. The results also showed that the basicity of the ILs anions plays an important role in their interaction with water, and it considerably determines the enthalpic behavior of the binary mixtures composed by Its and water. Concerning the cation effect, it is possible to state that generally gamma(infinity)(w) increases with the cation size, but it is shown that the cation-anion interaction strength is also important and is strongly correlated to the anion ability to interact with water. The results here reported are relevant in the understanding of ILs-water interactions and the impact of the various structural features of its on the gamma(infinity)(w) as these allow the development of guidelines for the choice of the most suitable lLs with enhanced interaction with water.