An empirical study of Kirkpatrick's evaluation model in the hospitality industry

This study examined Kirkpatrick’s training evaluation model (Kirkpatrick & Kirkpatrick, 2006) by assessing a sales training program conducted at an organization in the hospitality industry. The study assessed the employees’ training outcomes of knowledge and skills, job performance, and the impact of the training upon the organization. By assessing these training outcomes and their relationships, the study demonstrated whether Kirkpatrick’s theories are supported and the lower evaluation levels can be used to predict organizational impact. The population for this study was a group of reservations sales agents from a leading luxury hotel chain’s reservations center. During the study period from January 2005 to May 2007, there were 335 reservations sales agents employed in this Global Reservations Center (GRC). The number of reservations sales agents who had completed a sales training program/intervention during this period and had data available for at least two months pre and post training composed the sample for this study. The number of agents was 69 ( N = 69). Four hypotheses were tested through paired-samples t tests, correlation, and hierarchical regression analytic procedures. Results from the analyses supported the hypotheses in this study. The significant improvement in the call score supported hypothesis one that the reservations sales agents who completed the training improved their knowledge of content and required skills in handling calls (Level 2). Hypothesis two was accepted in part as there was significant improvement in call conversion, but there was no significant improvement of time usage. The significant improvement in the sales per call supported hypothesis three that the reservations agents who completed the training contributed to increased organizational impact (Level 4), i.e., made significantly more sales. Last, findings supported hypothesis four that Level 2 and Level 3 variables can be used for predicting Level 4 organizational impact. The findings supported the theory of Kirkpatrick’s evaluation model that in order to expect organizational results, a positive change in behavior (job performance) and learning must occur. The examinations of Levels 2 and 3 helped to partially explain and predict Level 4 results.

An evaluation of child welfare inservice training: The relative effectiveness of substance abuse content in improving worker knowledge and attitudes

Given the seriousness of substance abuse as a child welfare problem, the purpose of this study was to examine the relative effectiveness of an inservice training curriculum for child welfare workers. The training was designed to improve worker knowledge and attitudes in working with substance abusing families. Seventy (70) child welfare workers from public and private agencies in two south Florida counties participated in a pretest/posttest control group design that also trained and retested the control group. The literature review supports that the general preparedness of child welfare workers for the issues presented by substance abusing families is in question. Confounding this problem is a lack of understanding of substance abuse dynamics, worker biases, and predispositions. The two research hypotheses focused on whether inservice training could increase worker knowledge and improve worker attitudes in working with this population. Training delivery was in the form of a five-day inservice focusing on an array of substance abuse knowledge and attitudinal topics. Separate knowledge and attitude instruments were developed for the research and were administered, before and after training, to a purposive sample of participants that were randomly assigned to the experimental and control groups. The data analysis supported the research hypotheses but raised a question. Specifically, the experimental group demonstrated significant improvement in posttest scores on both instruments after receiving the training; whereas the control group, with training withheld, also demonstrated a significant improvement at posttest, but only on the knowledge instrument. Although the question was unanswered, when examined at a more critical significance level, only the experimental group remained significant. The hypotheses were reconfirmed when, after training and retesting, the control group also displayed significant improvement on both instruments. The findings support the conclusion that this substance abuse inservice was effective in improving worker knowledge and attitudes regarding working with substance abusing families. As an implication for social work practice, it suggests that similar inservice training can be a viable training resource when formal substance abuse training is unavailable. Additional research is suggested regarding to what degree increased substance abuse knowledge and improved worker attitudes correlate with improved practice.

The Creation and Evaluation of Novel Canine Training Aids for Cocaine Using Molecularly Encapsulated Sol-Gel Polymers and an Investigation of Canine Field Accuracy

Biological detectors, such as canines, are valuable tools used for the rapid identification of illicit materials. However, recent increased scrutiny over the reliability, field accuracy, and the capabilities of each detection canine is currently being evaluated in the legal system. For example, the Supreme Court case, State of Florida v. Harris, discussed the need for continuous monitoring of canine abilities, thresholds, and search capabilities. As a result, the fallibility of canines for detection was brought to light, as well as a need for further research and understanding of canine detection. This study is two-fold, as it looks to not only create new training aids for canines that can be manipulated for dissipation control, but also investigates canine field accuracy to objects with similar odors to illicit materials. It was the goal of this research to improve upon current canine training aid mimics. Sol-gel polymer training aids, imprinted with the active odor of cocaine, were developed. This novel training aid improved upon the longevity of currently existing training aids, while also provided a way to manipulate the polymer network to alter the dissipation rate of the imprinted active odors. The manipulation of the polymer network could allow handlers to control the abundance of odors presented to their canines, familiarizing themselves to their canine’s capabilities and thresholds, thereby increasing the canines’ strength in court. The field accuracy of detection canines was recently called into question during the Supreme Court case, State of Florida v. Jardines, where it was argued that if cocaine’s active odor, methyl benzoate, was found to be produced by the popular landscaping flower, snapdragons, canines will false alert to said flowers. Therefore, snapdragon flowers were grown and tested both in the laboratory and in the field to determine the odors produced by snapdragon flowers; the persistence of these odors once flowers have been cut; and whether detection canines will alert to both growing and cut flowers during a blind search scenario. Results revealed that although methyl benzoate is produced by snapdragon flowers, certified narcotics detection canines can distinguish cocaine’s odor profile from that of snapdragon flowers and will not alert.

Evaluation of the Scent Collection System for Its Effectiveness in Volatile Organic Compound Collection and Use in Canine Training

As a result of increased terrorist activity around the world, the development of a canine training aid suitable for daily military operations is necessary to provide effective canine explosive detection. Since the use of sniffer dogs has proven to be a reliable resource for the rapid detection of explosive volatiles organic compounds, the present study evaluated the ability of the Human Scent Collection System (HSCS) device for the creation of training aids for plasticized / tagged explosives, nitroglycerin and TNT containing explosives, and smokeless powders for canine training purposes. Through canine field testing, it was demonstrated that volatiles dynamically collected from real explosive material provided a positive canine response showing the effectiveness of the HSCS in creating canine training aids that can be used immediately or up to several weeks (3) after collection under proper storage conditions. These reliable non-hazardous training aids allow its use in areas where real explosive material aids are not practical and/or available.

The creation and evaluation of novel canine training aids for cocaine using molecularly encapsulated sol-gel polymers and an investigation of canine field accuracy

Biological detectors, such as canines, are valuable tools used for the rapid identification of illicit materials. However, recent increased scrutiny over the reliability, field accuracy, and the capabilities of each detection canine is currently being evaluated in the legal system. For example, the Supreme Court case, State of Florida v. Harris, discussed the need for continuous monitoring of canine abilities, thresholds, and search capabilities. As a result, the fallibility of canines for detection was brought to light, as well as a need for further research and understanding of canine detection. This study is two-fold, as it looks to not only create new training aids for canines that can be manipulated for dissipation control, but also investigates canine field accuracy to objects with similar odors to illicit materials. ^ It was the goal of this research to improve upon current canine training aid mimics. Sol-gel polymer training aids, imprinted with the active odor of cocaine, were developed. This novel training aid improved upon the longevity of currently existing training aids, while also provided a way to manipulate the polymer network to alter the dissipation rate of the imprinted active odors. The manipulation of the polymer network could allow handlers to control the abundance of odors presented to their canines, familiarizing themselves to their canine’s capabilities and thresholds, thereby increasing the canines’ strength in court.^ The field accuracy of detection canines was recently called into question during the Supreme Court case, State of Florida v. Jardines, where it was argued that if cocaine’s active odor, methyl benzoate, was found to be produced by the popular landscaping flower, snapdragons, canines will false alert to said flowers. Therefore, snapdragon flowers were grown and tested both in the laboratory and in the field to determine the odors produced by snapdragon flowers; the persistence of these odors once flowers have been cut; and whether detection canines will alert to both growing and cut flowers during a blind search scenario. Results revealed that although methyl benzoate is produced by snapdragon flowers, certified narcotics detection canines can distinguish cocaine’s odor profile from that of snapdragon flowers and will not alert.^

Evaluation of a six-week professional education curriculum designed to retain registered psychiatric nurses

During the past few years there has been a drastic shortage of registered nurses in the field. The shortage appears to have affected the field of psychiatric mental health nursing most intensely. The psychiatric nursing shortage is a multifaceted problem grounded in decreasing federal funds for advanced clinical training, inadequate undergraduate psychiatric experiences, lack of a well prepared articulate role model, the integrated curriculum and the confusion and blurring associated with the roles and functions of the psychiatric mental health nurse.^ This dissertation will describe the current nursing shortage; the decline in enrollment to nursing programs; the history of psychiatric nursing as a discipline; the shortage of psychiatric mental health nurses; factors contributing to the psychiatric nursing shortage and a plan for a solution to the nursing shortage in psychiatry.^ The paper focuses on an evaluation conducted on an internship curriculum designed to facilitate effective nursing care in the treatment of clients who exhibit emotional problems. The purpose of this study was to attract and retain nurses to employment opportunities in four Hospital Corporation of America (HCA) facilities, using a six week internship program.^ The study will yield an analysis of the effect of combining psychodynamic principles and knowledge with skills in the clinical area. The demands of educational practice have been merged with the discipline of psychiatric nursing in the development of this curriculum. ^

Mindmapping as an adult learning notetaking strategy to increase the encoding of information in a corporate training course

A study was conducted to investigate the effectiveness, as measured by performance on course posttests, of mindmapping versus traditional notetaking in a corporate training class. The purpose of this study was to increase knowledge concerning the effectiveness of mindmapping as an information encoding tool to enhance the effectiveness of learning. Corporations invest billions of dollars, annually, in training programs. Given this increased demand for effective and efficient workplace learning, continual reliance on traditional notetaking is questionable for the high-speed and continual learning required on workers.^ An experimental, posttest-only control group design was used to test the following hypotheses: (1) there is no significant difference in posttest scores on an achievement test, administered immediately after the course, between adult learners using mindmapping versus traditional notetaking methods in a training lecture, and (2) there is no significant difference in posttest scores on an achievement test, administered 30 days after the course, between adult learners using mindmapping versus traditional notetaking methods in a training lecture. After a 1.5 hour instruction on mindmapping, the treatment group used mindmapping throughout the course. The control group used traditional notetaking. T-tests were used to determine if there were significant differences between mean posttest scores between the two groups. In addition, an attitudinal survey, brain hemisphere dominance survey, course dynamics observations, and course evaluations were used to investigate preference for mindmapping, its perceived effect on test performance, and the effectiveness of mindmapping instruction.^ This study's principal finding was that although the mindmapping group did not perform significantly higher on posttests administered immediately and 30 days after the course, than the traditional notetaking group, the mindmapping group did score higher on both posttests and reported higher ratings of the course on every evaluation criteria. Lower educated, right brain dominant learners reported a significantly positive learning experience. These results suggest that mindmapping enhances and reinforces the preconditions of learning. Recommendations for future study are provided. ^

The effectiveness of training educators on their ability to identify function of problem behavior

The purpose of this study was to investigate the effectiveness of training educators in the pre-behavioral intervention process of functional behavioral assessment. An original evaluation instrument was developed entitled, The Survey for Students Exhibiting Challenging Behavior. The instrument included measures of participating educators, knowledge of function of problem behavior and their ability to generate recommendations for a behavior intervention plan. The instrument was distributed to schools in a large urban district and completed by special educators. Educators trained and untrained in the functional behavioral assessment process were compared in the study. ^ The study incorporated a post-test only design. All instruments were analyzed using a factorial ANOVA. Those educators who were trained in the district functional behavioral assessment program answered general questions related to function of problem behavior significantly better than those who did not receive training. There is no significant difference between educators on their ability to generate recommendations for behavior intervention plans. It is important that educators receive training in functional behavioral assessment to gain an understanding of the basic notions being function of problem behavior. Current training does not translate into educators' ability to make strong recommendations for behavior intervention plans. ^

A follow-up outcome evaluation of independent living services for foster care youth

This study aimed to evaluate the effectiveness of the Independent Living (IL) program targeting foster youths to prepare them for effective adulthood. The study employed a pre-post, two-group comparative research design. The IL group was composed of 49 young adults who participated in the IL or SIL (subsidized IL) program prior to their emancipation from foster care (mean age, 20.6 years). The comparison was made up of 18 young adults who experienced foster care but never participated in the IL or SIL programs (mean age, 20.2 years). Data were collected via a mailed survey that included the Daniel Memorial Independent Living Assessment (DMILA) and an additional questionnaire developed by the researcher. The study also examined: (1) why youth in foster care do not participate in IL programs, (2) how participating youth evaluate IL services and what recommendations they make to improve services, and (3) the internal consistency of the DMILA. Results suggest that the DMILA assessment has mediocre reliability. IL program participation is associated with better educational, employment, income, housing, early parenting-prevention, transportation, anger control, criminal-prevention, and self-evaluation outcomes. However, IL participation is not associated with better social support, perceived parenting competence, substance abuse-prevention, sexual risk-prevention outcomes, increased knowledge in money management skills, job seeking and job maintenance skills, interpersonal skills, or lower depression. Results also suggest that the outreach activities of the IL program may be flawed. IL participants reported the IL program was doing best in educational preparation, criminal involvement prevention, and money management preparation and least well in parenting preparation, housing preparation, employment preparation, and substance abuse prevention. To improve services, youths recommended primarily that IL counselors develop closer relationships with youths, that IL training better address organizational skills, and that monthly subsidy be raised and SIL eligibility requirements softened. The study's political context and limitations are also discussed and implications are derived regarding prevention, intervention, outreach, mentorship, empowerment, cross-systems collaboration, and future research. ^

An evaluation of a curriculum response to the State of Florida mandate for computer literacy at a large comprehensive high school in Dade County, Florida

Minimum Student Performance Standards in Computer Literacy and Science were passed by the Florida Legislature through the Educational Reform Act of 1983. This act mandated that all Florida high school graduates receive training in computer literacy. Schools and school systems were charged with the task of determining the best methods to deliver this instruction to their students. The scope of this study is to evaluate one school's response to the state of Florida's computer literacy mandate. The study was conducted at Miami Palmetto Senior High School, located in Dade County, Florida. The administration of Miami Palmetto Senior High School chose to develop and implement a new program to comply with the state mandate - integrating computer literacy into the existing biology curriculum. The study evaluated the curriculum to determine if computer literacy could be integrated successfully and meet both the biology and computer literacy objectives. The findings in this study showed that there were no significant differences between biology scores of the students taking the integrated curriculum and those taking a traditional curriculum of biology. Student in the integrated curriculum not only met the biology objectives as well as those in the traditional curriculum, they also successfully completed the intended objectives for computer literacy. Two sets of objectives were successfully completed in the integrated classes in the same amount of time used to complete one set of objectives in the traditional biology classes. Therefore, integrated curriculum was the more efficient means of meeting the intended objectives of both biology and computer literacy.