Evaluating End-User Training Effectiveness in ERP System Implementation

Today’s business world demands more and more internal and external integration and transparency among companies at all fields. Integrated ERP (enterprise resource planning) systems offer a possibility to improve business practices and procedures by providing a unified view on the business including all functions and departments. Due to the obvious benefits, the popularity of integrated ERP systems keeps growing. The implementation of ERP systems has however proven risky. The implementation projects tend to be long, extensive, and costly – and often they end up in a failure. Due to the significant task and role changes ERP implementation brings to almost everybody in the company, training has been identified as one of the most critical success factors of an ERP implementation. To ensure that the training is conducted in the most effective and successful manner, the training outcomes should be evaluated. So far, training evaluation has however gained only limited attention at most companies investing in different training programs. Uponor corporation has initiated a large ERP implementation and process harmonization program in 2004. Thousands of end-users have been trained during this project so far, and the work still continues until the project is completed in 2010. In this thesis, the evaluation of end-user training in Uponor’s ERP program is brought further from the current state of performing the basic participant satisfaction survey in the end of each class. The results show that in order to reach reliable training effectiveness evaluation results, not only the reaction towards training but also transfer of skills and attitudes and the final results of the training program should be evaluated.

Cost-effectiveness analysis of a European primary-care physician training in smoking cessation counseling.

BACKGROUND: Physician training in smoking cessation counseling has been shown to be effective as a means to increase quit success. We assessed the cost-effectiveness ratio of a smoking cessation counseling training programme. Its effectiveness was previously demonstrated in a cluster randomized, control trial performed in two Swiss university outpatients clinics, in which residents were randomized to receive training in smoking interventions or a control educational intervention. DESIGN AND METHODS: We used a Markov simulation model for effectiveness analysis. This model incorporates the intervention efficacy, the natural quit rate, and the lifetime probability of relapse after 1-year abstinence. We used previously published results in addition to hospital service and outpatient clinic cost data. The time horizon was 1 year, and we opted for a third-party payer perspective. RESULTS: The incremental cost of the intervention amounted to US$2.58 per consultation by a smoker, translating into a cost per life-year saved of US$25.4 for men and 35.2 for women. One-way sensitivity analyses yielded a range of US$4.0-107.1 in men and US$9.7-148.6 in women. Variations in the quit rate of the control intervention, the length of training effectiveness, and the discount rate yielded moderately large effects on the outcome. Variations in the natural cessation rate, the lifetime probability of relapse, the cost of physician training, the counseling time, the cost per hour of physician time, and the cost of the booklets had little effect on the cost-effectiveness ratio. CONCLUSIONS: Training residents in smoking cessation counseling is a very cost-effective intervention and may be more efficient than currently accepted tobacco control interventions.

The Effectiveness of a Voice Training Program for Telemarketers

Purpose. To use a randomized design to evaluate the effectiveness of voice training programs for telemarketers via multidimensional analysis. Methods. Forty-eight telemarketers were randomly assigned to two groups: voice training group (n = 14) who underwent training over an 8-week period and a nontraining control group (n = 34). Before and after training, recordings of the sustained vowel /epsilon/ and connected were collected for acoustic and perceptual analyses. Results. Based on pre- and posttraining comparisons, the voice training group presented with a significant reduction in percent jitter (P = 0.044). No other significant differences were observed, and inter-rater reliability varied from poor to fair. Conclusions. These findings suggest that voice training improved a single acoustic dimension, but do not change perceptual dimension of telemarketers' voices.

Increasing intercultural competence and tolerance in multicultural schools: A Training Program and its effectiveness

This study reports the implementation of a Training of Intercultural Competence and Tolerance (TICT) for upper-secondary school students and the empirical evaluation of its effectiveness. The TICT program was developed to counteract increasing interethnic conflicts in the North Caucasus Federal District of Russia. It is based on the theoretical and empirical framework of social psychology and cross-cultural psychology. The training effectiveness was assessed by conducting pre- and post-surveys among the training participants. The results indicate that TICT contributes to the development of a positive ethnic identity and the formation of a civic identity among the participating youth. It also increases their optimism regarding the future of interethnic relations in Russia and the subjective level of intercultural competence of majority group youth towards minority cultures. Thus, the evaluation of the training effectiveness of the TICT has shown that the aims of the training have been achieved to a large extent and that the Training of Intercultural Competence and Tolerance can be effectively used to prevent interethnic conflicts and promote interethnic relations in multicultural schools. Suggestions for the practical implementation of the TICT as well as for future research on the training's effectiveness are discussed.

Family Health Strategy professionals' view on the effects of Hansen's disease training

OBJECTIVEEvaluating how professionals of family health teams from three municipalities of Pernambuco perceive and interpret the effects of Hansen's disease training.METHODSA qualitative study using the perspective of Habermas. Six focus groups, totaling 33 nurses and 22 doctors were formed. The guide consisted of: reactions to training, learning, transfer of knowledge and organizational results.RESULTSThere were recurrent positive opinions on instructor performance, course materials, and an alert attitude to the occurrence of cases; the negative points were about lack of practical teaching, a lot of information in a short period of time and little emphasis on basic content. Low perceived self-efficacy and low locus of control, ambiguity, conflict of skills and the lack of support for the learning application. Nurses showed greater dissatisfaction with the organizational support.CONCLUSIONThe low effectiveness of training reveals the need to negotiate structured training from work problematization, considering performance conditions.

Predicting post-training reactions from pre-training attitudes

Les programmes de formation et d’apprentissage sont devenus des éléments parmi les plus essentiels pour les compagnies et la question se pose de savoir ce qui influence l’efficacité d’une formation. Récemment, la motivation pour la formation a été considérée comme le facteur déterminant. Ainsi, les objectifs de cette étude étaient d’examiner si la motivation pour la formation corrèle bien avec les antécédents et les réactions des employés formés, ainsi que d’analyser si la motivation joue un rôle de médiateur dans la prédiction des résultats d’une formation. Trois variables de « pré-formation » ont été choisies pour cette étude : l’attitude générale envers la formation, le sentiment d’efficacité personnelle en formation, et la planification de carrière. Les réactions immédiates des employés formés ont été choisies comme variable de « post-formation ». Un total de 152 employés d’une large compagnie québécoise a participé à cette étude en remplissant un questionnaire en début de formation et un autre à la fin. Les résultats de cette étude ont mis en évidence que la motivation pour la formation peut être prédite par l’attitude générale envers la formation, le sentiment d’efficacité personnelle en formation et la planification de carrière. De plus, la motivation pour la formation s’est révélée être le meilleur facteur de prédiction des réactions des employés formés. Les résultats ont également montré que la motivation pour la formation agit pleinement comme médiateur dans la relation entre le sentiment d’efficacité personnelle et la réaction des employés formés, et comme médiateur partiel entre l’attitude générale envers la formation et les réactions. Pour finir, cette étude a permis de découvrir que les employés nouvellement arrivés diffèrent des employés permanents dans leurs attitudes pré-formation et leurs réactions post-formation. Les résultats de cette étude sont discutés, des implications théoriques sont commentées et des implications pratiques pour les compagnies sont suggérées.

Exercise training increases myocardial inotropic response in food restricted rats

This study evaluated the effects of exercise training on myocardial function and ultrastructure of rats submitted to different levels of food restriction (FR). Male Wistar-Kyoto rats, 60 days old, were submitted to free access to food, light FR (20%), severe FR (50%) and/or to swimming training (one hour per day with 5% of load, five days per week for 90 days). Myocardial function was evaluated by left ventricular papillary muscle under basal condition (calcium 1.25 mM), and after extracellular calcium elevation to 5.2 mM and isoproterenol (I PM) addition. The ultrastructure of the myocardium was examined in the papillary muscle. The training effectiveness was verified by improvement of myocardial metabolic enzyme activities. Both 20% and 50% food restriction protocols presented minor body and ventricular weights gain. The 20%-FR, in sedentary or trained rats, did not alter myocardial function or ultrastructure. The 50%-FR, in sedentary rats, caused myocardial dysfunction under basal condition, decreased response to inotropic stimulation, and promoted myocardial ultrastructural damage. The 50%-FR, in exercised rats, increased myocardial dysfunction under basal condition but increased response to inotropic stimulation although there was myocardial ultrastructural damage. In conclusion, the exercise training in severe restriction caused marked myocardial dysfunction at basal condition but increased myocardial response to inotropic stimulation. (c) 2005 Elsevier B.V.. All rights reserved.

Webinar Training: an acceptable, feasible and effective approach for multi-site medical record abstraction: the BOWII experience

Background Abstractor training is a key element in creating valid and reliable data collection procedures. The choice between in-person vs. remote or simultaneous vs. sequential abstractor training has considerable consequences for time and resource utilization. We conducted a web-based (webinar) abstractor training session to standardize training across six individual Cancer Research Network (CRN) sites for a study of breast cancer treatment effects in older women (BOWII). The goals of this manuscript are to describe the training session, its participants and participants' evaluation of webinar technology for abstraction training. Findings A webinar was held for all six sites with the primary purpose of simultaneously training staff and ensuring consistent abstraction across sites. The training session involved sequential review of over 600 data elements outlined in the coding manual in conjunction with the display of data entry fields in the study's electronic data collection system. Post-training evaluation was conducted via Survey Monkey©. Inter-rater reliability measures for abstractors within each site were conducted three months after the commencement of data collection. Ten of the 16 people who participated in the training completed the online survey. Almost all (90%) of the 10 trainees had previous medical record abstraction experience and nearly two-thirds reported over 10 years of experience. Half of the respondents had previously participated in a webinar, among which three had participated in a webinar for training purposes. All rated the knowledge and information delivered through the webinar as useful and reported it adequately prepared them for data collection. Moreover, all participants would recommend this platform for multi-site abstraction training. Consistent with participant-reported training effectiveness, results of data collection inter-rater agreement within sites ranged from 89 to 98%, with a weighted average of 95% agreement across sites. Conclusions Conducting training via web-based technology was an acceptable and effective approach to standardizing medical record review across multiple sites for this group of experienced abstractors. Given the substantial time and cost savings achieved with the webinar, coupled with participants' positive evaluation of the training session, researchers should consider this instructional method as part of training efforts to ensure high quality data collection in multi-site studies.

Vocal Symptoms in Telemarketers: A Random and Controlled Field Trial

The present study was carried out to evaluate the effectiveness of a specific program regarding the occurrence of vocal attrition symptoms in telemarketers. A total of 71 subjects participated in this study: 28 completed the Vocal Symptoms questionnaire to test its reliability, and 43 were randomly assigned to two groups: an 8-week vocal training group (n = 14) and a no-training control group (n = 29), to evaluate the effectiveness of the training program with this tool. The voice training group also filled in the posttraining questionnaire `Benefits Obtained with Voice Training` (BVT). The vocal training program was not considered effective with regard to the occurrence of vocal symptoms. However, due to a probable increase in symptoms in untrained telemarketers, it can work as a protective factor. According to BVT answers, the vocal training contributed to an improvement in vocal use as a communication tool for telemarketers. Copyright (C) 2009 S. Karger AG, Basel

A MANAGEMENT INFORMATION SYSTEM AND EVALUATION SCHEME FOR THE UNIVERSITY OF TEXAS EMPLOYEE ASSISTANCE PROGRAMS

Early Employee Assistance Programs (EAPs) had their origin in humanitarian motives, and there was little concern for their cost/benefit ratios; however, as some programs began accumulating data and analyzing it over time, even with single variables such as absenteeism, it became apparent that the humanitarian reasons for a program could be reinforced by cost savings particularly when the existence of the program was subject to justification.^ Today there is general agreement that cost/benefit analyses of EAPs are desirable, but the specific models for such analyses, particularly those making use of sophisticated but simple computer based data management systems, are few.^ The purpose of this research and development project was to develop a method, a design, and a prototype for gathering managing and presenting information about EAPS. This scheme provides information retrieval and analyses relevant to such aspects of EAP operations as: (1) EAP personnel activities, (2) Supervisory training effectiveness, (3) Client population demographics, (4) Assessment and Referral Effectiveness, (5) Treatment network efficacy, (6) Economic worth of the EAP.^ This scheme has been implemented and made operational at The University of Texas Employee Assistance Programs for more than three years.^ Application of the scheme in the various programs has defined certain variables which remained necessary in all programs. Depending on the degree of aggressiveness for data acquisition maintained by program personnel, other program specific variables are also defined. ^

Efficacia della formazione alla salute e sicurezza sul lavoro: fattori di successo e criticità

Background: sulla base delle evidenze emerse dalle rassegne sistematiche in materia (Johnstone, 1994; Cohen et al.,1998; Robson et al., 2012; Burke et al., 2006; Ricci et al., 2015) si è ipotizzato che la formazione alla salute e sicurezza sul lavoro sia maggiormente efficace quando non è presentata come obbligatoria e venga articolata su più livelli di apprendimento, attraverso metodologie adeguate per ogni livello, con docenti che abbiano caratteristiche corrispondenti allo specifico obiettivo di apprendimento e la cui durata sia parametrata all’obiettivo stesso. Obiettivo di questa ricerca è valutare se esista e quanto sia intensa la relazione causale tra la formazione alla sicurezza sul lavoro e i suoi effetti sul miglioramento delle conoscenze, degli atteggiamenti, dei comportamenti, degli esiti per la salute, del clima di sicurezza aziendale, del controllo comportamentale percepito dai lavoratori, delle condizioni operative e procedure interne, oltre l’eventuale effetto di moderazione determinato da caratteristiche socio-demografiche dei partecipanti e dal gradimento della formazione. Metodo: la variabile indipendente è costituita dell’intervento formativo erogato, articolato in tre condizioni: formazione obbligatoria, formazione non obbligatoria, gruppo di controllo: sono stati posti a confronto due interventi di pari durata (16 settimane, per 10h complessive), realizzati con identiche modalità (step1 audio-visivo; step2 affiancamento su lavoro da parte del preposto; step3 discussione di auto-casi), ma differenziati rispetto all’essere presentati uno come formazione obbligatoria, l’altro come non obbligatoria. I due gruppi sono anche stati confrontati con un gruppo di controllo per il quale la formazione è prevista successivamente. I partecipanti sono stati assegnati in modo casuale al gruppo con obbligo formativo, senza obbligo formativo, di controllo. Sono stati presi come indicatori (variabili dipendenti) per valutare l’effetto della formazione: I livello – conoscenze: riconoscimento o produzione di un maggior numero di risposte corrette. II livello – atteggiamenti e credenze: maggiore propensione a mettere in atto comportamenti auto ed etero protettivi. III livello – comportamenti: comportamenti osservati più adeguati per la tutela della salute propria e altrui. IV livello – salute: maggior grado di benessere bio-psico-sociale auto-riferito. Le misure di esito consistono nella variazione tra la rilevazione iniziale e ogni rilevazione successiva, sulla base delle diverse misure registrate per ognuno dei quattro livelli dell’intervento formativo. Lo stesso confronto del tempo è stato realizzato per le misure del clima di sicurezza aziendale, del controllo comportamentale percepito dai lavoratori, delle condizioni operative e procedure interne, oltre l’eventuale effetto di moderazione determinato da caratteristiche socio-demografiche dei partecipanti e dal gradimento della formazione, quest’ultimo misurato solo immediatamente al termine dell’intervento. Risultati: le condizioni di intervento non differiscono in termini di efficacia, la formazione determina infatti gli stessi risultati per i partecipanti del gruppo obbligo formativo e di quello non obbligo, con una significativa differenza post-intervento rispetto al gruppo di controllo. La formazione ha un effetto forte nel miglioramento delle conoscenze che solo parzialmente decade nel tempo, ma comunque mantenendo un livello maggiore rispetto ai valori iniziali. In relazione al miglioramento di atteggiamenti e comportamenti sicuri nel lavoro al Videoterminale, l’effetto della formazione è modesto: per gli atteggiamenti si registra solo un miglioramento verso l’applicazione delle procedure come utili realmente e non come mero adempimento, ma tale effetto decade entro quattro mesi riportando i partecipanti su valori iniziali; i comportamenti invece migliorano nel tempo, ma con deboli differenze tra partecipanti alla formazione e gruppo di controllo, tuttavia tale miglioramento non decade in seguito. Non si registrano invece effetti della formazione nella direzione attesa in termini di esiti per la salute, per il miglioramento del clima di sicurezza e come maggior controllo comportamentale percepito, non risultano nemmeno dati evidenti di moderazione degli effetti dovuti a caratteristiche socio-demografiche dei partecipanti. Inoltre emerge che il gradimento per la formazione è correlato con migliori atteggiamenti (strumento audio-visivo), il miglioramento del clima di sicurezza e un maggior controllo comportamentale percepito (studio di auto-casi), ovvero gli step che hanno visto l’intervento di formatori qualificati. Infine, la formazione ha determinato migliori condizioni operative e l’adeguamento delle procedure interne. Conclusioni: la presente ricerca ci consente di affermare che la formazione erogata è stata efficace, oltre che molto gradita dai partecipanti, in particolare quando il formatore è qualificato per questa attività (step1 e 3). L’apprendimento prodotto è tanto più stabile nel tempo quanto più i contenuti sono in stretta relazione con l’esperienza lavorativa quotidiana dei partecipanti, mentre negli altri casi il decremento degli effetti è alquanto rapido, di conseguenza ribadiamo la necessità di erogare la formazione con continuità nel tempo. E’ risultato comunque modesto l’effetto della formazione per migliorare gli atteggiamenti e i comportamenti nel lavoro al VDT, ma, al di là di alcuni limiti metodologici, sono obiettivi ambiziosi che richiedono più tempo di quanto abbiamo potuto disporre in questa occasione e il cui conseguimento risente molto delle prassi reali adottate nel contesto lavorativo dopo il termine della formazione. Le evidenze finora prodotte non hanno poi chiarito in modo definitivo se attraverso la formazione si possano determinare effetti significativi nel miglioramento di esiti per la salute, anche eventualmente attraverso interventi di supporto individuale. Inoltre l’assenza di differenze significative negli effetti tra i partecipanti assegnati alla condizione di obbligo e quelli di non obbligo, eccezion fatta in direzione opposta alle attese per la misura del danno da lavoro, suggeriscono che nell’erogare la formazione, occorre sottolineare in misura molto rilevante l’importanza dell’intervento che viene realizzato, anche qualora esistesse una prescrizione normativa cogente. Infine, la ricerca ci ha fornito anche indicazioni metodologiche e misure valide che invitano ad estendere questa formazione, e la sua valutazione di efficacia, a diversi comparti economici e svariate mansioni. Nel fare questo è possibile fare riferimento, e testare nuovamente, un modello che indica la corretta percezione del rischio (conoscenza) come fattore necessario, ma non sufficiente per ottenere, con la mediazione di atteggiamenti favorevoli allo specifico comportamento, azioni sicure, attraverso le quali si rinforza l’atteggiamento e migliorano le conoscenze. La formazione, per raggiungere i propri obiettivi, deve tuttavia agire anche sui meccanismi di conformismo sociale favorevoli alla safety, questi originano da conoscenze e azioni sicure e reciprocamente le rinforzano.

Estudo sobre a Transferência da Formação na EFAPEL, S.A.

O presente trabalho de investigação pretendeu estudar e avaliar a transferência da formação para o local de trabalho e os seus impactos ao nível das alterações no desempenho dos colaboradores da EFAPEL, S.A. De forma a tornar possível esse objetivo, o estudo procurou apoiar-se nos pressupostos teóricos que sustêm um projeto desta natureza. Abordando a transferência da formação no contexto organizacional, procurou-se determinar quais os fatores que afetam a mesma para o local de trabalho e para a função desempenhada. Neste sentido, e considerando as três dimensões que influenciam a transferência da formação, o presente estudo pretende, de alguma forma, ser um contributo para um melhor conhecimento da transferência da formação através, da análise empírica de como determinadas variáveis relacionadas com as características individuais, as características da conceção da formação e com as características organizacionais, influenciam a transferência da formação. Os resultados obtidos indicam-nos que os fatores identificados como os que mais influenciam a transferência da formação são, sem dúvida, os fatores organizacionais, o que indica que a cultura e as práticas da organização são decisivas na transferência e eficácia da formação. Deseja-se que os resultados obtidos na investigação contribuam para a melhoria e ajustamentos no processo de gestão e implementação da formação na EFAPEL, S.A., com ganhos de eficiência e eficácia. / This research work was to study and evaluate the transfer of training to the workplace and their impacts in terms of changes in the performance of employees EFAPEL, SA. In order to make this goal possible, the study sought to build on the theoretical assumptions that sustain a project of this nature. Addressing the transfer of training in the organizational context, we sought to determine which factors affect the same for the workplace and for the function performed. In this sense, and considering the three dimensions that influence the transfer of training, the present study intends to somehow be a contribution to a better knowledge transfer through training, the empirical analysis of how certain variables related to individual characteristics, the characteristics of the design of training and organizational characteristics influence the transfer of training. The results show us that the factors identified as those that most influence the transfer of training are undoubtedly organizational factors, indicating that the culture and practices of the organization are crucial in the transfer and training effectiveness. It is hoped that the results obtained in the research will contribute to the improvement and adjustments in management process and implementation of training in EFAPEL, SA, with gains in efficiency and effectiveness.

The effectiveness of parent management training to increase self-efficacy in parents of children with Asperger syndrome

This study was a trial of an intervention programme aimed to improve parental self-efficacy in the management of problem behaviours associated with Asperger syndrome. The intervention was compared across two formats, a I day workshop and six individual sessions, and also with a non-intervention control group. The results indicated that, compared with the control group, parents in both intervention groups reported fewer problem behaviours and increased self-efficacy following the interventions, at both 4 weeks and 3 months follow-up. The results also showed a difference in self-efficacy between mothers and fathers, with mothers reporting a significantly greater increase in self-efficacy following intervention than fathers. There was no significant difference between the workshop format and the individual sessions.

The effectiveness of a teacher’s training workshop on Media Smart Program

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Management from the NOVA – School of Business and Economics