Evaluating End-User Training Effectiveness in ERP System Implementation

Today’s business world demands more and more internal and external integration and transparency among companies at all fields. Integrated ERP (enterprise resource planning) systems offer a possibility to improve business practices and procedures by providing a unified view on the business including all functions and departments. Due to the obvious benefits, the popularity of integrated ERP systems keeps growing. The implementation of ERP systems has however proven risky. The implementation projects tend to be long, extensive, and costly – and often they end up in a failure. Due to the significant task and role changes ERP implementation brings to almost everybody in the company, training has been identified as one of the most critical success factors of an ERP implementation. To ensure that the training is conducted in the most effective and successful manner, the training outcomes should be evaluated. So far, training evaluation has however gained only limited attention at most companies investing in different training programs. Uponor corporation has initiated a large ERP implementation and process harmonization program in 2004. Thousands of end-users have been trained during this project so far, and the work still continues until the project is completed in 2010. In this thesis, the evaluation of end-user training in Uponor’s ERP program is brought further from the current state of performing the basic participant satisfaction survey in the end of each class. The results show that in order to reach reliable training effectiveness evaluation results, not only the reaction towards training but also transfer of skills and attitudes and the final results of the training program should be evaluated.

A Comparative Study of the Effectiveness of a Prefabricated Appliance and a Stabilization Appliance in the Treatment of Myofascial pain and Headache

The aim of this thesis was to evaluate the short- and long-term effectiveness of a prefabricated occlusal appliance (R) on patients with myofascial pain and headache by comparing it with the treatment of the stabilization appliance (S). Another aim was to evaluate the effect of appliance treatment on stress-related salivary parameters like cortisol and IgA, as well as on flow rate values in these patients. Sixty-five patients diagnosed with myofascial temporomandibular disorder (TMD) pain, of whom 94% suffered concomitantly from headache, at two centres for Stomatognathic Physiology, one in Sweden and one in Finland, were included in this randomized controlled trial using Research Diagnostic Criteria for TMD (RDC/TMD), with history questionnaires and clinical examinations performed at baseline and at 6- and 10-weeks, and 6- and 12-month follow-ups. Patients were randomly assigned either to the R or the S group. Treatment outcome was measured according to IMMPACT (Initiative on Methods, Measurements, and Pain Assessment in Clinical Trials), i.e. four chronic pain outcome domains: pain intensity, overall improvement, physical and emotional functioning. Changes in frequency and intensity of headache were recorded. Thirty-nine patients participated in the saliva study. Salivary analyses were performed at 6 and 10 weeks. The results revealed no differences between groups at baseline. At all follow-ups, all four outcome measures, as well as frequency and intensity of headache, showed statistically significant within-group improvement compared to baseline, without significant differences between groups. No treatment-induced changes in saliva parameters could be registered. In conclusion, the effectiveness of the prefabricated appliance seemed to be similar to that of the stabilization appliance in alleviating myofascial pain, and frequency and intensity of headache, in the short as well as the long term. However, no changes in salivary parameters were observed during treatment.

The effectiveness of short-term literacy skills intervention on children at risk of reading and writing difficulties in Tanzania : a study of grade one children with dynamic assessment approach

The aim of the study was to create and evaluate an intervention programme for Tanzanian children from a low-income area who are at risk of reading and writing difficulties. The learning difficulties, including reading and writing difficulties, are likely to be behind many of the common school problems in Tanzania, but they are not well understood, and research is needed. The design of the study included an identification and intervention phase with follow-up. A group based dynamic assessment approach was used in identifying children at risk of difficulties in reading and writing. The same approach was used in the intervention. The study was a randomized experiment with one experimental and two control groups. For the experimental and the control groups, a total of 96 (46 girls and 50 boys) children from grade one were screened out of 301 children from two schools in a low income urban area of Dar-es-Salaam. One third of the children, the experimental group, participated in an intensive training programme in literacy skills for five weeks, six hours per week, aimed at promoting reading and writing ability, while the children in the control groups had a mathematics and art programme. Follow-up was performed five months after the intervention. The intervention programme and the tests were based on the Zambian BASAT (Basic Skill Assessment Tool, Ketonen & Mulenga, 2003), but the content was drawn from the Kiswahili school curriculum in Tanzania. The main components of the training and testing programme were the same, only differing in content. The training process was different from traditional training in Tanzanian schools in that principles of teaching and training in dynamic assessment were followed. Feedback was the cornerstone of the training and the focus was on supporting the children in exploring knowledge and strategies in performing the tasks. The experimental group improved significantly more (p = .000) than the control groups during the intervention from pre-test to follow-up (repeated measures ANOVA). No differences between the control groups were noticed. The effect was significant on all the measures: phonological awareness, reading skills, writing skills and overall literacy skills. A transfer effect on school marks in Kiswahili and English was found. Following a discussion of the results, suggestions for further research and adaptation of the programme are presented.

Effectiveness of Pilotage

The objective of the pilotage effectiveness study was to come up with a process descrip-tion of the pilotage procedure, to design performance indicators based on this process description, to be used by Finnpilot, and to work out a preliminary plan for the imple-mentation of the indicators within the Finnpilot organisation. The theoretical aspects of pilotage as well as the guidelines and standards used were determined through a literature review. Based on the literature review, a process flow model with the following phases was created: the planning of pilotage, the start of pilo-tage, the act of pilotage, the end of pilotage and the closing of pilotage. The model based on the literature review was tested through interviews and observation of pilotage. At the same time an e-mail survey directed at foreign pilotage organisations, which included a questionnaire concerning their standards and management systems, operations procedures, measurement tools and their attitude to the passage planning, was conducted. The main issues in the observations and interviews were the passage plan and the bridge team co-operation. The phases of the pilotage process model emerged in both the pilotage activities and the interviews whereas bridge team co-operation was relatively marginal. Most of the pilotage organisations, who responded to the query, also use some standard-based management system. All organisations who answered the survey use some sort of a pilotage process model. According to the query, the main measuring tools for pilotage are statistical information concerning pilotage and the organisations, the customer feedback surveys, and financial results. Attitudes to-wards passage planning were mostly positive among the organisations. A workshop with pilotage experts was arranged where the process model constructed on the basis of the literature review was tuned to match practical pilotage. In the workshop it was determined that certain phases and the corresponding tasks, through which pilo-tage can be described as a process, were identifiable in all pilotage. The result of the workshop was a complemented process model, which separates incoming and outgoing traffic, as well as the fairway pilotage and harbour pilotage from each other. Addition-ally indicators divided according to the data gathering method were defined. Data con-cerning safety and traffic flow is gathered in the form of customer feedback. The pilot's own perceptions of the pilotage process are gathered through self-assessment. The measurement data which is connected to the phases of the pilotage process is generated e.g. by gathering statistics of the success of the pilot dispatches, the accuracy of the pi-lotage and the incidents that occurred during the pilotage, near misses, deviations and accidents. The measurement data is collected via the PilotWeb at the closing of the pilo-tage. A separate project and a project group with pilots also participating will be established for the deployment of the performance indicators. The phases of the project are: the definition phase, the implementation phase and the deployment phase. The purpose of the definition phase is to prepare questions for ship commanders concerning the cus-tomer feedback questionnaire and also to work out the self-assessment queries and the queries concerning the process indicators.

The effectiveness of vocationally oriented multidisciplinary rehabilitation (ASLAK®) amongst public sector employees

In Finland, vocationally oriented medical rehabilitation (ASLAK®) is a common preventive rehabilitation measure with the primary goal of preserving and improving work ability. The ASLAK® programme has been used for almost 30 years, although limited data exist on its effectiveness. The aims of this study were to determine whether the increased risk of work disability predicts the participants’ likelihood to be granted ASLAK® rehabilitation and to assess the effectiveness of the programme in decreasing the risk of work disability and modifying health-risk behaviours. This study is a part of the on-going Finnish Public Sector Study conducted by the Finnish Institute of Occupational Health. Data on 53 416 employees (81% women) were gathered from employers’ records, national health registers and repeated survey responses. During the 5-year follow-up, increased levels of the risk factors for work disability did not predict participation in the rehabilitation programme. During the 2.8-year followup (range 0.04–5.0 years), the risk of long-term work disability (sick leave >90 days or retirement) overall or, more specifically, due to musculoskeletal or mental diseases did not differ between the rehabilitants who participated in ASLAK® in 1997–2005 and their propensity score matched controls. There was no evidence of ASLAK® being effective in changing participants’ health-risk behaviours or in improving perceived general or mental health. The results suggest that potential participant recognition, mainly taking place in occupational health care, may fail to identify those with a higher risk of work disability. No evidence on the effectiveness of the programme was found in the study cohort when measured by the selected indicators.

Effectiveness of the KiVa Antibullying Program

According to the participant role approach (Salmivalli, Lagerspetz, Björkqvist, Österman, & Kaukiainen, 1996), bullying is a group phenomenon that is largely enabled and maintained by the classmates taking on different participant roles (e.g., reinforcers or assistants of the bully). There is, however, very little evidence on whether the bystander behaviors actually have an effect on the risk for victimization. Furthermore, the participant role approach implies that the bystanders should be used in putting an end to bullying. This view has been put into practice in the KiVa antibullying program, but it has not yet been investigated whether the program is effective. Four studies were conducted to investigate, (a) whether the behaviors of bystanders have an effect on the risk for victimization (Study I) and (b) whether the KiVa program reduces bullying and victimization and has other beneficial effects as well (Studies II–IV). The participants included large samples of elementary and lower secondary school students (Grades 1–9) from Finland. The assessments were done with web-based questionnaires including questions about bullying and victimization (both self- and peer reports), and about several bullying-related constructs. The results of this thesis suggest that bystander behaviors in bullying situations may influence the risk for victimization of vulnerable students. Moreover, the results indicate that the KiVa antibullying program is effective in reducing victimization and bullying. The program effects are larger in elementary schools than in lower secondary schools, whereas in Grades 8 and 9, they are larger for boys than girls for some peer-reported outcomes. The magnitude of the overall effects can be considered practically significant when obtained in a large-scale dissemination of the program.

The effectiveness of financial innovation support tools. Comparative study of Latvia and Finland

In the Innovation Union Scoreboard of 2011, Latvia ranked last amongst the EU countries in innovation performance. Even though there is sufficient scientific and technological basis, the results remain modest or low in most of the indicators concerning innovations. Several aspects influence the performance a national innovation system. In Latvia, the low effectiveness is often attributed to lack of financial support tools. As a comparison, Finland was chosen because of its well-established and documented innovation system. The aim of this study is to research the efficiency and effectiveness of the current financial innovation support tool system in Latvia from the point of view of an innovating company. It also attempts to analyze the support tool system of Latvia and compare to the relevant parts of the Finnish system. The study found that it is problematic for innovative companies in Latvia to receive the necessary funding especially for start-ups and SMEs due to the low number of grant programs, funds and lacking offer from banks, venture capital and business angels. To improve the situation, the Latvian government should restructure the funding mechanisms putting a bigger emphasis on innovative start-ups and SMEs. That would lay a foundation for future growth and boost research and scientific activities in Latvia.

Dispersal and metacommunity dynamics in a soft-sediment benthic system : how well is the seafloor connected?

Connectivity depends on rates of dispersal between communities. For marine soft-sediment communities continued small-scale dispersal as post-larvae and as adults can be equally important in maintaining community composition, as initial recruitment of substrate by pelagic larvae. In this thesis post-larval dispersal strategies of benthic invertebrates, as well as mechanisms by which communities are connected were investigated. Such knowledge on dispersal is scarce, due to the difficulties in actually measuring dispersal directly in nature, and dispersal has not previously been quantified in the Baltic Sea. Different trap-types were used underwater to capture dispersing invertebrates at different sites, while in parallel measuring waves and currents. Local community composition was found to change predictably under varying rates of dispersal and physical connectivity (waves and currents). This response was, however, dependent on dispersal-related traits of taxa. Actively dispersing taxa will be relatively better at maintaining their position, as they are not as dependent on hydrodynamic conditions for dispersal and will be less prone to be passively transported by currents. Taxa also dispersed in relative proportions that were distinctly different from resident community composition and a significant proportion (40 %) of taxa were found to lack a planktonic larval life-stage. Community assembly was re-started in a large-scale manipulative field experiment over one year across several sites, which revealed how patterns of community composition (α-, β- and λ-diversity) change depending on rates of dispersal. Results also demonstrated that in response to small-scale disturbance, initial recruitment was by nearby-dominant species after which other species arrived from successively further away. At later assembly time, the number of coexisting species increased beyond what was expected purely by local niche requirements (species sorting), transferring regional differences in community composition (β-diversity) to the local scale (α-diversity, mass effect). Findings of this thesis complement more theoretical studies in metacommunity ecology by demonstrating that understanding how and when individuals disperse relative to underlying environmental heterogeneity is key to interpreting how patterns of diversity change across different spatial scales. Such information from nature is critical when predicting responses to, for example, different types of disturbances or management actions in conservation.

Cost-effectiveness analysis in South Karelia Central Hospital

The target organization of this study, otherwise South-Karelia Social and Health Care District (Eksote) provides health, senior, family and social welfare services. South Karelia Central Hospital provides special health care and offers health services from all of the most important medical specialties. Eksote has in use 15D instrument to measure the health-related quality of life (HRQoL) of their patients before and after their interventions for observing the health effects of the medical care. Furthermore, 15D allows measuring the effectiveness and cost-effectiveness of health care when comparing these before and after results of the 15D measurements and adding the costs of the interventions into this research. The main purposes of this study were to analyze the effectiveness and cost-effectiveness of medical care in South Karelia Central Hospital by using the gathered 15D data to calculate effectiveness and cost-effectiveness ratios and to analyze the reliability and availability of the data. Study has been conducted using literature review and quantitative research methods. The results indicate that from the patients within the eight units selected to this study the 15D change information was available from the 52 %, the 15D change and the cost information from 38 % and the information of quality-adjusted life years (QALYs) produced and the cost information from 35 %. The effectiveness and cost-effectiveness of medical care were greatest at the units of Pain Outpatient Clinic and Rheumatic Diseases Outpatient Clinic. The most effective medical care is given in the unit where the average price of one produced QALY is the highest (Orthopedics). However, the calculated standard deviations pointed out that there are great variances in the effectiveness and cost-effectiveness within the units also.