R&D Performance Analysis: Case Studies on the Challenges and Promotion of the Evaluation and Measurement of R&D

Due to the intense international competition, demanding, and sophisticated customers, and diverse transforming technological change, organizations need to renew their products and services by allocating resources on research and development (R&D). Managing R&D is complex, but vital for many organizations to survive in the dynamic, turbulent environment. Thus, the increased interest among decision-makers towards finding the right performance measures for R&D is understandable. The measures or evaluation methods of R&D performance can be utilized for multiple purposes; for strategic control, for justifying the existence of R&D, for providing information and improving activities, as well as for the purposes of motivating and benchmarking. The earlier research in the field of R&D performance analysis has generally focused on either the activities and considerable factors and dimensions - e.g. strategic perspectives, purposes of measurement, levels of analysis, types of R&D or phases of R&D process - prior to the selection of R&Dperformance measures, or on proposed principles or actual implementation of theselection or design processes of R&D performance measures or measurement systems. This study aims at integrating the consideration of essential factors anddimensions of R&D performance analysis to developed selection processes of R&D measures, which have been applied in real-world organizations. The earlier models for corporate performance measurement that can be found in the literature, are to some extent adaptable also to the development of measurement systemsand selecting the measures in R&D activities. However, it is necessary to emphasize the special aspects related to the measurement of R&D performance in a way that make the development of new approaches for especially R&D performance measure selection necessary: First, the special characteristics of R&D - such as the long time lag between the inputs and outcomes, as well as the overall complexity and difficult coordination of activities - influence the R&D performance analysis problems, such as the need for more systematic, objective, balanced and multi-dimensional approaches for R&D measure selection, as well as the incompatibility of R&D measurement systems to other corporate measurement systems and vice versa. Secondly, the above-mentioned characteristics and challenges bring forth the significance of the influencing factors and dimensions that need to be recognized in order to derive the selection criteria for measures and choose the right R&D metrics, which is the most crucial step in the measurement system development process. The main purpose of this study is to support the management and control of the research and development activities of organizations by increasing the understanding of R&D performance analysis, clarifying the main factors related to the selection of R&D measures and by providing novel types of approaches and methods for systematizing the whole strategy- and business-based selection and development process of R&D indicators.The final aim of the research is to support the management in their decision making of R&D with suitable, systematically chosen measures or evaluation methods of R&D performance. Thus, the emphasis in most sub-areas of the present research has been on the promotion of the selection and development process of R&D indicators with the help of the different tools and decision support systems, i.e. the research has normative features through providing guidelines by novel types of approaches. The gathering of data and conducting case studies in metal and electronic industry companies, in the information and communications technology (ICT) sector, and in non-profit organizations helped us to formulate a comprehensive picture of the main challenges of R&D performance analysis in different organizations, which is essential, as recognition of the most importantproblem areas is a very crucial element in the constructive research approach utilized in this study. Multiple practical benefits regarding the defined problemareas could be found in the various constructed approaches presented in this dissertation: 1) the selection of R&D measures became more systematic when compared to the empirical analysis, as it was common that there were no systematic approaches utilized in the studied organizations earlier; 2) the evaluation methods or measures of R&D chosen with the help of the developed approaches can be more directly utilized in the decision-making, because of the thorough consideration of the purpose of measurement, as well as other dimensions of measurement; 3) more balance to the set of R&D measures was desired and gained throughthe holistic approaches to the selection processes; and 4) more objectivity wasgained through organizing the selection processes, as the earlier systems were considered subjective in many organizations. Scientifically, this dissertation aims to make a contribution to the present body of knowledge of R&D performance analysis by facilitating dealing with the versatility and challenges of R&D performance analysis, as well as the factors and dimensions influencing the selection of R&D performance measures, and by integrating these aspects to the developed novel types of approaches, methods and tools in the selection processes of R&D measures, applied in real-world organizations. In the whole research, facilitation of dealing with the versatility and challenges in R&D performance analysis, as well as the factors and dimensions influencing the R&D performance measure selection are strongly integrated with the constructed approaches. Thus, the research meets the above-mentioned purposes and objectives of the dissertation from the scientific as well as from the practical point of view.

Governmental Measures to Enhance the Finnish Innovation System to Respond to the Challenge of Mitigating Climate Change

Climate innovations, that cover both technological applications and process and service innovations, play a key role in climate change mitigation. The purpose of this study was to examine how the Finnish innovation system could be enhanced with governmental measures so that the diffusion of climate innovations could be speeded up. During the study, it became evident that the governmental measures need to support the whole innovation chain, which comprises of research, development, demonstration and deployment. Only this can lead to the successful birth and diffusion of low carbon innovations. The study found that the strengths of the Finnish innovation system are research and development, and the current national innovation policies strongly support these activities. However, these have been emphasised at the expense of the demonstration and deployment. Consequently, the biggest bottlenecks in the Finnish innovation landscape are the lack of pilot and demonstration projects and slow commercialisation, thus the high price of the innovation. To meet with the challenge, the government should firstly promote strict greenhouse gas emission reduction targets. This would boost up the innovation activities, which would also lower the prices of the innovations. To speed up the commercialisation process, measures that stimulate the domestic market, such as feed-in-tariffs and public procurements, are needed. Special attention should also be paid to the measures that could shift the traditional closed innovation chain towards open innovation. This means that the product development should involve experts from several fields such as the user and marketing experts to speed up the commercialisation. In addition, efficient innovation co-operation between both private and public sector is essential. Finally, as the domestic resources are not adequate for producing all the innovations needed, the domestic innovation activities should be focused on a few sectors, and at the same time promote efficient import policies.

Performance Measurement of the Logistics Process

The objective of the thesis was to create a performance measurement system for the logistics process of a company. In addition, one goal was to make suggestions for improvements based on description and analysis of the process and current measures. The logistics process was described in detail, and the objectives for it were derived from the company strategy and goals. Suggestions for performance measurement system and process improvement were made based on current state analysis. As a result of the thesis, three new performance measures were decided to take into use. In addition, several improvements were suggested to the ERP system to make process smoother. Some of the improvements have already been added to the system and the rest will be added in the near future.

Improving the Supply Chain Performance Management System in a Finnish paper mill

This Master’s Thesis studies performance management system and its benefits, risks and costs. Objective of the thesis is to describe and evaluate currently used supply chain performance management system (SCPMS) in a Finnish paper mill and its interfaces with its business unit’s SCPMS. As a result, the host company has improvement road map for improving its SCPMS. Used SCPMS in the host company and its interfaces to business unit’s SCPMS are described based on interviews held in the host company and the business unit. Evaluation of the host company’s SCPMS is based on literature study. For improvement road map, three areas in need of improvements are chosen. The study shows the need of high level top management commitment in successful performance management system implementation and usage, especially when the system is deployed to lower levels in the organization.

Improving reporting management with relational database management system

Data management consists of collecting, storing, and processing the data into the format which provides value-adding information for decision-making process. The development of data management has enabled of designing increasingly effective database management systems to support business needs. Therefore as well as advanced systems are designed for reporting purposes, also operational systems allow reporting and data analyzing. The used research method in the theory part is qualitative research and the research type in the empirical part is case study. Objective of this paper is to examine database management system requirements from reporting managements and data managements perspectives. In the theory part these requirements are identified and the appropriateness of the relational data model is evaluated. In addition key performance indicators applied to the operational monitoring of production are studied. The study has revealed that the appropriate operational key performance indicators of production takes into account time, quality, flexibility and cost aspects. Especially manufacturing efficiency has been highlighted. In this paper, reporting management is defined as a continuous monitoring of given performance measures. According to the literature review, the data management tool should cover performance, usability, reliability, scalability, and data privacy aspects in order to fulfill reporting managements demands. A framework is created for the system development phase based on requirements, and is used in the empirical part of the thesis where such a system is designed and created for reporting management purposes for a company which operates in the manufacturing industry. Relational data modeling and database architectures are utilized when the system is built for relational database platform.

Fuzzy expert system in the prediction of neonatal resuscitation

In view of the importance of anticipating the occurrence of critical situations in medicine, we propose the use of a fuzzy expert system to predict the need for advanced neonatal resuscitation efforts in the delivery room. This system relates the maternal medical, obstetric and neonatal characteristics to the clinical conditions of the newborn, providing a risk measurement of need of advanced neonatal resuscitation measures. It is structured as a fuzzy composition developed on the basis of the subjective perception of danger of nine neonatologists facing 61 antenatal and intrapartum clinical situations which provide a degree of association with the risk of occurrence of perinatal asphyxia. The resulting relational matrix describes the association between clinical factors and risk of perinatal asphyxia. Analyzing the inputs of the presence or absence of all 61 clinical factors, the system returns the rate of risk of perinatal asphyxia as output. A prospectively collected series of 304 cases of perinatal care was analyzed to ascertain system performance. The fuzzy expert system presented a sensitivity of 76.5% and specificity of 94.8% in the identification of the need for advanced neonatal resuscitation measures, considering a cut-off value of 5 on a scale ranging from 0 to 10. The area under the receiver operating characteristic curve was 0.93. The identification of risk situations plays an important role in the planning of health care. These preliminary results encourage us to develop further studies and to refine this model, which is intended to implement an auxiliary system able to help health care staff to make decisions in perinatal care.

Marketing performance measurement in the marketing-finance interface

Marketing and finance are both facing challenges in the constantly changing business environment. Finance is challenged to change its role from cost control to value-adding business partner while marketing needs to be able to demonstrate its accountability so how it contributes to firm performance. Finance is the key partner for marketing to prove its impact by helping marketing to measure its actions. By doing so, finance can also emphasize its business partner role. There is not a lot of research conducted of the relationship between marketing and finance departments. The aim of this study is to investigate how the professional differences of marketing and finance and their forms of cooperation affect marketing performance measurement. Literature of marketing and finance disciplines, their cooperation, performance implications of their interface as well as the roles of marketing performance measurement, performance measurement system and measures were reviewed. This research was conducted as a qualitative case study among senior management of marketing and finance in the sporting goods company. The data collected through semi-structured interviews, participant observation and secondary data was described and classified and connections were made. The results of the study show that the nature of marketing and finance disciplines has many effects on their cooperation and performance measurement. Due to the ambiguous nature of marketing, measuring its performance is still seen as a challenge but digitalization is helping the measurement. It was indicated that marketing and finance professionals need to have different skillsets in order to perform their roles effectively and thus cooperation is needed. Marketing performance needs to be measured with both financial and nonfinancial measures. Both marketing and finance interviewees highlighted the importance of marketing measures over financial measures. Measuring marketing performance comprehensively is seen as a challenge since marketing and finance cooperation is still shaped by the cost control and budget management roles, rather than performance measurement. We recognized three constraints affecting this cooperation and performance measurement: people, time and software. If marketing and finance would develop deeper cooperation, they could create comprehensive performance measurement system that improves organizational performance.

The performance and strategies of adolescents in learning to read artificial words /

The present study explored processing strategies used by individuals when they begin to read c;l script. Stimuli were artificial words created from symbols and based on an alphabetic system. The words were.presented to Grade Nine and Ten students, with variations included in the difficulty of orthography and word familiarity, and then scores were recorded on the mean number of trials for defined learning variables. Qualitative findings revealed that subjects 1 earned parts of the visual a'nd auditory features of words prior to hooking up the visual stimulus to the word's name. Performance measures-which appear to affect the rate of learning were as follows: auditory short-term memory, auditory delayed short-term memory, visual delayed short- term memory, and word attack or decod~ng skills. Qualitative data emerging in verbal reports by the subjects revealed that strategies they pefceived to use were, graphic, phonetic decoding and word .reading.

OPTIMAL UTILIZATION OF SERVICE FACILITY FOR A k-OUT-OF-n SYSTEM WITH REPAIR BY EXTENDING SERVICE TO EXTERNAL CUSTOMERS IN A RETRIAL QUEUE

In this paper, we study a k-out-of-n system with single server who provides service to external customers also. The system consists of two parts:(i) a main queue consisting of customers (failed components of the k-out-of-n system) and (ii) a pool (of finite capacity M) of external customers together with an orbit for external customers who find the pool full. An external customer who finds the pool full on arrival, joins the orbit with probability and with probability 1− leaves the system forever. An orbital customer, who finds the pool full, at an epoch of repeated attempt, returns to orbit with probability (< 1) and with probability 1 − leaves the system forever. We compute the steady state system size probability. Several performance measures are computed, numerical illustrations are provided.

Determinants and measures of export performance – comprehensive literature review

As one of the key indicators of the firm’s ability to leverage successfully its resources and capabilities in the international context, export performance has been one of the most extensively studied phenomena. A plethora of studies have been conducted pertaining to provide better understanding of the factors (firm- or environment-specific) and behaviours (e.g., export strategy) that make exporting a successful venture. Following a comprehensive literature review undertaking in this study the current state of the export performance literature could be summarisedas (i) methodologically fragmented in that there is a variety of analytical and methodological approaches, (ii) conceptually diverse, a large number of determinants have been identified as having direct or indirect influence on the firm’s export performance, and a large number of indicators have been used to conceptualise and operationalise the export performance measures, and (iii) inconclusive, the studies have produced inconsistent results of the impact of different determinants on export performance.

Tracking performance evaluation on PETS 2015 Challenge datasets

This paper presents a quantitative evaluation of a tracking system on PETS 2015 Challenge datasets using well-established performance measures. Using the existing tools, the tracking system implements an end-to-end pipeline that include object detection, tracking and post- processing stages. The evaluation results are presented on the provided sequences of both ARENA and P5 datasets of PETS 2015 Challenge. The results show an encouraging performance of the tracker in terms of accuracy but a greater tendency of being prone to cardinality error and ID changes on both datasets. Moreover, the analysis show a better performance of the tracker on visible imagery than on thermal imagery.

Incorporating priorities for waiting customers in the hypercube queuing model with application to an emergency medical service system in Brazil

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Performance Septic Systems: Does an Advanced Septic System Provide Adequate Treatment on Black Hammock Island and is there Adequate Regulatory Policy to Ensure Integrity?

This project determined if the performance based septic system, proposed for a development on Black Hammock Island in Jacksonville, Florida, is the best choice to prevent environmental contamination from septic tanks and if adequate regulatory policy exists. Research shows a central wastewater treatment plant provides the most efficient pollutant removal but can be cost prohibitive. This project found performance based systems surpasses conventional septic system performance and are more suited and economical to remote areas without sewer service. This project finds current regulations to be inadequate and supports ordinance changes proposed by the Mayor of Jacksonville to enhance the current policy and provide more adequate and meaningful regulation.

The impact of supply chain performance measurement systems on dynamic behaviour in supply chains

The amplification of demand variation up a supply chain widely termed ‘the Bullwhip Effect’ is disruptive, costly and something that supply chain management generally seeks to minimise. Originally attributed to poor system design; deficiencies in policies, organisation structure and delays in material and information flow all lead to sub-optimal reorder point calculation. It has since been attributed to exogenous random factors such as: uncertainties in demand, supply and distribution lead time but these causes are not exclusive as academic and operational studies since have shown that orders and/or inventories can exhibit significant variability even if customer demand and lead time are deterministic. This increase in the range of possible causes of dynamic behaviour indicates that our understanding of the phenomenon is far from complete. One possible, yet previously unexplored, factor that may influence dynamic behaviour in supply chains is the application and operation of supply chain performance measures. Organisations monitoring and responding to their adopted key performance metrics will make operational changes and this action may influence the level of dynamics within the supply chain, possibly degrading the performance of the very system they were intended to measure. In order to explore this a plausible abstraction of the operational responses to the Supply Chain Council’s SCOR® (Supply Chain Operations Reference) model was incorporated into a classic Beer Game distribution representation, using the dynamic discrete event simulation software Simul8. During the simulation the five SCOR Supply Chain Performance Attributes: Reliability, Responsiveness, Flexibility, Cost and Utilisation were continuously monitored and compared to established targets. Operational adjustments to the; reorder point, transportation modes and production capacity (where appropriate) for three independent supply chain roles were made and the degree of dynamic behaviour in the Supply Chain measured, using the ratio of the standard deviation of upstream demand relative to the standard deviation of the downstream demand. Factors employed to build the detailed model include: variable retail demand, order transmission, transportation delays, production delays, capacity constraints demand multipliers and demand averaging periods. Five dimensions of supply chain performance were monitored independently in three autonomous supply chain roles and operational settings adjusted accordingly. Uniqueness of this research stems from the application of the five SCOR performance attributes with modelled operational responses in a dynamic discrete event simulation model. This project makes its primary contribution to knowledge by measuring the impact, on supply chain dynamics, of applying a representative performance measurement system.

Emergent strategy and the measurement of performance:the formulation of performance indicators at the microlevel

This article presents some evidence on an aspect of the design of a strategic control system, at the microlevel, within a single organization. The research we report used an ethnographic approach to provide an understanding of strategy formulation. Our aim is to contribute to an area of literature which is of increasing significance, but relatively underdeveloped in terms of the application of in-depth, field-research techniques. We take an intensive look at the manner in which performance measures are formulated, at the microlevel, within a single organization. The article presents, as an in-depth case analysis, the experience of a fisheries holding company in New Zealand. The article recounts the experiences of managers within the organization of the process of identification of such things as critical success factors and key performance indicators (KPIs) and, more broadly, the formulation of a strategic performance measurement system.