Benchmarking the n-tuple classifier with statlog dataset

The n-tuple recognition method was tested on 11 large real-world data sets and its performance compared to 23 other classification algorithms. On 7 of these, the results show no systematic performance gap between the n-tuple method and the others. Evidence was found to support a possible explanation for why the n-tuple method yields poor results for certain datasets. Preliminary empirical results of a study of the confidence interval (the difference between the two highest scores) are also reported. These suggest a counter-intuitive correlation between the confidence interval distribution and the overall classification performance of the system.

Benchmarking for information systems management using issues framework studies:cContent and methodology

As a means of benchmarking their position and assisting with anticipating an uncertain future, the identification of critical information systems (IS) management issues frameworks is becoming an increasingly important research task for both academics and industrialists. This paper provides a description and summary of previous work on identifying IS issues frameworks by reviewing 20 research investigations in terms of what they studied and how they were conducted. It also suggests some possible directions and methodologies for future research. The summary and suggestions for further work are applicable for issues framework research in the IS management field as well as in other business and management areas.

Achieving internal process benchmarking:guidance from BASF

Purpose - The purpose of the work discussed in this paper is to understand, analyse and benchmark the "Packing and Filling" processes within BASF. A benchmarking project is described in detail which aimed to cover sites in different countries that supplied many different variants of finished goods in order to establish best practice and then to generate some options for their implementation. Design/methodology/approach - The project used an adaptation of accepted benchmarking methodology combined with other techniques (such as rich picture generation, and cluster analysis) to maximise the insight generated. Findings - The findings of the research showed that one of the main factors effecting the process was how third parties were used (e.g. extent and nature of out-sourcing, and its degree of centralisation). Research limitations/ implications - The exercise was challenged by the selection of suitably similar benchmarking candidates because the environment was complex and highly varied; the paper explains practical solutions for dealing with this challenge. Practical limitations - Strategic and tactical options are outlined at the end of the paper and will have applicability to other organisations and industries that are looking to find the answers to frequently asked questions about how to successfully implement an internal process benchmarking project in a large complex organisation that has high variety in end products and delivery methods. Originality/value - The methodology described in this paper is of a proprietary and unique nature. The paper is structured around some key questions commonly asked of benchmarking, and the answers are provided via a real in-depth case study from BASF that spans 4 sites in 3 countries using 15 different filling lines. © Emerald Group Publishing Limited.

Benchmarking project management practices of Caribbean organizations using analytic hierarchy process

Effective management of projects is becoming increasingly important for any type of organization to remain competitive in today’s dynamic business environment due to pressure of globalization. The use of benchmarking is widening as a technique for supporting project management. Benchmarking can be described as the search for the best practices, leading to the superior performance of an organization. However, effectiveness of benchmarking depends on the use of tools for collecting and analyzing information and deriving subsequent improvement projects. This study demonstrates how analytic hierarchy process (AHP), a multiple attribute decision-making technique, can be used for benchmarking project management practices. The entire methodology has been applied to benchmark project management practice of Caribbean public sector organizations with organizations in the Indian petroleum sector, organizations in the infrastructure sector of Thailand and the UK. This study demonstrates the effectiveness of a proposed benchmarking model using AHP, determines problems and issues of Caribbean project management in the public sector and suggests improvement measures for effective project management.

Benchmarking the knowledge competitiveness of the globe's high performing regions:a review of the World Knowledge Competitiveness Index

Purpose – The purpose of this paper is to analyze the way in which the knowledge competitiveness of regions is measured and further introduces the World Knowledge Competitiveness Index (WKCI) benchmarking tool. Design/methodology/approach – The methodology consists of an econometric analysis of key indicators relating to the concept of knowledge competitiveness for 125 regions from across the globe consisting of 55 representatives from North America, 45 from Europe and 25 from Asia and Oceania. Findings – The key to winning the super competitive race in the knowledge-based economy is investment in the future: research and development, and education and training. It is found that the majority of the high-performing regional economies in the USA have a knowledge competitive edge over their counterparts in Europe and Asia. Research limitations/implications – To an extent, the research is limited by the availability of comparable indicators and metrics at the regional level that extend across the globe. Whilst comparative data are often accessible at the national level, regional data sources remain underdeveloped. Practical implications – The WKCI has become internationally recognized as an important instrument for economic development policymakers and regional investment promotion agents as they create and refine their strategies and targets. In particular, it has provided a benchmark that allows regions to compare their knowledge competitiveness with other regions for around the world and not only their own nation or continent. Originality/value – The WKCI is the first composite and relative measure of the knowledge competitiveness of the globe's best performing regions.

World knowledge competitiveness index 2002:benchmarking the globes high-performing regions

The World Knowledge Competitiveness Index 2002 is the first composite and relative measure of the knowledge economies of the globe's best performing regions. It represents an integrated and overall benchmark of the knowledge capacity, capability and sustainability of each region and the extent to which this knowledge is translated into economic value and transferred into the wealth of the citizens of each region. This publication has over 50 pages and covers the following sections: The Economics of Knowledge Competitiveness The Rankings - World Knowledge Competitiveness Index Human Capital Components Knowledge Capital Components Regional Economy Outputs Knowledge Sustainability Components Driving Knowledge-Based Growth

Methods and trends of performance benchmarking in UK utility regulation

Regulation is subject to information asymmetries that can lead to allocative and productive inefficiencies. One solution, suggested by Shleifer in 1985 and now adopted by many regulatory bodies round the world, is 'benchmarking', which is sometimes called 'yardstick competition'. In this paper we consider Shleifer's original approach to benchmarking and contrast this with the actual use of benchmarking by UK regulatory bodies in telecommunications, water and the energy sector since the privatizations of the 1980s and early 1990s. We find that benchmarking plays only one part and sometimes a small part in the setting of regulatory price caps in the UK. We also find that in practice benchmarking has been subject to a number of difficulties, which mean that it is never likely to be more than one tool in the regulator's armoury. The UK's experience provides lessons for regulation internationally. © 2006 Elsevier Ltd. All rights reserved.

Modelling and benchmarking business processes: The supply-line example

Benchmarking techniques have evolved over the years since Xerox’s pioneering visits to Japan in the late 1970s. The focus of benchmarking has also shifted during this period. By tracing in detail the evolution of benchmarking in one specific area of business activity, supply and distribution management, as seen by the participants in that evolution, creates a picture of a movement from single function, cost-focused, competitive benchmarking, through cross-functional, cross-sectoral, value-oriented benchmarking to process benchmarking. As process efficiency and effectiveness become the primary foci of benchmarking activities, the measurement parameters used to benchmark performance converge with the factors used in business process modelling. The possibility is therefore emerging of modelling business processes and then feeding the models with actual data from benchmarking exercises. This would overcome the most common criticism of benchmarking, namely that it intrinsically lacks the ability to move beyond current best practice. In fact the combined power of modelling and benchmarking may prove to be the basic building block of informed business process re-engineering.

Regional benchmarking in a global context:knowledge, competitiveness, and economic development

Benchmarking exercises have become increasingly popular within the sphere of regional policy making. However, most exercises are restricted to comparing regions within a particular continental bloc or nation.This article introduces the World Knowledge Competitiveness Index (WKCI), which is one of the very few benchmarking exercises established to compare regions across continents.The article discusses the formulation of the WKCI and analyzes the results of the most recent editions.The results suggest that there are significant variations in the knowledge-based regional economic development models at work across the globe. Further analysis also indicates that Silicon Valley, as the highest ranked WKCI region, holds a unique economic position among the globe’s leading regions. However, significant changes in the sources of regional competitiveness are evolving as a result of the emergence of new regional hot spots in Asia. It is concluded that benchmarking is imperative to the learning process of regional policy making.

The mosaic test:benchmarking colour-based image retrieval systems using image mosaics

Evaluation and benchmarking in content-based image retrieval has always been a somewhat neglected research area, making it difficult to judge the efficacy of many presented approaches. In this paper we investigate the issue of benchmarking for colour-based image retrieval systems, which enable users to retrieve images from a database based on lowlevel colour content alone. We argue that current image retrieval evaluation methods are not suited to benchmarking colour-based image retrieval systems, due in main to not allowing users to reflect upon the suitability of retrieved images within the context of a creative project and their reliance on highly subjective ground-truths. As a solution to these issues, the research presented here introduces the Mosaic Test for evaluating colour-based image retrieval systems, in which test-users are asked to create an image mosaic of a predetermined target image, using the colour-based image retrieval system that is being evaluated. We report on our findings from a user study which suggests that the Mosaic Test overcomes the major drawbacks associated with existing image retrieval evaluation methods, by enabling users to reflect upon image selections and automatically measuring image relevance in a way that correlates with the perception of many human assessors. We therefore propose that the Mosaic Test be adopted as a standardised benchmark for evaluating and comparing colour-based image retrieval systems.

Standardisation and benchmarking for improving translator training

The worldwide growth of the translation industry requires qualified professional translators. During the last decade, we have seen an enormous increase in translator training programmes offered by universities, mainly at postgraduate level. A challenge for such university programmes is to make sure that they prepare graduates who are qualified for the needs of the diverse profession in the rapidly changing market. This means that programmes need to be developed with the market needs in mind and that they need to ensure a good match between graduates' competences and employers' requirements. This paper addresses the following questions: How can universities adapt translator training programmes to the rapidly changing industry and the accompanying changes in professional profiles? How can we reconcile the requests of the industry for graduates who have practical and professional skills with the requests of the universities for graduates who have in-depth academic knowledge and intellectual skills? What standards and benchmarks are in place to assure quality of translator training programmes? Some such developments in respect of benchmarking are illustrated at first for the United Kingdom, followed by information on the European Master’s in Translation (EMT) project, an initiative at the European level. Finally, the paper reflects on the challenges which the EMT translator competence profile poses for university programmes.