ITS benefits: review of evaluation methods and reported benefits.

Texas Department of Transportation, Austin

Efficient allocation of research funds : economic evaluation methods with case studies in building technology /

"December 1979."

A környezeti teljesítményértékelés módszerei (Environmental performance evaluation methods)

A környezeti teljesítmény mérésére számtalan módszer létezik. A cikk a környezeti teljesítményértékelési eszközök útvesztőjében kínál némi eligazítást azáltal, hogy hat, a gyakorlatban is többé-kevésbé használt módszert mutat be és értékel. A szerző kísérletet tesz a bemutatott módszerek összehasonlítására is aszerint, hogy kitérnek-e a környezeti és a vállalati teljesítmény kapcsolatának vizsgálatára, illetve a környezeti teljesítményt kellően átfogóan vizsgálják-e. Nagyító alá kerül az a kérdés is, hogy vajon a teljesítményértékelési módszerek alapján jól teljesítő vállalatok valóban tekinthetők-e fenntarthatónak. ________ There are numerous methods existing for evaluating corporate environmental performance. The article offers some guidance in this labyrinth by introducing and evaluating six, in practice also used methods. The author makes an attempt to compare the different methods, whether they cover the relationship between environmental and company performance, and whether they analyse different components of environmental performance comprehensively enough. The question is also covered, whether companies with excellent performance based on the methods analysed can really be regarded as sustainable companies.

A közszolgálati szervezetek értékelési módszereinek osztályozása (Classification of evaluation methods of public sector organizations)

Az utóbbi évtizedekben egyre gyakrabban merült fel a közszolgálati szervezetek értékelésének igénye, és egyre újabb módszerek jelentek meg, amelyek felvetették ezek rendszerezésének szükségességét mind a gyakorlatban, mind a kutatásokban. A szerző a szakirodalomban fellelhető osztályozási kísérleteknek és az értékelés szakterülete szempontjainak figyelembevételével javaslatot tesz a közszolgálati szervezetek értékelési módszereinek osztályozási keretrendszerére. Az osztályozási szempontok között szerepel az értékelő helyzete, az értékelés szerepe és a megismerés módszere. Az osztályozási keretrendszer tartalmát a szerző példákkal is illusztrálja, amely jelzi a modell gyakorlati alkalmazhatóságát. Ugyanakkor a keretrendszer a kutatások fókuszának és érvényességi körének meghatározásában is segítséget nyújthat. _____ In the last decades the need of the evaluation of public sector organizations has emerged more and more often, and many new methods have shown up that has raised the need of their classification in practice and in research, as well. Based on literature review and the literature of evaluation the author makes a proposal on the classification framework of the evaluation methods of public sector organizations. The dimensions of the classification include the situation of evaluator, the role of evaluation and the approach of knowledge. The author illustrates the content of the framework with examples referring to the applicability of the model in practice. At the same time, the framework is also useful in determining the focus or the scope of research projects.

A comparative approach to web evaluation and website evaluation methods.

There is still a lack of an engineering approach for building Web systems, and the field of measuring the Web is not yet mature. In particular, there is an uncertainty in the selection of evaluation methods, and there are risks of standardizing inadequate evaluation practices. It is important to know whether we are evaluating the Web or specific website(s). We need a new categorization system, a different focus on evaluation methods, and an in-depth analysis that reveals the strengths and weaknesses of each method. As a contribution to the field of Web evaluation, this study proposes a novel approach to view and select evaluation methods based on the purpose and platforms of the evaluation. It has been shown that the choice of the appropriate evaluation method(s) depends greatly on the purpose of the evaluation.

Consumers Performance Evaluation of the Participation in Demand Response Programs Using Baseline Methods

Demand response has gain increasing importance in the context of competitive electricity markets environment. The use of demand resources is also advantageous in the context of smart grid operation. In addition to the need of new business models for integrating demand response, adequate methods are necessary for an accurate determination of the consumers’ performance evaluation after the participation in a demand response event. The present paper makes a comparison between some of the existing baseline methods related to the consumers’ performance evaluation, comparing the results obtained with these methods and also with a method proposed by the authors of the paper. A case study demonstrates the application of the referred methods to real consumption data belonging to a consumer connected to a distribution network.

A Survey on Graphical Methods for Classification Predictive Performance Evaluation

Predictive performance evaluation is a fundamental issue in design, development, and deployment of classification systems. As predictive performance evaluation is a multidimensional problem, single scalar summaries such as error rate, although quite convenient due to its simplicity, can seldom evaluate all the aspects that a complete and reliable evaluation must consider. Due to this, various graphical performance evaluation methods are increasingly drawing the attention of machine learning, data mining, and pattern recognition communities. The main advantage of these types of methods resides in their ability to depict the trade-offs between evaluation aspects in a multidimensional space rather than reducing these aspects to an arbitrarily chosen (and often biased) single scalar measure. Furthermore, to appropriately select a suitable graphical method for a given task, it is crucial to identify its strengths and weaknesses. This paper surveys various graphical methods often used for predictive performance evaluation. By presenting these methods in the same framework, we hope this paper may shed some light on deciding which methods are more suitable to use in different situations.

Evaluation of two morphometric methods of bone loss percentages caused by periodontitis in rats in different locations

Objective: The present study evaluated morphometrically bone loss percentages in experimental periodontitis in rats, comparing different locations (lingual mandible, palatal maxilla and buccal maxilla) and two evaluation methods (distance and area methods). Material and Methods: Ligatures were placed around the maxillary right second molar and around the mandibular right first molar in 14 female Wistar rats. The contralateral molars served as intragroup control. After 4 weeks, the rats were sacrificed and their mandible and maxilla were removed. The specimens were dissected and stained with methylene blue dye. Bone loss was evaluated by two different methods on the surfaces of the defleshed jaw. In the first method, the distance from the cementoenamel junction (CEJ) to the alveolar bone crest was measured in the roots of teeth associated with ligature. In the second method, the area of bone loss was determined using the alveolar tissue bone, CEJ and the proximal region of roots associated with the ligature as reference. The data were converted to bone loss percentages caused by ligature: (ligated - unligated) x 100/ligated. Results: When comparing the distance and area methods, no statistically significant difference was observed (p>0.05). Both methodologies indicated that the maxilla presented greater bone loss than the mandible and it was more accentuated on the buccal side than on the palatal side (p<0.05). Conclusions: The findings of this study show that both the area and the distance methods can be used to evaluate bone loss caused by ligature placement in rats, and suggest applying the morphometric methodology to the maxilla on the buccal side.

Porosity and sealing ability of root fillings with gutta-percha and BioRoot RCS or AH Plus sealers. Evaluation by three ex vivo methods

To investigate the ability of BioRoot RCS, a tricalcium silicate-based root canal sealer and AH Plus to effectively fill the root canals of contralateral teeth using three evaluation methods, and to investigate also the correlation between the methods. The prepared root canals of ten pairs of contralateral mandibular premolar teeth were filled with gutta-percha and sealer using lateral compaction. The percentage of voids within the root canal was assessed by micro-computed tomography, whilst sealing ability was investigated by fluid transport and leakage of fluorescent microspheres. The interaction of sealer with dentine, and sealer penetration were assessed by confocal microscopy. The void volume, fluid flow, microsphere leakage and sealer interaction with dentine for both materials were compared. Nonparametric (Mann-Whitney) tests were used to compare the % void and fluid transport of the two sealers. Spearman correlation was used to assess the pairwise relationships between the techniques. The level of significance was set to 0.05. BioRoot RCS exhibited significantly more percentage of voids than AH Plus. There was no difference in fluid flow and microsphere penetration. BioRoot RCS exhibited a different pattern of sealer penetration and interaction with the dentine walls compared to AH Plus. For both materials, the pairwise correlations between the three techniques were close to zero, indicating weak relationships. MicroCT analysis revealed a higher void volume for BioRoot RCS. The other techniques did not show a difference between the sealing ability of the sealers. The correlation between the three ex vivo methods of assessment was weak demonstrating their complementarity rather than their concordance.

Comparison of different space indexing methods for ecological evaluation of urban openspaces

Nowadays we meet many different evaluation methods regarding the ecological performance of green surfaces and parks. All these methods are extremely valuable in determining how well a green surface performs from ecological aspect and to what extent the environment were damaged if these sites would be built or would be developed any other way causing reduction of green surfaces. The goal of the article is to clarify the differences between two evaluation methods (GSI – Green Space Intensity, BARC – Biological Activity Rate Calculation) suitable for urban green infrastructure analysis and to see if any significant difference can be observed evaluating the same site by these methods. Our research sites are in Budapest and their sizes vary between 2,5-8 acres. The most important aspects of site analysis are the following: size and boundaries of the park, existence or lack of water features, the characteristics of their surfaces and the complexity of vegetation. We summarize the data of the site analysis in tables, make a summarizing diagram for visual representation and draw conclusions from the results. As a final step, we evaluate how these two evaluation systems relate to urban open space developments.

Evaluation of the Scottsdale Loop 101 automated speed enforcement demonstration program

Speeding is recognized as a major contributing factor in traffic crashes. In order to reduce speed-related crashes, the city of Scottsdale, Arizona implemented the first fixed-camera photo speed enforcement program (SEP) on a limited access freeway in the US. The 9-month demonstration program spanning from January 2006 to October 2006 was implemented on a 6.5 mile urban freeway segment of Arizona State Route 101 running through Scottsdale. This paper presents the results of a comprehensive analysis of the impact of the SEP on speeding behavior, crashes, and the economic impact of crashes. The impact on speeding behavior was estimated using generalized least square estimation, in which the observed speeds and the speeding frequencies during the program period were compared to those during other periods. The impact of the SEP on crashes was estimated using 3 evaluation methods: a before-and-after (BA) analysis using a comparison group, a BA analysis with traffic flow correction, and an empirical Bayes BA analysis with time-variant safety. The analysis results reveal that speeding detection frequencies (speeds> or =76 mph) increased by a factor of 10.5 after the SEP was (temporarily) terminated. Average speeds in the enforcement zone were reduced by about 9 mph when the SEP was implemented, after accounting for the influence of traffic flow. All crash types were reduced except rear-end crashes, although the estimated magnitude of impact varies across estimation methods (and their corresponding assumptions). When considering Arizona-specific crash related injury costs, the SEP is estimated to yield about $17 million in annual safety benefits.

The use of economic evaluation in CAM : an introductory framework

Background For CAM to feature prominently in health care decision-making there is a need to expand the evidence-base and to further incorporate economic evaluation into research priorities. In a world of scarce health care resources and an emphasis on efficiency and clinical efficacy, CAM, as indeed do all other treatments, requires rigorous evaluation to be considered in budget decision-making. Methods Economic evaluation provides the tools to measure the costs and health consequences of CAM interventions and thereby inform decision making. This article offers CAM researchers an introductory framework for understanding, undertaking and disseminating economic evaluation. The types of economic evaluation available for the study of CAM are discussed, and decision modelling is introduced as a method for economic evaluation with much potential for use in CAM. Two types of decision models are introduced, decision trees and Markov models, along with a worked example of how each method is used to examine costs and health consequences. This is followed by a discussion of how this information is used by decision makers. Conclusions Undoubtedly, economic evaluation methods form an important part of health care decision making. Without formal training it can seem a daunting task to consider economic evaluation, however, multidisciplinary teams provide an opportunity for health economists, CAM practitioners and other interested researchers, to work together to further develop the economic evaluation of CAM.

Technology transfer evaluation in the high technology industry : an interdisciplinary perspective

The underlying objective of this study was to develop a novel approach to evaluate the potential for commercialisation of a new technology. More specifically, this study examined the 'ex-ante'. evaluation of the technology transfer process. For this purpose, a technology originating from the high technology sector was used. The technology relates to the application of software for the detection of weak signals from space, which is an established method of signal processing in the field of radio astronomy. This technology has the potential to be used in commercial and industrial areas other than astronomy, such as detecting water leakages in pipes. Its applicability to detecting water leakage was chosen owing to several problems with detection in the industry as well as the impact it can have on saving water in the environment. This study, therefore, will demonstrate the importance of interdisciplinary technology transfer. The study employed both technical and business evaluation methods including laboratory experiments and the Delphi technique to address the research questions. There are several findings from this study. Firstly, scientific experiments were conducted and these resulted in a proof of concept stage of the chosen technology. Secondly, validation as well as refinement of criteria from literature that can be used for „ex-ante. evaluation of technology transfer has been undertaken. Additionally, after testing the chosen technology.s overall transfer potential using the modified set of criteria, it was found that the technology is still in its early stages and will require further development for it to be commercialised. Furthermore, a final evaluation framework was developed encompassing all the criteria found to be important. This framework can help in assessing the overall readiness of the technology for transfer as well as in recommending a viable mechanism for commercialisation. On the whole, the commercial potential of the chosen technology was tested through expert opinion, thereby focusing on the impact of a new technology and the feasibility of alternate applications and potential future applications.