Benchmarking for stability evaluation of computer systems

In this paper we propose a new benchmark to drive making decisions in maintenance of computer systems. This benchmark is made from load average sample data. The main goal is to improve reliability and performance of a set of devices or components. In particular, the stability of the system is measured in terms of variability of the load. A forecast of the behavior of this stability is also proposal as part of the reporting benchmark. At the final stage, a more stable system is obtained and its global reliability and performance can be then evaluated by means of appropriate specifications.

Benchmarking federated SPARQL query engines: Are existing testbeds enough?

Testbeds proposed so far to evaluate, compare, and eventually improve SPARQL query federation systems have still some limitations. Some variables and con�gurations that may have an impact on the behavior of these systems (e.g., network latency, data partitioning and query properties) are not su�ciently de�ned; this a�ects the results and repeatability of independent evaluation studies, and hence the insights that can be obtained from them. In this paper we evaluate FedBench, the most comprehensive testbed up to now, and empirically probe the need of considering additional dimensions and variables. The evaluation has been conducted on three SPARQL query federation systems, and the analysis of these results has allowed to uncover properties of these systems that would normally be hidden with the original testbeds.

Benchmarking of calculation schemes in Apollo2 and COBAYA3 for VVER lattices

This paper presents solutions of the NURISP VVER lattice benchmark using APOLLO2, TRIPOLI4 and COBAYA3 pin-by-pin. The main objective is to validate MOC based calculation schemes for pin-by-pin cross-section generation with APOLLO2 against TRIPOLI4 reference results. A specific objective is to test the APOLLO2 generated cross-sections and interface discontinuity factors in COBAYA3 pin-by-pin calculations with unstructured mesh. The VVER-1000 core consists of large hexagonal assemblies with 2mm inter-assembly water gaps which require the use of unstructured meshes in the pin-by-pin core simulators. The considered 2D benchmark problems include 19-pin clusters, fuel assemblies and 7-assembly clusters. APOLLO2 calculation schemes with the step characteristic method (MOC) and the higher-order Linear Surface MOC have been tested. The comparison of APOLLO2 vs.TRIPOLI4 results shows a very close agreement. The 3D lattice solver in COBAYA3 uses transport corrected multi-group diffusion approximation with interface discontinuity factors of GET or Black Box Homogenization type. The COBAYA3 pin-by-pin results in 2, 4 and 8 energy groups are close to the reference solutions when using side-dependent interface discontinuity factors.

On correctness in RDF stream processor benchmarking

Two complementary benchmarks have been proposed so far for the evaluation and continuous improvement of RDF stream processors: SRBench and LSBench. They put a special focus on different features of the evaluated systems, including coverage of the streaming extensions of SPARQL supported by each processor, query processing throughput, and an early analysis of query evaluation correctness, based on comparing the results obtained by different processors for a set of queries. However, none of them has analysed the operational semantics of these processors in order to assess the correctness of query evaluation results. In this paper, we propose a characterization of the operational semantics of RDF stream processors, adapting well-known models used in the stream processing engine community: CQL and SECRET. Through this formalization, we address correctness in RDF stream processor benchmarks, allowing to determine the multiple answers that systems should provide. Finally, we present CSRBench, an extension of SRBench to address query result correctness verification using an automatic method.

Towards a systematic benchmarking of ontology-based query rewriting systems

Query rewriting is one of the fundamental steps in ontologybased data access (OBDA) approaches. It takes as inputs an ontology and a query written according to that ontology, and produces as an output a set of queries that should be evaluated to account for the inferences that should be considered for that query and ontology. Different query rewriting systems give support to different ontology languages with varying expressiveness, and the rewritten queries obtained as an output do also vary in expressiveness. This heterogeneity has traditionally made it difficult to compare different approaches, and the area lacks in general commonly agreed benchmarks that could be used not only for such comparisons but also for improving OBDA support. In this paper we compile data, dimensions and measurements that have been used to evaluate some of the most recent systems, we analyse and characterise these assets, and provide a unified set of them that could be used as a starting point towards a more systematic benchmarking process for such systems. Finally, we apply this initial benchmark with some of the most relevant OBDA approaches in the state of the art.

Evaluation of the utilization of electric vehicles for building energy management in hotels

Governments are working in new policies to slow down total energy consumption and greenhouse gases (GHG) emissions, promoting the deployment of electric vehicles (EVs) in all countries. In order to facilitate this deployment and help to reduce the final costs of their batteries, additional utilization of EVs when those are parked has been proposed. EVs can be used to minimize the total electricity cost of buildings (named vehicle to building applications, V2B). In this paper an economic evaluation of EVs in the Building Energy Management System is shown. The optimal storage capacity and its equivalent number of EVs are determined. This value is then used for determining the optimal charging schedule to be applied to the batteries. From this schedule, the total expected profit is derived for the case of a real hotel in Spain.

Code assessment and modelling for Design Basis Accident Analysis of the European sodium fast reactor design. Part I: System description, modelling and benchmarking

The new reactor concepts proposed in the Generation IV International Forum (GIF) are conceived to improve the use of natural resources, reduce the amount of high-level radioactive waste and excel in their reliability and safe operation. Among these novel designs sodium fast reactors (SFRs) stand out due to their technological feasibility as demonstrated in several countries during the last decades. As part of the contribution of EURATOM to GIF the CP-ESFR is a collaborative project with the objective, among others, to perform extensive analysis on safety issues involving renewed SFR demonstrator designs. The verification of computational tools able to simulate the plant behaviour under postulated accidental conditions by code-to-code comparison was identified as a key point to ensure reactor safety. In this line, several organizations employed coupled neutronic and thermal-hydraulic system codes able to simulate complex and specific phenomena involving multi-physics studies adapted to this particular fast reactor technology. In the “Introduction” of this paper the framework of this study is discussed, the second section describes the envisaged plant design and the commonly agreed upon modelling guidelines. The third section presents a comparative analysis of the calculations performed by each organisation applying their models and codes to a common agreed transient with the objective to harmonize the models as well as validating the implementation of all relevant physical phenomena in the different system codes.

Towards a Systematic benchmarking of ontology-based query rewriting systems

Query rewriting is one of the fundamental steps in ontologybased data access (OBDA) approaches. It takes as inputs an ontology and a query written according to that ontology, and produces as an output a set of queries that should be evaluated to account for the inferences that should be considered for that query and ontology. Different query rewriting systems give support to different ontology languages with varying expressiveness, and the rewritten queries obtained as an output do also vary in expressiveness. This heterogeneity has traditionally made it difficult to compare different approaches, and the area lacks in general commonly agreed benchmarks that could be used not only for such comparisons but also for improving OBDA support. In this paper we compile data, dimensions and measurements that have been used to evaluate some of the most recent systems, we analyse and characterise these assets, and provide a unified set of them that could be used as a starting point towards a more systematic benchmarking process for such systems. Finally, we apply this initial benchmark with some of the most relevant OBDA approaches in the state of the art.

Parametric & nonparametric approaches to event studies: an application to a hotel’s market value

The main objective of this paper is twofold: on the one hand, to analyse the impact that the announcement of the opening of a new hotel has on the performance of its chain by carrying out an event study, and on the other hand, to compare the results of two different approaches to this method: a parametric specification based on the autoregressive conditional heteroskedasticity models to estimate the market model, and a nonparametric approach, which implies employing Theil’s nonparametric regression technique, which in turn, leads to the so-called complete nonparametric approach to event studies. The results that the empirical application arrives at are noteworthy as, on average, the reaction to such news releases is highly positive, both approaches reaching the same level of significance. However, a word of caution must be said when one is not only interested in detecting whether the market reacts, but also in obtaining an exhaustive calculation of the abnormal returns to further examine its determining factors.

Industry-specific effect of CSR initiatives: hotels and airlines

Purpose – This study aims to examine the relationships between a firm's corporate social responsibility (CSR) activities and its performance and risk. The authors hypothesize that industry-level effects are highly determinant of the sign and magnitude of these relationships to establish a ranking of industries to identify the position of the most prominent tourism-related industries: hotels and airlines. Based on the cybernetic model of decision making and the heuristics thereof, shareholders base their investment decisions derived from CSR announcements on the idea that the industries behave differently; their fixed costs being a relevant factor. Design/methodology/approach – The authors estimate the industry-specific effects of CSR initiatives on firms' performance and risk using a sample of 583 announcements from the Spanish Stock Market. Findings – The results show that while CSR announcements have a positive effect on performance when the authors do not account for industry-specific factors, once the authors incorporate these factors into the analysis, the authors find that firm performance and risk vary quite substantially as a function of the industry to which the firm belongs. Interestingly, while the hotel industry presents an average behavior (standing at 9th position in returns, 15th in terms of risk, and 8th according to the ratio returns/volatility), the airline industry presents the worst situation of all industries: last in performance and last in risk. Practical implications – The results help managers assess their decisions and allocate CSR resources optimally. Originality/value – This article is the first attempt to empirically test and comprehensively detect the different relationships between CSR and firm performance across industries.

Organizational design, quality management and competitive advantage in hotels

Purpose – The aim of this study is to examine the relationship between practices of quality management (QM) and the characteristics of organizational design, and QM and competitive advantage. Design/methodology/approach – The study uses a partial least squares approach to test these relationships in 350 hotels in Spain. Findings – The findings show that QM influences specialization, formalization and interdepartmental interactions, and that QM practices influence both cost and differentiation competitive advantage. The results also indicate the importance of QM strategic and operational systems as practices that have a key impact on the characteristics of organizational design. Similarly, the QM operational system is key in the relationship between QM and cost competitive advantage. Finally, the QM operational, information and strategic systems positively influence differentiation competitive advantage. Practical implications – When hotels adopt QM practices, there will be significant changes in a number of organizational variables, including specialization, formalization and interdepartmental interactions. This paper provides empirical evidence that QM practices improve both cost and differentiation competitive advantage in the hotel industry. Originality/value – There has been little research on the effects of QM on organizational design in the hotel industry. The contribution of this paper is that analyze the effects of QM on organizational design and competitive advantage, extending knowledge about these issues in a specific sector.