Key-CRDT stores

Dissertação para obtenção do Grau de Mestre em Engenharia Informática

Transactional failure recovery for a distributed key-value store

With the advent of cloud computing, many applications have embraced the ensuing paradigm shift towards modern distributed key-value data stores, like HBase, in order to benefit from the elastic scalability on offer. However, many applications still hesitate to make the leap from the traditional relational database model simply because they cannot compromise on the standard transactional guarantees of atomicity, isolation, and durability. To get the best of both worlds, one option is to integrate an independent transaction management component with a distributed key-value store. In this paper, we discuss the implications of this approach for durability. In particular, if the transaction manager provides durability (e.g., through logging), then we can relax durability constraints in the key-value store. However, if a component fails (e.g., a client or a key-value server), then we need a coordinated recovery procedure to ensure that commits are persisted correctly. In our research, we integrate an independent transaction manager with HBase. Our main contribution is a failure recovery middleware for the integrated system, which tracks the progress of each commit as it is flushed down by the client and persisted within HBase, so that we can recover reliably from failures. During recovery, commits that were interrupted by the failure are replayed from the transaction management log. Importantly, the recovery process does not interrupt transaction processing on the available servers. Using a benchmark, we evaluate the impact of component failure, and subsequent recovery, on application performance.

Concise server-wide causality management for eventually consistent data stores

Large scale distributed data stores rely on optimistic replication to scale and remain highly available in the face of net work partitions. Managing data without coordination results in eventually consistent data stores that allow for concurrent data updates. These systems often use anti-entropy mechanisms (like Merkle Trees) to detect and repair divergent data versions across nodes. However, in practice hash-based data structures are too expensive for large amounts of data and create too many false conflicts. Another aspect of eventual consistency is detecting write conflicts. Logical clocks are often used to track data causality, necessary to detect causally concurrent writes on the same key. However, there is a nonnegligible metadata overhead per key, which also keeps growing with time, proportional with the node churn rate. Another challenge is deleting keys while respecting causality: while the values can be deleted, perkey metadata cannot be permanently removed without coordination. Weintroduceanewcausalitymanagementframeworkforeventuallyconsistentdatastores,thatleveragesnodelogicalclocks(BitmappedVersion Vectors) and a new key logical clock (Dotted Causal Container) to provides advantages on multiple fronts: 1) a new efficient and lightweight anti-entropy mechanism; 2) greatly reduced per-key causality metadata size; 3) accurate key deletes without permanent metadata.

A review and a conceptual framework of the key value drivers of mass customisation

The aim of this paper is to conceptualise the key value drivers of mass customisation in order to provide a structured approach to explain the added value that customers attribute to mass customised products. We assume that the added value of mass customisation is ultimately reflected in an increased willingness to pay. Previous studies show diverse results concerning customers' willingness to pay for mass customised products. We contribute to the existing body of research by suggesting and discussing the influence of general product characteristics and factors of the mass customisation approach on the key value drivers of mass customisation. Furthermore, the development of a conceptual framework offers explanations for the dissimilarity in customers' willingness to pay and advances the knowledge about the value increment of mass customised products as perceived by customers.

Value creation and capital market valuation in the forest product industry

Tämä työ tähtää löytämään mahdollisia poikkeamia metsäteollisuusyritysten markkina-arvoissa ja tunnistaa tekijöitä jotka ovat vaikuttaneet pääomamarkkinoiden odotuksiin yritysten tulevaisuuden suorituskyvystä sekä yrityksen markkina-arvoon. Tämän työn päätavoitteena on kehittää diskontattuihin kassavirtoihin perustuva arvonmääritysmalli jolla mitataan metsäteollisuusyritysten tosiasiallista arvoa yritysten suorituskyvyn ja arvoajureiden perusteella. Lisäksi tavoitteena on löytää selittäviä tekijöitä havaituille eroille yritysten tosiasiallisesten arvojen ja markkinaperusteisten arvojen välisillä. Teoreettisessa osassa esitellään rahoitusteorian pääpiirteet arvonmäärityksen kannalta, aikasempia tutkimuksia sekä metsäteollisuuden toimialakohtaisia tekijöitä. Empiirisessä osassa kehittetään diskontattuihin kassavirtoihin perustuvaa arvonmääritymalli. Otos koostuu 32 suurimmasta Pohjoismaisesta ja Pohjoisamerikkalaisesta metsäteollisuusyrityksestä vuonna 2000. Tutkimuksen aikavälien 1991 -2000. Tulokset tukevat aikaisempia tutkimuksia jonka mukaan kasvuinvestoinnit eivät luo positiivisia odotuksia yrityksen tulevaisuuden kassavirroista. Tarkemmat löydöt ovat, että arvon luominen tutkimusajanjakson aikana ei vaikuttanut yhtä merkittävästi pääomamarkkinoiden odotuksiin yrityksen tulevaisuuden suorituskyvystä kuin mitatut tosiasialliset arvot. Tulokset viittaavat siihen, että metsäteollisuusyritysten markkina- arvot olivat keskimäärin riippuvaisempia itse yrityksestä, kuin sen toiminnasta.

Caching and Visualizing Statistical Analyses

We present the cacher and CodeDepends packages for R, which provide tools for (1) caching and analyzing the code for statistical analyses and (2) distributing these analyses to others in an efficient manner over the web. The cacher package takes objects created by evaluating R expressions and stores them in key-value databases. These databases of cached objects can subsequently be assembled into “cache packages” for distribution over the web. The cacher package also provides tools to help readers examine the data and code in a statistical analysis and reproduce, modify, or improve upon the results. In addition, readers can easily conduct alternate analyses of the data. The CodeDepends package provides complementary tools for analyzing and visualizing the code for a statistical analysis and this functionality has been integrated into the cacher package. In this chapter we describe the cacher and CodeDepends packages and provide examples of how they can be used for reproducible research.

Sonaecom, SGPS-SA: Time to face the challenges...as always

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Finance from the NOVA – School of Business and Economics

Epidemic store for massive scale systems

The MAP-i doctoral program of the Universities of Minho, Aveiro and Porto

Column-based databases: estudo exploratório no âmbito das bases de dados NoSQL

Dissertação de mestrado integrado em Engenharia e Gestão de Sistemas de Informação

Document-based databases: estudo comparativo no âmbito das bases de dados NoSql

Dissertação de mestrado integrado em Engenharia e Gestão de Sistemas de Informação

Computer-Aided Business Model Design

There is a lack of dedicated tools for business model design at a strategic level. However, in today's economic world the need to be able to quickly reinvent a company's business model is essential to stay competitive. This research focused on identifying the functionalities that are necessary in a computer-aided design (CAD) tool for the design of business models in a strategic context. Using design science research methodology a series of techniques and prototypes have been designed and evaluated to offer solutions to the problem. The work is a collection of articles which can be grouped into three parts: First establishing the context of how the Business Model Canvas (BMC) is used to design business models and explore the way in which CAD can contribute to the design activity. The second part extends on this by proposing new technics and tools which support elicitation, evaluation (assessment) and evolution of business models design with CAD. This includes features such as multi-color tagging to easily connect elements, rules to validate coherence of business models and features that are adapted to the correct business model proficiency level of its users. A new way to describe and visualize multiple versions of a business model and thereby help in addressing the business model as a dynamic object was also researched. The third part explores extensions to the business model canvas such as an intermediary model which helps IT alignment by connecting business model and enterprise architecture. And a business model pattern for privacy in a mobile environment, using privacy as a key value proposition. The prototyped techniques and proposition for using CAD tools in business model modeling will allow commercial CAD developers to create tools that are better suited to the needs of practitioners.

Tuotehallinnan kehittäminen ICT-palveluyrityksessä

Tuotehallinta on yrityksissä keskeinen arvoa tuottava toiminto, joka hallinnoi ja johtaa tuotteiden elinkaarta aina ideavaiheesta tuotteiden lopettamiseen saakka. Tuotteiden hyvän kilpailukyvyn kautta yritys saa kilpailuetua markkinassa. Tutkimuksen kohteena oleva case-yritys haluaa kehittää tuotehallinnan toimintaa, jotta se kykenee toimimaan aiempaa tehokkaammin ja menestymään paremmin tiukasti kilpailluilla markkinoilla. Diplomityön päätavoitteena oli löytää keinoja kohdeyrityksen yritysliiketoiminnan tuotehallinnan kehittämiseksi. Tutkimus toteutettiin laadullisena tapaustutkimuksena. Tutkimuksessa käytiin läpi aihealueen tuoretta tutkimustietoa sekä aiempaa teoriaa. Työssä tutkittiin kohdeyrityksen tuotehallinnan nykytilannetta ja kehittämismahdollisuuksia. Saatujen tutkimustulosten pohjalta ja tunnistettua teoriaa hyödyntäen johdettiin konkreettisia kehitystoimenpiteitä. Työ tuotti kriittisen näkökulman tuotehallinnan nykytilanteeseen sekä esityksen tärkeimmiksi tunnistetuista kehittämistoimenpiteistä. Tutkimuksen keskeisimpänä tuloksena toimii johtopäätös tarpeesta rakentaa aiempaa vahvempi tuotehallinta. Tämän aikaansaamiseksi tulee tehdä joukko kehittämistoimenpiteitä, jotka jaettiin lyhyen ja pitkän aikavälin toimenpiteisiin. Kehitystoimenpiteiden toteut-tamiseksi esitetiin muodostettavan oma hallittu kehitysohjelma.

Les «Turcs» de Parc-Extension l'exemple d'un «ordre» communautaire

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal

DISTRIBUTED REPRODUCIBLE RESEARCH USING CACHED COMPUTATIONS

The ability to make scientific findings reproducible is increasingly important in areas where substantive results are the product of complex statistical computations. Reproducibility can allow others to verify the published findings and conduct alternate analyses of the same data. A question that arises naturally is how can one conduct and distribute reproducible research? This question is relevant from the point of view of both the authors who want to make their research reproducible and readers who want to reproduce relevant findings reported in the scientific literature. We present a framework in which reproducible research can be conducted and distributed via cached computations and describe specific tools for both authors and readers. As a prototype implementation we introduce three software packages written in the R language. The cacheSweave and stashR packages together provide tools for caching computational results in a key-value style database which can be published to a public repository for readers to download. The SRPM package provides tools for generating and interacting with "shared reproducibility packages" (SRPs) which can facilitate the distribution of the data and code. As a case study we demonstrate the use of the toolkit on a national study of air pollution exposure and mortality.

A REPRODUCIBLE RESEARCH TOOLKIT FOR R

We present a collection of R packages for conducting and distributing reproducible research using R, Sweave, and LaTeX. The collection consists of the cacheSweave, stashR, and SRPM packages which allow for the caching of computations in Sweave documents and the distribution of those cached computations via remotely accessible key-value databases. We describe the caching mechanism used by the cacheSweave package and tools that we have developed for authors and readers for the purposes of creating and interacting with reproducible documents.