Pragmatic development of service based real-time change data capture

This thesis makes a contribution to the Change Data Capture (CDC) field by providing an empirical evaluation on the performance of CDC architectures in the context of realtime data warehousing. CDC is a mechanism for providing data warehouse architectures with fresh data from Online Transaction Processing (OLTP) databases. There are two types of CDC architectures, pull architectures and push architectures. There is exiguous data on the performance of CDC architectures in a real-time environment. Performance data is required to determine the real-time viability of the two architectures. We propose that push CDC architectures are optimal for real-time CDC. However, push CDC architectures are seldom implemented because they are highly intrusive towards existing systems and arduous to maintain. As part of our contribution, we pragmatically develop a service based push CDC solution, which addresses the issues of intrusiveness and maintainability. Our solution uses Data Access Services (DAS) to decouple CDC logic from the applications. A requirement for the DAS is to place minimal overhead on a transaction in an OLTP environment. We synthesize DAS literature and pragmatically develop DAS that eciently execute transactions in an OLTP environment. Essentially we develop effeicient RESTful DAS, which expose Transactions As A Resource (TAAR). We evaluate the TAAR solution and three pull CDC mechanisms in a real-time environment, using the industry recognised TPC-C benchmark. The optimal CDC mechanism in a real-time environment, will capture change data with minimal latency and will have a negligible affect on the database's transactional throughput. Capture latency is the time it takes a CDC mechanism to capture a data change that has been applied to an OLTP database. A standard definition for capture latency and how to measure it does not exist in the field. We create this definition and extend the TPC-C benchmark to make the capture latency measurement. The results from our evaluation show that pull CDC is capable of real-time CDC at low levels of user concurrency. However, as the level of user concurrency scales upwards, pull CDC has a significant impact on the database's transaction rate, which affirms the theory that pull CDC architectures are not viable in a real-time architecture. TAAR CDC on the other hand is capable of real-time CDC, and places a minimal overhead on the transaction rate, although this performance is at the expense of CPU resources.

Using architecture models to support the generation and operation of component-based adaptive systems

Modelling architectural information is particularly important because of the acknowledged crucial role of software architecture in raising the level of abstraction during development. In the MDE area, the level of abstraction of models has frequently been related to low-level design concepts. However, model-driven techniques can be further exploited to model software artefacts that take into account the architecture of the system and its changes according to variations of the environment. In this paper, we propose model-driven techniques and dynamic variability as concepts useful for modelling the dynamic fluctuation of the environment and its impact on the architecture. Using the mappings from the models to implementation, generative techniques allow the (semi) automatic generation of artefacts making the process more efficient and promoting software reuse. The automatic generation of configurations and reconfigurations from models provides the basis for safer execution. The architectural perspective offered by the models shift focus away from implementation details to the whole view of the system and its runtime change promoting high-level analysis. © 2009 Springer Berlin Heidelberg.

Institutional change and the challenge of policy coordination in the English regions

By contrast to major constitutional reforms elsewhere in the UK, in England's eight regions beyond London New Labour has favoured administrative decentralisation. This paper examines these institutional arrangements and assesses their capacity to develop a more integrated approach to territorial development. It confirms a growing awareness of the need to ensure greater coherence between policies to promote economic, social and environmental wellbeing. Nonetheless, a complex regional institutional architecture, inconsistent sector-based strategies, a lack of strategic leadership and blurred accountabilities hamper moves towards policy integration and the delivery of joint outcomes. Moreover, despite ongoing reforms, the absence of a clear regional agenda in a functionally designed Whitehall raises fundamental questions about the ability of sub-national bodies to work collectively to develop and implement a more coherent approach to regional policy.

Optimising the nanoporous architecture of solid acid and base catalysts for biodiesel synthesis

Dwindling oil reserves and growing concerns over CO2 emissions and associated climate change are driving the utilisation of renewable feedstocks as alternative, sustainable fuel sources. While rising oil prices are improving the commercial feasibility of biodiesel production, many current processes still employ homogeneous acid and/or base catalysts to transform plant or algae oil into the fatty acid methyl ester (FAME) components of biodiesel. Fuel purification requires energy intensive aqueous quench and neutralization steps, thus the rational design of new high activity catalysts is required to deliver biodiesel as a major player in the 21st century sustainable energy portfolio. Advances in the development of heterogeneous catalysts for biodiesel synthesis require catalysts with pore architectures designed to improve the accessibility of bulky viscous reactants typical of plant oils. Here we discuss how improvements to active site accessibility and catalyst activity in transesterification or esterification reactions can be achieved either by designing hierarchical pore networks or by pore expansion and use of interconnected pore architectures.

An end to end architecture for ubiquitous super-fast broadband

There is growing pressure to ensure that future broadband networks are both super fast and ubiquitously available to all users without the need for large government subsidies, this requires a radical change to network architectures. © OSA 2013.