Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Insights into the molecular architecture of a peptide nanotube using FTIR and solid-state NMR spectroscopic measurements on an aligned sample

The self-assembly of proteins and peptides into b-sheet-rich amyloid fibers is a process that has gained notoriety because of its association with human diseases and disorders. Spontaneous self-assembly of peptides into nonfibrillar supramolecular structures can also provide a versatile and convenient mechanism for the bottom-up design of biocompatible materials with functional properties favoring a wide range of practical applications.[1] One subset of these fascinating and potentially useful nanoscale constructions are the peptide nanotubes, elongated cylindrical structures with a hollow center bounded by a thin wall of peptide molecules.[2] A formidable challenge in optimizing and harnessing the properties of nanotube assemblies is to gain atomistic insight into their architecture, and to elucidate precisely how the tubular morphology is constructed from the peptide building blocks. Some of these fine details have been elucidated recently with the use of magic-angle-spinning (MAS) solidstate NMR (SSNMR) spectroscopy.[3] MAS SSNMR measurements of chemical shifts and through-space interatomic distances provide constraints on peptide conformation (e.g., b-strands and turns) and quaternary packing. We describe here a new application of a straightforward SSNMR technique which, when combined with FTIR spectroscopy, reports quantitatively on the orientation of the peptide molecules within the nanotube structure, thereby providing an additional structural constraint not accessible to MAS SSNMR.

Calculating the application criticality and business risk from technology obsolescence

The problem of technology obsolescence in information intensive businesses (software and hardware no longer being supported and replaced by improved and different solutions) and a cost constrained market can severely increase costs and operational, and ultimately reputation risk. Although many businesses recognise technological obsolescence, the pervasive nature of technology often means they have little information to identify the risk and location of pending obsolescence and little money to apply to the solution. This paper presents a low cost structured method to identify obsolete software and the risk of their obsolescence where the structure of a business and its supporting IT resources can be captured, modelled, analysed and the risk to the business of technology obsolescence identified to enable remedial action using qualified obsolescence information. The technique is based on a structured modelling approach using enterprise architecture models and a heatmap algorithm to highlight high risk obsolescent elements. The method has been tested and applied in practice in three consulting studies carried out by Capgemini involving four UK police forces. However the generic technique could be applied to any industry based on plans to improve it using ontology framework methods. This paper contains details of enterprise architecture meta-models and related modelling.

A benchmark-driven modelling approach for evaluating deployment choices on a multi-core architecture

The complexity of current and emerging architectures provides users with options about how best to use the available resources, but makes predicting performance challenging. In this work a benchmark-driven model is developed for a simple shallow water code on a Cray XE6 system, to explore how deployment choices such as domain decomposition and core affinity affect performance. The resource sharing present in modern multi-core architectures adds various levels of heterogeneity to the system. Shared resources often includes cache, memory, network controllers and in some cases floating point units (as in the AMD Bulldozer), which mean that the access time depends on the mapping of application tasks, and the core's location within the system. Heterogeneity further increases with the use of hardware-accelerators such as GPUs and the Intel Xeon Phi, where many specialist cores are attached to general-purpose cores. This trend for shared resources and non-uniform cores is expected to continue into the exascale era. The complexity of these systems means that various runtime scenarios are possible, and it has been found that under-populating nodes, altering the domain decomposition and non-standard task to core mappings can dramatically alter performance. To find this out, however, is often a process of trial and error. To better inform this process, a performance model was developed for a simple regular grid-based kernel code, shallow. The code comprises two distinct types of work, loop-based array updates and nearest-neighbour halo-exchanges. Separate performance models were developed for each part, both based on a similar methodology. Application specific benchmarks were run to measure performance for different problem sizes under different execution scenarios. These results were then fed into a performance model that derives resource usage for a given deployment scenario, with interpolation between results as necessary.

Insurgencies and counterinsurgency strategies: patterns and dilemmas

The roots of insurgencies and counterinsurgency go back to Antiquity, and consistent patterns can be traced. These include the state's use of its own armed forces against insurgents who tend to be inferior in terms of armaments, and states' attempts to delegitimize violent aimed to overthrow it, and the need for insurgents to recur to illegal means to challenge the state's power. Very often insurgents have to team up with criminal networks in order to do so, undermining their ability to claim legitimacy.

Categories & order systems: Claude Parent and The Serving Library intersections of architecture, art and editorial design

This paper discusses the work of Claude Parent and The Serving Library, considering the critiques generated by their intersecting of architecture, art and editorial design. Through focus on the ways in which hosting environment, architecture and forms of expanded publishing can serve to dissolve disciplinary boundaries and activities of production, spectatorship and reception, it draws on the lineage of 1960s/70s Conceptual Art in considering these practices as a means through which to escape medium specificity and spatial confinement. Relationships between actual and virtual space are then read against this broadening of aesthetic ideas and the theory of critical modernity.

Spatial patterns and environmental constraints on ecosystem services at a catchment scale

Improved understanding and prediction of the fundamental environmental controls on ecosystem service supply across the landscape will help to inform decisions made by policy makers and land-water managers. To evaluate this issue for a local catchment case study, we explored metrics and spatial patterns of service supply for water quality regulation, agriculture production, carbon storage, and biodiversity for the Macronutrient Conwy catchment. Methods included using ecosystem models such as LUCI and JULES, integration of national scale field survey datasets, earth observation products and plant trait databases, to produce finely resolved maps of species richness and primary production. Analyses were done with both 1x1 km gridded and subcatchment data. A common single gradient characterised catchment scale ecosystem services supply with agricultural production and carbon storage at opposing ends of the gradient as reported for a national-scale assessment. Species diversity was positively related to production due to the below national average productivity levels in the Conwy combined with the unimodal relationship between biodiversity and productivity at the national scale. In contrast to the national scale assessment, a strong reduction in water quality as production increased was observed in these low productive systems. Various soil variables were tested for their predictive power of ecosystem service supply. Soil carbon, nitrogen, their ratio and soil pH all had double the power of rainfall and altitude, each explaining around 45% of variation but soil pH is proposed as a potential metric for ecosystem service supply potential as it is a simple and practical metric which can be carried out in the field with crowd-sourcing technologies now available. The study emphasises the importance of considering multiple ecosystem services together due to the complexity of covariation at local and national scales, and the benefits of exploiting a wide range of metrics for each service to enhance data robustness.

Cultural value of architecture in homes and neighbourhoods

This paper provides an account of the Cultural Value of Architecture in Homes and Neighbourhoods, (CVoA), a project developed with the Royal Institute of British Architects (RIBA). The first stage of the project was a critical review of ‘grey literature’ since 2000, industry based research on the value of architecture subdivided into themes: overall value; health and wellbeing; neighbourhood cohesion and heritage and belonging. Findings from the review revealed a marked absence of evidence of the value of architecture and an over preoccupation with the final building, the product of an interdisciplinary team not just Architects, as well as a general confusion about what it is that Architects do. Further consultation has led to the development of a framework for defining and communicating the skillsets of Architects and for developing an evidence base for their value. Our target audience is non-Architects as we are concerned with making the profession more inclusive hence our desire to create simple definitions and terminology.