Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Lightly branched comb polyesters: application in fast drying solvent-borne coating formulations

Novel oxazoline-based comb-polymers possessing linoleyl or oleic side chains have been synthesized and used to produce low viscosity coatings. Inclusion of the polymers in model paint formulations results in coatings that exhibit faster drying times than commercially available alkyd resin formulations. The comb polymers were produced from diol substituted oxazoline monomers that were synthesized through a scalable, solvent free protocol and purified by simple recrystallisation. Co-polymerisation of the oxazolines with adipic acid at 160 °C in the bulk resulted in the targeted polyester comb type polymers. The polymers were soluble in a range of organic solvents and compatible with commercial alkyd resins. Model paint formulations containing up to 40 wt% of the linoleyl-based comb polymers exhibited a dramatic reduction in viscosity (from 35 to 13 Poise at 25 °C) with increasing quantities of polymer added. Dynamic mechanical analysis (DMA) studies revealed that the drying rate of the model paint formulations containing the comb polymers was enhanced when compared with that of commercial alkyd resins.

Perception of thickness, mouth-coating and mouth-drying of dairy beverages by younger and older volunteer

Sensory perception has been found to change during ageing. The perception of mouth feel by older adults, and the role of ageing on the sensory perception of texture attributes is uncertain. . This study investigated perception of the textural attributes of thickness, mouth-coating and mouth-drying, in the context of dairy beverages, by older and younger adults. Just noticeable differences (JND) of a starch thickener and for cream concentration within milk were established for thickness and mouth-coating perception, finding no age-related differences between participant groups. Mouth-drying was assessed through the directional paired comparison of a mouth-drying milk beverage to a skimmed milk sample. The older adults were found to be more sensitive to mouth-drying (p=0.03) than the younger adults. This study found no age-related decline in texture perception with older adults finding perception of some attributes such as mouth-drying enhanced by ageing.

A comparison of automated keyphrase extraction techniques and of automatic evaluation vs. human evaluation

Keyphrases are added to documents to help identify the areas of interest they contain. However, in a significant proportion of papers author selected keyphrases are not appropriate for the document they accompany: for instance, they can be classificatory rather than explanatory, or they are not updated when the focus of the paper changes. As such, automated methods for improving the use of keyphrases are needed, and various methods have been published. However, each method was evaluated using a different corpus, typically one relevant to the field of study of the method’s authors. This not only makes it difficult to incorporate the useful elements of algorithms in future work, but also makes comparing the results of each method inefficient and ineffective. This paper describes the work undertaken to compare five methods across a common baseline of corpora. The methods chosen were Term Frequency, Inverse Document Frequency, the C-Value, the NC-Value, and a Synonym based approach. These methods were analysed to evaluate performance and quality of results, and to provide a future benchmark. It is shown that Term Frequency and Inverse Document Frequency were the best algorithms, with the Synonym approach following them. Following these findings, a study was undertaken into the value of using human evaluators to judge the outputs. The Synonym method was compared to the original author keyphrases of the Reuters’ News Corpus. The findings show that authors of Reuters’ news articles provide good keyphrases but that more often than not they do not provide any keyphrases.

Wall materials and techniques available for low cost housing in Khartoum from a sustainability point of view

Khartoum like many cities in least developing countries (LDCs) still witnesses huge influx of people. Accommodation of the new comers leads to encroachment on the cultivation land leads to sprawl expansion of Greater Khartoum. The city expanded in diameter from 16.8 km in 1955 to 802.5 km in 1998. Most of this horizontal expansion was residential. In 2008 Khartoum accommodated 29% of the urban population of Sudan. Today Khartoum is considered as one of 43 major cities in Africa that accommodates more than 1 million inhabitants. Most of new comers live in the outskirts of the city e.g. Dar El-Salam and Mayo neighbourhoods. The majority of those new comers built their houses especially the walls from mud, wood, straw and sacks. Selection of building materials usually depends on its price regardless of the environmental impact, quality, thermal performance and life of the material. Most of the time, this results in increasing the cost with variables of impacts over the environment during the life of the building. Therefore, consideration of the environmental impacts, social impacts and economic impacts is crucial in the selection of any building material. Decreasing such impacts could lead to more sustainable housing. Comparing the sustainability of the available wall building materials for low cost housing in Khartoum is carried out through the life cycle assessment (LCA) technique. The purpose of this paper is to compare the most available local building materials for walls for the urban poor of Khartoum from a sustainability point of view by going through the manufacturing of the materials, the use of these materials and then the disposal of the materials after their life comes to an end. Findings reveal that traditional red bricks couldn’t be considered as a sustainable wall building material that will draw the future of the low cost housing in Greater Khartoum. On the other hand, results of the comparison lead to draw attention to the wide range of the soil techniques and to its potentials to be a promising sustainable wall material for urban low cost housing in Khartoum.

Influence of encapsulation and coating materials on the survival of Lactobacillus plantarum and Bifidobacterium longum in fruit juices

The aim of this work was to compare alginate and pectin beads for improving the survival of Lactobacillus plantarum and Bifidobacterium longum during storage in pomegranate and cranberry juice, and to evaluate the influence of various coating materials, including chitosan, gelatin and glucomannan on cell survival and on the size and hardness of the beads. In pomegranate juice, free cells of L. plantarum died within 4 weeks of storage and those of B. longum within 1 week; in cranberry juice both types of cells died within one week. Encapsulation within either alginate or pectin beads improved cell survival considerably, but coating of the beads with chitosan or gelatin improved it even further; coating with glucomannan did not have any positive effect. The double gelatin coated pectin beads gave the highest protection among all types of beads, as a final concentration of approximately 108 CFU/mL and 106 CFU/mL for both L. plantarum and B. longum was obtained after 6 weeks of storage in pomegranate and cranberry juice, respectively. The good protection could be attributed to the very strong interaction between the two polymers, as measured by turbidity experiments, leading to the formation of a polyelectrolyte complex. It was also shown that the coating was able to inhibit the penetration of gallic acid within the beads, which was used in this study as a model phenolic compound with antimicrobial activity; this is a likely mechanism through which the beads were able to protect the cells from the antimicrobial activity of phenolic compounds present in both types of juices. Despite their good protective effect, the pectin beads were considerably softer than the alginate beads, an issue that should be addressed in order to increase their mechanical stability.

An overview of interactive visual data mining techniques for knowledge discovery

n the past decade, the analysis of data has faced the challenge of dealing with very large and complex datasets and the real-time generation of data. Technologies to store and access these complex and large datasets are in place. However, robust and scalable analysis technologies are needed to extract meaningful information from these datasets. The research field of Information Visualization and Visual Data Analytics addresses this need. Information visualization and data mining are often used complementary to each other. Their common goal is the extraction of meaningful information from complex and possibly large data. However, though data mining focuses on the usage of silicon hardware, visualization techniques also aim to access the powerful image-processing capabilities of the human brain. This article highlights the research on data visualization and visual analytics techniques. Furthermore, we highlight existing visual analytics techniques, systems, and applications including a perspective on the field from the chemical process industry.

Synthesis of novel hyperbranched polymers featuring oxazoline linear units and their application in fast-drying solvent-borne coating formulations

Novel acid-terminated hyperbranched polymers (HBPs) containing adipic acid and oxazoline monomers derived from oleic and linoleic acid have been synthesized via a bulk polymerization procedure. Branching was achieved as a consequence of an acid-catalyzed opening of the oxazoline ring to produce a trifunctional monomer in situ which delivered branching levels of >45% as determined by 1H and 13C NMR spectroscopy. The HBPs were soluble in common solvents, such as CHCl3, acetone, tetrahydrofuran, dimethylformamide, and dimethyl sulfoxide and were further functionalized by addition of citronellol to afford white-spirit soluble materials that could be used in coating formulations. During end group modification, a reduction in branching levels of the HBPs (down to 12–24%) was observed, predominantly on account of oxazoline ring reformation and trans-esterification processes under the reaction conditions used. In comparison to commercial alkyd resin paint coatings, formulations of the citronellol-functionalized hyperbranched materials blended with a commercial alkyd resin exhibited dramatic decreases of the blend viscosity when the HBP content was increased. The curing characteristics of the HBP/alkyd blend formulations were studied by dynamic mechanical analysis which revealed that the new coatings cured more quickly and produced tougher materials than otherwise identical coatings prepared from only the commercial alkyd resins.

Extended optimal estimation techniques for sea surface temperature from the Spinning Enhanced Visible and Infra-Red Imager (SEVIRI)

Sea surface temperature (SST) can be estimated from day and night observations of the Spinning Enhanced Visible and Infra-Red Imager (SEVIRI) by optimal estimation (OE). We show that exploiting the 8.7 μm channel, in addition to the “traditional” wavelengths of 10.8 and 12.0 μm, improves OE SST retrieval statistics in validation. However, the main benefit is an improvement in the sensitivity of the SST estimate to variability in true SST. In a fair, single-pixel comparison, the 3-channel OE gives better results than the SST estimation technique presently operational within the Ocean and Sea Ice Satellite Application Facility. This operational technique is to use SST retrieval coefficients, followed by a bias-correction step informed by radiative transfer simulation. However, the operational technique has an additional “atmospheric correction smoothing”, which improves its noise performance, and hitherto had no analogue within the OE framework. Here, we propose an analogue to atmospheric correction smoothing, based on the expectation that atmospheric total column water vapour has a longer spatial correlation length scale than SST features. The approach extends the observations input to the OE to include the averaged brightness temperatures (BTs) of nearby clear-sky pixels, in addition to the BTs of the pixel for which SST is being retrieved. The retrieved quantities are then the single-pixel SST and the clear-sky total column water vapour averaged over the vicinity of the pixel. This reduces the noise in the retrieved SST significantly. The robust standard deviation of the new OE SST compared to matched drifting buoys becomes 0.39 K for all data. The smoothed OE gives SST sensitivity of 98% on average. This means that diurnal temperature variability and ocean frontal gradients are more faithfully estimated, and that the influence of the prior SST used is minimal (2%). This benefit is not available using traditional atmospheric correction smoothing.

Urban retrofitting: identifying disruptive and sustaining technologies using performative and foresight techniques

Cities, which are now inhabited by a majority of the world's population, are not only an important source of global environmental and resource depletion problems, but can also act as important centres of technological innovation and social learning in the continuing quest for a low carbon future. Planning and managing large-scale transitions in cities to deal with these pressures require an understanding of urban retrofitting at city scale. In this context performative techniques (such as backcasting and roadmapping) can provide valuable tools for helping cities develop a strategic view of the future. However, it is also important to identify ‘disruptive’ and ‘sustaining’ technologies which may contribute to city-based sustainability transitions. This paper presents research findings from the EPSRC Retrofit 2050 project, and explores the relationship between technology roadmaps and transition theory literature, highlighting the research gaps at urban/city level. The paper develops a research methodology to describe the development of three guiding visions for city-regional retrofit futures, and identifies key sustaining and disruptive technologies at city scale within these visions using foresight (horizon scanning) techniques. The implications of the research for city-based transition studies and related methodologies are discussed.

FAMOUS, faster: using parallel computing techniques to accelerate the FAMOUS/HadCM3 climate model with a focus on the radiative transfer algorithm

We have optimised the atmospheric radiation algorithm of the FAMOUS climate model on several hardware platforms. The optimisation involved translating the Fortran code to C and restructuring the algorithm around the computation of a single air column. Instead of the existing MPI-based domain decomposition, we used a task queue and a thread pool to schedule the computation of individual columns on the available processors. Finally, four air columns are packed together in a single data structure and computed simultaneously using Single Instruction Multiple Data operations. The modified algorithm runs more than 50 times faster on the CELL’s Synergistic Processing Elements than on its main PowerPC processing element. On Intel-compatible processors, the new radiation code runs 4 times faster. On the tested graphics processor, using OpenCL, we find a speed-up of more than 2.5 times as compared to the original code on the main CPU. Because the radiation code takes more than 60% of the total CPU time, FAMOUS executes more than twice as fast. Our version of the algorithm returns bit-wise identical results, which demonstrates the robustness of our approach. We estimate that this project required around two and a half man-years of work.

Alanine-rich amphiphilic peptide containing the RGD cell adhesion motif: a coating material for human fibroblast attachment and culture

We studied the self-assembly of peptide A6RGD (A: alanine, R: arginine, G: glycine, D: aspartic acid) in water, and the use of A6RGD substrates as coatings to promote the attachment of human cornea stromal fibroblasts (hCSFs). The self-assembled motif of A6RGD was shown to depend on the peptide concentration in water, where both vesicle and fibril formation were observed. Oligomers were detected for 0.7 wt% A6RGD, which evolved into short peptide fibres at 1.0 wt% A6RGD, while a co-existence of vesicles and long peptide fibres was revealed for 2–15 wt% A6RGD. A6RGD vesicle walls were shown to have a multilayer structure built out of highly interdigitated A6 units, while A6RGD fibres were based on β-sheet assemblies. Changes in the self-assembly motif with concentration were reflected in the cell culture assay results. Films dried from 0.1–1.0 wt% A6RGD solutions allowed hCSFs to attach and significantly enhanced cell proliferation relative to the control. In contrast, films dried from 2.5 wt% A6RGD solutions were toxic to hCSFs.