Homogeneous and heterogeneous distributed classification for pocket data mining

Pocket Data Mining (PDM) describes the full process of analysing data streams in mobile ad hoc distributed environments. Advances in mobile devices like smart phones and tablet computers have made it possible for a wide range of applications to run in such an environment. In this paper, we propose the adoption of data stream classification techniques for PDM. Evident by a thorough experimental study, it has been proved that running heterogeneous/different, or homogeneous/similar data stream classification techniques over vertically partitioned data (data partitioned according to the feature space) results in comparable performance to batch and centralised learning techniques.

P-found: grid-enabling distributed repositories of protein folding and unfolding simulations for data mining

The P-found protein folding and unfolding simulation repository is designed to allow scientists to perform data mining and other analyses across large, distributed simulation data sets. There are two storage components in P-found: a primary repository of simulation data that is used to populate the second component, and a data warehouse that contains important molecular properties. These properties may be used for data mining studies. Here we demonstrate how grid technologies can support multiple, distributed P-found installations. In particular, we look at two aspects: firstly, how grid data management technologies can be used to access the distributed data warehouses; and secondly, how the grid can be used to transfer analysis programs to the primary repositories — this is an important and challenging aspect of P-found, due to the large data volumes involved and the desire of scientists to maintain control of their own data. The grid technologies we are developing with the P-found system will allow new large data sets of protein folding simulations to be accessed and analysed in novel ways, with significant potential for enabling scientific discovery.

Demand response — a different form of distributed storage?

Reduced flexibility of low carbon generation could pose new challenges for future energy systems. Both demand response and distributed storage may have a role to play in supporting future system balancing. This paper reviews how these technically different, but functionally similar approaches compare and compete with one another. Household survey data is used to test the effectiveness of price signals to deliver demand responses for appliances with a high degree of agency. The underlying unit of storage for different demand response options is discussed, with particular focus on the ability to enhance demand side flexibility in the residential sector. We conclude that a broad range of options, with different modes of storage, may need to be considered, if residential demand flexibility is to be maximised.

Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Power allocation strategies for distributed space-time codes in two-way relay networks

We study a two-way relay network (TWRN), where distributed space-time codes are constructed across multiple relay terminals in an amplify-and-forward mode. Each relay transmits a scaled linear combination of its received symbols and their conjugates,with the scaling factor chosen based on automatic gain control. We consider equal power allocation (EPA) across the relays, as well as the optimal power allocation (OPA) strategy given access to instantaneous channel state information (CSI). For EPA, we derive an upper bound on the pairwise-error-probability (PEP), from which we prove that full diversity is achieved in TWRNs. This result is in contrast to one-way relay networks, in which case a maximum diversity order of only unity can be obtained. When instantaneous CSI is available at the relays, we show that the OPA which minimizes the conditional PEP of the worse link can be cast as a generalized linear fractional program, which can be solved efficiently using the Dinkelback-type procedure.We also prove that, if the sum-power of the relay terminals is constrained, then the OPA will activate at most two relays.

Toward vicarious calibration of microwave remote-sensing satellites in arid environments

The Soil Moisture and Ocean Salinity (SMOS) satellite marks the commencement of dedicated global surface soil moisture missions, and the first mission to make passive microwave observations at L-band. On-orbit calibration is an essential part of the instrument calibration strategy, but on-board beam-filling targets are not practical for such large apertures. Therefore, areas to serve as vicarious calibration targets need to be identified. Such sites can only be identified through field experiments including both in situ and airborne measurements. For this purpose, two field experiments were performed in central Australia. Three areas are studied as follows: 1) Lake Eyre, a typically dry salt lake; 2) Wirrangula Hill, with sparse vegetation and a dense cover of surface rock; and 3) Simpson Desert, characterized by dry sand dunes. Of those sites, only Wirrangula Hill and the Simpson Desert are found to be potentially suitable targets, as they have a spatial variation in brightness temperatures of <4 K under normal conditions. However, some limitations are observed for the Simpson Desert, where a bias of 15 K in vertical and 20 K in horizontal polarization exists between model predictions and observations, suggesting a lack of understanding of the underlying physics in this environment. Subsequent comparison with model predictions indicates a SMOS bias of 5 K in vertical and 11 K in horizontal polarization, and an unbiased root mean square difference of 10 K in both polarizations for Wirrangula Hill. Most importantly, the SMOS observations show that the brightness temperature evolution is dominated by regular seasonal patterns and that precipitation events have only little impact.

A methodology for in-situ and remote sensing of microphysical and radiative properties of contrails as they evolve into cirrus

Contrails and especially their evolution into cirrus-like clouds are thought to have very important effects on local and global radiation budgets, though are generally not well represented in global climate models. Lack of contrail parameterisations is due to the limited availability of in situ contrail measurements which are difficult to obtain. Here we present a methodology for successful sampling and interpretation of contrail microphysical and radiative data using both in situ and remote sensing instrumentation on board the FAAM BAe146 UK research aircraft as part of the COntrails Spreading Into Cirrus (COSIC) study.

Sequential variations of phytoplankton growth and mortality in an NPZ model: a remote-sensing-based assessment

Radiometric data in the visible domain acquired by satellite remote sensing have proven to be powerful for monitoring the states of the ocean, both physical and biological. With the help of these data it is possible to understand certain variations in biological responses of marine phytoplankton on ecological time scales. Here, we implement a sequential data-assimilation technique to estimate from a conventional nutrient–phytoplankton–zooplankton (NPZ) model the time variations of observed and unobserved variables. In addition, we estimate the time evolution of two biological parameters, namely, the specific growth rate and specific mortality of phytoplankton. Our study demonstrates that: (i) the series of time-varying estimates of specific growth rate obtained by sequential data assimilation improves the fitting of the NPZ model to the satellite-derived time series: the model trajectories are closer to the observations than those obtained by implementing static values of the parameter; (ii) the estimates of unobserved variables, i.e., nutrient and zooplankton, obtained from an NPZ model by implementation of a pre-defined parameter evolution can be different from those obtained on applying the sequences of parameters estimated by assimilation; and (iii) the maximum estimated specific growth rate of phytoplankton in the study area is more sensitive to the sea-surface temperature than would be predicted by temperature-dependent functions reported previously. The overall results of the study are potentially useful for enhancing our understanding of the biological response of phytoplankton in a changing environment.

Modelling the time-evolution of phytoplankton size spectra from satellite remote sensing

A dynamic size-structured model is developed for phytoplankton and nutrients in the oceanic mixed layer and applied to extract phytoplankton biomass at discrete size fractions from remotely sensed, ocean-colour data. General relationships between cell size and biophysical processes (such as sinking, grazing, and primary production) of phytoplankton were included in the model through a bottom–up approach. Time-dependent, mixed-layer depth was used as a forcing variable, and a sequential data-assimilation scheme was implemented to derive model trajectories. From a given time-series, the method produces estimates of size-structured biomass at every observation, so estimates seasonal succession of individual phytoplankton size, derived here from remote sensing for the first time. From these estimates, normalized phytoplankton biomass size spectra over a period of 9 years were calculated for one location in the North Atlantic. Further analysis demonstrated that strong relationships exist between the seasonal trends of the estimated size spectra and the mixed-layer depth, nutrient biomass, and total chlorophyll. The results contain useful information on the time-dependent biomass flux in the pelagic ecosystem.

Retrieval of phytoplankton size from bio-optical measurements: theory and applications

The absorption coefficient of a substance distributed as discrete particles in suspension is less than that of the same material dissolved uniformly in a medium—a phenomenon commonly referred to as the flattening effect. The decrease in the absorption coefficient owing to flattening effect depends on the concentration of the absorbing pigment inside the particle, the specific absorption coefficient of the pigment within the particle, and on the diameter of the particle, if the particles are assumed to be spherical. For phytoplankton cells in the ocean, with diameters ranging from less than 1 µm to more than 100 µm, the flattening effect is variable, and sometimes pronounced, as has been well documented in the literature. Here, we demonstrate how the in vivo absorption coefficient of phytoplankton cells per unit concentration of its major pigment, chlorophyll a, can be used to determine the average cell size of the phytoplankton population. Sensitivity analyses are carried out to evaluate the errors in the estimated diameter owing to potential errors in the model assumptions. Cell sizes computed for field samples using the model are compared qualitatively with indirect estimates of size classes derived from high performance liquid chromatography data. Also, the results are compared quantitatively against measurements of cell size in laboratory cultures. The method developed is easy-to-apply as an operational tool for in situ observations, and has the potential for application to remote sensing of ocean colour data.

The phenology of phytoplankton blooms: ecosystems indicators from remote sensing

Remote sensing offers many advantages in the development of ecosystem indicators for the pelagic zone of the ocean. Particularly suitable in this context are the indicators arising from time series that can be constructed from remotely sensed data. For example, using ocean-colour radiometry, the phenology of phytoplankton blooms can be assessed. Metrics defined in this way show promise as informative indicators for the entire pelagic ecosystem. A simple phytoplankton–substrate model, with forcing dependent on latitude and day number is used to explore the qualitative features of bloom phenology for comparison with the results observed in a suite of 10-year time series of chlorophyll concentration, as assessed by remote sensing, from the Northwest Atlantic Ocean. The model reveals features of the dynamics that might otherwise have been overlooked in evaluation of the observational data.

Nutrient sensing and signalling in plants: Potassium and phosphorus

Potassium and phosphorus are important macronutrients for crops but are often deficient in the field. Very little is known about how plants sense fluctuations in K and P and how information about K and P availability is integrated at the whole plant level into physiological and metabolic adaptations. This chapter reviews recent advances in discovering molecular responses of plants to K and P deficiency by microarray experiments. These studies provide us not only with a comprehensive picture of adaptive mechanisms, but also with a large number of transcriptional markers that can be used to identify upstream components of K and P signalling pathways. On the basis of the available information we discuss putative receptors and signals involved in the sensing and integration of K and P status both at the cellular and at the whole plant level. These involve membrane potential, voltage-dependent ion channels, intracellular Ca and pH, and transcription factors, as well as hormones and metabolites for systemic signalling. Genetic screens of reporter lines for transcriptional markers and metabolome analysis of K- and P-deficient plants are likely to further advance our knowledge in this area in the near future.

Electrochemical sensing of 2D condensation in amyloid peptides

The interfacial behavior of the model amyloid peptide octamer YYKLVFFC (peptide 1) and two other amyloid peptides YEVHHQKLVFF (peptide 2) and KKLVFFA (peptide 3) at the metal|aqueous solution interface was studied by voltammetric and constant current chronopotentiometric stripping (CPS). All three peptides are adsorbed in a wide potential range and exhibit different interfacial organizations depending on the electrode potential. At the least negative potentials, chemisorption of peptide 1 occurs through the formation of a metal sulfur bond. This bond is broken close to −0.6 V. The peptide undergoes self-association at more negative potentials, leading to the formation of a “pit” characteristic of a 2D condensed film. Under the same conditions the other peptides do not produce such a pit. Formation of the 2D condensed layer in peptide 1 is supported by the time, potential and temperature dependences of the interfacial capacity and it is shown that presence of the 2D layer is reflected by the peptide CPS signals due to the catalytic hydrogen evolution. The ability of peptide 1 to form the potential-dependent 2D condensed layer has been reported neither for any other peptide nor for any protein molecule. This ability might be related to the well-known oligomerization and aggregation of Alzheimer amyloid peptides.

Comparison of the radiative properties and direct radiative effect of aerosols from a global aerosol model and remote sensing data over ocean

A global aerosol transport model (Oslo CTM2) with main aerosol components included is compared to five satellite retrievals of aerosol optical depth (AOD) and one data set of the satellite-derived radiative effect of aerosols. The model is driven with meteorological data for the period November 1996 to June 1997 which is the time period investigated in this study. The modelled AOD is within the range of the AOD from the various satellite retrievals over oceanic regions. The direct radiative effect of the aerosols as well as the atmospheric absorption by aerosols are in both cases found to be of the order of 20 Wm−2 in certain regions in both the satellite-derived and the modelled estimates as a mean over the period studied. Satellite and model data exhibit similar patterns of aerosol optical depth, radiative effect of aerosols, and atmospheric absorption of the aerosols. Recently published results show that global aerosol models have a tendency to underestimate the magnitude of the clear-sky direct radiative effect of aerosols over ocean compared to satellite-derived estimates. However, this is only to a small extent the case with the Oslo CTM2. The global mean direct radiative effect of aerosols over ocean is modelled with the Oslo CTM2 to be –5.5 Wm−2 and the atmospheric aerosol absorption 1.5 Wm−2.