Establishing a reliable Jini infrastructure for parallel applications

Java is becoming an increasingly popular language for developing distributed and parallel scientific and engineering applications. Jini is a Java-based infrastructure developed by Sun that can allegedly provide all the services necessary to support distributed applications. It is the aim of this paper to explore and investigate the services and properties that Jini actually provides and match these against the needs of high performance distributed and parallel applications written in Java. The motivation for this work is the need to develop a distributed infrastructure to support an MPI-like interface to Java known as MPJ. In the first part of the paper we discuss the needs of MPJ, the parallel environment that we wish to support. In particular we look at aspects such as reliability and ease of use. We then move on to sketch out the Jini architecture and review the components and services that Jini provides. In the third part of the paper we critically explore a Jini infrastructure that could be used to support MPJ. Here we are particularly concerned with Jini's ability to support reliably a cocoon of MPJ processes executing in a heterogeneous envirnoment. In the final part of the paper we summarise our findings and report on future work being undertaken on Jini and MPJ.

Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Non-uniform data distribution for communication-efficient parallel clustering

Global communicationrequirements andloadimbalanceof someparalleldataminingalgorithms arethe major obstacles to exploitthe computational power of large-scale systems. This work investigates how non-uniform data distributions can be exploited to remove the global communication requirement and to reduce the communication costin parallel data mining algorithms and, in particular, in the k-means algorithm for cluster analysis. In the straightforward parallel formulation of the k-means algorithm, data and computation loads are uniformly distributed over the processing nodes. This approach has excellent load balancing characteristics that may suggest it could scale up to large and extreme-scale parallel computing systems. However, at each iteration step the algorithm requires a global reduction operationwhichhinders thescalabilityoftheapproach.Thisworkstudiesadifferentparallelformulation of the algorithm where the requirement of global communication is removed, while maintaining the same deterministic nature ofthe centralised algorithm. The proposed approach exploits a non-uniform data distribution which can be either found in real-world distributed applications or can be induced by means ofmulti-dimensional binary searchtrees. The approachcanalso be extended to accommodate an approximation error which allows a further reduction ofthe communication costs. The effectiveness of the exact and approximate methods has been tested in a parallel computing system with 64 processors and in simulations with 1024 processing element

Parallel pipelined histogram architecture via c-slow retiming

A parallel pipelined array of cells suitable for realtime computation of histograms is proposed. The cell architecture builds on previous work to now allow operating on a stream of data at 1 pixel per clock cycle. This new cell is more suitable for interfacing to camera sensors or to microprocessors of 8-bit data buses which are common in consumer digital cameras. Arrays using the new proposed cells are obtained via C-slow retiming techniques and can be clocked at a 65% faster frequency than previous arrays. This achieves over 80% of the performance of two-pixel per clock cycle parallel pipelined arrays.

A parallel quantum histogram architecture

A parallel formulation of an algorithm for the histogram computation of n data items using an on-the-fly data decomposition and a novel quantum-like representation (QR) is developed. The QR transformation separates multiple data read operations from multiple bin update operations thereby making it easier to bind data items into their corresponding histogram bins. Under this model the steps required to compute the histogram is n/s + t steps, where s is a speedup factor and t is associated with pipeline latency. Here, we show that an overall speedup factor, s, is available for up to an eightfold acceleration. Our evaluation also shows that each one of these cells requires less area/time complexity compared to similar proposals found in the literature.

Foreign direct investment in high-risk environments: an historical perspective

Since the banking crisis of 2008 the global economy is perceived as riskier than before. Firms that cannot manage risks have withdrawn from countries in which they previously invested. These problems are not new. For centuries firms have invested in risky foreign environments, and many of them have succeeded. This paper reviews the risk management strategies of foreign investors. Using archival evidence and secondary sources it distinguishes the different types of risks that investors face and the different strategies by which risks can be managed. It investigates which strategies are used to manage which types of risk.

Marine Isotope Stage 9 environments of fluvial deposits at Hackney, north London, UK

Middle Pleistocene deposits at Hackney, north London comprise a thick unit of organic sands and silts occupying a channel near the confluence of the River Thames in south-eastern England and its left-bank tributary the River Lea. They represent a short time interval, perhaps no more than a few years, within a late Middle Pleistocene interglacial. The organic sediments are overlain by unfossiliferous sands and gravels indicating deposition on the floodplain of a braided river under cool or cold climatic conditions. The fossil plant, insect, mollusc and vertebrate remains from the interglacial deposits all indicate climatic conditions with summers warmer than the present in SE England, and winters with a similar thermal climate. The biostratigraphic evidence suggests that the time period represented by the organic unit is part of MIS 9, although the geochronological evidence for such an age is inconclusive. The palaeontological evidence strongly suggests that this temperate stage was warmer than the succeeding temperate stage MIS 7 or the Holocene, and approaching the Ipswichian (MISs 5e) in its warmth. The multidisciplinary description of the Hackney deposits is one of the first to reconstruct terrestrial conditions in Marine Isotope Stage 9 in Western Europe.

Rigorous bounds on the nonlinear saturation of instabilities to parallel shear flows

A novel method is presented for obtaining rigorous upper bounds on the finite-amplitude growth of instabilities to parallel shear flows on the beta-plane. The method relies on the existence of finite-amplitude Liapunov (normed) stability theorems, due to Arnol'd, which are nonlinear generalizations of the classical stability theorems of Rayleigh and Fjørtoft. Briefly, the idea is to use the finite-amplitude stability theorems to constrain the evolution of unstable flows in terms of their proximity to a stable flow. Two classes of general bounds are derived, and various examples are considered. It is also shown that, for a certain kind of forced-dissipative problem with dissipation proportional to vorticity, the finite-amplitude stability theorems (which were originally derived for inviscid, unforced flow) remain valid (though they are no longer strictly Liapunov); the saturation bounds therefore continue to hold under these conditions.

DK-1D: a drift-kinetic simulation tool for modelling the shear Alfvén wave and its interaction with collisionless plasma

We present a highly accurate tool for the simulation of shear Alfven waves (SAW) in collisionless plasma. SAW are important in space plasma environments because for small perpendicular scale lengths they can support an electric field parallel to the ambient magnetic field. Electrons can be accelerated by the parallel electric field and these waves have been implicated as the source of vibrant auroral displays. However, the parallel electric field carried by SAW is small in comparison to the perpendicular electric field of the wave, making it difficult to measure directly in the laboratory, or by satellites in the near-Earth plasma environment. In this paper, we present a simulation code that provides a means to study in detail the SAW-particle interaction in both space and laboratory plasma. Using idealised, small-amplitude propagating waves with a single perpendicular wavenumber, the simulation code accurately reproduces the damping rates and parallel electric field amplitudes predicted by linear theory for varying temperatures and perpendicular scale lengths. We present a rigorous kinetic derivation of the parallel electric field strength for small-amplitude SAW and show that commonly-used inertial and kinetic approximations are valid except for where the ratio of thermal to Alfv\'{e}n speed is between 0.7 and 1.0. We also present nonlinear simulations of large-amplitude waves and show that in cases of strong damping, the damping rates and parallel electric field strength deviate from linear predictions when wave energies are greater than only a few percent of the plasma kinetic energy, a situation which is often observed in the magnetosphere. The drift-kinetic code provides reliable, testable predictions of the parallel electric field strength which can be investigated directly in the laboratory, and will help to bridge the gap between studies of SAW in man-made and naturally occuring plasma.

An exact local conservation theorem for finite-amplitude disturbances to non-parallel shear flows, with remarks on Hamiltonian structure and on Arnol'd's stability theorems

Disturbances of arbitrary amplitude are superposed on a basic flow which is assumed to be steady and either (a) two-dimensional, homogeneous, and incompressible (rotating or non-rotating) or (b) stably stratified and quasi-geostrophic. Flow over shallow topography is allowed in either case. The basic flow, as well as the disturbance, is assumed to be subject neither to external forcing nor to dissipative processes like viscosity. An exact, local ‘wave-activity conservation theorem’ is derived in which the density A and flux F are second-order ‘wave properties’ or ‘disturbance properties’, meaning that they are O(a2) in magnitude as disturbance amplitude a [rightward arrow] 0, and that they are evaluable correct to O(a2) from linear theory, to O(a3) from second-order theory, and so on to higher orders in a. For a disturbance in the form of a single, slowly varying, non-stationary Rossby wavetrain, $\overline{F}/\overline{A}$ reduces approximately to the Rossby-wave group velocity, where (${}^{-}$) is an appropriate averaging operator. F and A have the formal appearance of Eulerian quantities, but generally involve a multivalued function the correct branch of which requires a certain amount of Lagrangian information for its determination. It is shown that, in a certain sense, the construction of conservable, quasi-Eulerian wave properties like A is unique and that the multivaluedness is inescapable in general. The connection with the concepts of pseudoenergy (quasi-energy), pseudomomentum (quasi-momentum), and ‘Eliassen-Palm wave activity’ is noted. The relationship of this and similar conservation theorems to dynamical fundamentals and to Arnol'd's nonlinear stability theorems is discussed in the light of recent advances in Hamiltonian dynamics. These show where such conservation theorems come from and how to construct them in other cases. An elementary proof of the Hamiltonian structure of two-dimensional Eulerian vortex dynamics is put on record, with explicit attention to the boundary conditions. The connection between Arnol'd's second stability theorem and the suppression of shear and self-tuning resonant instabilities by boundary constraints is discussed, and a finite-amplitude counterpart to Rayleigh's inflection-point theorem noted

Restricting microbial exposure in early life negates the immune benefits associated with gut colonization in environments of high microbial diversity

Background: Acquisition of the intestinal microbiota in early life corresponds with the development of the mucosal immune system. Recent work on caesarean-delivered infants revealed that early microbial composition is influenced by birthing method and environment. Furthermore, we have confirmed that early-life environment strongly influences both the adult gut microbiota and development of the gut immune system. Here, we address the impact of limiting microbial exposure after initial colonization on the development of adult gut immunity. Methodology/Principal Findings: Piglets were born in indoor or outdoor rearing units, allowing natural colonization in the immediate period after birth, prior to transfer to high-health status isolators. Strikingly, gut closure and morphological development were strongly affected by isolator-rearing, independent of indoor or outdoor origins of piglets. Isolator-reared animals showed extensive vacuolation and disorganization of the gut epithelium, inferring that normal gut closure requires maturation factors present in maternal milk. Although morphological maturation and gut closure were delayed in isolatorreared animals, these hard-wired events occurred later in development. Type I IFN, IL-22, IL-23 and Th17 pathways were increased in indoor-isolator compared to outdoor-isolator animals during early life, indicating greater immune activation in pigs originating from indoor environments reflecting differences in the early microbiota. This difference was less apparent later in development due to enhanced immune activation and convergence of the microbiota in all isolator-reared animals. This correlated with elevation of Type I IFN pathways in both groups, although T cell pathways were still more affected in indoor-reared animals. Conclusions/Significance: Environmental factors, in particular microbial exposure, influence expression of a large number of immune-related genes. However, the homeostatic effects of microbial colonization in outdoor environments require sustained microbial exposure throughout development. Gut development in high-hygiene environments negatively impacts on normal succession of the gut microbiota and promotes innate immune activation which may impair immune homeostasis.

C-slow retimed parallel histogram architectures for consumer imaging devices

A parallel pipelined array of cells suitable for real-time computation of histograms is proposed. The cell architecture builds on previous work obtained via C-slow retiming techniques and can be clocked at 65 percent faster frequency than previous arrays. The new arrays can be exploited for higher throughput particularly when dual data rate sampling techniques are used to operate on single streams of data from image sensors. In this way, the new cell operates on a p-bit data bus which is more convenient for interfacing to camera sensors or to microprocessors in consumer digital cameras.

Toward vicarious calibration of microwave remote-sensing satellites in arid environments

The Soil Moisture and Ocean Salinity (SMOS) satellite marks the commencement of dedicated global surface soil moisture missions, and the first mission to make passive microwave observations at L-band. On-orbit calibration is an essential part of the instrument calibration strategy, but on-board beam-filling targets are not practical for such large apertures. Therefore, areas to serve as vicarious calibration targets need to be identified. Such sites can only be identified through field experiments including both in situ and airborne measurements. For this purpose, two field experiments were performed in central Australia. Three areas are studied as follows: 1) Lake Eyre, a typically dry salt lake; 2) Wirrangula Hill, with sparse vegetation and a dense cover of surface rock; and 3) Simpson Desert, characterized by dry sand dunes. Of those sites, only Wirrangula Hill and the Simpson Desert are found to be potentially suitable targets, as they have a spatial variation in brightness temperatures of <4 K under normal conditions. However, some limitations are observed for the Simpson Desert, where a bias of 15 K in vertical and 20 K in horizontal polarization exists between model predictions and observations, suggesting a lack of understanding of the underlying physics in this environment. Subsequent comparison with model predictions indicates a SMOS bias of 5 K in vertical and 11 K in horizontal polarization, and an unbiased root mean square difference of 10 K in both polarizations for Wirrangula Hill. Most importantly, the SMOS observations show that the brightness temperature evolution is dominated by regular seasonal patterns and that precipitation events have only little impact.

Characterization of energy flux partitioning in urban environments: links with surface seasonal properties

A better understanding of links between the properties of the urban environment and the exchange to the atmosphere is central to a wide range of applications. The numerous measurements of surface energy balance data in urban areas enable intercomparison of observed fluxes from distinct environments. This study analyzes a large database in two new ways. First, instead of normalizing fluxes using net all-wave radiation only the incoming radiative fluxes are used, to remove the surface attributes from the denominator. Second, because data are now available year-round, indices are developed to characterize the fraction of the surface (built; vegetation) actively engaged in energy exchanges. These account for shading patterns within city streets and seasonal changes in vegetation phenology; their impact on the partitioning of the incoming radiation is analyzed. Data from 19 sites in North America, Europe, Africa, and Asia (including 6-yr-long observation campaigns) are used to derive generalized surface–flux relations. The midday-period outgoing radiative fraction decreases with an increasing total active surface index, the stored energy fraction increases with an active built index, and the latent heat fraction increases with an active vegetated index. Parameterizations of these energy exchange ratios as a function of the surface indices [i.e., the Flux Ratio–Active Index Surface Exchange (FRAISE) scheme] are developed. These are used to define four urban zones that characterize energy partitioning on the basis of their active surface indices. An independent evaluation of FRAISE, using three additional sites from the Basel Urban Boundary Layer Experiment (BUBBLE), yields accurate predictions of the midday flux partitioning at each location.