Non-uniform data distribution for communication-efficient parallel clustering

Global communicationrequirements andloadimbalanceof someparalleldataminingalgorithms arethe major obstacles to exploitthe computational power of large-scale systems. This work investigates how non-uniform data distributions can be exploited to remove the global communication requirement and to reduce the communication costin parallel data mining algorithms and, in particular, in the k-means algorithm for cluster analysis. In the straightforward parallel formulation of the k-means algorithm, data and computation loads are uniformly distributed over the processing nodes. This approach has excellent load balancing characteristics that may suggest it could scale up to large and extreme-scale parallel computing systems. However, at each iteration step the algorithm requires a global reduction operationwhichhinders thescalabilityoftheapproach.Thisworkstudiesadifferentparallelformulation of the algorithm where the requirement of global communication is removed, while maintaining the same deterministic nature ofthe centralised algorithm. The proposed approach exploits a non-uniform data distribution which can be either found in real-world distributed applications or can be induced by means ofmulti-dimensional binary searchtrees. The approachcanalso be extended to accommodate an approximation error which allows a further reduction ofthe communication costs. The effectiveness of the exact and approximate methods has been tested in a parallel computing system with 64 processors and in simulations with 1024 processing element

What controls the vertical distribution of aerosol? Relationships between process sensitivity in HadGEM3–UKCA and inter-model variation from AeroCom Phase II

The vertical profile of aerosol is important for its radiative effects, but weakly constrained by observations on the global scale, and highly variable among different models. To investigate the controlling factors in one particular model, we investigate the effects of individual processes in HadGEM3–UKCA and compare the resulting diversity of aerosol vertical profiles with the inter-model diversity from the AeroCom Phase II control experiment. In this way we show that (in this model at least) the vertical profile is controlled by a relatively small number of processes, although these vary among aerosol components and particle sizes. We also show that sufficiently coarse variations in these processes can produce a similar diversity to that among different models in terms of the global-mean profile and, to a lesser extent, the zonal-mean vertical position. However, there are features of certain models' profiles that cannot be reproduced, suggesting the influence of further structural differences between models. In HadGEM3–UKCA, convective transport is found to be very important in controlling the vertical profile of all aerosol components by mass. In-cloud scavenging is very important for all except mineral dust. Growth by condensation is important for sulfate and carbonaceous aerosol (along with aqueous oxidation for the former and ageing by soluble material for the latter). The vertical extent of biomass-burning emissions into the free troposphere is also important for the profile of carbonaceous aerosol. Boundary-layer mixing plays a dominant role for sea salt and mineral dust, which are emitted only from the surface. Dry deposition and below-cloud scavenging are important for the profile of mineral dust only. In this model, the microphysical processes of nucleation, condensation and coagulation dominate the vertical profile of the smallest particles by number (e.g. total CN  >  3 nm), while the profiles of larger particles (e.g. CN  >  100 nm) are controlled by the same processes as the component mass profiles, plus the size distribution of primary emissions. We also show that the processes that affect the AOD-normalised radiative forcing in the model are predominantly those that affect the vertical mass distribution, in particular convective transport, in-cloud scavenging, aqueous oxidation, ageing and the vertical extent of biomass-burning emissions.

Part load operation coefficient of air-conditioning system of public building

IPLV overall coefficient, presented by Air-Conditioning and Refrigeration Institute (ARI) of America, shows running/operation status of air-conditioning system host only. For overall operation coefficient, logical solution has not been developed, to reflect the whole air-conditioning system under part load. In this research undertaking, the running time proportions of air-conditioning systems under part load have been obtained through analysis on energy consumption data during practical operation in all public buildings in Chongqing. This was achieved by using analysis methods, based on the statistical energy consumption data distribution of public buildings month-by-month. Comparing with the weight number of IPLV, part load operation coefficient of air-conditioning system, based on this research, does not only show the status of system refrigerating host, but also reflects and calculate energy efficiency of the whole air-conditioning system. The coefficient results from the processing and analyzing of practical running data, shows the practical running status of area and building type (actual and objective) – not clear. The method is different from model analysis which gets IPLV weight number, in the sense that this method of coefficient results in both four equal proportions and also part load operation coefficient of air-conditioning system under any load rate as necessary.

Ozone climatology using interactive chemistry: results from the Canadian Middle Atmosphere Model

The climatology of ozone produced by the Canadian Middle Atmosphere Model (CMAM) is presented. This three-dimensional global model incorporates the radiative feedbacks of ozone and water vapor calculated on-line with a photochemical module. This module includes a comprehensive gas-phase reaction set and a limited set of heterogeneous reactions to account for processes occurring on background sulphate aerosols. While transport is global, photochemistry is solved from about 400 hPa to the top of the model at ∼95 km. This approach provides a complete and comprehensive representation of transport, emission, and photochemistry of various constituents from the surface to the mesopause region. A comparison of model results with observations indicates that the ozone distribution and variability are in agreement with observations throughout most of the model domain. Column ozone annual variation is represented to within 5–10% of the observations except in the Southern Hemisphere for springtime high latitudes. The vertical ozone distribution is generally well represented by the model up to the mesopause region. Nevertheless, in the upper stratosphere, the model generally underestimates the amount of ozone as well as the latitudinal tilting of ozone isopleths at high latitude. Ozone variability is analyzed and compared with measurements. The comparison shows that the phase and amplitude of the seasonal variation as well as shorter timescale variations are well represented by the model at various latitudes and heights. Finally, the impact of incorporating ozone radiative feedback on the model climatology is isolated. It is found that the incorporation of ozone radiative feedback results in a cooling of ∼8 K in the summer stratopause region, which corrects a warm bias that results when climatological ozone is used.

Efficient group communication for large-scale parallel clustering

Global communication requirements and load imbalance of some parallel data mining algorithms are the major obstacles to exploit the computational power of large-scale systems. This work investigates how non-uniform data distributions can be exploited to remove the global communication requirement and to reduce the communication cost in iterative parallel data mining algorithms. In particular, the analysis focuses on one of the most influential and popular data mining methods, the k-means algorithm for cluster analysis. The straightforward parallel formulation of the k-means algorithm requires a global reduction operation at each iteration step, which hinders its scalability. This work studies a different parallel formulation of the algorithm where the requirement of global communication can be relaxed while still providing the exact solution of the centralised k-means algorithm. The proposed approach exploits a non-uniform data distribution which can be either found in real world distributed applications or can be induced by means of multi-dimensional binary search trees. The approach can also be extended to accommodate an approximation error which allows a further reduction of the communication costs.

Clouds and the atmospheric circulation response to warming

We study the effect of clouds on the atmospheric circulation response to CO2 quadrupling in an aquaplanet model with a slab-ocean lower boundary. The cloud effect is isolated by locking the clouds to either the control or 4xCO2 state in the shortwave (SW) or longwave (LW) radiation schemes. In our model, cloud-radiative changes explain more than half of the total poleward expansion of the Hadley cells, midlatitude jets, and storm tracks under CO2 quadrupling, even though they cause only one-fourth of the total global-mean surface warming. The effect of clouds on circulation results mainly from the SW cloud-radiative changes, which strongly enhance the Equator-to-pole temperature gradient at all levels in the troposphere, favoring stronger and poleward-shifted midlatitude eddies. By contrast, quadrupling CO2 while holding the clouds fixed causes strong polar amplification and weakened midlatitude baroclinicity at lower levels, yielding only a small poleward expansion of the circulation. Our results show that (a) the atmospheric circulation responds sensitively to cloud-driven changes in meridional and vertical temperature distribution, and (b) the spatial structure of cloud feedbacks likely plays a dominant role in the circulation response to greenhouse gas forcing. While the magnitude and spatial structure of the cloud feedback are expected to be highly model-dependent, an analysis of 4xCO2 simulations of CMIP5 models shows that the SW cloud feedback likely forces a poleward expansion of the tropospheric circulation in most climate models.

Flight periodicity and the vertical distribution of high-altitude moth migration over southern Britain

The continuous operation of insect-monitoring radars in the UK has permitted, for the first time, the characterization of various phenomena associated with high-altitude migration of large insects over this part of northern Europe. Previous studies have taken a case-study approach, concentrating on a small number of nights of particular interest. Here, combining data from two radars, and from an extensive suction- and light-trapping network, we have undertaken a more systematic, longer-term study of diel flight periodicity and vertical distribution of macro-insects in the atmosphere. Firstly, we identify general features of insect abundance and stratification, occurring during the 24-hour cycle, which emerge from four years’ aggregated radar data for the summer months in southern Britain. These features include mass emigrations at dusk and to a lesser extent at dawn, and daytime concentrations associated with thermal convection. We then focus our attention on the well-defined layers of large nocturnal migrants that form in the early evening, usually at heights of 200–500 m above ground. We present evidence from both radar and trap data that these nocturnal layers are composed mainly of noctuid moths, with species such as Noctua pronuba, Autographa gamma, Agrotis exclamationis, A. segetum, Xestia c-nigrum and Phlogophora meticulosa predominating.

Distribution and statistics of African mesoscale convective weather systems based on the ISCCP Meteosat imagery

This paper provides for the first time an objective short-term (8 yr) climatology of African convective weather systems based on satellite imagery. Eight years of infrared International Satellite Cloud Climatology Project-European Space Agency's Meteorological Satellite (ISCCP-Meteosat) satellite imagery has been analyzed using objective feature identification, tracking, and statistical techniques for the July, August, and September periods and the region of Africa and the adjacent Atlantic ocean. This allows various diagnostics to be computed and used to study the distribution of mesoscale and synoptic-scale convective weather systems from mesoscale cloud clusters and squall lines to tropical cyclones. An 8-yr seasonal climatology (1983-90) and the seasonal cycle of this convective activity are presented and discussed. Also discussed is the dependence of organized convection for this region, on the orography, convective, and potential instability and vertical wind shear using European Centre for Medium-Range Weather Forecasts reanalysis data.

Radar studies of the vertical distribution of insects migrating over southern Britain: the influence of temperature inversions on nocturnal layer concentrations

Insects migrating over two sites in southern UK (Malvern in Worcestershire, and Harpenden in Hertfordshire) have been monitored continuously with nutating vertical-looking radars (VLRs) equipped with powerful control and analysis software. These observations make possible, for the first time, a systematic investigation of the vertical distribution of insect aerial density in the atmosphere, over temporal scales ranging from the short (instantaneous vertical profiles updated every 15 min) to the very long (profiles aggregated over whole seasons or even years). In the present paper, an outline is given of some general features of insect stratification as revealed by the radars, followed by a description of occasions during warm nights in the summer months when intense insect layers developed. Some of these nocturnal layers were due to the insects flying preferentially at the top of strong surface temperature inversions, and in other cases, layering was associated with higher-altitude temperature maxima, such as those due to subsidence inversions. The layers were formed from insects of a great variety of sizes, but peaks in the mass distributions pointed to a preponderance of medium-sized noctuid moths on certain occasions.

Effects of summer rainfall manipulations on the abundance and vertical distribution of herbivorous soil macro-invertebrates

Soil invertebrate communities are likely to be highly vulnerable to low soil moisture, caused by a reduction in summer rainfall which is predicted for some regions under current climate change scenarios. However, the effects of changes in summer rainfall on soil invertebrate assemblages have rarely been tested experimentally. In this study, samples were taken in 2003 and 2004 from a long-running field experiment, to investigate the impact of 10 years of experimental summer drought and increased summer rainfall manipulations on the soil fauna of a calcareous grassland. Summer drought altered the soil invertebrate assemblage in the autumn, immediately following treatment application, but by the following spring treatment effects were no longer apparent. The two most common root herbivore species responded differently to the summer rainfall manipulations. Larvae of the dominant root-chewing species, Agriotes lineatus, were more numerous under enhanced rainfall in both the spring and autumn. In contrast, abundance of the Coccoidea Lecanopsis formicarum was unaffected by the rainfall manipulations. The responses of root herbivores to an increased incidence of summer droughts are therefore likely to vary, depending on their feeding strategy and life history. (c) 2007 Elsevier Masson SAS. All rights reserved.

Vertical distribution, size and composition of the weed seedbank under various tillage and herbicide treatments in a sequence of industrial crops

Investigations were conducted during the 2003, 2004 and 2005 growing seasons in northern Greece to evaluate effects of tillage regime (mouldboard plough, chisel plough and rotary tiller), cropping sequence (continuous cotton, cotton-sugar beet rotation and continuous tobacco) and herbicide treatment on weed seedbank dynamics. Amaranthus spp. and Portulaca oleracea were the most abundant species, ranging from 76% to 89% of total weed seeds found in 0-15 and 15-30 cm soil depths during the 3 years. With the mouldboard plough, 48% and 52% of the weed seedbank was found in the 0-15 and 15-30 cm soil horizons, while approximately 60% was concentrated in the upper 15 cm soil horizon for chisel plough and rotary tillage. Mouldboard ploughing significantly buried more Echinochloa crus-galli seeds in the 15-30 cm soil horizon compared with the other tillage regimes. Total seedbank (0-30 cm) of P. oleracea was significantly reduced in cotton-sugar beet rotation compared with cotton and tobacco monocultures, while the opposite occurred for E. crus-galli. Total seed densities of most annual broad-leaved weed species (Amaranthus spp., P. oleracea, Solanum nigrum) and E. crus-galli were lower in herbicide treated than in untreated plots. The results suggest that in light textured soils, conventional tillage with herbicide use gradually reduces seed density of small seeded weed species in the top 15 cm over several years. In contrast, crop rotation with the early established sugar beet favours spring-germinating grass weed species, but also prevents establishment of summer-germinating weed species by the early developing crop canopy.

Workflow data exchange semantics, object discovery & integration architecture for cross media production & distribution

There has been a clear lack of common data exchange semantics for inter-organisational workflow management systems where the research has mainly focused on technical issues rather than language constructs. This paper presents the neutral data exchanges semantics required for the workflow integration within the AXAEDIS framework and presents the mechanism for object discovery from the object repository where little or no knowledge about the object is available. The paper also presents workflow independent integration architecture with the AXAEDIS Framework.