Dynamic group communication for large-scale parallel data mining

Exascale systems are the next frontier in high-performance computing and are expected to deliver a performance of the order of 10^18 operations per second using massive multicore processors. Very large- and extreme-scale parallel systems pose critical algorithmic challenges, especially related to concurrency, locality and the need to avoid global communication patterns. This work investigates a novel protocol for dynamic group communication that can be used to remove the global communication requirement and to reduce the communication cost in parallel formulations of iterative data mining algorithms. The protocol is used to provide a communication-efficient parallel formulation of the k-means algorithm for cluster analysis. The approach is based on a collective communication operation for dynamic groups of processes and exploits non-uniform data distributions. Non-uniform data distributions can be either found in real-world distributed applications or induced by means of multidimensional binary search trees. The analysis of the proposed dynamic group communication protocol has shown that it does not introduce significant communication overhead. The parallel clustering algorithm has also been extended to accommodate an approximation error, which allows a further reduction of the communication costs. The effectiveness of the exact and approximate methods has been tested in a parallel computing system with 64 processors and in simulations with 1024 processing elements.

LOFZY 2005 - Field experiment on Cyclones over the Norwegian Sea: meteorological measurements of the research aircraft Falcon, 23 autonomous water buoys and radiosoundings at the research vessel Celtic Explorer

The field campaign LOFZY 2005 (LOFoten ZYklonen, engl.: Cyclones) was carried out in the frame of Collaborative Research Centre 512, which deals with low-pressure systems (cyclones) and the climate system of the North Atlantic. Cyclones are of special interest due to their influence on the interaction between atmosphere and ocean. Cyclone activity in the northern part of the Atlantic Ocean is notably high and is of particular importance for the entire Atlantic Ocean. An area of maximum precipitation exists in front of the Norwegian Lofoten islands. One aim of the LOFZY field campaign was to clarify the role cyclones play in the interaction of ocean and atmosphere. In order to obtain a comprehensive dataset of cyclone activity and ocean-atmosphere interaction a field experiment was carried out in the Lofoten region during March and April 2005. Employed platforms were the Irish research vessel RV Celtic Explorer which conducted a meteorological (radiosondes, standard parameters, observations) and an oceanographic (CTD) program. The German research aircraft Falcon accomplished eight flight missions (between 4-21 March) to observe synoptic conditions with high spatial and temporal resolution. In addition 23 autonomous marine buoys were deployed in advance of the campaign in the observed area to measure drift, air-temperature and -pressure and water-temperature. In addition to the published datasets several other measurements were performed during the experiment. Corresonding datasets will be published in the near future and are available on request. Details about all used platforms and sensors and all performed measurements are listed in the fieldreport. The following datasets are available on request: ground data at RV Celtic Explorer