Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Wave-activity conservation laws for the three-dimensional anelastic and Boussinesq equations with a horizontally homogeneous background flow

Wave-activity conservation laws are key to understanding wave propagation in inhomogeneous environments. Their most general formulation follows from the Hamiltonian structure of geophysical fluid dynamics. For large-scale atmospheric dynamics, the Eliassen–Palm wave activity is a well-known example and is central to theoretical analysis. On the mesoscale, while such conservation laws have been worked out in two dimensions, their application to a horizontally homogeneous background flow in three dimensions fails because of a degeneracy created by the absence of a background potential vorticity gradient. Earlier three-dimensional results based on linear WKB theory considered only Doppler-shifted gravity waves, not waves in a stratified shear flow. Consideration of a background flow depending only on altitude is motivated by the parameterization of subgrid-scales in climate models where there is an imposed separation of horizontal length and time scales, but vertical coupling within each column. Here we show how this degeneracy can be overcome and wave-activity conservation laws derived for three-dimensional disturbances to a horizontally homogeneous background flow. Explicit expressions for pseudoenergy and pseudomomentum in the anelastic and Boussinesq models are derived, and it is shown how the previously derived relations for the two-dimensional problem can be treated as a limiting case of the three-dimensional problem. The results also generalize earlier three-dimensional results in that there is no slowly varying WKB-type requirement on the background flow, and the results are extendable to finite amplitude. The relationship A E =cA P between pseudoenergy A E and pseudomomentum A P, where c is the horizontal phase speed in the direction of symmetry associated with A P, has important applications to gravity-wave parameterization and provides a generalized statement of the first Eliassen–Palm theorem.

On the group-velocity property for wave-activity conservation laws

The density and the flux of wave-activity conservation laws are generally required to satisfy the group-velocity property: under the WKB approximation (i.e., for nearly monochromatic small-amplitude waves in a slowly varying medium), the flux divided by the density equals the group velocity. It is shown that this property is automatically satisfied if, under the WKB approximation, the only source of rapid variations in the density and the flux lies in the wave phase. A particular form of the density, based on a self-adjoint operator, is proposed as a systematic choice for a density verifying this condition.

A Hamiltonian weak-wave model for shallow-water flow

A reduced dynamical model is derived which describes the interaction of weak inertia–gravity waves with nonlinear vortical motion in the context of rotating shallow–water flow. The formal scaling assumptions are (i) that there is a separation in timescales between the vortical motion and the inertia–gravity waves, and (ii) that the divergence is weak compared to the vorticity. The model is Hamiltonian, and possesses conservation laws analogous to those in the shallow–water equations. Unlike the shallow–water equations, the energy invariant is quadratic. Nonlinear stability theorems are derived for this system, and its linear eigenvalue properties are investigated in the context of some simple basic flows.

Wave-activity conservation laws and stability theorems for semi-geostrophic dynamics: part 2. pseudoenergy-based theory

This paper represents the second part of a study of semi-geostrophic (SG) geophysical fluid dynamics. SG dynamics shares certain attractive properties with the better known and more widely used quasi-geostrophic (QG) model, but is also a good prototype for balanced models that are more accurate than QG dynamics. The development of such balanced models is an area of great current interest. The goal of the present work is to extend a central body of QG theory, concerning the evolution of disturbances to prescribed basic states, to SG dynamics. Part 1 was based on the pseudomomentum; Part 2 is based on the pseudoenergy. A pseudoenergy invariant is a conserved quantity, of second order in disturbance amplitude relative to a prescribed steady basic state, which is related to the time symmetry of the system. We derive such an invariant for the semi-geostrophic equations, and use it to obtain: (i) a linear stability theorem analogous to Arnol'd's ‘first theorem’; and (ii) a small-amplitude local conservation law for the invariant, obeying the group-velocity property in the WKB limit. The results are analogous to their quasi-geostrophic forms, and reduce to those forms in the limit of small Rossby number. The results are derived for both the f-plane Boussinesq form of semi-geostrophic dynamics, and its extension to β-plane compressible flow by Magnusdottir & Schubert. Novel features particular to semi-geostrophic dynamics include apparently unnoticed lateral boundary stability criteria. Unlike the boundary stability criteria found in the first part of this study, however, these boundary criteria do not necessarily preclude the construction of provably stable basic states. The interior semi-geostrophic dynamics has an underlying Hamiltonian structure, which guarantees that symmetries in the system correspond naturally to the system's invariants. This is an important motivation for the theoretical approach used in this study. The connection between symmetries and conservation laws is made explicit using Noether's theorem applied to the Eulerian form of the Hamiltonian description of the interior dynamics.

Wave-activity conservation laws and stability theorems for semi-geostrophic dynamics: part 1. pseudomomentum-based theory

There exists a well-developed body of theory based on quasi-geostrophic (QG) dynamics that is central to our present understanding of large-scale atmospheric and oceanic dynamics. An important question is the extent to which this body of theory may generalize to more accurate dynamical models. As a first step in this process, we here generalize a set of theoretical results, concerning the evolution of disturbances to prescribed basic states, to semi-geostrophic (SG) dynamics. SG dynamics, like QG dynamics, is a Hamiltonian balanced model whose evolution is described by the material conservation of potential vorticity, together with an invertibility principle relating the potential vorticity to the advecting fields. SG dynamics has features that make it a good prototype for balanced models that are more accurate than QG dynamics. In the first part of this two-part study, we derive a pseudomomentum invariant for the SG equations, and use it to obtain: (i) linear and nonlinear generalized Charney–Stern theorems for disturbances to parallel flows; (ii) a finite-amplitude local conservation law for the invariant, obeying the group-velocity property in the WKB limit; and (iii) a wave-mean-flow interaction theorem consisting of generalized Eliassen–Palm flux diagnostics, an elliptic equation for the stream-function tendency, and a non-acceleration theorem. All these results are analogous to their QG forms. The pseudomomentum invariant – a conserved second-order disturbance quantity that is associated with zonal symmetry – is constructed using a variational principle in a similar manner to the QG calculations. Such an approach is possible when the equations of motion under the geostrophic momentum approximation are transformed to isentropic and geostrophic coordinates, in which the ageostrophic advection terms are no longer explicit. Symmetry-related wave-activity invariants such as the pseudomomentum then arise naturally from the Hamiltonian structure of the SG equations. We avoid use of the so-called ‘massless layer’ approach to the modelling of isentropic gradients at the lower boundary, preferring instead to incorporate explicitly those boundary contributions into the wave-activity and stability results. This makes the analogy with QG dynamics most transparent. This paper treats the f-plane Boussinesq form of SG dynamics, and its recent extension to β-plane, compressible flow by Magnusdottir & Schubert. In the limit of small Rossby number, the results reduce to their respective QG forms. Novel features particular to SG dynamics include apparently unnoticed lateral boundary stability criteria in (i), and the necessity of including additional zonal-mean eddy correlation terms besides the zonal-mean potential vorticity fluxes in the wave-mean-flow balance in (iii). In the companion paper, wave-activity conservation laws and stability theorems based on the SG form of the pseudoenergy are presented.

Nonlinear wave-activity conservation laws and Hamiltonian structure for the two-dimensional anelastic equations

Exact, finite-amplitude, local wave-activity conservation laws are derived for disturbances to steady flows in the context of the two-dimensional anelastic equations. The conservation laws are expressed entirely in terms of Eulerian quantities, and have the property that, in the limit of a small-amplitude, slowly varying, monochromatic wave train, the wave-activity density A and flux F, when averaged over phase, satisfy F = cgA where cg is the group velocity of the waves. For nonparallel steady flows, the only conserved wave activity is a form of disturbance pseudoenergy; when the steady flow is parallel, there is in addition a conservation law for the disturbance pseudomomentum. The above results are obtained not only for isentropic background states (which give the so-called “deep form” of the anelastic equations), but also for arbitrary background potential-temperature profiles θ0(z) so long as the variation in θ0(z) over the depth of the fluid is small compared with θ0 itself. The Hamiltonian structure of the equations is established in both cases, and its symmetry properties discussed. An expression for available potential energy is also derived that, for the case of a stably stratified background state (i.e., dθ0/dz > 0), is locally positive definite; the expression is valid for fully three-dimensional flow. The counterparts to results for the two-dimensional Boussinesq equations are also noted.

Sodomy laws and gender variance in Tahiti and Hawai‘i

In both Hawaiian and Tahitian, the central meaning of mahu denotes gender-variant individuals, particularly male-bodied persons who have a significant investment in femininity. However, in Hawai‘i, unlike Tahiti, the word mahu is now more commonly used as an insult against gay or transgender people. The negative connotation of the term in Hawaiian indexes lower levels of social acceptability for mahu identity on O‘ahu (Hawai‘i’s most populous island) as compared to Tahiti. The article argues that these differences are partly due to a historical legacy of sexually repressive laws. The article traces the history of sodomy laws in these two Polynesian societies and argues that this history supports the hypothesis that sodomy laws (in conjunction with such social processes as urbanisation and Christianisation) are partially to blame for the diminished social status of mahu on O‘ahu. A different social and legal history in Tahiti accounts for the fact that the loss of social status experienced by Tahitian mahu has been lesser than that of their Hawaiian counterparts.

Precipitation scaling with temperature in warm and cold climates: an analysis of CMIP5 simulations

We investigate the scaling between precipitation and temperature changes in warm and cold climates using six models that have simulated the response to both increased CO2 and Last Glacial Maximum (LGM) boundary conditions. Globally, precipitation increases in warm climates and decreases in cold climates by between 1.5%/°C and 3%/°C. Precipitation sensitivity to temperature changes is lower over the land than over the ocean and lower over the tropical land than over the extratropical land, reflecting the constraint of water availability. The wet tropics get wetter in warm climates and drier in cold climates, but the changes in dry areas differ among models. Seasonal changes of tropical precipitation in a warmer world also reflect this “rich get richer” syndrome. Precipitation seasonality is decreased in the cold-climate state. The simulated changes in precipitation per degree temperature change are comparable to the observed changes in both the historical period and the LGM.

Evidence of a universal scaling relationship for leaf CO2 drawdown along an aridity gradient

The leaf carbon isotope ratio (δ13C) of C3 plants is inversely related to the drawdown of CO2 concentration during photosynthesis, which increases towards drier environments. We aimed to discriminate between the hypothesis of universal scaling, which predicts between-species responses of δ13C to aridity similar to within-species responses, and biotic homoeostasis, which predicts offsets in the δ13C of species occupying adjacent ranges. The Northeast China Transect spans 130–900 mm annual precipitation within a narrow latitude and temperature range. Leaves of 171 species were sampled at 33 sites along the transect (18 at ≥ 5 sites) for dry matter, carbon (C) and nitrogen (N) content, specific leaf area (SLA) and δ13C. The δ13C of species generally followed a common relationship with the climatic moisture index (MI). Offsets between adjacent species were not observed. Trees and forbs diverged slightly at high MI. In C3 plants, δ13C predicted N per unit leaf area (Narea) better than MI. The δ13C of C4 plants was invariant with MI. SLA declined and Narea increased towards low MI in both C3 and C4 plants. The data are consistent with optimal stomatal regulation with respect to atmospheric dryness. They provide evidence for universal scaling of CO2 drawdown with aridity in C3 plants.

Workers with elderly dependants: employment law’s response to the latest care-giving conundrum

This paper considers how employment laws are being used in response to what we have termed ‘the eldercare/workplace conundrum’. It is well known that people are now living longer but health is still failing in a significant percentage of older people, meaning that many adults require care for longer, albeit to varying degrees and for varying amounts of time. Many of these individuals will receive care from relatives or close friends who are participating in the labour market: this is increasingly likely as adults are expected / wanting to remain in paid work for longer, often into their 60s and 70s. The requirements of elderly dependants can cause these workers huge difficulties and dilemmas as they attempt, across time, to accommodate the particular needs of the person for whom they wish to provide care, often a loved one, and meet the particular demands of their employment relationship. In this paper we consider why this is an area of social policy that warrants effective legal engagement and consider, drawing on various examples of legal responses in other countries that face similar conundrums, what might improve legal engagement in this area.