Data stream mining in ubiquitous environments: state-of-the-art and current directions

In this article, we review the state-of-the-art techniques in mining data streams for mobile and ubiquitous environments. We start the review with a concise background of data stream processing, presenting the building blocks for mining data streams. In a wide range of applications, data streams are required to be processed on small ubiquitous devices like smartphones and sensor devices. Mobile and ubiquitous data mining target these applications with tailored techniques and approaches addressing scarcity of resources and mobility issues. Two categories can be identified for mobile and ubiquitous mining of streaming data: single-node and distributed. This survey will cover both categories. Mining mobile and ubiquitous data require algorithms with the ability to monitor and adapt the working conditions to the available computational resources. We identify the key characteristics of these algorithms and present illustrative applications. Distributed data stream mining in the mobile environment is then discussed, presenting the Pocket Data Mining framework. Mobility of users stimulates the adoption of context-awareness in this area of research. Context-awareness and collaboration are discussed in the Collaborative Data Stream Mining, where agents share knowledge to learn adaptive accurate models.

Power transfer in velocity-vortex acceleration

A theoretical model is presented of an electron acceleration-as-oscillator method derived from the work of Joseph Larmor unified with J. Clerk Maxwell’s theory of vorticity for the displacement of radiation into free-space at an antenna interface.

Mismatch Negativity (MMN) reveals inefficient auditory ventral stream function in chronic auditory comprehension impairments

Background: Auditory discrimination is significantly impaired in Wernicke’s aphasia (WA) and thought to be causatively related to the language comprehension impairment which characterises the condition. This study used mismatch negativity (MMN) to investigate the neural responses corresponding to successful and impaired auditory discrimination in WA. Methods: Behavioural auditory discrimination thresholds of CVC syllables and pure tones were measured in WA (n=7) and control (n=7) participants. Threshold results were used to develop multiple-deviant mismatch negativity (MMN) oddball paradigms containing deviants which were either perceptibly or non-perceptibly different from the standard stimuli. MMN analysis investigated differences associated with group, condition and perceptibility as well as the relationship between MMN responses and comprehension (within which behavioural auditory discrimination profiles were examined). Results: MMN waveforms were observable to both perceptible and non-perceptible auditory changes. Perceptibility was only distinguished by MMN amplitude in the PT condition. The WA group could be distinguished from controls by an increase in MMN response latency to CVC stimuli change. Correlation analyses displayed relationship between behavioural CVC discrimination and MMN amplitude in the control group, where greater amplitude corresponded to better discrimination. The WA group displayed the inverse effect; both discrimination accuracy and auditory comprehension scores were reduced with increased MMN amplitude. In the WA group, a further correlation was observed between the lateralisation of MMN response and CVC discrimination accuracy; the greater the bilateral involvement the better the discrimination accuracy. Conclusions: The results from this study provide further evidence for the nature of auditory comprehension impairment in WA and indicate that the auditory discrimination deficit is grounded in a reduced ability to engage in efficient hierarchical processing and the construction of invariant auditory objects. Correlation results suggest that people with chronic WA may rely on an inefficient, noisy right hemisphere auditory stream when attempting to process speech stimuli.

The importance of vertical velocity variability for estimates of the indirect aerosol effects

The activation of aerosols to form cloud droplets is dependent upon vertical velocities whose local variability is not typically resolved at the GCM grid scale. Consequently, it is necessary to represent the subgrid-scale variability of vertical velocity in the calculation of cloud droplet number concentration. This study uses the UK Chemistry and Aerosols community model (UKCA) within the Hadley Centre Global Environmental Model (HadGEM3), coupled for the first time to an explicit aerosol activation parameterisation, and hence known as UKCA-Activate. We explore the range of uncertainty in estimates of the indirect aerosol effects attributable to the choice of parameterisation of the subgrid-scale variability of vertical velocity in HadGEM-UKCA. Results of simulations demonstrate that the use of a characteristic vertical velocity cannot replicate results derived with a distribution of vertical velocities, and is to be discouraged in GCMs. This study focuses on the effect of the variance (σw2) of a Gaussian pdf (probability density function) of vertical velocity. Fixed values of σw (spanning the range measured in situ by nine flight campaigns found in the literature) and a configuration in which σw depends on turbulent kinetic energy are tested. Results from the mid-range fixed σw and TKE-based configurations both compare well with observed vertical velocity distributions and cloud droplet number concentrations. The radiative flux perturbation due to the total effects of anthropogenic aerosol is estimated at −1.9 W m−2 with σw = 0.1 m s−1, −2.1 W m−2 with σw derived from TKE, −2.25 W m−2 with σw = 0.4 m s−1, and −2.3 W m−2 with σw = 0.7 m s−1. The breadth of this range is 0.4 W m−2, which is comparable to a substantial fraction of the total diversity of current aerosol forcing estimates. Reducing the uncertainty in the parameterisation of σw would therefore be an important step towards reducing the uncertainty in estimates of the indirect aerosol effects. Detailed examination of regional radiative flux perturbations reveals that aerosol microphysics can be responsible for some climate-relevant radiative effects, highlighting the importance of including microphysical aerosol processes in GCMs.

Comment on “B_y fluctuations in the magnetosheath and azimuthal flow velocity transients in the dayside ionosphere” by Newell and Sibeck

Newell and Sibeck [1993] (hereafter N&S) list some objections to our interpretation of dayside auroral transients and associated azimuthal flow bursts in terms of pulsed reconnection [e.g. Lockwood et al., 1989; 1993a]. They present what they term an “apparently overlooked” alternative explanation in terms of steady reconnection and fluctuations in the magnitude of the By component of the magnetosheath field. The objections of N&S can all be answered by reference to our previous publications and their alternative explanation was only “overlooked” in so far as it fails to explain the observations. Here we discuss just some of the reasons why the objections of N&S are invalid, and then give reasons why the events are not simply due to magnetosheath |By| changes.

Dayside ionospheric convection changes in response to long-period interplanetary Magnetic field oscillations: Determination of the ionospheric phase velocity

Ground magnetic field perturbations recorded by the CANOPUS magnetometer network in the 7 to 13 MLT sector are used to examine how reconfigurations of the dayside polar ionospheric flow take place in response to north-south changes of the IMF. During the 6-hour interval in question IMF Bz oscillates between ±7 nT with about a 1-hour period. Corresponding variations in the ground magnetic disturbance are observed which we infer are due to changes in ionospheric flow. Cross correlation of the data obtained from two ground stations at 73.5° magnetic latitude, but separated by ∼2 hours in MLT, shows that changes in the flow are initiated in the prenoon sector (∼10 MLT) and then spread outward toward dawn and dusk with a phase speed of ∼5 km s−1 over the longitude range ∼8 to 12 MLT, slowing to ∼2 km s−1 outside this range. Cross correlating the data from these ground stations with IMP 8 IMF Bz records produces a MLT variation in the ground response delay relative to the IMF which is compatible with these deduced phase speeds. We interpret these observations in terms of the ionospheric response to the onset, expansion and decay of magnetic reconnection at the dayside magnetopause.

Incoherent scatter radar observations of non-Maxwellian ion velocity distributions in the auroral F-region

Observations by the EISCAT experiments “POLAR” and Common Programme CP-3 reveal non-Maxwellian ion velocity distributions in the auroral F-region ionosphere. Analysis of data from three periods is presented. During the first period, convection velocities are large (≈2 km s-1) and constant over part of a CP-3 latitude scan; the second period is one of POLAR data containing a short-lived (<1 min.) burst of rapid (>1.5 km s-1) flow. We concentrate on these two periods as they allow the study of a great many features of the ion-neutral interactions which drive the plasma non-thermal and provide the best available experimental test for models of the 3-dimensional ion velocity distribution function. The third period is included to illustrate the fact that non-thermal plasma frequently exists in the auroral ionosphere: the data, also from the POLAR experiment, cover a three-hour period of typical auroral zone flow and analysis reveals that the ion distribution varies from Maxwellian to the threshold of a toroidal form.

The effect of rapid changes in ionospheric flow on velocity vectors deduced from radar beam-swinging experiments

The effects on the horizontal ionospheric velocity vectors deduced from radar beam-swinging experiments, which occur when changes in the flow take place on short time scales compared with the experiment cycle time, are analysed in detail. The further complications which arise in the interpretation of beam-swinging data, due to longitudinal gradients in the flow and to field-aligned flows, are also considered. It is concluded that these effects are unlikely to seriously compromise statistical determinations of the response time of the flow, e.g. to changes in the north-south component of the IMF, such as have been recently reported by Etemadiet al. (1988, Planet. Space Sci.36, 471), using EISCAT ‘Polar’ data.

The influence of anisotropic F region ion velocity distributions on ionospheric ion outflows into the magnetosphere

The contribution to the field-aligned ionospheric ion momentum equation, due to coupling between pressure anisotropy and the inhomogeneous geomagnetic field, is investigated. We term this contribution the “hydrodynamic mirror force” and investigate its dependence on the ion drift and the resulting deformations of the ion velocity distribution function from an isotropic form. It is shown that this extra upforce increases rapidly with ion drift relative to the neutral gas but is not highly dependent on the ion-neutral collision model employed. An example of a burst of flow observed by EISCAT, thought to be the ionospheric signature of a flux transfer event at the magnetopause, is studied in detail and it is shown that the nonthermal plasma which results is subject to a hydrodynamic mirror force which is roughly 10% of the gravitational downforce. In addition, predictions by the coupled University College London-Sheffield University model of the ionosphere and thermosphere show that the hydrodynamic mirror force in the auroral oval is up to 3% of the gravitational force for Kp of about 3, rising to 10% following a sudden increase in cross-cap potential. The spatial distribution of the upforce shows peaks in the cusp region and in the post-midnight auroral oval, similar to that of observed low-energy heavy ion flows from the ionosphere into the magnetosphere. We suggest the hydrodynamic mirror force may modulate these outflows by controlling the supply of heavy ions to regions of ion acceleration and that future simulations of the effects of Joule heating on ion outflows should make allowance for it.

Non-Maxwellian ion velocity distributions observed using EISCAT

Recent observations from the EISCAT incoherent scatter radar have revealed bursts of poleward ion flow in the dayside auroral ionosphere which are consistent with the ionospheric signature of flux transfer events at the magnetopause. These bursts frequently contain ion drifts which exceed the neutral thermal speed and, because the neutral thermospheric wind is incapable of responding sufficiently rapidly, toroidal, non-Maxwellian ion velocity distributions are expected. The EISCAT observations are made with high time resolution (15 seconds) and at a large angle to the geomagnetic field (73.5°), allowing the non-Maxwellian nature of the distribution to be observed remotely for the first time. The observed features are also strongly suggestive of a toroidal distribution: characteristic spectral shape, increased scattered power (both consistent with reduced Landau damping and enhanced electric field fluctuations) and excessively high line-of-sight ion temperatures deduced if a Maxwellian distribution is assumed. These remote sensing observations allow the evolution of the distributions to be observed. They are found to be non-Maxwellian whenever the ion drift exceeds the neutral thermal speed, indicating that such distributions can exist over the time scale of the flow burst events (several minutes).

How well can we model stream phosphorus concentrations in agricultural catchments?

Mechanistic catchment-scale phosphorus models appear to perform poorly where diffuse sources dominate. We investigate the reasons for this for one model, INCA-P, testing model output against 18 months of daily data in a small Scottish catchment. We examine key model processes and provide recommendations for model improvement and simplification. Improvements to the particulate phosphorus simulation are especially needed. The model evaluation procedure is then generalised to provide a checklist for identifying why model performance may be poor or unreliable, incorporating calibration, data, structural and conceptual challenges. There needs to be greater recognition that current models struggle to produce positive Nash–Sutcliffe statistics in agricultural catchments when evaluated against daily data. Phosphorus modelling is difficult, but models are not as useless as this might suggest. We found a combination of correlation coefficients, bias, a comparison of distributions and a visual assessment of time series a better means of identifying realistic simulations.

Changes in sewage sludge carbon forms along a treatment stream

The behaviour and fate of macronutrients and pollutants in sewage sludge applied to the land are affected by the chemical composition of the sludge organic matter, which in turn is influenced by both sewage source and by sewage treatment processes. In this study, 13C nuclear magnetic resonance (NMR) spectroscopy was used to characterise the organic matter of sludges collected at three different points along the treatment stream of a municipal sewage works with a domestic catchment. Sludge at the first point, an undigested liquid (UL) sludge, had a substantially different composition to the anaerobically digested (AD) and dewatered sludge cake (DC) materials, which were similar to each other. In particular, the UL sludge contained more alkyl C than the AD or DC sludges. All three sludges were found to contain mobile alkyl C that is poorly observed using the cross polarisation (CP) technique, necessitating the use of the less sensitive, but more quantitatively reliable direct polarisation (DP) technique to obtain accurate distributions of C types.

Soil phosphorus dynamics and phytoavailability from sewage sludge at different stages in a treatment stream

The effect of different stages of sewage sludge treatment on phosphorus (P) dynamics in amended soils was determined using samples of undigested liquid (UL), anaerobically digested liquid (AD) and dewatered anaerobically digested (DC) sludge. Sludges were taken from three points in the same treatment stream and applied to a sandy loam soil in field-based mesocosms at 4, 8 and 16t ha−1 dry solids. Mesocosms were sown with perennial ryegrass (Lolium perenne cv. Melle), and the sward was harvested after 35 and 70 days to determine yield and foliar P concentration. Soils were also sampled during this period to measure P transformations and the activities of acid phosphomonoesterase and phosphodiesterase. Data show that the AD amended soils had the greatest plant-available and foliar P content up to the second harvest, but the UL amended soils had the greatest enzyme activity. Characterisation of control and 16t ha−1 soils and sludge using solution 31P nuclear magnetic resonance (NMR) spectroscopy after NaOH–EDTA extraction revealed that P was predominantly in the inorganic pool in all three sludge samples, with the highest proportion (of the total extracted P) as inorganic P in the anaerobically digested liquid sludge. After sludge incorporation, P was immobilised to organic species. The majority of organic P was in monoester-P forms, while the remainder of organic P (diester P and phosphonate P) was more susceptible to transformations through time and showed variation with sludge type. These results show that application of sewage sludge at rates as low as 4t ha−1 can have a significant nutritional benefit to ryegrass over an initial 35-day growth and subsequent 35-day re-growth periods. Differences in P transformation, and hence nutritional benefit, between sludge types were evident throughout the experiment. Thus, differences in sludge treatment process alter the edaphic mineralisation characteristics of biosolids derived from the same source material.