Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr – Part 1: A new geomagnetic data composite

We present a new composite of geomagnetic activity which is designed to be as homogeneous in its construction as possible. This is done by only combining data that, by virtue of the locations of the source observatories used, have similar responses to solar wind and IMF (interplanetary magnetic field) variations. This will enable us (in Part 2, Lockwood et al., 2013a) to use the new index to reconstruct the interplanetary magnetic field, B, back to 1846 with a full analysis of errors. Allowance is made for the effects of secular change in the geomagnetic field. The composite uses interdiurnal variation data from Helsinki for 1845–1890 (inclusive) and 1893–1896 and from Eskdalemuir from 1911 to the present. The gaps are filled using data from the Potsdam (1891–1892 and 1897–1907) and the nearby Seddin observatories (1908–1910) and intercalibration achieved using the Potsdam–Seddin sequence. The new index is termed IDV(1d) because it employs many of the principles of the IDV index derived by Svalgaard and Cliver (2010), inspired by the u index of Bartels (1932); however, we revert to using one-day (1d) means, as employed by Bartels, because the use of near-midnight values in IDV introduces contamination by the substorm current wedge auroral electrojet, giving noise and a dependence on solar wind speed that varies with latitude. The composite is compared with independent, early data from European-sector stations, Greenwich, St Petersburg, Parc St Maur, and Ekaterinburg, as well as the composite u index, compiled from 2–6 stations by Bartels, and the IDV index of Svalgaard and Cliver. Agreement is found to be extremely good in all cases, except two. Firstly, the Greenwich data are shown to have gradually degraded in quality until new instrumentation was installed in 1915. Secondly, we infer that the Bartels u index is increasingly unreliable before about 1886 and overestimates the solar cycle amplitude between 1872 and 1883 and this is amplified in the proxy data used before 1872. This is therefore also true of the IDV index which makes direct use of the u index values.

Flight periodicity and the vertical distribution of high-altitude moth migration over southern Britain

The continuous operation of insect-monitoring radars in the UK has permitted, for the first time, the characterization of various phenomena associated with high-altitude migration of large insects over this part of northern Europe. Previous studies have taken a case-study approach, concentrating on a small number of nights of particular interest. Here, combining data from two radars, and from an extensive suction- and light-trapping network, we have undertaken a more systematic, longer-term study of diel flight periodicity and vertical distribution of macro-insects in the atmosphere. Firstly, we identify general features of insect abundance and stratification, occurring during the 24-hour cycle, which emerge from four years’ aggregated radar data for the summer months in southern Britain. These features include mass emigrations at dusk and to a lesser extent at dawn, and daytime concentrations associated with thermal convection. We then focus our attention on the well-defined layers of large nocturnal migrants that form in the early evening, usually at heights of 200–500 m above ground. We present evidence from both radar and trap data that these nocturnal layers are composed mainly of noctuid moths, with species such as Noctua pronuba, Autographa gamma, Agrotis exclamationis, A. segetum, Xestia c-nigrum and Phlogophora meticulosa predominating.

Firms in international trade: importers’ and exporters’ heterogeneity in Italian manufacturing industry

Combining data on structural characteristics and economic performance for a large sample of Italian firms with data on exporting and importing activity, we uncover evidence supporting recent theories on firm heterogeneity and international trade, together with some new facts. In particular, we find that importing is associated with substantial firm heterogeneity. First, we document that trade is more concentrated than employment and sales, and show that importing is even more concentrated than exporting both within sectors and along the sector- and country-extensive margins. Second, while supporting the fact that firms involved in both are the best performers, we also find that firms involved only in importing activities perform better than those involved only in exporting. Our evidence suggests there is a strong self-selection effect in the case of importers and the performance premia of internationalised firms correlate relatively more with the degree of geographical and sectoral diversification of imports.

Combining satellite data and models to estimate cloud radiative effect at the surface and in the atmosphere

Satellite measurements and numerical forecast model reanalysis data are used to compute an updated estimate of the cloud radiative effect on the global multi-annual mean radiative energy budget of the atmosphere and surface. The cloud radiative cooling effect through reflection of shortwave radiation dominates over the longwave heating effect, resulting in a net cooling of the climate system of –21 Wm-2. The shortwave radiative effect of cloud is primarily manifest as a reduction in the solar radiation absorbed at the surface of -53 Wm-2. Clouds impact longwave radiation by heating the moist tropical atmosphere (up to around 40 Wm-2 for global annual means) while enhancing the radiative cooling of the atmosphere over other regions, in particular higher latitudes and sub-tropical marine stratocumulus regimes. While clouds act to cool the climate system during the daytime, the cloud greenhouse effect heats the climate system at night. The influence of cloud radiative effect on determining cloud feedbacks and changes in the water cycle are discussed.

Semantic-level Visual Content Descriptor combining visual and textual cues as collaterals

In this paper, we introduce a novel high-level visual content descriptor which is devised for performing semantic-based image classification and retrieval. The work can be treated as an attempt to bridge the so called “semantic gap”. The proposed image feature vector model is fundamentally underpinned by the image labelling framework, called Collaterally Confirmed Labelling (CCL), which incorporates the collateral knowledge extracted from the collateral texts of the images with the state-of-the-art low-level image processing and visual feature extraction techniques for automatically assigning linguistic keywords to image regions. Two different high-level image feature vector models are developed based on the CCL labelling of results for the purposes of image data clustering and retrieval respectively. A subset of the Corel image collection has been used for evaluating our proposed method. The experimental results to-date already indicates that our proposed semantic-based visual content descriptors outperform both traditional visual and textual image feature models.

Correlated observation errors in data assimilation

Data assimilation provides techniques for combining observations and prior model forecasts to create initial conditions for numerical weather prediction (NWP). The relative weighting assigned to each observation in the analysis is determined by its associated error. Remote sensing data usually has correlated errors, but the correlations are typically ignored in NWP. Here, we describe three approaches to the treatment of observation error correlations. For an idealized data set, the information content under each simplified assumption is compared with that under correct correlation specification. Treating the errors as uncorrelated results in a significant loss of information. However, retention of an approximated correlation gives clear benefits.

Variational data assimilation for parameter estimation: application to a simple morphodynamic model

Data assimilation is a sophisticated mathematical technique for combining observational data with model predictions to produce state and parameter estimates that most accurately approximate the current and future states of the true system. The technique is commonly used in atmospheric and oceanic modelling, combining empirical observations with model predictions to produce more accurate and well-calibrated forecasts. Here, we consider a novel application within a coastal environment and describe how the method can also be used to deliver improved estimates of uncertain morphodynamic model parameters. This is achieved using a technique known as state augmentation. Earlier applications of state augmentation have typically employed the 4D-Var, Kalman filter or ensemble Kalman filter assimilation schemes. Our new method is based on a computationally inexpensive 3D-Var scheme, where the specification of the error covariance matrices is crucial for success. A simple 1D model of bed-form propagation is used to demonstrate the method. The scheme is capable of recovering near-perfect parameter values and, therefore, improves the capability of our model to predict future bathymetry. Such positive results suggest the potential for application to more complex morphodynamic models.

On differentiating ground clutter and insect echoes from Doppler weather radars using archived data

Normally wind measurements from Doppler radars rely on the presence of rain. During fine weather, insects become a potential radar target for wind measurement. However, it is difficult to separate ground clutter and insect echoes when spectral or polarimetric methods are not available. Archived reflectivity and velocity data from repeated scans provide alternative methods. The probability of detection (POD) method, which maps areas with a persistent signal as ground clutter, is ineffective when most scans also contain persistent insect echoes. We developed a clutter detection method which maps the standard deviation of velocity (SDV) over a large number of scans, and can differentiate insects and ground clutter close to the radar. Beyond the range of persistent insect echoes, the POD method more thoroughly removes ground clutter. A new, pseudo-probability clutter map was created by combining the POD and SDV maps. The new map optimised ground clutter detection without removing insect echoes.

Algorithmic statistical analysis of electrophysiological data for the investigation of structure-activity relationship in single neurons

We are developing computational tools supporting the detailed analysis of the dependence of neural electrophysiological response on dendritic morphology. We approach this problem by combining simulations of faithful models of neurons (experimental real life morphological data with known models of channel kinetics) with algorithmic extraction of morphological and physiological parameters and statistical analysis. In this paper, we present the novel method for an automatic recognition of spike trains in voltage traces, which eliminates the need for human intervention. This enables classification of waveforms with consistent criteria across all the analyzed traces and so it amounts to reduction of the noise in the data. This method allows for an automatic extraction of relevant physiological parameters necessary for further statistical analysis. In order to illustrate the usefulness of this procedure to analyze voltage traces, we characterized the influence of the somatic current injection level on several electrophysiological parameters in a set of modeled neurons. This application suggests that such an algorithmic processing of physiological data extracts parameters in a suitable form for further investigation of structure-activity relationship in single neurons.

Surface based hypothesis verification in intensity images using geometric and appearance data

In this paper we discuss current work concerning Appearance-based and CAD-based vision; two opposing vision strategies. CAD-based vision is geometry based, reliant on having complete object centred models. Appearance-based vision builds view dependent models from training images. Existing CAD-based vision systems that work with intensity images have all used one and zero dimensional features, for example lines, arcs, points and corners. We describe a system we have developed for combining these two strategies. Geometric models are extracted from a commercial CAD library of industry standard parts. Surface appearance characteristics are then learnt automatically by observing actual object instances. This information is combined with geometric information and is used in hypothesis evaluation. This augmented description improves the systems robustness to texture, specularities and other artifacts which are hard to model with geometry alone, whilst maintaining the advantages of a geometric description.

Efficient non-linear data assimilation in geophysical fluid dynamics

New ways of combining observations with numerical models are discussed in which the size of the state space can be very large, and the model can be highly nonlinear. Also the observations of the system can be related to the model variables in highly nonlinear ways, making this data-assimilation (or inverse) problem highly nonlinear. First we discuss the connection between data assimilation and inverse problems, including regularization. We explore the choice of proposal density in a Particle Filter and show how the ’curse of dimensionality’ might be beaten. In the standard Particle Filter ensembles of model runs are propagated forward in time until observations are encountered, rendering it a pure Monte-Carlo method. In large-dimensional systems this is very inefficient and very large numbers of model runs are needed to solve the data-assimilation problem realistically. In our approach we steer all model runs towards the observations resulting in a much more efficient method. By further ’ensuring almost equal weight’ we avoid performing model runs that are useless in the end. Results are shown for the 40 and 1000 dimensional Lorenz 1995 model.

Three dimensional picture of the local structure of 1,4-Polybutadiene from a complete atomistic model and neutron scattering data

An efficient method of combining neutron diffraction data over an extended Q range with detailed atomistic models is presented. A quantitative and qualitative mapping of the organization of the chain conformation in both glass and liquid phase has been performed. The proposed structural refinement method is based on the exploitation of the intrachain features of the diffraction pattern by the use of internal coordinates for bond lengths, valence angles and torsion rotations. Models are built stochastically by assignment of these internal coordinates from probability distributions with limited variable parameters. Variation of these parameters is used in the construction of models that minimize the differences between the observed and calculated structure factors. A series of neutron scattering data of 1,4-polybutadiene at the region 20320 K is presented. Analysis of the experimental data yield bond lengths for C-C and C=C of 1.54 and 1.35 Å respectively. Valence angles of the backbone were found to be at 112 and 122.8 for the CCC and CC=C respectively. Three torsion angles corresponding to the double bond and the adjacent R and β bonds were found to occupy cis and trans, s(, trans and g( and trans states, respectively. We compare our results with theoretical predictions, computer simulations, RIS models, and previously reported experimental results.

Data assimilation for state and parameter estimation: application to morphodynamic modelling

Data assimilation is predominantly used for state estimation; combining observational data with model predictions to produce an updated model state that most accurately approximates the true system state whilst keeping the model parameters fixed. This updated model state is then used to initiate the next model forecast. Even with perfect initial data, inaccurate model parameters will lead to the growth of prediction errors. To generate reliable forecasts we need good estimates of both the current system state and the model parameters. This paper presents research into data assimilation methods for morphodynamic model state and parameter estimation. First, we focus on state estimation and describe implementation of a three dimensional variational(3D-Var) data assimilation scheme in a simple 2D morphodynamic model of Morecambe Bay, UK. The assimilation of observations of bathymetry derived from SAR satellite imagery and a ship-borne survey is shown to significantly improve the predictive capability of the model over a 2 year run. Here, the model parameters are set by manual calibration; this is laborious and is found to produce different parameter values depending on the type and coverage of the validation dataset. The second part of this paper considers the problem of model parameter estimation in more detail. We explain how, by employing the technique of state augmentation, it is possible to use data assimilation to estimate uncertain model parameters concurrently with the model state. This approach removes inefficiencies associated with manual calibration and enables more effective use of observational data. We outline the development of a novel hybrid sequential 3D-Var data assimilation algorithm for joint state-parameter estimation and demonstrate its efficacy using an idealised 1D sediment transport model. The results of this study are extremely positive and suggest that there is great potential for the use of data assimilation-based state-parameter estimation in coastal morphodynamic modelling.

Integration of a 3D Variational data assimilation scheme with a coastal area morphodynamic model of Morecambe Bay

This paper describes the implementation of a 3D variational (3D-Var) data assimilation scheme for a morphodynamic model applied to Morecambe Bay, UK. A simple decoupled hydrodynamic and sediment transport model is combined with a data assimilation scheme to investigate the ability of such methods to improve the accuracy of the predicted bathymetry. The inverse forecast error covariance matrix is modelled using a Laplacian approximation which is calibrated for the length scale parameter required. Calibration is also performed for the Soulsby-van Rijn sediment transport equations. The data used for assimilation purposes comprises waterlines derived from SAR imagery covering the entire period of the model run, and swath bathymetry data collected by a ship-borne survey for one date towards the end of the model run. A LiDAR survey of the entire bay carried out in November 2005 is used for validation purposes. The comparison of the predictive ability of the model alone with the model-forecast-assimilation system demonstrates that using data assimilation significantly improves the forecast skill. An investigation of the assimilation of the swath bathymetry as well as the waterlines demonstrates that the overall improvement is initially large, but decreases over time as the bathymetry evolves away from that observed by the survey. The result of combining the calibration runs into a pseudo-ensemble provides a higher skill score than for a single optimized model run. A brief comparison of the Optimal Interpolation assimilation method with the 3D-Var method shows that the two schemes give similar results.