Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 3: improved representation of solar cycle 11

Svalgaard (2014) has recently pointed out that the calibration of the Helsinki magnetic observatory���s H component variometer was probably in error in published data for the years 1866–1874.5 and that this makes the interdiurnal variation index based on daily means, IDV(1d), (Lockwood et al., 2013a), and the interplanetary magnetic field strength derived from it (Lockwood et al., 2013b), too low around the peak of solar cycle 11. We use data from the modern Nurmijarvi station, relatively close to the site of the original Helsinki Observatory, to confirm a 30% underestimation in this interval and hence our results are fully consistent with the correction derived by Svalgaard. We show that the best method for recalibration uses the Helsinki Ak(H) and aa indices and is accurate to ±10 %. This makes it preferable to recalibration using either the sunspot number or the diurnal range of geomagnetic activity which we find to be accurate to ±20 %. In the case of Helsinki data during cycle 11, the two recalibration methods produce very similar corrections which are here confirmed using newly digitised data from the nearby St Petersburg observatory and also using declination data from Helsinki. However, we show that the IDV index is, compared to later years, too similar to sunspot number before 1872, revealing independence of the two data series has been lost; either because the geomagnetic data used to compile IDV has been corrected using sunspot numbers, or vice versa, or both. We present corrected data sequences for both the IDV(1d) index and the reconstructed IMF (interplanetary magnetic field).We also analyse the relationship between the derived near-Earth IMF and the sunspot number and point out the relevance of the prior history of solar activity, in addition to the contemporaneous value, to estimating any “floor” value of the near-Earth interplanetary field.

Centennial variations in sunspot number, open solar flux and streamer belt width: 1. correction of the sunspot number record since 1874

We analyse the widely-used international/ Zürich sunspot number record, R, with a view to quantifying a suspected calibration discontinuity around 1945 (which has been termed the “Waldmeier discontinuity” [Svalgaard, 2011]). We compare R against the composite sunspot group data from the Royal Greenwich Observatory (RGO) network and the Solar Optical Observing Network (SOON), using both the number of sunspot groups, N{sub}G{\sub}, and the total area of the sunspots, A{sub}G{\sub}. In addition, we compare R with the recently developed interdiurnal variability geomagnetic indices IDV and IDV(1d). In all four cases, linearity of the relationship with R is not assumed and care is taken to ensure that the relationship of each with R is the same before and after the putative calibration change. It is shown the probability that a correction is not needed is of order 10{sup}−8{\sup} and that R is indeed too low before 1945. The optimum correction to R for values before 1945 is found to be 11.6%, 11.7%, 10.3% and 7.9% using A{sub}G{\sub}, N{sub)G{\sub}, IDV, and IDV(1d), respectively. The optimum value obtained by combining the sunspot group data is 11.6% with an uncertainty range 8.1-14.8% at the 2σ level. The geomagnetic indices provide an independent yet less stringent test but do give values that fall within the 2σ uncertainty band with optimum values are slightly lower than from the sunspot group data. The probability of the correction needed being as large as 20%, as advocated by Svalgaard [2011], is shown to be 1.6 × 10{sup}−5{\sup}.

Independence referendums: who should vote and who should be offered citizenship?

In this EUDO CITIZENSHIP Forum Debate, several authors consider the interrelations between eligibility criteria for participation in independence referendum (that may result in the creation of a new independent state) and the determination of putative citizenship ab initio (on day one) of such a state. The kick-off contribution argues for resemblance of an independence referendum franchise and of the initial determination of the citizenry, critically appraising the incongruence between the franchise for the 18 September 2014 Scottish independence referendum, and the blueprint for Scottish citizenship ab initio put forward by the Scottish Government in its 'Scotland's Future' White Paper. Contributors to this debate come from divergent disciplines (law, political science, sociology, philosophy). They reflect on and contest the above claims, both generally and in relation to regional settings including (in addition to Scotland) Catalonia/Spain, Flanders/Belgium, Quebec/Canada, Post-Yugoslavia and Puerto-Rico/USA.

Atmospheric electric fields during the Carrington flare

Karen Aplin and Giles Harrison examine international records of the 1859 Carrington flare and consider what they mean for our understanding of space weather today. Space weather is increasingly recognized as a hazard to modern societies, and one way to assess the extent of its possible impact is through analysis of historic space weather events. One such event was the massive solar storm of late August and early September 1859. This is now widely known as the “Carrington flare” or “Carrington event” after the visual solar emissions on 1 September first reported by the Victorian astronomer Richard Carrington from his observatory in Redhill, Surrey (Carrington 1859). The related aurorae and subsequent effects on telegraph networks are well documented (e.g. Clark 2007, Boteler 2006), but use of modern techniques, such as analysis of nitrates produced by solar protons in ice cores to retrospectively assess the nature of the solar flare, has proved problematic (Wolff et al. 2012). This means that there is still very little quantitative information about the flare beyond magnetic observations (e.g. Viljanen et al. 2014).

Influence of short-term solar disturbances on the fair weather conduction current

The fair weather atmospheric electrical current (Jz) couples the ionosphere to the lower atmosphere and thus provides a route by which changes in solar activity can modify processes in the lower troposphere. This paper examines the temporal variations and spectral characteristics of continuous measurements of Jz conducted at the Wise Observatory in Mitzpe-Ramon, Israel (30°35′ N, 34°45′ E), during two large CMEs, and during periods of increased solar wind density. Evidence is presented for the effects of geomagnetic storms and sub-storms on low latitude Jz during two coronal mass ejections (CMEs), on 24–25th October 2011 and 7–8th March 2012, when the variability in Jz increased by an order of magnitude compared to normal fair weather conditions. The dynamic spectrum of the increased Jz fluctuations exhibit peaks in the Pc5 frequency range. Similar low frequency characteristics occur during periods of enhanced solar wind proton density. During the October 2011 event, the periods of increased fluctuations in Jz lasted for 7 h and coincided with fluctuations of the inter-planetary magnetic field (IMF) detected by the ACE satellite. We suggest downward mapping of ionospheric electric fields as a possible mechanism for the increased fluctuations.

An optimal inverse method using Doppler lidar measurements to estimate the surface sensible heat flux

Inverse methods are widely used in various fields of atmospheric science. However, such methods are not commonly used within the boundary-layer community, where robust observations of surface fluxes are a particular concern. We present a new technique for deriving surface sensible heat fluxes from boundary-layer turbulence observations using an inverse method. Doppler lidar observations of vertical velocity variance are combined with two well-known mixed-layer scaling forward models for a convective boundary layer (CBL). The inverse method is validated using large-eddy simulations of a CBL with increasing wind speed. The majority of the estimated heat fluxes agree within error with the proscribed heat flux, across all wind speeds tested. The method is then applied to Doppler lidar data from the Chilbolton Observatory, UK. Heat fluxes are compared with those from a mast-mounted sonic anemometer. Errors in estimated heat fluxes are on average 18 %, an improvement on previous techniques. However, a significant negative bias is observed (on average −63%) that is more pronounced in the morning. Results are improved for the fully-developed CBL later in the day, which suggests that the bias is largely related to the choice of forward model, which is kept deliberately simple for this study. Overall, the inverse method provided reasonable flux estimates for the simple case of a CBL. Results shown here demonstrate that this method has promise in utilizing ground-based remote sensing to derive surface fluxes. Extension of the method is relatively straight-forward, and could include more complex forward models, or other measurements.

Opportunities for magnetospheric research with coordinated cluster and ground-based observations

ESA’s first multi-satellite mission Cluster is unique in its concept of 4 satellites orbiting in controlled formations. This will give an unprecedented opportunity to study structure and dynamics of the magnetosphere. In this paper we discuss ways in which ground-based remote-sensing observations of the ionosphere can be used to support the multipoint in-situ satellite measurements. There are a very large number of potentially useful configurations between the satellites and any one ground-based observatory; however, the number of ideal occurrences for any one configuration is low. Many of the ground-based instruments cannot operate continuously and Cluster will take data only for a part of each orbit, depending on how much high-resolution (‘burst-mode’) data are acquired. In addition, there are a great many instrument modes and the formation, size and shape of the cluster of the four satellites to consider. These circumstances create a clear and pressing need for careful planning to ensure that the scientific return from Cluster is maximised by additional coordinated ground-based observations. For this reason, ESA established a working group to coordinate the observations on the ground with Cluster. We will give a number of examples how the combined spacecraft and ground-based observations can address outstanding questions in magnetospheric physics. An online computer tool has been prepared to allow for the planning of conjunctions and advantageous constellations between the Cluster spacecraft and individual or combined ground-based systems. During the mission a ground-based database containing index and summary data will help to identify interesting datasets and allow to select intervals for coordinated studies. We illustrate the philosophy of our approach, using a few important examples of the many possible configurations between the satellite and the ground-based instruments.

Development of substorm cross-tail current disruption as seen from the ground

We discuss substorm observations made near 2100 magnetic local time (MLT) on March 7, 1991, in a collaborative study involving data from the European Incoherent Scatter radar, all-sky camera data, and magnetometer data from the Tromsø Auroral Observatory, the U.K. Sub-Auroral Magnetometer Network (SAMNET) and the IMAGE magnetometer chain. We conclude that for the substorm studied a plasmoid was not pinched off until at least 10 min after onset at the local time of the observations (2100 MLT) and that the main substorm electrojet expanded westward over this local time 14 min after onset. In the late growth phase/early expansion phase, we observed southward drifting arcs probably moving faster than the background plasma. Similar southward moving arcs in the recovery phase moved at a speed which does not appear to be significantly different from the measured plasma flow speed. We discuss these data in terms of the “Kiruna conjecture” and classical “near-Earth neutral line” paradigms, since the data show features of both models of substorm development. We suggest that longitudinal variation in behavior may reconcile the differences between the two models in the case of this substorm.

Flow-aligned jets in the magnetospheric cusp: Results from the Geospace Environment Modeling Pilot Program

The extended flight of the Airborne Ionospheric Observatory during the Geospace Environment Modeling (GEM) Pilot program on January 16, 1990, allowed continuous all-sky monitoring of the two-dimensional ionospheric footprint of the northward interplanetary magnetic field (IMF) cusp in several wavelengths. Especially important in determining the locus of magnetosheath electron precipitation was the 630.0-nm red line emission. The most striking morphological change in the images was the transient appearance of zonally elongated regions of enhanced 630.0-nm emission which resembled “rays” emanating from the centroid of the precipitation. The appearance of these rays was strongly correlated with the Y component of the IMF: when the magnitude of By was large compared to Bz, the rays appeared; otherwise, the distribution was relatively unstructured. Late in the flight the field of view of the imager included the field of view of flow measurements from the European incoherent scatter radar (EISCAT). The rays visible in 630.0-nm emission exactly aligned with the position of strong flow jets observed by EISCAT. We attribute this correspondence to the requirement of quasi-neutrality; namely, the soft electrons have their largest precipitating fluxes where the bulk of the ions precipitate. The ions, in regions of strong convective flow, are spread out farther along the flow path than in regions of weaker flow. The occurrence and direction of these flow bursts are controlled by the IMF in a manner consistent with newly opened flux tubes; i.e., when |By| > |Bz|, tension in the reconnected field lines produce east-west flow regions downstream of the ionospheric projection of the x line. We interpret the optical rays (flow bursts), which typically last between 5 and 15 min, as evidence of periods of enhanced dayside (or lobe) reconnection when |By| > |Bz|. The length of the reconnection pulse is difficult to determine, however, since strong zonal flows would be expected to persist until the tension force in the field line has decayed, even if the duration of the enhanced reconnection was relatively short.

An arch in the UK

Arches, streamers, polar lights, merry dancers… just a few of many names used to describe the aurora borealis in historical documents in the UK. We have compiled a new catalogue of 20591 independent reports of auroral sightings from the British Isles and Ireland for 1700–1975 using observatory yearbooks, the diaries of amateur observers, newspaper reports and the scientific literature. Our aim is to provide an independent data series that can aid understanding of longterm solar variability, alongside cosmogenic isotope data and historic records of geomagnetic activity and sunspots.

Validation of a priori CME arrival predictions made using real-time heliospheric imager observations

Between December 2010 and March 2013, volunteers for the Solar Stormwatch (SSW) Citizen Science project have identified and analyzed coronal mass ejections (CMEs) in the near real-time Solar Terrestrial Relations Observatory Heliospheric Imager observations, in order to make “Fearless Forecasts” of CME arrival times and speeds at Earth. Of the 60 predictions of Earth-directed CMEs, 20 resulted in an identifiable Interplanetary CME (ICME) at Earth within 1.5–6 days, with an average error in predicted transit time of 22 h, and average transit time of 82.3 h. The average error in predicting arrival speed is 151 km s−1, with an average arrival speed of 425km s−1. In the same time period, there were 44 CMEs for which there are no corresponding SSW predictions, and there were 600 days on which there was neither a CME predicted nor observed. A number of metrics show that the SSW predictions do have useful forecast skill; however, there is still much room for improvement. We investigate potential improvements by using SSW inputs in three models of ICME propagation: two of constant acceleration and one of aerodynamic drag. We find that taking account of interplanetary acceleration can improve the average errors of transit time to 19 h and arrival speed to 77 km s−1.

Big Data and ecosystem research programmes

The size and complexity of data sets generated within ecosystem-level programmes merits their capture, curation, storage and analysis, synthesis and visualisation using Big Data approaches. This review looks at previous attempts to organise and analyse such data through the International Biological Programme and draws on the mistakes made and the lessons learned for effective Big Data approaches to current Research Councils United Kingdom (RCUK) ecosystem-level programmes, using Biodiversity and Ecosystem Service Sustainability (BESS) and Environmental Virtual Observatory Pilot (EVOp) as exemplars. The challenges raised by such data are identified, explored and suggestions are made for the two major issues of extending analyses across different spatio-temporal scales and for the effective integration of quantitative and qualitative data.

Tests of sunspot number sequences: 3. Effects of regression procedures on the calibration of historic sunspot data

We use sunspot group observations from the Royal Greenwich Observatory (RGO) to investigate the effects of intercalibrating data from observers with different visual acuities. The tests are made by counting the number of groups RB above a variable cut-off threshold of observed total whole-spot area (uncorrected for foreshortening) to simulate what a lower acuity observer would have seen. The synthesised annual means of RB are then re-scaled to the full observed RGO group number RA using a variety of regression techniques. It is found that a very high correlation between RA and RB (rAB > 0.98) does not prevent large errors in the intercalibration (for example sunspot maximum values can be over 30 % too large even for such levels of rAB). In generating the backbone sunspot number (RBB), Svalgaard and Schatten (2015, this issue) force regression fits to pass through the scatter plot origin which generates unreliable fits (the residuals do not form a normal distribution) and causes sunspot cycle amplitudes to be exaggerated in the intercalibrated data. It is demonstrated that the use of Quantile-Quantile (“Q  Q”) plots to test for a normal distribution is a useful indicator of erroneous and misleading regression fits. Ordinary least squares linear fits, not forced to pass through the origin, are sometimes reliable (although the optimum method used is shown to be different when matching peak and average sunspot group numbers). However, other fits are only reliable if non-linear regression is used. From these results it is entirely possible that the inflation of solar cycle amplitudes in the backbone group sunspot number as one goes back in time, relative to related solar-terrestrial parameters, is entirely caused by the use of inappropriate and non-robust regression techniques to calibrate the sunspot data.