Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 4: Near-Earth solar wind speed, IMF, and open solar flux

In the concluding paper of this tetralogy, we here use the different geomagnetic activity indices to reconstruct the near-Earth interplanetary magnetic field (IMF) and solar wind flow speed, as well as the open solar flux (OSF) from 1845 to the present day. The differences in how the various indices vary with near-Earth interplanetary parameters, which are here exploited to separate the effects of the IMF and solar wind speed, are shown to be statistically significant at the 93% level or above. Reconstructions are made using four combinations of different indices, compiled using different data and different algorithms, and the results are almost identical for all parameters. The correction to the aa index required is discussed by comparison with the Ap index from a more extensive network of mid-latitude stations. Data from the Helsinki magnetometer station is used to extend the aa index back to 1845 and the results confirmed by comparison with the nearby St Petersburg observatory. The optimum variations, using all available long-term geomagnetic indices, of the near-Earth IMF and solar wind speed, and of the open solar flux, are presented; all with ±2sigma� uncertainties computed using the Monte Carlo technique outlined in the earlier papers. The open solar flux variation derived is shown to be very similar indeed to that obtained using the method of Lockwood et al. (1999).

Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 3: improved representation of solar cycle 11

Svalgaard (2014) has recently pointed out that the calibration of the Helsinki magnetic observatory’s H component variometer was probably in error in published data for the years 1866–1874.5 and that this makes the interdiurnal variation index based on daily means, IDV(1d), (Lockwood et al., 2013a), and the interplanetary magnetic field strength derived from it (Lockwood et al., 2013b), too low around the peak of solar cycle 11. We use data from the modern Nurmijarvi station, relatively close to the site of the original Helsinki Observatory, to confirm a 30% underestimation in this interval and hence our results are fully consistent with the correction derived by Svalgaard. We show that the best method for recalibration uses the Helsinki Ak(H) and aa indices and is accurate to ±10 %. This makes it preferable to recalibration using either the sunspot number or the diurnal range of geomagnetic activity which we find to be accurate to ±20 %. In the case of Helsinki data during cycle 11, the two recalibration methods produce very similar corrections which are here confirmed using newly digitised data from the nearby St Petersburg observatory and also using declination data from Helsinki. However, we show that the IDV index is, compared to later years, too similar to sunspot number before 1872, revealing independence of the two data series has been lost; either because the geomagnetic data used to compile IDV has been corrected using sunspot numbers, or vice versa, or both. We present corrected data sequences for both the IDV(1d) index and the reconstructed IMF (interplanetary magnetic field).We also analyse the relationship between the derived near-Earth IMF and the sunspot number and point out the relevance of the prior history of solar activity, in addition to the contemporaneous value, to estimating any “floor” value of the near-Earth interplanetary field.

Evidence for solar wind modulation of lightning

The response of lightning rates over Europe to arrival of high speed solar wind streams at Earth is investigated using a superposed epoch analysis. Fast solar wind stream arrival is determined from modulation of the solar wind V y component, measured by the Advanced Composition Explorer spacecraft. Lightning rate changes around these event times are determined from the very low frequency arrival time difference (ATD) system of the UK Met Office. Arrival of high speed streams at Earth is found to be preceded by a decrease in total solar irradiance and an increase in sunspot number and Mg II emissions. These are consistent with the high speed stream's source being co-located with an active region appearing on the Eastern solar limb and rotating at the 27 d period of the Sun. Arrival of the high speed stream at Earth also coincides with a small (~1%) but rapid decrease in galactic cosmic ray flux, a moderate (~6%) increase in lower energy solar energetic protons (SEPs), and a substantial, statistically significant increase in lightning rates. These changes persist for around 40 d in all three quantities. The lightning rate increase is corroborated by an increase in the total number of thunder days observed by UK Met stations, again persisting for around 40 d after the arrival of a high speed solar wind stream. This result appears to contradict earlier studies that found an anti-correlation between sunspot number and thunder days over solar cycle timescales. The increase in lightning rates and thunder days that we observe coincides with an increased flux of SEPs which, while not being detected at ground level, nevertheless penetrate the atmosphere to tropospheric altitudes. This effect could be further amplified by an increase in mean lightning stroke intensity that brings more strokes above the detection threshold of the ATD system. In order to remove any potential seasonal bias the analysis was repeated for daily solar wind triggers occurring during the summer months (June to August). Though this reduced the number of solar wind triggers to 32, the response in both lightning and thunder day data remained statistically significant. This modulation of lightning by regular and predictable solar wind events may be beneficial to medium range forecasting of hazardous weather.

Detection of lower tropospheric responses to solar energetic particles at midlatitudes

Solar energetic particles (SEPs) occasionally contribute additional atmospheric ionization beyond that arising from the usual galactic cosmic ray background. During an SEP event associated with a solar flare on April 11, 2013, the vertical ionization rate profile obtained using a balloon-borne detector showed enhanced ionization with a 26% increase at 20 km, over Reading, United Kingdom. Fluctuations in atmospheric electrical parameters were also detected at the surface, beneath the balloon’s trajectory. As no coincident changes in geomagnetism occurred, the electrical fluctuations are very likely to be associated with increased ionization, as observed by the balloon measurements. The lack of response of surface neutron monitors during this event indicates that energetic particles that are not detected at the surface by neutron monitors can nevertheless enter and influence the atmosphere’s weather-generating regions.

Centennial variations in sunspot number, open solar flux and streamer belt width: 1. correction of the sunspot number record since 1874

We analyse the widely-used international/ Zürich sunspot number record, R, with a view to quantifying a suspected calibration discontinuity around 1945 (which has been termed the “Waldmeier discontinuity” [Svalgaard, 2011]). We compare R against the composite sunspot group data from the Royal Greenwich Observatory (RGO) network and the Solar Optical Observing Network (SOON), using both the number of sunspot groups, N{sub}G{\sub}, and the total area of the sunspots, A{sub}G{\sub}. In addition, we compare R with the recently developed interdiurnal variability geomagnetic indices IDV and IDV(1d). In all four cases, linearity of the relationship with R is not assumed and care is taken to ensure that the relationship of each with R is the same before and after the putative calibration change. It is shown the probability that a correction is not needed is of order 10{sup}−8{\sup} and that R is indeed too low before 1945. The optimum correction to R for values before 1945 is found to be 11.6%, 11.7%, 10.3% and 7.9% using A{sub}G{\sub}, N{sub)G{\sub}, IDV, and IDV(1d), respectively. The optimum value obtained by combining the sunspot group data is 11.6% with an uncertainty range 8.1-14.8% at the 2σ level. The geomagnetic indices provide an independent yet less stringent test but do give values that fall within the 2σ uncertainty band with optimum values are slightly lower than from the sunspot group data. The probability of the correction needed being as large as 20%, as advocated by Svalgaard [2011], is shown to be 1.6 × 10{sup}−5{\sup}.

Centennial variations in sunspot number, open solar flux and streamer belt width: 2. Comparison with the geomagnetic data

We investigate the relationship between interdiurnal variation geomagnetic activity indices, IDV and IDV(1d), corrected sunspot number, R{sub}C{\sub}, and the group sunspot number R{sub}G{\sub}. R{sub}C{\sub} uses corrections for both the “Waldmeier discontinuity”, as derived in Paper 1 [Lockwood et al., 2014c], and the “Wolf discontinuity” revealed by Leussu et al. [2013]. We show that the simple correlation of the geomagnetic indices with R{sub}C{\sub}{sup}n{\sup} or R{sub}G{\sub}{sup}n{\sup} masks a considerable solar cycle variation. Using IDV(1d) or IDV to predict or evaluate the sunspot numbers, the errors are almost halved by allowing for the fact that the relationship varies over the solar cycle. The results indicate that differences between R{sub}C{\sub} and R{sub}G{\sub} have a variety of causes and are highly unlikely to be attributable to errors in either R{sub}G{\sub} alone, as has recently been assumed. Because it is not known if R{sub}C{\sub} or R{sub}G{\sub} is a better predictor of open flux emergence before 1874, a simple sunspot number composite is suggested which, like R{sub}G{\sub}, enables modelling of the open solar flux for 1610 onwards in Paper 3, but maintains the characteristics of R{sub}C{\sub}.

Centennial variations in sunspot number, open solar flux and streamer belt width: 3. Modelling

From the variation of near-Earth interplanetary conditions, reconstructed for the mid-19th century to the present day using historic geomagnetic activity observations, Lockwood and Owens [2014] have suggested that Earth remains within a broadened streamer belt during solar cycles when the Open Solar Flux (OSF) is low. From this they propose that the Earth was immersed in almost constant slow solar wind during the Maunder minimum (c. 1650-1710). In this paper, we extend continuity modelling of the OSF to predict the streamer belt width using both group sunspot numbers and corrected international sunspot numbers to quantify the emergence rate of new OSF. The results support the idea that the solar wind at Earth was persistently slow during the Maunder minimum because the streamer belt was broad.

The effect of chosen extraterrestrial solar spectrum on clear-sky atmospheric absorption and heating rates in the near infrared

The extraterrestrial solar spectrum (ESS) is an important component in near infrared (near-IR) radiative transfer calculations. However, the impact of a particular choice of the ESS in these regions has been given very little attention. A line-by-line (LBL) transfer model has been used to calculate the absorbed solar irradiance and solar heating rates in the near-IR from 2000-10000 cm−1(1-5 μm) using different ESS. For overhead sun conditions in a mid-latitude summer atmosphere, the absorbed irradiances could differ by up to about 11 Wm−2 (8.2%) while the tropospheric and stratospheric heating rates could differ by up to about 0.13 K day−1 (8.1%) and 0.19 K day−1 (7.6%). The spectral shape of the ESS also has a small but non-negligible impact on these factors in the near-IR.

The interdependence of continental warm cloud properties derived from unexploited solar background signals in ground-based lidar measurements

We have extensively analysed the interdependence between cloud optical depth, droplet effective radius, liquid water path (LWP) and geometric thickness for stratiform warm clouds using ground-based observations. In particular, this analysis uses cloud optical depths retrieved from untapped solar background signals that are previously unwanted and need to be removed in most lidar applications. Combining these new optical depth retrievals with radar and microwave observations at the Atmospheric Radiation Measurement (ARM) Climate Research Facility in Oklahoma during 2005–2007, we have found that LWP and geometric thickness increase and follow a power-law relationship with cloud optical depth regardless of the presence of drizzle; LWP and geometric thickness in drizzling clouds can be generally 20–40 % and at least 10 % higher than those in non-drizzling clouds, respectively. In contrast, droplet effective radius shows a negative correlation with optical depth in drizzling clouds and a positive correlation in non-drizzling clouds, where, for large optical depths, it asymptotes to 10 μm. This asymptotic behaviour in non-drizzling clouds is found in both the droplet effective radius and optical depth, making it possible to use simple thresholds of optical depth, droplet size, or a combination of these two variables for drizzle delineation. This paper demonstrates a new way to enhance ground-based cloud observations and drizzle delineations using existing lidar networks.

Influence of short-term solar disturbances on the fair weather conduction current

The fair weather atmospheric electrical current (Jz) couples the ionosphere to the lower atmosphere and thus provides a route by which changes in solar activity can modify processes in the lower troposphere. This paper examines the temporal variations and spectral characteristics of continuous measurements of Jz conducted at the Wise Observatory in Mitzpe-Ramon, Israel (30°35′ N, 34°45′ E), during two large CMEs, and during periods of increased solar wind density. Evidence is presented for the effects of geomagnetic storms and sub-storms on low latitude Jz during two coronal mass ejections (CMEs), on 24–25th October 2011 and 7–8th March 2012, when the variability in Jz increased by an order of magnitude compared to normal fair weather conditions. The dynamic spectrum of the increased Jz fluctuations exhibit peaks in the Pc5 frequency range. Similar low frequency characteristics occur during periods of enhanced solar wind proton density. During the October 2011 event, the periods of increased fluctuations in Jz lasted for 7 h and coincided with fluctuations of the inter-planetary magnetic field (IMF) detected by the ACE satellite. We suggest downward mapping of ionospheric electric fields as a possible mechanism for the increased fluctuations.

The Solar Stormwatch CME catalogue: results from the first space weather citizen science project

Solar Stormwatch was the first space weather citizen science project, the aim of which was to identify and track coronal mass ejections (CMEs) observed by the Heliospheric Imagers aboard the STEREO satellites. The project has now been running for approximately 4 years, with input from >16000 citizen scientists, resulting in a dataset of >38000 time-elongation profiles of CME trajectories, observed over 18 pre-selected position angles. We present our method for reducing this data set into aCME catalogue. The resulting catalogue consists of 144 CMEs over the period January-2007 to February-2010, of which 110 were observed by STEREO-A and 77 were observed by STEREO-B. For each CME, the time-elongation profiles generated by the citizen scientists are averaged into a consensus profile along each position angle that the event was tracked. We consider this catalogue to be unique, being at present the only citizen science generated CME catalogue, tracking CMEs over an elongation range of 4 degrees out to a maximum of approximately 70 degrees. Using single spacecraft fitting techniques, we estimate the speed, direction, solar source region and latitudinal width of each CME. This shows that, at present, the Solar Stormwatch catalogue (which covers only solar minimum years) contains almost exclusively slow CMEs, with a mean speed of approximately 350 kms−1. The full catalogue is available for public access at www.met.reading.ac.uk/spate/stormwatch. This includes, for each event, the unprocessed time-elongation profiles generated by Solar Stormwatch, the consensus time-elongation profiles and a set of summary plots, as well as the estimated CME properties.

Ensemble downscaling in coupled solar wind-magnetosphere modeling for space weather forecasting

Advanced forecasting of space weather requires simulation of the whole Sun-to-Earth system, which necessitates driving magnetospheric models with the outputs from solar wind models. This presents a fundamental difficulty, as the magnetosphere is sensitive to both large-scale solar wind structures, which can be captured by solar wind models, and small-scale solar wind “noise,” which is far below typical solar wind model resolution and results primarily from stochastic processes. Following similar approaches in terrestrial climate modeling, we propose statistical “downscaling” of solar wind model results prior to their use as input to a magnetospheric model. As magnetospheric response can be highly nonlinear, this is preferable to downscaling the results of magnetospheric modeling. To demonstrate the benefit of this approach, we first approximate solar wind model output by smoothing solar wind observations with an 8 h filter, then add small-scale structure back in through the addition of random noise with the observed spectral characteristics. Here we use a very simple parameterization of noise based upon the observed probability distribution functions of solar wind parameters, but more sophisticated methods will be developed in the future. An ensemble of results from the simple downscaling scheme are tested using a model-independent method and shown to add value to the magnetospheric forecast, both improving the best estimate and quantifying the uncertainty. We suggest a number of features desirable in an operational solar wind downscaling scheme.

A magnetometer for the Solar Orbiter mission

The magnetometer is a key instrument to the Solar Orbiter mission. The magnetic field is a fundamental parameter in any plasma: a precise and accurate measurement of the field is essential for understanding almost all aspects of plasma dynamics such as shocks and stream-stream interactions. Many of Solar Orbiter’s mission goals are focussed around the link between the Sun and space. A combination of in situ measurements by the magnetometer, remote measurements of solar magnetic fields and global modelling is required to determine this link and hence how the Sun affects interplanetary space. The magnetic field is typically one of the most precisely measured plasma parameters and is therefore the most commonly used measurement for studies of waves, turbulence and other small scale phenomena. It is also related to the coronal magnetic field which cannot be measured directly. Accurate knowledge of the magnetic field is essential for the calculation of fundamental plasma parameters such as the plasma beta, Alfvén speed and gyroperiod. We describe here the objectives and context of magnetic field measurements on Solar Orbiter and an instrument that fulfils those objectives as defined by the scientific requirements for the mission.

Centennial changes in solar activity and the response of galactic cosmic rays

There is a growing consensus that the eleven year modulation of galactic cosmic rays (GCRs) resulting from solar activity is related to interplanetary propagating diffusive barriers (PDBs). The source of these PDBs is not well understood and numerical models describing GCR modulation simulate their effect by scaling the diffusion tensor to the interplanetary magnetic field strength (IMF). The implications of a century-scale change in solar wind speed and open solar flux, for numerical modelling of GCR modulation and the reconstruction of GCR variations over the last hundred years are discussed. The dominant role of the solar non-axisymmetric magnetic field in both forcing longitudinal solar wind speed fluctuations at solar maximum and in increasing the IMF is discussed in the context of a long-term rise in the open solar magnetic flux.

Centennial changes in the solar wind speed and in the open solar flux

We use combinations of geomagnetic indices, based on both variation range and hourly means, to derive the solar wind flow speed, the interplanetary magnetic field strength at 1 AU and the total open solar flux between 1895 and the present. We analyze the effects of the regression procedure and geomagnetic indices used by adopting four analysis methods. These give a mean interplanetary magnetic field strength increase of 45.1 ± 4.5% between 1903 and 1956, associated with a 14.4 ± 0.7% rise in the solar wind speed. We use averaging timescales of 1 and 2 days to allow for the difference between the magnetic fluxes threading the coronal source surface and the heliocentric sphere at 1 AU. The largest uncertainties originate from the choice of regression procedure: the average of all eight estimates of the rise in open solar flux is 73.0 ± 5.0%, but the best procedure, giving the narrowest and most symmetric distribution of fit residuals, yields 87.3 ± 3.9%.