A 27 day persistence model of near-Earth solar wind conditions: a long lead-time forecast and a benchmark for dynamical models

Geomagnetic activity has long been known to exhibit approximately 27 day periodicity, resulting from solar wind structures repeating each solar rotation. Thus a very simple near-Earth solar wind forecast is 27 day persistence, wherein the near-Earth solar wind conditions today are assumed to be identical to those 27 days previously. Effective use of such a persistence model as a forecast tool, however, requires the performance and uncertainty to be fully characterized. The first half of this study determines which solar wind parameters can be reliably forecast by persistence and how the forecast skill varies with the solar cycle. The second half of the study shows how persistence can provide a useful benchmark for more sophisticated forecast schemes, namely physics-based numerical models. Point-by-point assessment methods, such as correlation and mean-square error, find persistence skill comparable to numerical models during solar minimum, despite the 27 day lead time of persistence forecasts, versus 2–5 days for numerical schemes. At solar maximum, however, the dynamic nature of the corona means 27 day persistence is no longer a good approximation and skill scores suggest persistence is out-performed by numerical models for almost all solar wind parameters. But point-by-point assessment techniques are not always a reliable indicator of usefulness as a forecast tool. An event-based assessment method, which focusses key solar wind structures, finds persistence to be the most valuable forecast throughout the solar cycle. This reiterates the fact that the means of assessing the “best” forecast model must be specifically tailored to its intended use.

A self-similar expansion model for use in solar wind transient propogation studies

Since the advent of wide-angle imaging of the inner heliosphere, a plethora of techniques have been developed to investigate the three-dimensional structure and kinematics of solar wind transients, such as coronal mass ejections, from their signatures in single- and multi-spacecraft imaging observations. These techniques, which range from the highly complex and computationally intensive to methods based on simple curve fitting, all have their inherent advantages and limitations. In the analysis of single-spacecraft imaging observations, much use has been made of the fixed φ fitting (FPF) and harmonic mean fitting (HMF) techniques, in which the solar wind transient is considered to be a radially propagating point source (fixed φ, FP, model) and a radially expanding circle anchored at Sun centre (harmonic mean, HM, model), respectively. Initially, we compare the radial speeds and propagation directions derived from application of the FPF and HMF techniques to a large set of STEREO/Heliospheric Imager (HI) observations. As the geometries on which these two techniques are founded constitute extreme descriptions of solar wind transients in terms of their extent along the line of sight, we describe a single-spacecraft fitting technique based on a more generalized model for which the FP and HM geometries form the limiting cases. In addition to providing estimates of a transient’s speed and propagation direction, the self-similar expansion fitting (SSEF) technique provides, in theory, the capability to estimate the transient’s angular extent in the plane orthogonal to the field of view. Using the HI observations, and also by performing a Monte Carlo simulation, we assess the potential of the SSEF technique.

Implications of the recent low solar minimum for the solar wind during the Maunder minimum

The behavior of the Sun and near-Earth space during grand solar minima is not understood; however, the recent long and low minimum of the decadal-scale solar cycle gives some important clues, with implications for understanding the solar dynamo and predicting space weather conditions. The speed of the near-Earth solar wind and the strength of the interplanetary magnetic field (IMF) embedded within it can be reliably reconstructed for before the advent of spacecraft monitoring using observations of geomagnetic activity that extend back to the mid-19th century. We show that during the solar cycle minima around 1879 and 1901 the average solar wind speed was exceptionally low, implying the Earth remained within the streamer belt of slow solar wind flow for extended periods. This is consistent with a broader streamer belt, which was also a feature of the recent low minimum (2009), and yields a prediction that the low near-Earth IMF during the Maunder minimum (1640-1700), as derived from models and deduced from cosmogenic isotopes, was accompanied by a persistent and relatively constant solar wind of speed roughly half the average for the modern era.

Solar cycle evolution of dipolar and pseudostreamer belts and their relation to the slow solar wind

Dipolar streamers are coronal structures formed by open solar flux converging from coronal holes of opposite polarity. Thus the dipolar streamer belt traces the coronal foot print of the heliospheric current sheet (HCS), and it is strongly associated with the origin of slow solar wind. Pseudostreamers, on the other hand, separate converging regions of open solar flux from coronal holes of the same polarity and do not contain current sheets. They have recently received a great deal of interest as a possible additional source of slow solar wind. Here we add to that growing body of work by using the potential-field source-surface model to determine the occurrence and location of dipolar and pseudostreamers over the last three solar cycles. In addition to providing new information about pseudostreamer morphology, the results help explain why the observations taken during the first Ulysses perihelion pass in 1995 showed noncoincidence between dipolar streamer belt and the locus of slowest flow. We find that Carrington rotation averages of the heliographic latitudes of dipolar and pseudostreamer belts are systematically shifted away from the equator, alternately in opposite directions, with a weak solar cycle periodicity, thus keeping slow wind from the web of combined streamer belts approximately symmetric about the equator. The largest separation of dipolar and pseudostreamer belts occurred close to the Ulysses pass, allowing a unique opportunity to see that slow wind from pseudostreamer belts north of the southward-displaced dipolar belt was responsible for the noncoincident pattern.

Automated identification and tracking of polar-cap plasma patches at solar minimum

A method of automatically identifying and tracking polar-cap plasma patches, utilising data inversion and feature-tracking methods, is presented. A well-established and widely used 4-D ionospheric imaging algorithm, the Multi-Instrument Data Assimilation System (MIDAS), inverts slant total electron content (TEC) data from ground-based Global Navigation Satellite System (GNSS) receivers to produce images of the free electron distribution in the polar-cap ionosphere. These are integrated to form vertical TEC maps. A flexible feature-tracking algorithm, TRACK, previously used extensively in meteorological storm-tracking studies is used to identify and track maxima in the resulting 2-D data fields. Various criteria are used to discriminate between genuine patches and "false-positive" maxima such as the continuously moving day-side maximum, which results from the Earth's rotation rather than plasma motion. Results for a 12-month period at solar minimum, when extensive validation data are available, are presented. The method identifies 71 separate structures consistent with patch motion during this time. The limitations of solar minimum and the consequent small number of patches make climatological inferences difficult, but the feasibility of the method for patches larger than approximately 500 km in scale is demonstrated and a larger study incorporating other parts of the solar cycle is warranted. Possible further optimisation of discrimination criteria, particularly regarding the definition of a patch in terms of its plasma concentration enhancement over the surrounding background, may improve results.

Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 4: Near-Earth solar wind speed, IMF, and open solar flux

In the concluding paper of this tetralogy, we here use the different geomagnetic activity indices to reconstruct the near-Earth interplanetary magnetic field (IMF) and solar wind flow speed, as well as the open solar flux (OSF) from 1845 to the present day. The differences in how the various indices vary with near-Earth interplanetary parameters, which are here exploited to separate the effects of the IMF and solar wind speed, are shown to be statistically significant at the 93% level or above. Reconstructions are made using four combinations of different indices, compiled using different data and different algorithms, and the results are almost identical for all parameters. The correction to the aa index required is discussed by comparison with the Ap index from a more extensive network of mid-latitude stations. Data from the Helsinki magnetometer station is used to extend the aa index back to 1845 and the results confirmed by comparison with the nearby St Petersburg observatory. The optimum variations, using all available long-term geomagnetic indices, of the near-Earth IMF and solar wind speed, and of the open solar flux, are presented; all with ±2sigma� uncertainties computed using the Monte Carlo technique outlined in the earlier papers. The open solar flux variation derived is shown to be very similar indeed to that obtained using the method of Lockwood et al. (1999).

Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 3: improved representation of solar cycle 11

Svalgaard (2014) has recently pointed out that the calibration of the Helsinki magnetic observatory’s H component variometer was probably in error in published data for the years 1866–1874.5 and that this makes the interdiurnal variation index based on daily means, IDV(1d), (Lockwood et al., 2013a), and the interplanetary magnetic field strength derived from it (Lockwood et al., 2013b), too low around the peak of solar cycle 11. We use data from the modern Nurmijarvi station, relatively close to the site of the original Helsinki Observatory, to confirm a 30% underestimation in this interval and hence our results are fully consistent with the correction derived by Svalgaard. We show that the best method for recalibration uses the Helsinki Ak(H) and aa indices and is accurate to ±10 %. This makes it preferable to recalibration using either the sunspot number or the diurnal range of geomagnetic activity which we find to be accurate to ±20 %. In the case of Helsinki data during cycle 11, the two recalibration methods produce very similar corrections which are here confirmed using newly digitised data from the nearby St Petersburg observatory and also using declination data from Helsinki. However, we show that the IDV index is, compared to later years, too similar to sunspot number before 1872, revealing independence of the two data series has been lost; either because the geomagnetic data used to compile IDV has been corrected using sunspot numbers, or vice versa, or both. We present corrected data sequences for both the IDV(1d) index and the reconstructed IMF (interplanetary magnetic field).We also analyse the relationship between the derived near-Earth IMF and the sunspot number and point out the relevance of the prior history of solar activity, in addition to the contemporaneous value, to estimating any “floor” value of the near-Earth interplanetary field.

Evidence for solar wind modulation of lightning

The response of lightning rates over Europe to arrival of high speed solar wind streams at Earth is investigated using a superposed epoch analysis. Fast solar wind stream arrival is determined from modulation of the solar wind V y component, measured by the Advanced Composition Explorer spacecraft. Lightning rate changes around these event times are determined from the very low frequency arrival time difference (ATD) system of the UK Met Office. Arrival of high speed streams at Earth is found to be preceded by a decrease in total solar irradiance and an increase in sunspot number and Mg II emissions. These are consistent with the high speed stream's source being co-located with an active region appearing on the Eastern solar limb and rotating at the 27 d period of the Sun. Arrival of the high speed stream at Earth also coincides with a small (~1%) but rapid decrease in galactic cosmic ray flux, a moderate (~6%) increase in lower energy solar energetic protons (SEPs), and a substantial, statistically significant increase in lightning rates. These changes persist for around 40 d in all three quantities. The lightning rate increase is corroborated by an increase in the total number of thunder days observed by UK Met stations, again persisting for around 40 d after the arrival of a high speed solar wind stream. This result appears to contradict earlier studies that found an anti-correlation between sunspot number and thunder days over solar cycle timescales. The increase in lightning rates and thunder days that we observe coincides with an increased flux of SEPs which, while not being detected at ground level, nevertheless penetrate the atmosphere to tropospheric altitudes. This effect could be further amplified by an increase in mean lightning stroke intensity that brings more strokes above the detection threshold of the ATD system. In order to remove any potential seasonal bias the analysis was repeated for daily solar wind triggers occurring during the summer months (June to August). Though this reduced the number of solar wind triggers to 32, the response in both lightning and thunder day data remained statistically significant. This modulation of lightning by regular and predictable solar wind events may be beneficial to medium range forecasting of hazardous weather.

Detection of lower tropospheric responses to solar energetic particles at midlatitudes

Solar energetic particles (SEPs) occasionally contribute additional atmospheric ionization beyond that arising from the usual galactic cosmic ray background. During an SEP event associated with a solar flare on April 11, 2013, the vertical ionization rate profile obtained using a balloon-borne detector showed enhanced ionization with a 26% increase at 20 km, over Reading, United Kingdom. Fluctuations in atmospheric electrical parameters were also detected at the surface, beneath the balloon’s trajectory. As no coincident changes in geomagnetism occurred, the electrical fluctuations are very likely to be associated with increased ionization, as observed by the balloon measurements. The lack of response of surface neutron monitors during this event indicates that energetic particles that are not detected at the surface by neutron monitors can nevertheless enter and influence the atmosphere’s weather-generating regions.

Centennial variations in sunspot number, open solar flux and streamer belt width: 1. correction of the sunspot number record since 1874

We analyse the widely-used international/ Zürich sunspot number record, R, with a view to quantifying a suspected calibration discontinuity around 1945 (which has been termed the “Waldmeier discontinuity” [Svalgaard, 2011]). We compare R against the composite sunspot group data from the Royal Greenwich Observatory (RGO) network and the Solar Optical Observing Network (SOON), using both the number of sunspot groups, N{sub}G{\sub}, and the total area of the sunspots, A{sub}G{\sub}. In addition, we compare R with the recently developed interdiurnal variability geomagnetic indices IDV and IDV(1d). In all four cases, linearity of the relationship with R is not assumed and care is taken to ensure that the relationship of each with R is the same before and after the putative calibration change. It is shown the probability that a correction is not needed is of order 10{sup}−8{\sup} and that R is indeed too low before 1945. The optimum correction to R for values before 1945 is found to be 11.6%, 11.7%, 10.3% and 7.9% using A{sub}G{\sub}, N{sub)G{\sub}, IDV, and IDV(1d), respectively. The optimum value obtained by combining the sunspot group data is 11.6% with an uncertainty range 8.1-14.8% at the 2σ level. The geomagnetic indices provide an independent yet less stringent test but do give values that fall within the 2σ uncertainty band with optimum values are slightly lower than from the sunspot group data. The probability of the correction needed being as large as 20%, as advocated by Svalgaard [2011], is shown to be 1.6 × 10{sup}−5{\sup}.

Centennial variations in sunspot number, open solar flux and streamer belt width: 2. Comparison with the geomagnetic data

We investigate the relationship between interdiurnal variation geomagnetic activity indices, IDV and IDV(1d), corrected sunspot number, R{sub}C{\sub}, and the group sunspot number R{sub}G{\sub}. R{sub}C{\sub} uses corrections for both the “Waldmeier discontinuity”, as derived in Paper 1 [Lockwood et al., 2014c], and the “Wolf discontinuity” revealed by Leussu et al. [2013]. We show that the simple correlation of the geomagnetic indices with R{sub}C{\sub}{sup}n{\sup} or R{sub}G{\sub}{sup}n{\sup} masks a considerable solar cycle variation. Using IDV(1d) or IDV to predict or evaluate the sunspot numbers, the errors are almost halved by allowing for the fact that the relationship varies over the solar cycle. The results indicate that differences between R{sub}C{\sub} and R{sub}G{\sub} have a variety of causes and are highly unlikely to be attributable to errors in either R{sub}G{\sub} alone, as has recently been assumed. Because it is not known if R{sub}C{\sub} or R{sub}G{\sub} is a better predictor of open flux emergence before 1874, a simple sunspot number composite is suggested which, like R{sub}G{\sub}, enables modelling of the open solar flux for 1610 onwards in Paper 3, but maintains the characteristics of R{sub}C{\sub}.

Centennial variations in sunspot number, open solar flux and streamer belt width: 3. Modelling

From the variation of near-Earth interplanetary conditions, reconstructed for the mid-19th century to the present day using historic geomagnetic activity observations, Lockwood and Owens [2014] have suggested that Earth remains within a broadened streamer belt during solar cycles when the Open Solar Flux (OSF) is low. From this they propose that the Earth was immersed in almost constant slow solar wind during the Maunder minimum (c. 1650-1710). In this paper, we extend continuity modelling of the OSF to predict the streamer belt width using both group sunspot numbers and corrected international sunspot numbers to quantify the emergence rate of new OSF. The results support the idea that the solar wind at Earth was persistently slow during the Maunder minimum because the streamer belt was broad.

The effect of chosen extraterrestrial solar spectrum on clear-sky atmospheric absorption and heating rates in the near infrared

The extraterrestrial solar spectrum (ESS) is an important component in near infrared (near-IR) radiative transfer calculations. However, the impact of a particular choice of the ESS in these regions has been given very little attention. A line-by-line (LBL) transfer model has been used to calculate the absorbed solar irradiance and solar heating rates in the near-IR from 2000-10000 cm−1(1-5 μm) using different ESS. For overhead sun conditions in a mid-latitude summer atmosphere, the absorbed irradiances could differ by up to about 11 Wm−2 (8.2%) while the tropospheric and stratospheric heating rates could differ by up to about 0.13 K day−1 (8.1%) and 0.19 K day−1 (7.6%). The spectral shape of the ESS also has a small but non-negligible impact on these factors in the near-IR.

The interdependence of continental warm cloud properties derived from unexploited solar background signals in ground-based lidar measurements

We have extensively analysed the interdependence between cloud optical depth, droplet effective radius, liquid water path (LWP) and geometric thickness for stratiform warm clouds using ground-based observations. In particular, this analysis uses cloud optical depths retrieved from untapped solar background signals that are previously unwanted and need to be removed in most lidar applications. Combining these new optical depth retrievals with radar and microwave observations at the Atmospheric Radiation Measurement (ARM) Climate Research Facility in Oklahoma during 2005–2007, we have found that LWP and geometric thickness increase and follow a power-law relationship with cloud optical depth regardless of the presence of drizzle; LWP and geometric thickness in drizzling clouds can be generally 20–40 % and at least 10 % higher than those in non-drizzling clouds, respectively. In contrast, droplet effective radius shows a negative correlation with optical depth in drizzling clouds and a positive correlation in non-drizzling clouds, where, for large optical depths, it asymptotes to 10 μm. This asymptotic behaviour in non-drizzling clouds is found in both the droplet effective radius and optical depth, making it possible to use simple thresholds of optical depth, droplet size, or a combination of these two variables for drizzle delineation. This paper demonstrates a new way to enhance ground-based cloud observations and drizzle delineations using existing lidar networks.

Influence of short-term solar disturbances on the fair weather conduction current

The fair weather atmospheric electrical current (Jz) couples the ionosphere to the lower atmosphere and thus provides a route by which changes in solar activity can modify processes in the lower troposphere. This paper examines the temporal variations and spectral characteristics of continuous measurements of Jz conducted at the Wise Observatory in Mitzpe-Ramon, Israel (30°35′ N, 34°45′ E), during two large CMEs, and during periods of increased solar wind density. Evidence is presented for the effects of geomagnetic storms and sub-storms on low latitude Jz during two coronal mass ejections (CMEs), on 24–25th October 2011 and 7–8th March 2012, when the variability in Jz increased by an order of magnitude compared to normal fair weather conditions. The dynamic spectrum of the increased Jz fluctuations exhibit peaks in the Pc5 frequency range. Similar low frequency characteristics occur during periods of enhanced solar wind proton density. During the October 2011 event, the periods of increased fluctuations in Jz lasted for 7 h and coincided with fluctuations of the inter-planetary magnetic field (IMF) detected by the ACE satellite. We suggest downward mapping of ionospheric electric fields as a possible mechanism for the increased fluctuations.