A high-resolution near-infrared extraterrestrial solar spectrum derived from ground-based Fourier transform spectrometer measurements

A detailed spectrally-resolved extraterrestrial solar spectrum (ESS) is important for line-by-line radiative transfer modeling in the near-infrared (near-IR). Very few observationally-based high-resolution ESS are available in this spectral region. Consequently the theoretically-calculated ESS by Kurucz has been widely adopted. We present the CAVIAR (Continuum Absorption at Visible and Infrared Wavelengths and its Atmospheric Relevance) ESS which is derived using the Langley technique applied to calibrated observations using a ground-based high-resolution Fourier transform spectrometer (FTS) in atmospheric windows from 2000–10000 cm-1 (1–5 μm). There is good agreement between the strengths and positions of solar lines between the CAVIAR and the satellite-based ACE-FTS (Atmospheric Chemistry Experiment-FTS) ESS, in the spectral region where they overlap, and good agreement with other ground-based FTS measurements in two near-IR windows. However there are significant differences in the structure between the CAVIAR ESS and spectra from semi-empirical models. In addition, we found a difference of up to 8 % in the absolute (and hence the wavelength-integrated) irradiance between the CAVIAR ESS and that of Thuillier et al., which was based on measurements from the Atmospheric Laboratory for Applications and Science satellite and other sources. In many spectral regions, this difference is significant, as the coverage factor k = 2 (or 95 % confidence limit) uncertainties in the two sets of observations do not overlap. Since the total solar irradiance is relatively well constrained, if the CAVIAR ESS is correct, then this would indicate an integrated “loss” of solar irradiance of about 30 W m-2 in the near-IR that would have to be compensated by an increase at other wavelengths.

Solar origin of heliospheric magnetic field inversions: evidence for coronal loop opening within pseudostreamers

The orientation of the heliospheric magnetic field (HMF) in near‒Earth space is generally a good indicator of the polarity of HMF foot points at the photosphere. There are times, however, when the HMF folds back on itself (is inverted), as indicated by suprathermal electrons locally moving sunward, even though they must ultimately be carrying the heat flux away from the Sun. Analysis of the near‒Earth solar wind during the period 1998–2011 reveals that inverted HMF is present approximately 5.5% of the time and is generally associated with slow, dense solar wind and relatively weak HMF intensity. Inverted HMF is mapped to the coronal source surface, where a new method is used to estimate coronal structure from the potential‒field source‒surface model. We find a strong association with bipolar streamers containing the heliospheric current sheet, as expected, but also with unipolar or pseudostreamers, which contain no current sheet. Because large‒scale inverted HMF is a widely accepted signature of interchange reconnection at the Sun, this finding provides strong evidence for models of the slow solar wind which involve coronal loop opening by reconnection within pseudostreamer belts as well as the bipolar streamer belt. Occurrence rates of bipolar‒ and pseudostreamers suggest that they are equally likely to result in inverted HMF and, therefore, presumably undergo interchange reconnection at approximately the same rate. Given the different magnetic topologies involved, this suggests the rate of reconnection is set externally, possibly by the differential rotation rate which governs the circulation of open solar flux.

Reconstruction and prediction of variations in the open solar magnetic flux and interplanetary conditions

Historic geomagnetic activity observations have been used to reveal centennial variations in the open solar flux and the near-Earth heliospheric conditions (the interplanetary magnetic field and the solar wind speed). The various methods are in very good agreement for the past 135 years when there were sufficient reliable magnetic observatories in operation to eliminate problems due to site-specific errors and calibration drifts. This review underlines the physical principles that allow these reconstructions to be made, as well as the details of the various algorithms employed and the results obtained. Discussion is included of: the importance of the averaging timescale; the key differences between “range” and “interdiurnal variability” geomagnetic data; the need to distinguish source field sector structure from heliospherically-imposed field structure; the importance of ensuring that regressions used are statistically robust; and uncertainty analysis. The reconstructions are exceedingly useful as they provide calibration between the in-situ spacecraft measurements from the past five decades and the millennial records of heliospheric behaviour deduced from measured abundances of cosmogenic radionuclides found in terrestrial reservoirs. Continuity of open solar flux, using sunspot number to quantify the emergence rate, is the basis of a number of models that have been very successful in reproducing the variation derived from geomagnetic activity. These models allow us to extend the reconstructions back to before the development of the magnetometer and to cover the Maunder minimum. Allied to the radionuclide data, the models are revealing much about how the Sun and heliosphere behaved outside of grand solar maxima and are providing a means of predicting how solar activity is likely to evolve now that the recent grand maximum (that had prevailed throughout the space age) has come to an end.

A 27 day persistence model of near-Earth solar wind conditions: a long lead-time forecast and a benchmark for dynamical models

Geomagnetic activity has long been known to exhibit approximately 27 day periodicity, resulting from solar wind structures repeating each solar rotation. Thus a very simple near-Earth solar wind forecast is 27 day persistence, wherein the near-Earth solar wind conditions today are assumed to be identical to those 27 days previously. Effective use of such a persistence model as a forecast tool, however, requires the performance and uncertainty to be fully characterized. The first half of this study determines which solar wind parameters can be reliably forecast by persistence and how the forecast skill varies with the solar cycle. The second half of the study shows how persistence can provide a useful benchmark for more sophisticated forecast schemes, namely physics-based numerical models. Point-by-point assessment methods, such as correlation and mean-square error, find persistence skill comparable to numerical models during solar minimum, despite the 27 day lead time of persistence forecasts, versus 2–5 days for numerical schemes. At solar maximum, however, the dynamic nature of the corona means 27 day persistence is no longer a good approximation and skill scores suggest persistence is out-performed by numerical models for almost all solar wind parameters. But point-by-point assessment techniques are not always a reliable indicator of usefulness as a forecast tool. An event-based assessment method, which focusses key solar wind structures, finds persistence to be the most valuable forecast throughout the solar cycle. This reiterates the fact that the means of assessing the “best” forecast model must be specifically tailored to its intended use.

A self-similar expansion model for use in solar wind transient propogation studies

Since the advent of wide-angle imaging of the inner heliosphere, a plethora of techniques have been developed to investigate the three-dimensional structure and kinematics of solar wind transients, such as coronal mass ejections, from their signatures in single- and multi-spacecraft imaging observations. These techniques, which range from the highly complex and computationally intensive to methods based on simple curve fitting, all have their inherent advantages and limitations. In the analysis of single-spacecraft imaging observations, much use has been made of the fixed φ fitting (FPF) and harmonic mean fitting (HMF) techniques, in which the solar wind transient is considered to be a radially propagating point source (fixed φ, FP, model) and a radially expanding circle anchored at Sun centre (harmonic mean, HM, model), respectively. Initially, we compare the radial speeds and propagation directions derived from application of the FPF and HMF techniques to a large set of STEREO/Heliospheric Imager (HI) observations. As the geometries on which these two techniques are founded constitute extreme descriptions of solar wind transients in terms of their extent along the line of sight, we describe a single-spacecraft fitting technique based on a more generalized model for which the FP and HM geometries form the limiting cases. In addition to providing estimates of a transient’s speed and propagation direction, the self-similar expansion fitting (SSEF) technique provides, in theory, the capability to estimate the transient’s angular extent in the plane orthogonal to the field of view. Using the HI observations, and also by performing a Monte Carlo simulation, we assess the potential of the SSEF technique.

Implications of the recent low solar minimum for the solar wind during the Maunder minimum

The behavior of the Sun and near-Earth space during grand solar minima is not understood; however, the recent long and low minimum of the decadal-scale solar cycle gives some important clues, with implications for understanding the solar dynamo and predicting space weather conditions. The speed of the near-Earth solar wind and the strength of the interplanetary magnetic field (IMF) embedded within it can be reliably reconstructed for before the advent of spacecraft monitoring using observations of geomagnetic activity that extend back to the mid-19th century. We show that during the solar cycle minima around 1879 and 1901 the average solar wind speed was exceptionally low, implying the Earth remained within the streamer belt of slow solar wind flow for extended periods. This is consistent with a broader streamer belt, which was also a feature of the recent low minimum (2009), and yields a prediction that the low near-Earth IMF during the Maunder minimum (1640-1700), as derived from models and deduced from cosmogenic isotopes, was accompanied by a persistent and relatively constant solar wind of speed roughly half the average for the modern era.

Solar cycle evolution of dipolar and pseudostreamer belts and their relation to the slow solar wind

Dipolar streamers are coronal structures formed by open solar flux converging from coronal holes of opposite polarity. Thus the dipolar streamer belt traces the coronal foot print of the heliospheric current sheet (HCS), and it is strongly associated with the origin of slow solar wind. Pseudostreamers, on the other hand, separate converging regions of open solar flux from coronal holes of the same polarity and do not contain current sheets. They have recently received a great deal of interest as a possible additional source of slow solar wind. Here we add to that growing body of work by using the potential-field source-surface model to determine the occurrence and location of dipolar and pseudostreamers over the last three solar cycles. In addition to providing new information about pseudostreamer morphology, the results help explain why the observations taken during the first Ulysses perihelion pass in 1995 showed noncoincidence between dipolar streamer belt and the locus of slowest flow. We find that Carrington rotation averages of the heliographic latitudes of dipolar and pseudostreamer belts are systematically shifted away from the equator, alternately in opposite directions, with a weak solar cycle periodicity, thus keeping slow wind from the web of combined streamer belts approximately symmetric about the equator. The largest separation of dipolar and pseudostreamer belts occurred close to the Ulysses pass, allowing a unique opportunity to see that slow wind from pseudostreamer belts north of the southward-displaced dipolar belt was responsible for the noncoincident pattern.

Automated identification and tracking of polar-cap plasma patches at solar minimum

A method of automatically identifying and tracking polar-cap plasma patches, utilising data inversion and feature-tracking methods, is presented. A well-established and widely used 4-D ionospheric imaging algorithm, the Multi-Instrument Data Assimilation System (MIDAS), inverts slant total electron content (TEC) data from ground-based Global Navigation Satellite System (GNSS) receivers to produce images of the free electron distribution in the polar-cap ionosphere. These are integrated to form vertical TEC maps. A flexible feature-tracking algorithm, TRACK, previously used extensively in meteorological storm-tracking studies is used to identify and track maxima in the resulting 2-D data fields. Various criteria are used to discriminate between genuine patches and "false-positive" maxima such as the continuously moving day-side maximum, which results from the Earth's rotation rather than plasma motion. Results for a 12-month period at solar minimum, when extensive validation data are available, are presented. The method identifies 71 separate structures consistent with patch motion during this time. The limitations of solar minimum and the consequent small number of patches make climatological inferences difficult, but the feasibility of the method for patches larger than approximately 500 km in scale is demonstrated and a larger study incorporating other parts of the solar cycle is warranted. Possible further optimisation of discrimination criteria, particularly regarding the definition of a patch in terms of its plasma concentration enhancement over the surrounding background, may improve results.

Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 4: Near-Earth solar wind speed, IMF, and open solar flux

In the concluding paper of this tetralogy, we here use the different geomagnetic activity indices to reconstruct the near-Earth interplanetary magnetic field (IMF) and solar wind flow speed, as well as the open solar flux (OSF) from 1845 to the present day. The differences in how the various indices vary with near-Earth interplanetary parameters, which are here exploited to separate the effects of the IMF and solar wind speed, are shown to be statistically significant at the 93% level or above. Reconstructions are made using four combinations of different indices, compiled using different data and different algorithms, and the results are almost identical for all parameters. The correction to the aa index required is discussed by comparison with the Ap index from a more extensive network of mid-latitude stations. Data from the Helsinki magnetometer station is used to extend the aa index back to 1845 and the results confirmed by comparison with the nearby St Petersburg observatory. The optimum variations, using all available long-term geomagnetic indices, of the near-Earth IMF and solar wind speed, and of the open solar flux, are presented; all with ±2sigma� uncertainties computed using the Monte Carlo technique outlined in the earlier papers. The open solar flux variation derived is shown to be very similar indeed to that obtained using the method of Lockwood et al. (1999).

Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 3: improved representation of solar cycle 11

Svalgaard (2014) has recently pointed out that the calibration of the Helsinki magnetic observatory’s H component variometer was probably in error in published data for the years 1866–1874.5 and that this makes the interdiurnal variation index based on daily means, IDV(1d), (Lockwood et al., 2013a), and the interplanetary magnetic field strength derived from it (Lockwood et al., 2013b), too low around the peak of solar cycle 11. We use data from the modern Nurmijarvi station, relatively close to the site of the original Helsinki Observatory, to confirm a 30% underestimation in this interval and hence our results are fully consistent with the correction derived by Svalgaard. We show that the best method for recalibration uses the Helsinki Ak(H) and aa indices and is accurate to ±10 %. This makes it preferable to recalibration using either the sunspot number or the diurnal range of geomagnetic activity which we find to be accurate to ±20 %. In the case of Helsinki data during cycle 11, the two recalibration methods produce very similar corrections which are here confirmed using newly digitised data from the nearby St Petersburg observatory and also using declination data from Helsinki. However, we show that the IDV index is, compared to later years, too similar to sunspot number before 1872, revealing independence of the two data series has been lost; either because the geomagnetic data used to compile IDV has been corrected using sunspot numbers, or vice versa, or both. We present corrected data sequences for both the IDV(1d) index and the reconstructed IMF (interplanetary magnetic field).We also analyse the relationship between the derived near-Earth IMF and the sunspot number and point out the relevance of the prior history of solar activity, in addition to the contemporaneous value, to estimating any “floor” value of the near-Earth interplanetary field.

Evidence for solar wind modulation of lightning

The response of lightning rates over Europe to arrival of high speed solar wind streams at Earth is investigated using a superposed epoch analysis. Fast solar wind stream arrival is determined from modulation of the solar wind V y component, measured by the Advanced Composition Explorer spacecraft. Lightning rate changes around these event times are determined from the very low frequency arrival time difference (ATD) system of the UK Met Office. Arrival of high speed streams at Earth is found to be preceded by a decrease in total solar irradiance and an increase in sunspot number and Mg II emissions. These are consistent with the high speed stream's source being co-located with an active region appearing on the Eastern solar limb and rotating at the 27 d period of the Sun. Arrival of the high speed stream at Earth also coincides with a small (~1%) but rapid decrease in galactic cosmic ray flux, a moderate (~6%) increase in lower energy solar energetic protons (SEPs), and a substantial, statistically significant increase in lightning rates. These changes persist for around 40 d in all three quantities. The lightning rate increase is corroborated by an increase in the total number of thunder days observed by UK Met stations, again persisting for around 40 d after the arrival of a high speed solar wind stream. This result appears to contradict earlier studies that found an anti-correlation between sunspot number and thunder days over solar cycle timescales. The increase in lightning rates and thunder days that we observe coincides with an increased flux of SEPs which, while not being detected at ground level, nevertheless penetrate the atmosphere to tropospheric altitudes. This effect could be further amplified by an increase in mean lightning stroke intensity that brings more strokes above the detection threshold of the ATD system. In order to remove any potential seasonal bias the analysis was repeated for daily solar wind triggers occurring during the summer months (June to August). Though this reduced the number of solar wind triggers to 32, the response in both lightning and thunder day data remained statistically significant. This modulation of lightning by regular and predictable solar wind events may be beneficial to medium range forecasting of hazardous weather.

Detection of lower tropospheric responses to solar energetic particles at midlatitudes

Solar energetic particles (SEPs) occasionally contribute additional atmospheric ionization beyond that arising from the usual galactic cosmic ray background. During an SEP event associated with a solar flare on April 11, 2013, the vertical ionization rate profile obtained using a balloon-borne detector showed enhanced ionization with a 26% increase at 20 km, over Reading, United Kingdom. Fluctuations in atmospheric electrical parameters were also detected at the surface, beneath the balloon’s trajectory. As no coincident changes in geomagnetism occurred, the electrical fluctuations are very likely to be associated with increased ionization, as observed by the balloon measurements. The lack of response of surface neutron monitors during this event indicates that energetic particles that are not detected at the surface by neutron monitors can nevertheless enter and influence the atmosphere’s weather-generating regions.

Centennial variations in sunspot number, open solar flux and streamer belt width: 1. correction of the sunspot number record since 1874

We analyse the widely-used international/ Zürich sunspot number record, R, with a view to quantifying a suspected calibration discontinuity around 1945 (which has been termed the “Waldmeier discontinuity” [Svalgaard, 2011]). We compare R against the composite sunspot group data from the Royal Greenwich Observatory (RGO) network and the Solar Optical Observing Network (SOON), using both the number of sunspot groups, N{sub}G{\sub}, and the total area of the sunspots, A{sub}G{\sub}. In addition, we compare R with the recently developed interdiurnal variability geomagnetic indices IDV and IDV(1d). In all four cases, linearity of the relationship with R is not assumed and care is taken to ensure that the relationship of each with R is the same before and after the putative calibration change. It is shown the probability that a correction is not needed is of order 10{sup}−8{\sup} and that R is indeed too low before 1945. The optimum correction to R for values before 1945 is found to be 11.6%, 11.7%, 10.3% and 7.9% using A{sub}G{\sub}, N{sub)G{\sub}, IDV, and IDV(1d), respectively. The optimum value obtained by combining the sunspot group data is 11.6% with an uncertainty range 8.1-14.8% at the 2σ level. The geomagnetic indices provide an independent yet less stringent test but do give values that fall within the 2σ uncertainty band with optimum values are slightly lower than from the sunspot group data. The probability of the correction needed being as large as 20%, as advocated by Svalgaard [2011], is shown to be 1.6 × 10{sup}−5{\sup}.

Centennial variations in sunspot number, open solar flux and streamer belt width: 2. Comparison with the geomagnetic data

We investigate the relationship between interdiurnal variation geomagnetic activity indices, IDV and IDV(1d), corrected sunspot number, R{sub}C{\sub}, and the group sunspot number R{sub}G{\sub}. R{sub}C{\sub} uses corrections for both the “Waldmeier discontinuity”, as derived in Paper 1 [Lockwood et al., 2014c], and the “Wolf discontinuity” revealed by Leussu et al. [2013]. We show that the simple correlation of the geomagnetic indices with R{sub}C{\sub}{sup}n{\sup} or R{sub}G{\sub}{sup}n{\sup} masks a considerable solar cycle variation. Using IDV(1d) or IDV to predict or evaluate the sunspot numbers, the errors are almost halved by allowing for the fact that the relationship varies over the solar cycle. The results indicate that differences between R{sub}C{\sub} and R{sub}G{\sub} have a variety of causes and are highly unlikely to be attributable to errors in either R{sub}G{\sub} alone, as has recently been assumed. Because it is not known if R{sub}C{\sub} or R{sub}G{\sub} is a better predictor of open flux emergence before 1874, a simple sunspot number composite is suggested which, like R{sub}G{\sub}, enables modelling of the open solar flux for 1610 onwards in Paper 3, but maintains the characteristics of R{sub}C{\sub}.

Centennial variations in sunspot number, open solar flux and streamer belt width: 3. Modelling

From the variation of near-Earth interplanetary conditions, reconstructed for the mid-19th century to the present day using historic geomagnetic activity observations, Lockwood and Owens [2014] have suggested that Earth remains within a broadened streamer belt during solar cycles when the Open Solar Flux (OSF) is low. From this they propose that the Earth was immersed in almost constant slow solar wind during the Maunder minimum (c. 1650-1710). In this paper, we extend continuity modelling of the OSF to predict the streamer belt width using both group sunspot numbers and corrected international sunspot numbers to quantify the emergence rate of new OSF. The results support the idea that the solar wind at Earth was persistently slow during the Maunder minimum because the streamer belt was broad.