The potential of 1 h refractivity changes from an operational C-band magnetron-based radar for numerical weather prediction validation and data assimilation

Refractivity changes (ΔN) derived from radar ground clutter returns serve as a proxy for near-surface humidity changes (1 N unit ≡ 1% relative humidity at 20 °C). Previous studies have indicated that better humidity observations should improve forecasts of convection initiation. A preliminary assessment of the potential of refractivity retrievals from an operational magnetron-based C-band radar is presented. The increased phase noise at shorter wavelengths, exacerbated by the unknown position of the target within the 300 m gate, make it difficult to obtain absolute refractivity values, so we consider the information in 1 h changes. These have been derived to a range of 30 km with a spatial resolution of ∼4 km; the consistency of the individual estimates (within each 4 km × 4 km area) indicates that ΔN errors are about 1 N unit, in agreement with in situ observations. Measurements from an instrumented tower on summer days show that the 1 h refractivity changes up to a height of 100 m remain well correlated with near-surface values. The analysis of refractivity as represented in the operational Met Office Unified Model at 1.5, 4 and 12 km grid lengths demonstrates that, as model resolution increases, the spatial scales of the refractivity structures improve. It is shown that the magnitude of refractivity changes is progressively underestimated at larger grid lengths during summer. However, the daily time series of 1 h refractivity changes reveal that, whereas the radar-derived values are very well correlated with the in situ observations, the high-resolution model runs have little skill in getting the right values of ΔN in the right place at the right time. This suggests that the assimilation of these radar refractivity observations could benefit forecasts of the initiation of convection.

The effect of phase-correlated returns and spatial smoothing on the accuracy of radar refractivity retrievals

Radar refractivity retrievals have the potential to accurately capture near-surface humidity fields from the phase change of ground clutter returns. In practice, phase changes are very noisy and the required smoothing will diminish large radial phase change gradients, leading to severe underestimates of large refractivity changes (ΔN). To mitigate this, the mean refractivity change over the field (ΔNfield) must be subtracted prior to smoothing. However, both observations and simulations indicate that highly correlated returns (e.g., when single targets straddle neighboring gates) result in underestimates of ΔNfield when pulse-pair processing is used. This may contribute to reported differences of up to 30 N units between surface observations and retrievals. This effect can be avoided if ΔNfield is estimated using a linear least squares fit to azimuthally averaged phase changes. Nevertheless, subsequent smoothing of the phase changes will still tend to diminish the all-important spatial perturbations in retrieved refractivity relative to ΔNfield; an iterative estimation approach may be required. The uncertainty in the target location within the range gate leads to additional phase noise proportional to ΔN, pulse length, and radar frequency. The use of short pulse lengths is recommended, not only to reduce this noise but to increase both the maximum detectable refractivity change and the number of suitable targets. Retrievals of refractivity fields must allow for large ΔN relative to an earlier reference field. This should be achievable for short pulses at S band, but phase noise due to target motion may prevent this at C band, while at X band even the retrieval of ΔN over shorter periods may at times be impossible.

Quantifying errors due to frequency changes and target location uncertainty for radar refractivity retrievals

Radar refractivity retrievals can capture near-surface humidity changes, but noisy phase changes of the ground clutter returns limit the accuracy for both klystron- and magnetron-based systems. Observations with a C-band (5.6 cm) magnetron weather radar indicate that the correction for phase changes introduced by local oscillator frequency changes leads to refractivity errors no larger than 0.25 N units: equivalent to a relative humidity change of only 0.25% at 20°C. Requested stable local oscillator (STALO) frequency changes were accurate to 0.002 ppm based on laboratory measurements. More serious are the random phase change errors introduced when targets are not at the range-gate center and there are changes in the transmitter frequency (ΔfTx) or the refractivity (ΔN). Observations at C band with a 2-μs pulse show an additional 66° of phase change noise for a ΔfTx of 190 kHz (34 ppm); this allows the effect due to ΔN to be predicted. Even at S band with klystron transmitters, significant phase change noise should occur when a large ΔN develops relative to the reference period [e.g., ~55° when ΔN = 60 for the Next Generation Weather Radar (NEXRAD) radars]. At shorter wavelengths (e.g., C and X band) and with magnetron transmitters in particular, refractivity retrievals relative to an earlier reference period are even more difficult, and operational retrievals may be restricted to changes over shorter (e.g., hourly) periods of time. Target location errors can be reduced by using a shorter pulse or identified by a new technique making alternate measurements at two closely spaced frequencies, which could even be achieved with a dual–pulse repetition frequency (PRF) operation of a magnetron transmitter.

Bollène-2002 experiment: radar quantitative precipitation estimation in the Cévennes–Vivarais region, France

The Bollène-2002 Experiment was aimed at developing the use of a radar volume-scanning strategy for conducting radar rainfall estimations in the mountainous regions of France. A developmental radar processing system, called Traitements Régionalisés et Adaptatifs de Données Radar pour l’Hydrologie (Regionalized and Adaptive Radar Data Processing for Hydrological Applications), has been built and several algorithms were specifically produced as part of this project. These algorithms include 1) a clutter identification technique based on the pulse-to-pulse variability of reflectivity Z for noncoherent radar, 2) a coupled procedure for determining a rain partition between convective and widespread rainfall R and the associated normalized vertical profiles of reflectivity, and 3) a method for calculating reflectivity at ground level from reflectivities measured aloft. Several radar processing strategies, including nonadaptive, time-adaptive, and space–time-adaptive variants, have been implemented to assess the performance of these new algorithms. Reference rainfall data were derived from a careful analysis of rain gauge datasets furnished by the Cévennes–Vivarais Mediterranean Hydrometeorological Observatory. The assessment criteria for five intense and long-lasting Mediterranean rain events have proven that good quantitative precipitation estimates can be obtained from radar data alone within 100-km range by using well-sited, well-maintained radar systems and sophisticated, physically based data-processing systems. The basic requirements entail performing accurate electronic calibration and stability verification, determining the radar detection domain, achieving efficient clutter elimination, and capturing the vertical structure(s) of reflectivity for the target event. Radar performance was shown to depend on type of rainfall, with better results obtained with deep convective rain systems (Nash coefficients of roughly 0.90 for point radar–rain gauge comparisons at the event time step), as opposed to shallow convective and frontal rain systems (Nash coefficients in the 0.6–0.8 range). In comparison with time-adaptive strategies, the space–time-adaptive strategy yields a very significant reduction in the radar–rain gauge bias while the level of scatter remains basically unchanged. Because the Z–R relationships have not been optimized in this study, results are attributed to an improved processing of spatial variations in the vertical profile of reflectivity. The two main recommendations for future work consist of adapting the rain separation method for radar network operations and documenting Z–R relationships conditional on rainfall type.

Phase calibration of the EISCAT Svalbard Radar interferometer using optical satellite signatures

The link between natural ion-line enhancements in radar spectra and auroral activity has been the subject of recent studies but conclusions have been limited by the spatial and temporal resolution previously available. The next challenge is to use shorter sub-second integration times in combination with interferometric programmes to resolve spatial structure within the main radar beam, and so relate enhanced filaments to individual auroral rays. This paper presents initial studies of a technique, using optical and spectral satellite signatures, to calibrate the received phase of a signal with the position of the scattering source along the interferometric baseline of the EISCAT Svalbard Radar. It is shown that a consistent relationship can be found only if the satellite passage through the phase fringes is adjusted from the passage predicted by optical tracking. This required adjustment is interpreted as being due to the vector between the theoretical focusing points of the two antennae, i.e. the true radar baseline, differing from the baseline obtained by survey between the antenna foot points. A method to obtain a measurement of the true interferometric baseline using multiple satellite passes is outlined.

Fractal geometry of aggregate snowflakes revealed by triple wavelength radar measurements

Radar reflectivity measurements from three different wavelengths are used to retrieve information about the shape of aggregate snowflakes in deep stratiform ice clouds. Dual-wavelength ratios are calculated for different shape models and compared to observations at 3, 35 and 94 GHz. It is demonstrated that many scattering models, including spherical and spheroidal models, do not adequately describe the aggregate snowflakes that are observed. The observations are consistent with fractal aggregate geometries generated by a physically-based aggregation model. It is demonstrated that the fractal dimension of large aggregates can be inferred directly from the radar data. Fractal dimensions close to 2 are retrieved, consistent with previous theoretical models and in-situ observations.

Nightside studies of coherent HF Radar spectral width behaviour

A previous case study found a relationship between high spectral width measured by the CUTLASS Finland HF radar and elevated electron temperatures observed by the EISCAT and ESR incoherent scatter radars in the postmidnight sector of magnetic local time. This paper expands that work by briefly re-examining that interval and looking in depth at two further case studies. In all three cases a region of high HF spectral width (>200 ms−1) exists poleward of a region of low HF spectral width (<200 ms^{−1}). Each case, however, occurs under quite different geomagnetic conditions. The original case study occurred during an interval with no observed electrojet activity, the second study during a transition from quiet to active conditions with a clear band of ion frictional heating indicating the location of the flow reversal boundary, and the third during an isolated substorm. These case studies indicate that the relationship between elevated electron temperature and high HF radar spectral width appears on closed field lines after 03:00 magnetic local time (MLT) on the nightside. It is not clear whether the same relationship would hold on open field lines, since our analysis of this relationship is restricted in latitude. We find two important properties of high spectral width data on the nightside. Firstly the high spectral width values occur on both open and closed field lines, and secondly that the power spectra which exhibit high widths are both single-peak and multiple-peak. In general the regions of high spectral width (>200 ms−1) have more multiple-peak spectra than the regions of low spectral widths whilst still maintaining a majority of single-peak spectra. We also find that the region of ion frictional heating is collocated with many multiplepeak HF spectra. Several mechanisms for the generation of high spectral width have been proposed which would produce multiple-peak spectra, these are discussed in relation to the data presented here. Since the regions of high spectral width are observed both on closed and open field lines the use of the boundary between low and high spectral width as an ionospheric proxy for the open/closed field line boundary is not a simple matter, if indeed it is possible at all.

Simultaneous optical and radar signatures of poleward-moving auroral forms

Dayside poleward moving auroral forms (PMAFs) were detected between 06:30 and 07:00 UT on December 16, 1998, by the meridian scanning photometer and the all-sky camera at Ny Alesund, Svalbard. Simultaneous SuperDARN HF radar measurements permitted the study of the associated ionospheric velocity pattern. A good general agreement is observed between the location and movement of velocity enhancements (flow channels) and the PMAFs. Clear signatures of equatorward flow were detected in the vicinity of PMAFs. This flow is believed to be the signature of a return flow outside the reconnected Aux tube, as predicted by the Southwood model. The simulated signatures of this model reproduce globally the measured signatures, and differences with the experimental data can be explained by the simplifications of the model. Proposed schemes of the flow modification due to the presence of several flow channels and the modification of cusp and region 1 field-aligned currents at the time of sporadic reconnection events are shown to fit well with the observations.

Plasma structure within poleward-moving cusp/cleft auroral transients: EISCAT Svalbard radar observations and an explanation in terms of large local time extent of events

We report high-resolution observations of the southward-IMF cusp/cleft ionosphere made on December 16th 1998 by the EISCAT (European incoherent scatter) Svalbard radar (ESR), and compare them with observations of dayside auroral luminosity, as seen at a wavelength of 630 nm by a meridian scanning photometer at Ny Alesund, and of plasma flows, as seen by the CUTLASS (co-operative UK twin location auroral sounding system) Finland HF radar. The optical data reveal a series of poleward-moving transient red-line (630 nm) enhancements, events that have been associated with bursts in the rate of magnetopause reconnection generating new open flux. The combined observations at this time have strong similarities to predictions of the effects of soft electron precipitation modulated by pulsed reconnection, as made by Davis and Lockwood (1996); however, the effects of rapid zonal flow in the ionosphere, caused by the magnetic curvature force on the newly opened field lines, are found to be a significant additional factor. In particular, it is shown how enhanced plasma loss rates induced by the rapid convection can explain two outstanding anomalies of the 630 nm transients, namely how minima in luminosity form between the poleward-moving events and how events can re-brighten as they move poleward. The observations show how cusp/cleft aurora and transient poleward-moving auroral forms appear in the ESR data and the conditions which cause enhanced 630 nm emission in the transients: they are an important first step in enabling the ESR to identify these features away from the winter solstice when supporting auroral observations are not available.

Coherent EISCAT Svalbard Radar spectra from the dayside cusp/cleft and their implications for transient field-aligned currents

Naturally enhanced incoherent scatter spectra from the vicinity of the dayside cusp/cleft, interpreted as being due to plasma turbulence driven by short bursts of intense field-aligned current, are compared with high-resolution narrow-angle auroral images and meridian scanning photometer data. Enhanced spectra have been observed on many occasions in association with nightside aurora, but there has been only one report of such spectra seen in the cusp/cleft region. Narrow-angle images show considerable change in the aurora on timescales shorter than the 10-s radar integration period, which could explain spectra observed with both ion lines simultaneously enhanced. Enhanced radar spectra are generally seen inside or beside regions of 630-nm auroral emission, indicative of sharp F region conductivity gradients, but there appears also to be a correlation with dynamic, small-scale auroral forms of order 100 m and less in width.

Incoherent scatter radar observations related to magnetospheric dynamics

Over the past decade incoherent scatter radars have provided fundamental observations of velocities and plasma parameters in the high-latitude ionosphere which relate to the dynamical processes responsible for the excitation of flow in the coupled solar wind-magnetosphere-ionosphere system. These observations have played a central role in inspiring a change of paradigm from a picture of quasi-steady flows parameterised by the direction of the interplanetary magnetic field to a picture of inherently time-dependent flows driven by coupling processes at the magnetopause and in the tail. Flows and particle precipitation in the dayside ionosphere are reasonably well understood in principle in terms of the effects of time-dependent reconnection at the magnetopause, though coordinated high- and low-altitude observations are lacking. Related phenomena also appear to occur in the tail, forming the “equatorward-drifting arcs” which are present during quiet times, as well as during the growth and early expansion phases of substorms. At expansion onset, the substorm bulge forms well equatorward of the arc formation region, and may take ∼ 10 min or more to reach it in its poleward expansion. Nightside ionospheric flows are then considerably perturbed by the effects of strong precipitation-induced conductivity gradients.

The impact of uncertain precipitation data on insurance loss estimates using a flood catastrophe model

Catastrophe risk models used by the insurance industry are likely subject to significant uncertainty, but due to their proprietary nature and strict licensing conditions they are not available for experimentation. In addition, even if such experiments were conducted, these would not be repeatable by other researchers because commercial confidentiality issues prevent the details of proprietary catastrophe model structures from being described in public domain documents. However, such experimentation is urgently required to improve decision making in both insurance and reinsurance markets. In this paper we therefore construct our own catastrophe risk model for flooding in Dublin, Ireland, in order to assess the impact of typical precipitation data uncertainty on loss predictions. As we consider only a city region rather than a whole territory and have access to detailed data and computing resources typically unavailable to industry modellers, our model is significantly more detailed than most commercial products. The model consists of four components, a stochastic rainfall module, a hydrological and hydraulic flood hazard module, a vulnerability module, and a financial loss module. Using these we undertake a series of simulations to test the impact of driving the stochastic event generator with four different rainfall data sets: ground gauge data, gauge-corrected rainfall radar, meteorological reanalysis data (European Centre for Medium-Range Weather Forecasts Reanalysis-Interim; ERA-Interim) and a satellite rainfall product (The Climate Prediction Center morphing method; CMORPH). Catastrophe models are unusual because they use the upper three components of the modelling chain to generate a large synthetic database of unobserved and severe loss-driving events for which estimated losses are calculated. We find the loss estimates to be more sensitive to uncertainties propagated from the driving precipitation data sets than to other uncertainties in the hazard and vulnerability modules, suggesting that the range of uncertainty within catastrophe model structures may be greater than commonly believed.

Sondrestrom and EISCAT radar observations of poleward-moving auroral forms

During many magnetospheric substorms, the auroral oval near midnight is observed to expand poleward in association with strong negative perturbations measured by local ground magnetometers. We show Sondrestrom and EISCAT incoherent scatter radar measurements during three such events. In each of the events, enhanced ionization produced by the precipitation moved northward by several degrees of latitude within 10–20 min. The electric fields measured during the three events were significantly different. In one event the electric field was southward everywhere within the precipitation region. In the other two events a reversal in the meridional component of the field was observed. In one case the reversal occurred within the precipitation region, while in the other case the reversal was at the poleward boundary of the precipitation. The westward electrojet that produces the negative H-perturbation in the ground magnetic field has Hall and Pedersen components to varying degrees. In one case the Hall component was eastward and the Pedersen component was westward, but the net magnetic H-deflection on the ground was negative. Simultaneous EISCAT measurements made near the dawn meridian during one of the events show that the polar cap boundary moved northward at the same time as the aurora expanded northward at Sondrestrom. Most of the differences in the electrodynamic configuration in the three events can be accounted for in terms of the location at which the measurements were made relative to the center of the auroral bulge.

Analysis of incoherent scatter radar data from non-thermal F-region plasma

A procedure is presented for fitting incoherent scatter radar data from non-thermal F-region ionospheric plasma, using theoretical spectra previously predicted. It is found that values of the shape distortion factor D∗, associated with deviations of the ion velocity distribution from a Maxwellian distribution, and ion temperatures can be deduced (the results being independent of the path of iteration) if the angle between the line-of-sight and the geomagnetic field is larger than about 15–20°. The procedure can be used with one or both of two sets of assumptions. These concern the validity of the adopted model for the line-of-sight ion velocity distribution in the one case or for the full three-dimensional ion velocity distribution function in the other. The distribution function employed was developed to describe the line-of-sight velocity distribution for large aspect angles, but both experimental data and Monte Carlo simulations indicate that the form of the field-perpendicular distribution can also describe the distribution at more general aspect angles. The assumption of this form for the line-of-sight velocity distribution at a general aspect angle enables rigorous derivation of values of the one-dimensional, line-of-sight ion temperature. With some additional assumptions (principally that the field-parallel distribution is always Maxwellian and there is a simple relationship between the ion temperature anisotropy and the distortion of the field-perpendicular distribution from a Maxwellian), fits to data for large aspect angles enable determination of line-of-sight temperatures at all aspect angles and hence, of the average ion temperature and the ion temperature anisotropy. For small aspect angles, the analysis is restricted to the determination of the line-of-sight ion temperature because the theoretical spectrum is insensitive to non-thermal effects when the plasma is viewed along directions almost parallel to the magnetic field. This limitation is expected to apply to any realistic model of the ion velocity distribution function and its consequences are discussed. Fit strategies which allow for mixed ion composition are also considered. Examples of fits to data from various EISCAT observing programmes are presented.