Clear-sky biases in satellite infrared estimates of upper tropospheric humidity and its trends

We use microwave retrievals of upper tropospheric humidity (UTH) to estimate the impact of clear-sky-only sampling by infrared instruments on the distribution, variability and trends in UTH. Our method isolates the impact of the clear-sky-only sampling, without convolving errors from other sources. On daily time scales IR-sampled UTH contains large data gaps in convectively active areas, with only about 20-30 % of the tropics (30 S­ 30 N) being sampled. This results in a dry bias of about -9 %RH in the area-weighted tropical daily UTH time series. On monthly scales, maximum clear-sky bias (CSB) is up to -30 %RH over convectively active areas. The magnitude of CSB shows significant correlations with UTH itself (-0.5) and also with the variability in UTH (-0.6). We also show that IR-sampled UTH time series have higher interannual variability and smaller trends compared to microwave sampling. We argue that a significant part of the smaller trend results from the contrasting influence of diurnal drift in the satellite measurements on the wet and dry regions of the tropics.

Prediction of coagulation properties, titratable acidity and pH of bovine milk using mid-infrared spectroscopy

This study investigated the potential application of mid-infrared spectroscopy (MIR 4,000–900 cm−1) for the determination of milk coagulation properties (MCP), titratable acidity (TA), and pH in Brown Swiss milk samples (n = 1,064). Because MCP directly influence the efficiency of the cheese-making process, there is strong industrial interest in developing a rapid method for their assessment. Currently, the determination of MCP involves time-consuming laboratory-based measurements, and it is not feasible to carry out these measurements on the large numbers of milk samples associated with milk recording programs. Mid-infrared spectroscopy is an objective and nondestructive technique providing rapid real-time analysis of food compositional and quality parameters. Analysis of milk rennet coagulation time (RCT, min), curd firmness (a30, mm), TA (SH°/50 mL; SH° = Soxhlet-Henkel degree), and pH was carried out, and MIR data were recorded over the spectral range of 4,000 to 900 cm−1. Models were developed by partial least squares regression using untreated and pretreated spectra. The MCP, TA, and pH prediction models were improved by using the combined spectral ranges of 1,600 to 900 cm−1, 3,040 to 1,700 cm−1, and 4,000 to 3,470 cm−1. The root mean square errors of cross-validation for the developed models were 2.36 min (RCT, range 24.9 min), 6.86 mm (a30, range 58 mm), 0.25 SH°/50 mL (TA, range 3.58 SH°/50 mL), and 0.07 (pH, range 1.15). The most successfully predicted attributes were TA, RCT, and pH. The model for the prediction of TA provided approximate prediction (R2 = 0.66), whereas the predictive models developed for RCT and pH could discriminate between high and low values (R2 = 0.59 to 0.62). It was concluded that, although the models require further development to improve their accuracy before their application in industry, MIR spectroscopy has potential application for the assessment of RCT, TA, and pH during routine milk analysis in the dairy industry. The implementation of such models could be a means of improving MCP through phenotypic-based selection programs and to amend milk payment systems to incorporate MCP into their payment criteria.

Spatio-temporal surface soil heat flux estimates from satellite data: results for the AMMA experiment at the Fakara (Niger) supersite

This paper describes a method that employs Earth Observation (EO) data to calculate spatiotemporal estimates of soil heat flux, G, using a physically-based method (the Analytical Method). The method involves a harmonic analysis of land surface temperature (LST) data. It also requires an estimate of near-surface soil thermal inertia; this property depends on soil textural composition and varies as a function of soil moisture content. The EO data needed to drive the model equations, and the ground-based data required to provide verification of the method, were obtained over the Fakara domain within the African Monsoon Multidisciplinary Analysis (AMMA) program. LST estimates (3 km × 3 km, one image 15 min−1) were derived from MSG-SEVIRI data. Soil moisture estimates were obtained from ENVISAT-ASAR data, while estimates of leaf area index, LAI, (to calculate the effect of the canopy on G, largely due to radiation extinction) were obtained from SPOT-HRV images. The variation of these variables over the Fakara domain, and implications for values of G derived from them, were discussed. Results showed that this method provides reliable large-scale spatiotemporal estimates of G. Variations in G could largely be explained by the variability in the model input variables. Furthermore, it was shown that this method is relatively insensitive to model parameters related to the vegetation or soil texture. However, the strong sensitivity of thermal inertia to soil moisture content at low values of relative saturation (<0.2) means that in arid or semi-arid climates accurate estimates of surface soil moisture content are of utmost importance, if reliable estimates of G are to be obtained. This method has the potential to improve large-scale evaporation estimates, to aid land surface model prediction and to advance research that aims to explain failure in energy balance closure of meteorological field studies.

The role of atmosphere feedbacks during ENSO in the CMIP3 models. Part III: the shortwave flux feedback

Previous studies using coupled general circulation models (GCMs) suggest that the atmosphere model plays a dominant role in the modeled El Nin ̃ o–Southern Oscillation (ENSO), and that intermodel differences in the thermodynamical damping of sea surface temperatures (SSTs) are a dominant contributor to the ENSO amplitude diversity. This study presents a detailed analysis of the shortwave flux feedback (aSW) in 12 Coupled Model Intercomparison Project phase 3 (CMIP3) simulations, motivated by findings that aSW is the primary contributor to model thermodynamical damping errors. A ‘‘feedback decomposition method,’’ developed to elucidate the aSW biases, shows that all models un- derestimate the dynamical atmospheric response to SSTs in the eastern equatorial Pacific, leading to un- derestimated aSW values. Biases in the cloud response to dynamics and the shortwave interception by clouds also contribute to errors in aSW. Changes in the aSW feedback between the coupled and corresponding atmosphere-only simulations are related to changes in the mean dynamics. A large nonlinearity is found in the observed and modeled SW flux feedback, hidden when linearly cal- culating aSW. In the observations, two physical mechanisms are proposed to explain this nonlinearity: 1) a weaker subsidence response to cold SST anomalies than the ascent response to warm SST anomalies and 2) a nonlinear high-level cloud cover response to SST. The shortwave flux feedback nonlinearity tends to be underestimated by the models, linked to an underestimated nonlinearity in the dynamical response to SST. The process-based methodology presented in this study may help to correct model ENSO atmospheric biases, ultimately leading to an improved simulation of ENSO in GCMs.

Cloud droplet size and liquid water path retrievals from zenith radiance measurements: examples from the Atmospheric Radiation Measurement Program and the Aerosol Robotic Network

The ground-based Atmospheric Radiation Measurement Program (ARM) and NASA Aerosol Robotic Net- work (AERONET) routinely monitor clouds using zenith ra- diances at visible and near-infrared wavelengths. Using the transmittance calculated from such measurements, we have developed a new retrieval method for cloud effective droplet size and conducted extensive tests for non-precipitating liquid water clouds. The underlying principle is to combine a liquid-water-absorbing wavelength (i.e., 1640 nm) with a non-water-absorbing wavelength for acquiring information on cloud droplet size and optical depth. For simulated stratocumulus clouds with liquid water path less than 300 g m−2 and horizontal resolution of 201 m, the retrieval method underestimates the mean effective radius by 0.8μm, with a root-mean-squared error of 1.7 μm and a relative deviation of 13%. For actual observations with a liquid water path less than 450 g m−2 at the ARM Oklahoma site during 2007– 2008, our 1.5-min-averaged retrievals are generally larger by around 1 μm than those from combined ground-based cloud radar and microwave radiometer at a 5-min temporal resolution. We also compared our retrievals to those from combined shortwave flux and microwave observations for relatively homogeneous clouds, showing that the bias between these two retrieval sets is negligible, but the error of 2.6 μm and the relative deviation of 22 % are larger than those found in our simulation case. Finally, the transmittance-based cloud effective droplet radii agree to better than 11 % with satellite observations and have a negative bias of 1 μm. Overall, the retrieval method provides reasonable cloud effective radius estimates, which can enhance the cloud products of both ARM and AERONET.

A method to diagnose boundary-layer type using Doppler lidar

A new technique for objective classification of boundary layers is applied to ground-based vertically pointing Doppler lidar and sonic anemometer data. The observed boundary layer has been classified into nine different types based on those in the Met Office ‘Lock’ scheme, using vertical velocity variance and skewness, along with attenuated backscatter coefficient and surface sensible heat flux. This new probabilistic method has been applied to three years of data from Chilbolton Observatory in southern England and a climatology of boundary-layer type has been created. A clear diurnal cycle is present in all seasons. The most common boundary-layer type is stable with no cloud (30.0% of the dataset). The most common unstable type is well mixed with no cloud (15.4%). Decoupled stratocumulus is the third most common boundary-layer type (10.3%) and cumulus under stratocumulus occurs 1.0% of the time. The occurrence of stable boundary-layer types is much higher in the winter than the summer and boundary-layer types capped with cumulus cloud are more prevalent in the warm seasons. The most common diurnal evolution of boundary-layer types, occurring on 52 days of our three-year dataset, is that of no cloud with the stability changing from stable to unstable during daylight hours. These results are based on 16393 hours, 62.4% of the three-year dataset, of diagnosed boundary-layer type. This new method is ideally suited to long-term evaluation of boundary-layer type parametrisations in weather forecast and climate models.

Infrared dynamics of decaying two-dimensional turbulence governed by the Charney-Hasegawa-Mima equation

The low wave number range of decaying turbulence governed by the Charney-Hasegawa-Mima (CHM) equation is examined theoretically and by direct numerical simulation. Here, the low wave number range is defined as values of the wave number k below the wave number kE corresponding to the peak of the energy spectrum, or alternatively the centroid wave number of the energy spectrum. The energy spectrum in the low wave number range in the infrared regime (k →0) is theoretically derived to be E(k) ∼k5, using a quasinormal Markovianized model of the CHM equation. This result is verified by direct numerical simulation of the CHM equation. The wave number triads (k,p,q) responsible for the formation of the low wave number spectrum are also examined. It is found that the energy flux Π(k) for k< kE can be entirely expressed by Π(-)(k), which is the total net input of energy to wave numbers k. Furthermore, the contribution of nonlocal triad interactions to the energy flux is found to be predominant in the range log (k/kE)<-0.5, where the nonlocal interactions are defined to be those triad interactions for which the ratio of the largest leg of the triad to the smallest leg is larger than four. ©2001 The Physical Society of Japan

Fusion of infrared polarization and intensity images using support value transform and fuzzy combination rules

Infrared polarization and intensity imagery provide complementary and discriminative information in image understanding and interpretation. In this paper, a novel fusion method is proposed by effectively merging the information with various combination rules. It makes use of both low-frequency and highfrequency images components from support value transform (SVT), and applies fuzzy logic in the combination process. Images (both infrared polarization and intensity images) to be fused are firstly decomposed into low-frequency component images and support value image sequences by the SVT. Then the low-frequency component images are combined using a fuzzy combination rule blending three sub-combination methods of (1) region feature maximum, (2) region feature weighting average, and (3) pixel value maximum; and the support value image sequences are merged using a fuzzy combination rule fusing two sub-combination methods of (1) pixel energy maximum and (2) region feature weighting. With the variables of two newly defined features, i.e. the low-frequency difference feature for low-frequency component images and the support-value difference feature for support value image sequences, trapezoidal membership functions are proposed and developed in tuning the fuzzy fusion process. Finally the fused image is obtained by inverse SVT operations. Experimental results of visual inspection and quantitative evaluation both indicate the superiority of the proposed method to its counterparts in image fusion of infrared polarization and intensity images.

Modelling of urban sensible heat flux at multiple spatial scales : a demonstration using airborne hyperspectral imagery of Shanghai and a temperature–emissivity separation approach

Urbanization related alterations to the surface energy balance impact urban warming (‘heat islands’), the growth of the boundary layer, and many other biophysical processes. Traditionally, in situ heat flux measures have been used to quantify such processes, but these typically represent only a small local-scale area within the heterogeneous urban environment. For this reason, remote sensing approaches are very attractive for elucidating more spatially representative information. Here we use hyperspectral imagery from a new airborne sensor, the Operative Modular Imaging Spectrometer (OMIS), along with a survey map and meteorological data, to derive the land cover information and surface parameters required to map spatial variations in turbulent sensible heat flux (QH). The results from two spatially-explicit flux retrieval methods which use contrasting approaches and, to a large degree, different input data are compared for a central urban area of Shanghai, China: (1) the Local-scale Urban Meteorological Parameterization Scheme (LUMPS) and (2) an Aerodynamic Resistance Method (ARM). Sensible heat fluxes are determined at the full 6 m spatial resolution of the OMIS sensor, and at lower resolutions via pixel aggregation and spatial averaging. At the 6 m spatial resolution, the sensible heat flux of rooftop dominated pixels exceeds that of roads, water and vegetated areas, with values peaking at ∼ 350 W m− 2, whilst the storage heat flux is greatest for road dominated pixels (peaking at around 420 W m− 2). We investigate the use of both OMIS-derived land surface temperatures made using a Temperature–Emissivity Separation (TES) approach, and land surface temperatures estimated from air temperature measures. Sensible heat flux differences from the two approaches over the entire 2 × 2 km study area are less than 30 W m− 2, suggesting that methods employing either strategy maybe practica1 when operated using low spatial resolution (e.g. 1 km) data. Due to the differing methodologies, direct comparisons between results obtained with the LUMPS and ARM methods are most sensibly made at reduced spatial scales. At 30 m spatial resolution, both approaches produce similar results, with the smallest difference being less than 15 W m− 2 in mean QH averaged over the entire study area. This is encouraging given the differing architecture and data requirements of the LUMPS and ARM methods. Furthermore, in terms of mean study QH, the results obtained by averaging the original 6 m spatial resolution LUMPS-derived QH values to 30 and 90 m spatial resolution are within ∼ 5 W m− 2 of those derived from averaging the original surface parameter maps prior to input into LUMPS, suggesting that that use of much lower spatial resolution spaceborne imagery data, for example from Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) is likely to be a practical solution for heat flux determination in urban areas.

A critical revision of the estimation of the latent heat flux from two-wavelength scintillometry

Simultaneous scintillometer measurements at multiple wavelengths (pairing visible or infrared with millimetre or radio waves) have the potential to provide estimates of path-averaged surface fluxes of sensible and latent heat. Traditionally, the equations to deduce fluxes from measurements of the refractive index structure parameter at the two wavelengths have been formulated in terms of absolute humidity. Here, it is shown that formulation in terms of specific humidity has several advantages. Specific humidity satisfies the requirement for a conserved variable in similarity theory and inherently accounts for density effects misapportioned through the use of absolute humidity. The validity and interpretation of both formulations are assessed and the analogy with open-path infrared gas analyser density corrections is discussed. Original derivations using absolute humidity to represent the influence of water vapour are shown to misrepresent the latent heat flux. The errors in the flux, which depend on the Bowen ratio (larger for drier conditions), may be of the order of 10%. The sensible heat flux is shown to remain unchanged. It is also verified that use of a single scintillometer at optical wavelengths is essentially unaffected by these new formulations. Where it may not be possible to reprocess two-wavelength results, a density correction to the latent heat flux is proposed for scintillometry, which can be applied retrospectively to reduce the error.

Reconstruction of geomagnetic activity and near-Earth interplanetary conditions over the past 167 yr - Part 4: Near-Earth solar wind speed, IMF, and open solar flux

In the concluding paper of this tetralogy, we here use the different geomagnetic activity indices to reconstruct the near-Earth interplanetary magnetic field (IMF) and solar wind flow speed, as well as the open solar flux (OSF) from 1845 to the present day. The differences in how the various indices vary with near-Earth interplanetary parameters, which are here exploited to separate the effects of the IMF and solar wind speed, are shown to be statistically significant at the 93% level or above. Reconstructions are made using four combinations of different indices, compiled using different data and different algorithms, and the results are almost identical for all parameters. The correction to the aa index required is discussed by comparison with the Ap index from a more extensive network of mid-latitude stations. Data from the Helsinki magnetometer station is used to extend the aa index back to 1845 and the results confirmed by comparison with the nearby St Petersburg observatory. The optimum variations, using all available long-term geomagnetic indices, of the near-Earth IMF and solar wind speed, and of the open solar flux, are presented; all with ±2sigma� uncertainties computed using the Monte Carlo technique outlined in the earlier papers. The open solar flux variation derived is shown to be very similar indeed to that obtained using the method of Lockwood et al. (1999).

Infrared optical coatings for the EarthCARE Multispectral Imager

The Earth Cloud, Aerosol and Radiation Explorer mission (EarthCARE) Multispectral Imager (MSI) is a radiometric instrument designed to provide the imaging of the atmospheric cloud cover and the cloud top surface temperature from a sun-synchronous low Earth orbit. The MSI forms part of a suite of four instruments destined to support the European Space Agency Living Planet mission on-board the EarthCARE satellite payload to be launched in 2016, whose synergy will be used to construct three-dimensional scenes, textures and temperatures of atmospheric clouds and aerosols. The MSI instrument contains seven channels: four solar channels to measure visible and short-wave infrared wavelengths, and three channels to measure infrared thermal emission. In this paper, we describe the optical layout of the infrared instrument channels, thin-film multilayer designs, the coating deposition method and the spectral system throughput for the bandpass interference filters, dichroic beam splitters, lenses and mirror coatings to discriminate wavelengths at 8.8, 10.8, & 12.0 µm. The rationale for the selection of thin-film materials, spectral measurement technique, and environmental testing performance are also presented.

Open solar flux estimates from near-Earth measurements of the interplanetary magnetic field: comparison of the first two perihelion passes of the Ulysses spacecraft

Results from all phases of the orbits of the Ulysses spacecraft have shown that the magnitude of the radial component of the heliospheric field is approximately independent of heliographic latitude. This result allows the use of near- Earth observations to compute the total open flux of the Sun. For example, using satellite observations of the interplanetary magnetic field, the average open solar flux was shown to have risen by 29% between 1963 and 1987 and using the aa geomagnetic index it was found to have doubled during the 20th century. It is therefore important to assess fully the accuracy of the result and to check that it applies to all phases of the solar cycle. The first perihelion pass of the Ulysses spacecraft was close to sunspot minimum, and recent data from the second perihelion pass show that the result also holds at solar maximum. The high level of correlation between the open flux derived from the various methods strongly supports the Ulysses discovery that the radial field component is independent of latitude. We show here that the errors introduced into open solar flux estimates by assuming that the heliospheric field’s radial component is independent of latitude are similar for the two passes and are of order 25% for daily values, falling to 5% for averaging timescales of 27 days or greater. We compare here the results of four methods for estimating the open solar flux with results from the first and second perehelion passes by Ulysses. We find that the errors are lowest (1–5% for averages over the entire perehelion passes lasting near 320 days), for near-Earth methods, based on either interplanetary magnetic field observations or the aa geomagnetic activity index. The corresponding errors for the Solanki et al. (2000) model are of the order of 9–15% and for the PFSS method, based on solar magnetograms, are of the order of 13–47%. The model of Solanki et al. is based on the continuity equation of open flux, and uses the sunspot number to quantify the rate of open flux emergence. It predicts that the average open solar flux has been decreasing since 1987, as Correspondence to: M. Lockwood (m.lockwood@rl.ac.uk) is observed in the variation of all the estimates of the open flux. This decline combines with the solar cycle variation to produce an open flux during the second (sunspot maximum) perihelion pass of Ulysses which is only slightly larger than that during the first (sunspot minimum) perihelion pass.

Twenty-three cycles of changing open solar magnetic flux

This paper presents a comparison of various estimates of the open solar flux, deduced from measurements of the interplanetary magnetic field, from the aa geomagnetic index and from photospheric magnetic field observations. The first two of these estimates are made using the Ulysses discovery that the radial heliospheric field is approximately independent of heliographic latitude, the third makes use of the potential-field source surface method to map the total flux through the photosphere to the open flux at the top of the corona. The uncertainties associated with using the Ulysses result are 5%, but the effects of the assumptions of the potential field source surface method are harder to evaluate. Nevertheless, the three methods give similar results for the last three solar cycles when the data sets overlap. In 11-year running means, all three methods reveal that 1987 marked a significant peak in the long-term variation of the open solar flux. This peak is close to the solar minimum between sunspot cycles 21 and 22, and consequently the mean open flux (averaged from minimum to minimum) is similar for these two cycles. However, this similarity between cycles 21 and 22 in no way implies that the open flux is constant. The long-term variation shows that these cycles are fundamentally different in that the average open flux was rising during cycle 21 (from consistently lower values in cycle 20 and toward the peak in 1987) but was falling during cycle 22 (toward consistently lower values in cycle 23). The estimates from the geomagnetic aa index are unique as they extend from 1842 onwards (using the Helsinki extension). This variation gives strong anticorrelations, with very high statistical significance levels, with cosmic ray fluxes and with the abundances of the cosmogenic isotopes that they produce. Thus observations of photospheric magnetic fields, of cosmic ray fluxes, and of cosmogenic isotope abundances all support the long-term drifts in open solar flux reported by Lockwood et al. [1999a, 1999b].

Long-term drift of the coronal source magnetic flux and the total solar irradiance

We test the method of Lockwood et al. [1999] for deriving the coronal source flux from the geomagnetic aa index and show it to be accurate to within 12% for annual means and 4.5% for averages over a sunspot cycle. Using data from four solar constant monitors during 1981-1995, we find a linear relationship between this magnetic flux and the total solar irradiance. From this correlation, we show that the 131% rise in the mean coronal source field over the interval 1901-1995 corresponds to a rise in the average total solar irradiance of {\Delta}I = 1.65 +/- 0.23 Wm^{-2}.