Assessment of the consistency of near-infrared water vapor line intensities using high-spectral-resolution ground-based Fourier transform measurements of solar radiation

Calculations of the absorption of solar radiation by atmospheric gases, and water vapor in particular, are dependent on the quality of databases of spectral line parameters. There has been increasing scrutiny of databases such as HITRAN in recent years, but this has mostly been performed on a band-by-band basis. We report nine high-spectral-resolution (0.03 cm(-1)) measurements of the solar radiation reaching the surface in southern England over the wave number range 2000 to 12,500 cm(-1) (0.8 to 5 mm) that allow a unique assessment of the consistency of the spectral line databases over this entire spectral region. The data are assessed in terms of the modeled water vapor column that is required to bring calculations and observations into agreement; for an entirely consistent database, this water vapor column should be constant with frequency. For the HITRAN01 database, the spread in water vapor column is about 11%, with distinct shifts between different spectral regions. The HITRAN04 database is in significantly better agreement (about 5% spread) in the completely updated 3000 to 8000 cm(-1) spectral region, but inconsistencies between individual spectral regions remain: for example, in the 8000 to 9500 cm(-1) spectral region, the results indicate an 18% (+/- 1%) underestimate in line intensities with respect to the 3000 to 8000 cm(-1) region. These measurements also indicate the impact of isotopic fractionation of water vapor in the 2500 to 2900 cm(-1) range, where HDO lines dominate over the lines of the most abundant isotope of H2O.

Developments in near infrared spectroscopy

Vibrational spectroscopy at high excitation is an important research frontier for two reasons. Firstly, the near infrared is proving to be an important area for the analytical applications of spectroscopy, and we would therefore like to understand how the spectra we observe relate to the molecular structure of the absorbing species. Secondly, there is a fundamental interest in understanding molecular dynamics and energy flow within a polyatomic molecule at high excitation, because this is the boundary between spectroscopy and chemistry through which we try to understand the details of a chemical reaction. In this presentation I shall survey recent progress in this field.

Whole crop cereals 2. Prediction of apparent digestibility and energy value from in vitro digestion techniques and near infrared reflectance spectroscopy and of chemical composition by near infrared reflectance spectroscopy

Samples of whole crop wheat (WCW, n = 134) and whole crop barley (WCB, n = 16) were collected from commercial farms in the UK over a 2-year period (2003/2004 and 2004/2005). Near infrared reflectance spectroscopy (NIRS) was compared with laboratory and in vitro digestibility measures to predict digestible organic matter in the dry matter (DOMD) and metabolisable energy (ME) contents measured in vivo using sheep. Spectral models using the mean spectra of two scans were compared with those using individual spectra (duplicate spectra). Overall NIRS accurately predicted the concentration of chemical components in whole crop cereals apart from crude protein. ammonia-nitrogen, water-soluble carbohydrates, fermentation acids and solubility values. In addition. the spectral models had higher prediction power for in vivo DOMD and ME than chemical components or in vitro digestion methods. Overall there Was a benefit from the use of duplicate spectra rather than mean spectra and this was especially so for predicting in vivo DOMD and ME where the sample population size was smaller. The spectral models derived deal equally well with WCW and WCB and Would he of considerable practical value allowing rapid determination of nutritive value of these forages before their use in diets of productive animals. (C) 2008 Elsevier B.V. All rights reserved.

Near infrared reflectance spectroscopy (NIRS) to predict biological parameters of maize silage: effects of particle comminution, oven drying temperature and the presence of residual moisture

Maize silage nutritive quality is routinely determined by near infrared reflectance spectroscopy (NIRS). However, little is known about the impact of sample preparation on the accuracy of the calibration to predict biological traits. A sample population of 48 maize silages representing a wide range of physiological maturities was used in a study to determine the impact of different sample preparation procedures (i.e., drying regimes; the presence or absence of residual moisture; the degree of particle comminution) on resultant NIR prediction statistics. All silages were scanned using a total of 12 combinations of sample pre-treatments. Each sample preparation combination was subjected to three multivariate regression techniques to give a total of 36 predictions per biological trait. Increased sample preparations procedure, relative to scanning the unprocessed whole plant (WP) material, always resulted in a numerical minimisation of model statistics. However, the ability of each of the treatments to significantly minimise the model statistics differed. Particle comminution was the most important factor, oven-drying regime was intermediate, and residual moisture presence was the least important. Models to predict various biological parameters of maize silage will be improved if material is subjected to a high degree of particle comminution (i.e., having been passed through a 1 mm screen) and developed on plant material previously dried at 60 degrees C. The extra effort in terms of time and cost required to remove sample residual moisture cannot be justified. (c) 2005 Elsevier B.V. All rights reserved.

Using near infrared reflectance spectroscopy (NIRS) to predict the biological parameters of maize silage

The microbial fermentability, ruminal degradability and digestibility of 48 maize silages were determined using in vitro gas production (GP), in situ degradability and in vitro digestibility procedures. The silages were produced from forage maize harvested throughout the summer of 1998, and represent a wide range of physiological maturities. Large variations among samples were observed for all biological parameters, with the exception of in vitro digestibility and the asymptote of in vitro GP. The potential of near infrared reflectance spectroscopy (NIRS) to predict the biological parameters measured was determined by regression of the biological data against the respective spectral profile. NIRS demonstrated only a moderate ability (R-2 > 0.60-0.80) to predict in vitro digestibility, modelled kinetics of gas production (excluding the asymptote of gas production) and the modelled ruminally soluble dry matter (DM) fraction. Calibration statistics for remaining biological parameters were unacceptably poor (R-2 = 0.60). (C) 2004 Elsevier B.V. All rights reserved.

Assessment of the consistency of H2O line intensities over the near-infrared using sun-pointing ground-based Fourier transform spectroscopy

We report on the consistency of water vapour line intensities in selected spectral regions between 800–12,000 cm−1 under atmospheric conditions using sun-pointing Fourier transform infrared spectroscopy. Measurements were made across a number of days at both a low and high altitude field site, sampling a relatively moist and relatively dry atmosphere. Our data suggests that across most of the 800–12,000 cm−1 spectral region water vapour line intensities in recent spectral line databases are generally consistent with what was observed. However, we find that HITRAN-2008 water vapour line intensities are systematically lower by up to 20% in the 8000–9200 cm−1 spectral interval relative to other spectral regions. This discrepancy is essentially removed when two new linelists (UCL08, a compilation of linelists and ab-initio calculations, and one based on recent laboratory measurements by Oudot et al. (2010) [10] in the 8000–9200 cm−1 spectral region) are used. This strongly suggests that the H2O line strengths in the HITRAN-2008 database are indeed underestimated in this spectral region and in need of revision. The calculated global-mean clear-sky absorption of solar radiation is increased by about 0.3 W m−2 when using either the UCL08 or Oudot line parameters in the 8000–9200 cm−1 region, instead of HITRAN-2008. We also found that the effect of isotopic fractionation of HDO is evident in the 2500–2900 cm−1 region in the observations.

Water vapour continuum absorption in near-infrared windows derived from laboratory measurements

In most near-infrared atmospheric windows, absorption of solar radiation is dominated by the water vapor self-continuum and yet there is a paucity of measurements in these windows. We report new laboratory measurements of the self-continuum absorption at temperatures between 293 and 472 K and pressures from 0.015 to 5 atm in four near-infrared windows between 1 and 4 m (10000-2500 cm-1); the measurements are made over a wider range of wavenumber, temperatures and pressures than any previous measurements. They show that the self-continuum in these windows is typically one order of magnitude stronger than given in representations of the continuum widely used in climate and weather prediction models. These results are also not consistent with current theories attributing the self continuum within windows to the far-wings of strong spectral lines in the nearby water vapor absorption bands; we suggest that they are more consistent with water dimers being the major contributor to the continuum. The calculated global-average clear-sky atmospheric absorption of solar radiation is increased by 0.75 W/m2 (which is about 1% of the total clear-sky absorption) by using these new measurements as compared to calculations with the MT_CKD-2.5 self-continuum model.

Visible-near infrared spectroscopy sensor for predicting curd and whey composition during cheese processing

The potential of visible-near infrared spectra, obtained using a light backscatter sensor, in conjunction with chemometrics, to predict curd moisture and whey fat content in a cheese vat was examined. A three-factor (renneting temperature, calcium chloride, cutting time), central composite design was carried out in triplicate. Spectra (300–1,100 nm) of the product in the cheese vat were captured during syneresis using a prototype light backscatter sensor. Stirring followed upon cutting the gel, and samples of curd and whey were removed at 10 min intervals and analyzed for curd moisture and whey fat content. Spectral data were used to develop models for predicting curd moisture and whey fat contents using partial least squares regression. Subjecting the spectral data set to Jack-knifing improved the accuracy of the models. The whey fat models (R = 0.91, 0.95) and curd moisture model (R = 0.86, 0.89) provided good and approximate predictions, respectively. Visible-near infrared spectroscopy was found to have potential for the prediction of important syneresis indices in stirred cheese vats.

Prediction of moisture, calorific value, ash and carbon content of two dedicated bioenergy crops using near-infrared spectroscopy

The potential of near infrared spectroscopy in conjunction with partial least squares regression to predict Miscanthus xgiganteus and short rotation coppice willow quality indices was examined. Moisture, calorific value, ash and carbon content were predicted with a root mean square error of cross validation of 0.90% (R2 = 0.99), 0.13 MJ/kg (R2 = 0.99), 0.42% (R2 = 0.58), and 0.57% (R2 = 0.88), respectively. The moisture and calorific value prediction models had excellent accuracy while the carbon and ash models were fair and poor, respectively. The results indicate that near infrared spectroscopy has the potential to predict quality indices of dedicated energy crops, however the models must be further validated on a wider range of samples prior to implementation. The utilization of such models would assist in the optimal use of the feedstock based on its biomass properties.

On-line prediction of cheese making using backscatter of near infrared indices light

The potential of a fibre optic sensor, detecting light backscatter in a cheese vat during coagulation and syneresis, to predict curd moisture, fat loses and curd yield was examined. Temperature, cutting time and calcium levels were varied to assess the strength of the predictions over a range of processing conditions. Equations were developed using a combination of independent variables, milk compositional and light backscatter parameters. Fat losses, curd yield and curd moisture content were predicted with a standard error of prediction (SEP) of +/- 2.65 g 100 g(-1) (R-2 = 0.93), +/- 0.95% (R-2 = 0.90) and +/- 1.43% (R-2 = 0.94), respectively. These results were used to develop a model for predicting curd moisture as a function of time during syneresis (SEP = +/- 1.72%; R-2 = 0.95). By monitoring coagulation and syneresis, this sensor technology could be employed to control curd moisture content, thereby improving process control during cheese manufacture. (c) 2007 Elsevier Ltd. All rights reserved..

Water vapour foreign-continuum absorption in near-infrared windows from laboratory measurements

For a long time, it has been believed that atmospheric absorption of radiation within wavelength regions of relatively high infrared transmittance (so-called ‘windows’) was dominated by the water vapour self-continuum, that is, spectrally smooth absorption caused by H2O−H2O pair interaction. Absorption due to the foreign continuum (i.e. caused mostly by H2O−N2 bimolecular absorption in the Earth's atmosphere) was considered to be negligible in the windows. We report new retrievals of the water vapour foreign continuum from high-resolution laboratory measurements at temperatures between 350 and 430 K in four near-infrared windows between 1.1 and 5 μm (9000–2000 cm−1). Our results indicate that the foreign continuum in these windows has a very weak temperature dependence and is typically between one and two orders of magnitude stronger than that given in representations of the continuum currently used in many climate and weather prediction models. This indicates that absorption owing to the foreign continuum may be comparable to the self-continuum under atmospheric conditions in the investigated windows. The calculated global-average clear-sky atmospheric absorption of solar radiation is increased by approximately 0.46 W m−2 (or 0.6% of the total clear-sky absorption) by using these new measurements when compared with calculations applying the widely used MTCKD (Mlawer–Tobin–Clough–Kneizys–Davies) foreign-continuum model.

Near-infrared water vapour self-continuum at close to room temperature

The gaseous absorption of solar radiation within near-infrared atmospheric windows in the Earth's atmosphere is dominated by the water vapour continuum. Recent measurements by Baranov et al. (2011) [17] in 2500 cm−1 (4 μm) window and by Ptashnik et al. (2011) [18] in a few near-infrared windows revealed that the self-continuum absorption is typically an order of magnitude stronger than given by the MT_CKD continuum model prior to version 2.5. Most of these measurements, however, were made at elevated temperatures, which makes their application to atmospheric conditions difficult. Here we report new laboratory measurements of the self-continuum absorption at 289 and 318 K in the near-infrared spectral region 1300–8000 cm−1, using a multipass 30 m base cell with total optical path 612 m. Our results confirm the main conclusions of the previous measurements both within bands and in windows. Of particular note is that we present what we believe to be the first near-room temperature measurement using Fourier Transform Spectrometry of the self-continuum in the 6200 cm−1 (1.6 μm) window, which provides tentative evidence that, at such temperatures, the water vapour continuum absorption may be as strong as it is in 2.1 μm and 4 μm windows and up to 2 orders of magnitude stronger than the MT_CKD-2.5 continuum. We note that alternative methods of measuring the continuum in this window have yielded widely differing assessment of its strength, which emphasises the need for further measurements.

A high-resolution near-infrared extraterrestrial solar spectrum derived from ground-based Fourier transform spectrometer measurements

A detailed spectrally-resolved extraterrestrial solar spectrum (ESS) is important for line-by-line radiative transfer modeling in the near-infrared (near-IR). Very few observationally-based high-resolution ESS are available in this spectral region. Consequently the theoretically-calculated ESS by Kurucz has been widely adopted. We present the CAVIAR (Continuum Absorption at Visible and Infrared Wavelengths and its Atmospheric Relevance) ESS which is derived using the Langley technique applied to calibrated observations using a ground-based high-resolution Fourier transform spectrometer (FTS) in atmospheric windows from 2000–10000 cm-1 (1–5 μm). There is good agreement between the strengths and positions of solar lines between the CAVIAR and the satellite-based ACE-FTS (Atmospheric Chemistry Experiment-FTS) ESS, in the spectral region where they overlap, and good agreement with other ground-based FTS measurements in two near-IR windows. However there are significant differences in the structure between the CAVIAR ESS and spectra from semi-empirical models. In addition, we found a difference of up to 8 % in the absolute (and hence the wavelength-integrated) irradiance between the CAVIAR ESS and that of Thuillier et al., which was based on measurements from the Atmospheric Laboratory for Applications and Science satellite and other sources. In many spectral regions, this difference is significant, as the coverage factor k = 2 (or 95 % confidence limit) uncertainties in the two sets of observations do not overlap. Since the total solar irradiance is relatively well constrained, if the CAVIAR ESS is correct, then this would indicate an integrated “loss” of solar irradiance of about 30 W m-2 in the near-IR that would have to be compensated by an increase at other wavelengths.

The effect of chosen extraterrestrial solar spectrum on clear-sky atmospheric absorption and heating rates in the near infrared

The extraterrestrial solar spectrum (ESS) is an important component in near infrared (near-IR) radiative transfer calculations. However, the impact of a particular choice of the ESS in these regions has been given very little attention. A line-by-line (LBL) transfer model has been used to calculate the absorbed solar irradiance and solar heating rates in the near-IR from 2000-10000 cm−1(1-5 μm) using different ESS. For overhead sun conditions in a mid-latitude summer atmosphere, the absorbed irradiances could differ by up to about 11 Wm−2 (8.2%) while the tropospheric and stratospheric heating rates could differ by up to about 0.13 K day−1 (8.1%) and 0.19 K day−1 (7.6%). The spectral shape of the ESS also has a small but non-negligible impact on these factors in the near-IR.

Global radiative and climate effect of the water vapour continuum at visible and near-infrared wavelengths

Recent laboratory measurements show that absorption by the water vapour continuum in near-infrared windows may be about an order of magnitude higher than assumed in many radiation codes. The radiative impact of the continuum at visible and near-infrared wavelengths is examined for the present day and for a possible future warmer climate (with a global-mean total column water increase of 33%). The calculations use a continuum model frequently used in climate models (‘CKD’) and a continuum model where absorption is enhanced at wavelengths greater than 1 µm based on recent measurements (‘CAVIAR’). The continuum predominantly changes the partitioning between solar radiation absorbed by the surface and the atmosphere; changes in top-of-atmosphere net irradiances are smaller. The global-mean clear-sky atmospheric absorption is enhanced by 1.5 W m−2 (about 2%) and 2.8 W m−2 (about 3.5%) for CKD and CAVIAR respectively, relative to a hypothetical no-continuum case, with all-sky enhancements about 80% of these values. The continuum is, in relative terms, more important for radiation budget changes between the present day and a possible future climate. Relative to the no-continuum case, the increase in global-mean clear-sky absorption is 8% higher using CKD and almost 20% higher using CAVIAR; all-sky enhancements are about half these values. The effect of the continuum is estimated for the solar component of the water vapour feedback, the reduction in downward surface irradiance and precipitation change in a warmer world. For CKD and CAVIAR respectively, and relative to the no-continuum case, the solar component of the water vapour feedback is enhanced by about 4 and 9%, the change in clear-sky downward surface irradiance is 7 and 18% more negative, and the global-mean precipitation response decreases by 1 and 4%. There is a continued need for improved continuum measurements, especially at atmospheric temperatures and at wavelengths below 2 µm.