Unsupervised genetic algorithm deployed for intrusion detection

This paper represents the first step in an on-going work for designing an unsupervised method based on genetic algorithm for intrusion detection. Its main role in a broader system is to notify of an unusual traffic and in that way provide the possibility of detecting unknown attacks. Most of the machine-learning techniques deployed for intrusion detection are supervised as these techniques are generally more accurate, but this implies the need of labeling the data for training and testing which is time-consuming and error-prone. Hence, our goal is to devise an anomaly detector which would be unsupervised, but at the same time robust and accurate. Genetic algorithms are robust and able to avoid getting stuck in local optima, unlike the rest of clustering techniques. The model is verified on KDD99 benchmark dataset, generating a solution competitive with the solutions of the state-of-the-art which demonstrates high possibilities of the proposed method.

Effect of improving representation of horizontal and vertical cloud structure on the Earth's global radiation budget. Part II: The global effects

Reliably representing both horizontal cloud inhomogeneity and vertical cloud overlap is fundamentally important for the radiation budget of a general circulation model. Here, we build on the work of Part One of this two-part paper by applying a pair of parameterisations that account for horizontal inhomogeneity and vertical overlap to global re-analysis data. These are applied both together and separately in an attempt to quantify the effects of poor representation of the two components on radiation budget. Horizontal inhomogeneity is accounted for using the “Tripleclouds” scheme, which uses two regions of cloud in each layer of a gridbox as opposed to one; vertical overlap is accounted for using “exponential-random” overlap, which aligns vertically continuous cloud according to a decorrelation height. These are applied to a sample of scenes from a year of ERA-40 data. The largest radiative effect of horizontal inhomogeneity is found to be in areas of marine stratocumulus; the effect of vertical overlap is found to be fairly uniform, but with larger individual short-wave and long-wave effects in areas of deep, tropical convection. The combined effect of the two parameterisations is found to reduce the magnitude of the net top-of-atmosphere cloud radiative forcing (CRF) by 2.25 W m−2, with shifts of up to 10 W m−2 in areas of marine stratocumulus. The effects of the uncertainty in our parameterisations on radiation budget is also investigated. It is found that the uncertainty in the impact of horizontal inhomogeneity is of order ±60%, while the uncertainty in the impact of vertical overlap is much smaller. This suggests an insensitivity of the radiation budget to the exact nature of the global decorrelation height distribution derived in Part One.

Evaluating the ability of a numerical weather prediction model to forecast tracer concentrations during ETEX 2

In this paper the meteorological processes responsible for transporting tracer during the second ETEX (European Tracer EXperiment) release are determined using the UK Met Office Unified Model (UM). The UM predicted distribution of tracer is also compared with observations from the ETEX campaign. The dominant meteorological process is a warm conveyor belt which transports large amounts of tracer away from the surface up to a height of 4 km over a 36 h period. Convection is also an important process, transporting tracer to heights of up to 8 km. Potential sources of error when using an operational numerical weather prediction model to forecast air quality are also investigated. These potential sources of error include model dynamics, model resolution and model physics. In the UM a semi-Lagrangian monotonic advection scheme is used with cubic polynomial interpolation. This can predict unrealistic negative values of tracer which are subsequently set to zero, and hence results in an overprediction of tracer concentrations. In order to conserve mass in the UM tracer simulations it was necessary to include a flux corrected transport method. Model resolution can also affect the accuracy of predicted tracer distributions. Low resolution simulations (50 km grid length) were unable to resolve a change in wind direction observed during ETEX 2, this led to an error in the transport direction and hence an error in tracer distribution. High resolution simulations (12 km grid length) captured the change in wind direction and hence produced a tracer distribution that compared better with the observations. The representation of convective mixing was found to have a large effect on the vertical transport of tracer. Turning off the convective mixing parameterisation in the UM significantly reduced the vertical transport of tracer. Finally, air quality forecasts were found to be sensitive to the timing of synoptic scale features. Errors in the position of the cold front relative to the tracer release location of only 1 h resulted in changes in the predicted tracer concentrations that were of the same order of magnitude as the absolute tracer concentrations.

A new method for evaluating regional air quality forecasts

A Kriging interpolation method is combined with an object-based evaluation measure to assess the ability of the UK Met Office's dispersion and weather prediction models to predict the evolution of a plume of tracer as it was transported across Europe. The object-based evaluation method, SAL, considers aspects of the Structure, Amplitude and Location of the pollutant field. The SAL method is able to quantify errors in the predicted size and shape of the pollutant plume, through the structure component, the over- or under-prediction of the pollutant concentrations, through the amplitude component, and the position of the pollutant plume, through the location component. The quantitative results of the SAL evaluation are similar for both models and close to a subjective visual inspection of the predictions. A negative structure component for both models, throughout the entire 60 hour plume dispersion simulation, indicates that the modelled plumes are too small and/or too peaked compared to the observed plume at all times. The amplitude component for both models is strongly positive at the start of the simulation, indicating that surface concentrations are over-predicted by both models for the first 24 hours, but modelled concentrations are within a factor of 2 of the observations at later times. Finally, for both models, the location component is small for the first 48 hours after the start of the tracer release, indicating that the modelled plumes are situated close to the observed plume early on in the simulation, but this plume location error grows at later times. The SAL methodology has also been used to identify differences in the transport of pollution in the dispersion and weather prediction models. The convection scheme in the weather prediction model is found to transport more pollution vertically out of the boundary layer into the free troposphere than the dispersion model convection scheme resulting in lower pollutant concentrations near the surface and hence a better forecast for this case study.

Baroclinic stationary waves in aquaplanet models

An aquaplanet model is used to study the nature of the highly persistent low-frequency waves that have been observed in models forced by zonally symmetric boundary conditions. Using the Hayashi spectral analysis of the extratropical waves, the authors find that a quasi-stationary wave 5 belongs to a wave packet obeying a well-defined dispersion relation with eastward group velocity. The components of the dispersion relation with k ≥ 5 baroclinically convert eddy available potential energy into eddy kinetic energy, whereas those with k < 5 are baroclinically neutral. In agreement with Green’s model of baroclinic instability, wave 5 is weakly unstable, and the inverse energy cascade, which had been previously proposed as a main forcing for this type of wave, only acts as a positive feedback on its predominantly baroclinic energetics. The quasi-stationary wave is reinforced by a phase lock to an analogous pattern in the tropical convection, which provides further amplification to the wave. It is also found that the Pedlosky bounds on the phase speed of unstable waves provide guidance in explaining the latitudinal structure of the energy conversion, which is shown to be more enhanced where the zonal westerly surface wind is weaker. The wave’s energy is then trapped in the waveguide created by the upper tropospheric jet stream. In agreement with Green’s theory, as the equator-to-pole SST difference is reduced, the stationary marginally stable component shifts toward higher wavenumbers, while wave 5 becomes neutral and westward propagating. Some properties of the aquaplanet quasi-stationary waves are found to be in interesting agreement with a low frequency wave observed by Salby during December–February in the Southern Hemisphere so that this perspective on low frequency variability, apart from its value in terms of basic geophysical fluid dynamics, might be of specific interest for studying the earth’s atmosphere.

Changes of interannual NAO variability in response to greenhouse gases forcing

Observations show that there was change in interannual North Atlantic Oscillation (NAO) variability in the mid-1970s. This change was characterized by an eastward shift of the NAO action centres, a poleward shift of zonal wind anomalies and a downstream extension of climate anomalies associated with the NAO. The NAO interannual variability for the period after the mid-1970s has an annular mode structure that penetrates deeply into the stratosphere, indicating a strengthened relationship between the NAO and the Arctic Oscillation (AO) and strengthened stratosphere-troposphere coupling. In this study we have investigated possible causes of these changes in the NAO by carrying out experiments with an atmospheric GCM. The model is forced either by doubling CO2, or increasing sea surface temperatures (SST), or both. In the case of SST forcing the SST anomaly is derived from a coupled model simulation forced by increasing CO2. Results indicate that SST and CO2 change both force a poleward and eastward shift in the pattern of interannual NAO variability and the associated poleward shift of zonal wind anomalies, similar to the observations. The effect of SST change can be understood in terms of mean changes in the troposphere. The direct effect of CO2 change, in contrast, can not be understood in terms of mean changes in the troposphere. However, there is a significant response in the stratosphere, characterized by a strengthened climatological polar vortex with strongly enhanced interannual variability. In this case, the NAO interannual variability has a strong link with the variability over the North Pacific, as in the annular AO pattern, and is also strongly related to the stratospheric vortex, indicating strengthened stratosphere-troposphere coupling. The similarity of changes in many characteristics of NAO interannual variability between the model response to doubling CO2 and those in observations in the mid-1970s implies that the increase of greenhouse gas concentration in the atmosphere, and the resulting changes in the stratosphere, might have played an important role in the multidecadal change of interannual NAO variability and its associated climate anomalies during the late twentieth century. The weak change in mean westerlies in the troposphere in response to CO2 change implies that enhanced and eastward extended mid-latitude westerlies in the troposphere might not be a necessary condition for the poleward and eastward shift of the NAO action centres in the mid-1970s.

Kinetic energy analysis of the response of the Atlantic meridional overturning circulation to CO2-forced climate change

Atmosphere–ocean general circulation models (AOGCMs) predict a weakening of the Atlantic meridional overturning circulation (AMOC) in response to anthropogenic forcing of climate, but there is a large model uncertainty in the magnitude of the predicted change. The weakening of the AMOC is generally understood to be the result of increased buoyancy input to the north Atlantic in a warmer climate, leading to reduced convection and deep water formation. Consistent with this idea, model analyses have shown empirical relationships between the AMOC and the meridional density gradient, but this link is not direct because the large-scale ocean circulation is essentially geostrophic, making currents and pressure gradients orthogonal. Analysis of the budget of kinetic energy (KE) instead of momentum has the advantage of excluding the dominant geostrophic balance. Diagnosis of the KE balance of the HadCM3 AOGCM and its low-resolution version FAMOUS shows that KE is supplied to the ocean by the wind and dissipated by viscous forces in the global mean of the steady-state control climate, and the circulation does work against the pressure-gradient force, mainly in the Southern Ocean. In the Atlantic Ocean, however, the pressure-gradient force does work on the circulation, especially in the high-latitude regions of deep water formation. During CO2-forced climate change, we demonstrate a very good temporal correlation between the AMOC strength and the rate of KE generation by the pressure-gradient force in 50–70°N of the Atlantic Ocean in each of nine contemporary AOGCMs, supporting a buoyancy-driven interpretation of AMOC changes. To account for this, we describe a conceptual model, which offers an explanation of why AOGCMs with stronger overturning in the control climate tend to have a larger weakening under CO2 increase.

Transport in the low-latitude tropopause zone diagnosed using particle trajectories

Recent literature has described a “transition zone” between the average top of deep convection in the Tropics and the stratosphere. Here transport across this zone is investigated using an offline trajectory model. Particles were advected by the resolved winds from the European Centre for Medium-Range Weather Forecasts reanalyses. For each boreal winter clusters of particles were released in the upper troposphere over the four main regions of tropical deep convection (Indonesia, central Pacific, South America, and Africa). Most particles remain in the troposphere, descending on average for every cluster. The horizontal components of 5-day trajectories are strongly influenced by the El Niño–Southern Oscillation (ENSO), but the Lagrangian average descent does not have a clear ENSO signature. Tropopause crossing locations are first identified by recording events when trajectories from the same release regions cross the World Meteorological Organization lapse rate tropopause. Most crossing events occur 5–15 days after release, and 30-day trajectories are sufficiently long to estimate crossing number densities. In a further two experiments slight excursions across the lapse rate tropopause are differentiated from the drift deeper into the stratosphere by defining the “tropopause zone” as a layer bounded by the average potential temperature of the lapse rate tropopause and the profile temperature minimum. Transport upward across this zone is studied using forward trajectories released from the lower bound and back trajectories arriving at the upper bound. Histograms of particle potential temperature (θ) show marked differences between the transition zone, where there is a slow spread in θ values about a peak that shifts slowly upward, and the troposphere below 350 K. There forward trajectories experience slow radiative cooling interspersed with bursts of convective heating resulting in a well-mixed distribution. In contrast θ histograms for back trajectories arriving in the stratosphere have two distinct peaks just above 300 and 350 K, indicating the sharp change from rapid convective heating in the well-mixed troposphere to slow ascent in the transition zone. Although trajectories slowly cross the tropopause zone throughout the Tropics, all three experiments show that most trajectories reaching the stratosphere from the lower troposphere within 30 days do so over the west Pacific warm pool. This preferred location moves about 30°–50° farther east in an El Niño year (1982/83) and about 30° farther west in a La Niña year (1988/89). These results could have important implications for upper-troposphere–lower-stratosphere pollution and chemistry studies.

The impact of finer-resolution air-sea coupling on the intraseasonal oscillation of the Indian monsoon

The new HadKPP atmosphere–ocean coupled model is described and then used to determine the effects of sub-daily air–sea coupling and fine near-surface ocean vertical resolution on the representation of the Northern Hemisphere summer intra-seasonal oscillation. HadKPP comprises the Hadley Centre atmospheric model coupled to the K Profile Parameterization ocean-boundary-layer model. Four 30-member ensembles were performed that varied in oceanic vertical resolution between 1 m and 10 m and in coupling frequency between 3 h and 24 h. The 10 m, 24 h ensemble exhibited roughly 60% of the observed 30–50 day variability in sea-surface temperatures and rainfall and very weak northward propagation. Enhancing either only the vertical resolution or only the coupling frequency produced modest improvements in variability and only a standing intra-seasonal oscillation. Only the 1 m, 3 h configuration generated organized, northward-propagating convection similar to observations. Sub-daily surface forcing produced stronger upper-ocean temperature anomalies in quadrature with anomalous convection, which likely affected lower-atmospheric stability ahead of the convection, causing propagation. Well-resolved air–sea coupling did not improve the eastward propagation of the boreal summer intra-seasonal oscillation in this model. Upper-ocean vertical mixing and diurnal variability in coupled models must be improved to accurately resolve and simulate tropical sub-seasonal variability. In HadKPP, the mere presence of air–sea coupling was not sufficient to generate an intra-seasonal oscillation resembling observations.

Equatorial waves in opposite QBO phases

A methodology for identifying equatorial waves is used to analyze the multilevel 40-yr ECMWF Re-Analysis (ERA-40) data for two different years (1992 and 1993) to investigate the behavior of the equatorial waves under opposite phases of the quasi-biennial oscillation (QBO). A comprehensive view of 3D structures and of zonal and vertical propagation of equatorial Kelvin, westward-moving mixed Rossby–gravity (WMRG), and n = 1 Rossby (R1) waves in different QBO phases is presented. Consistent with expectation based on theory, upward-propagating Kelvin waves occur more frequently during the easterly QBO phase than during the westerly QBO phase. However, the westward-moving WMRG and R1 waves show the opposite behavior. The presence of vertically propagating equatorial waves in the stratosphere also depends on the upper tropospheric winds and tropospheric forcing. Typical propagation parameters such as the zonal wavenumber, zonal phase speed, period, vertical wavelength, and vertical group velocity are found. In general, waves in the lower stratosphere have a smaller zonal wavenumber, shorter period, faster phase speed, and shorter vertical wavelength than those in the upper troposphere. All of the waves in the lower stratosphere show an upward group velocity and downward phase speed. When the phase of the QBO is not favorable for waves to propagate, their phase speed in the lower stratosphere is larger and their period is shorter than in the favorable phase, suggesting Doppler shifting by the ambient flow and a filtering of the slow waves. Tropospheric WMRG and R1 waves in the Western Hemisphere also show upward phase speed and downward group velocity, with an indication of their forcing from middle latitudes. Although the waves observed in the lower stratosphere are dominated by “free” waves, there is evidence of some connection with previous tropical convection in the favorable year for the Kelvin waves in the warm water hemisphere and WMRG and R1 waves in the Western Hemisphere, which is suggestive of the importance of convective forcing for the existence of propagating coupled Kelvin waves and midlatitude forcing for the existence of coupled WMRG and R1 waves.

A simplified mathematical model for urban microclimate simulation

Techniques for modelling urban microclimates and urban block surfaces temperatures are desired by urban planners and architects for strategic urban designs at the early design stages. This paper introduces a simplified mathematical model for urban simulations (UMsim) including urban surfaces temperatures and microclimates. The nodal network model has been developed by integrating coupled thermal and airflow model. Direct solar radiation, diffuse radiation, reflected radiation, long-wave radiation, heat convection in air and heat transfer in the exterior walls and ground within the complex have been taken into account. The relevant equations have been solved using the finite difference method under the Matlab platform. Comparisons have been conducted between the data produced from the simulation and that from an urban experimental study carried out in a real architectural complex on the campus of Chongqing University, China in July 2005 and January 2006. The results show a satisfactory agreement between the two sets of data. The UMsim can be used to simulate the microclimates, in particular the surface temperatures of urban blocks, therefore it can be used to assess the impact of urban surfaces properties on urban microclimates. The UMsim will be able to produce robust data and images of urban environments for sustainable urban design.

Moisture transport in mid-latitude cyclones

We discuss how synoptic-scale variability controls the transport of atmospheric water vapour by mid-latitude cyclones. Idealised simulations are used to investigate quantitatively what factors determine the magnitude of cyclone moisture transport. It is demonstrated that large-scale ascent on the warmconveyor belt and shallow cumulus convection are equally important for ventilating moisture from the boundary layer into the free troposphere, and that ventilated moisture can be transported large distances eastwards and polewards by the cyclone, before being returned to the surface as precipitation. The initial relative humidity is shown to have little affect on the ability of the cyclone to transport moisture, whilst the absolute temperature and meridional temperature gradient provide much stronger controls. Scaling arguments are presented to quantify the dependence of moisture transport on large-scale and boundary-layer parameters. It is shown that ventilation by shallow convection and warm-conveyor belt advection vary in the same way with changes to large-scale parameters. However, shallow convective ventilation has a much stronger dependence on boundary-layer parameters than warm-conveyor belt ventilation.

A comparison of extreme European daily precipitation simulated by a global and a regional climate model for present and future climates

The intensity and distribution of daily precipitation is predicted to change under scenarios of increased greenhouse gases (GHGs). In this paper, we analyse the ability of HadCM2, a general circulation model (GCM), and a high-resolution regional climate model (RCM), both developed at the Met Office's Hadley Centre, to simulate extreme daily precipitation by reference to observations. A detailed analysis of daily precipitation is made at two UK grid boxes, where probabilities of reaching daily thresholds in the GCM and RCM are compared with observations. We find that the RCM generally overpredicts probabilities of extreme daily precipitation but that, when the GCM and RCM simulated values are scaled to have the same mean as the observations, the RCM captures the upper-tail distribution more realistically. To compare regional changes in daily precipitation in the GHG-forced period 2080-2100 in the GCM and the RCM, we develop two methods. The first considers the fractional changes in probability of local daily precipitation reaching or exceeding a fixed 15 mm threshold in the anomaly climate compared with the control. The second method uses the upper one-percentile of the control at each point as the threshold. Agreement between the models is better in both seasons with the latter method, which we suggest may be more useful when considering larger scale spatial changes. On average, the probability of precipitation exceeding the 1% threshold increases by a factor of 2.5 (GCM and RCM) in winter and by I .7 (GCM) or 1.3 (RCM) in summer.

Changes to Indian Ocean subantarctic mode water in a coupled climate model as CO2 forcing increases

Subantarctic mode water (SAMW) has been shown to be a good indicator of anthropogenic climate change in coupled climate models. SAMW in a coupled climate model and the response of modeled SAMW to increasing CO2 are examined in detail. How SAMW adjusts from climatological values toward a new equilibrium in the coupled model, with different climatological temperature and salinity properties, is shown. The combined formation rate of SAMW and Antarctic intermediate water is calculated as approximately 18 Sv (Sv ≡ 106 m3 s−1) in the Indian sector of the Southern Ocean, slightly lower than climatological values would suggest. When forced with increasing CO2, SAMW is produced at a similar rate but at lower densities. This result suggests that the rate of heat uptake in this part of the ocean will be unchanged by anthropogenic forcing. The important signal in the response of SAMW is the shift to colder and fresher values on isopycnals that is believed to be related to changes in thermodynamic surface forcing. It is shown that, given uniform forcing, SAMW is expected to enhance the signal relative to other water masses. Independent increases in surface heating or freshwater forcing can produce changes similar to those observed, but the two different types of forcing are distinguishable using separate forcing experiments, hodographs, and passive anomaly tracers. The changes in SAMW forced by increasing CO2 are dominated by surface heating, but changes to freshwater fluxes are also important.

A simple relationship between volcanic sulfate aerosol optical depth and surface temperature change simulated in an atmosphere-ocean general circulation model.

In this study we quantify the relationship between the aerosol optical depth increase from a volcanic eruption and the severity of the subsequent surface temperature decrease. This investigation is made by simulating 10 different sizes of eruption in a global circulation model (GCM) by changing stratospheric sulfate aerosol optical depth at each time step. The sizes of the simulated eruptions range from Pinatubo‐sized up to the magnitude of supervolcanic eruptions around 100 times the size of Pinatubo. From these simulations we find that there is a smooth monotonic relationship between the global mean maximum aerosol optical depth anomaly and the global mean temperature anomaly and we derive a simple mathematical expression which fits this relationship well. We also construct similar relationships between global mean aerosol optical depth and the temperature anomaly at every individual model grid box to produce global maps of best‐fit coefficients and fit residuals. These maps are used with caution to find the eruption size at which a local temperature anomaly is clearly distinct from the local natural variability and to approximate the temperature anomalies which the model may simulate following a Tambora‐sized eruption. To our knowledge, this is the first study which quantifies the relationship between aerosol optical depth and resulting temperature anomalies in a simple way, using the wealth of data that is available from GCM simulations.