Support Vector Machines: Training and Applications

The Support Vector Machine (SVM) is a new and very promising classification technique developed by Vapnik and his group at AT&T Bell Labs. This new learning algorithm can be seen as an alternative training technique for Polynomial, Radial Basis Function and Multi-Layer Perceptron classifiers. An interesting property of this approach is that it is an approximate implementation of the Structural Risk Minimization (SRM) induction principle. The derivation of Support Vector Machines, its relationship with SRM, and its geometrical insight, are discussed in this paper. Training a SVM is equivalent to solve a quadratic programming problem with linear and box constraints in a number of variables equal to the number of data points. When the number of data points exceeds few thousands the problem is very challenging, because the quadratic form is completely dense, so the memory needed to store the problem grows with the square of the number of data points. Therefore, training problems arising in some real applications with large data sets are impossible to load into memory, and cannot be solved using standard non-linear constrained optimization algorithms. We present a decomposition algorithm that can be used to train SVM's over large data sets. The main idea behind the decomposition is the iterative solution of sub-problems and the evaluation of, and also establish the stopping criteria for the algorithm. We present previous approaches, as well as results and important details of our implementation of the algorithm using a second-order variant of the Reduced Gradient Method as the solver of the sub-problems. As an application of SVM's, we present preliminary results we obtained applying SVM to the problem of detecting frontal human faces in real images.

Desarrollo de catalizadores en sistemas de reacción avanzados para la producción de hidrógeno a partir de biogás

[ES]En el presente documento se expone el estudio experimental que consiste en la comparación de diferentes catalizadores en sistemas de reacción avanzados, microrreactores, para la producción de hidrógeno a partir de biogás. El hidrógeno es un vector energético que puede emplearse como combustible, y por tanto, un candidato perfecto para sustituir aquellos combustibles provenientes de fuentes fósiles. Este Proyecto de Fin de Grado se ha basado en desarrollar el proceso conocido como tri-reformado de biogás. Esta técnica, al contrario que las técnicas convencionales de producción, presenta numerosas ventajas ya que la materia prima empleada, el biogás, es una fuente de origen renovable. Para llevar a cabo este estudio se han preparado distintos catalizadores, basados todos ellos en platino. La elección de este metal noble es debido a su alto grado de reactividad, especialmente en sistemas de reacción micro-estructurados. Con el objetivo de reducir los costes asociados al propio catalizador, se añadieron, junto con el platino, otros metales más baratos a fin de analizar su idoneidad en el proceso del tri-reformado. Por tanto, partiendo de un catalizador de referencia que contiene un 5% de platino, se prepararon otros catalizadores mantenido constante, en un 5%, la composición de metal total. Estos catalizadores se han denominado de la siguiente manera: 2.5(Pt-Me), siendo Me cada especie metálica diferente. Tras preparar los catalizadores, se llevaron a cabo diferentes experimentos con un reactor convencional de lecho fijo. El objetivo fue establecer unas condiciones de operación tal que asegurasen una adecuada comparación entre catalizadores. De este modo, se realizaron ensayos de actividad catalítica a diferentes temperaturas y velocidades espaciales para someter a los catalizadores a condiciones de operación extremas, bajo las cuales, las diferencias entre catalizadores fueran más notorias. Una vez detalladas las condiciones de operación adecuadas para la comparación de catalizadores, se llevaron a cabo los correspondientes ensayos con los catalizadores impregnados en los sistemas de reacción avanzados, denominados micorreactores. Estos ensayos se basaron en operar a una velocidad espacial constante para estudiar la influencia de la temperatura. Además, se llevaron a cabo ensayos de estabilidad de hasta 110 horas en las condiciones de operación más desfavorables. Por último se compararon las conversiones de CH4 y CO2 y el rendimiento de H2 de todas las formulaciones catalíticas preparadas, y se concluyó que el mejor candidato para el proceso del tri-reformado es el catalizador 2.5(Pt-Pd).

A singular vector perspective of 4DVAR: The spatial structure and evolution of baroclinic weather systems

The extent to which the four-dimensional variational data assimilation (4DVAR) is able to use information about the time evolution of the atmosphere to infer the vertical spatial structure of baroclinic weather systems is investigated. The singular value decomposition (SVD) of the 4DVAR observability matrix is introduced as a novel technique to examine the spatial structure of analysis increments. Specific results are illustrated using 4DVAR analyses and SVD within an idealized 2D Eady model setting. Three different aspects are investigated. The first aspect considers correcting errors that result in normal-mode growth or decay. The results show that 4DVAR performs well at correcting growing errors but not decaying errors. Although it is possible for 4DVAR to correct decaying errors, the assimilation of observations can be detrimental to a forecast because 4DVAR is likely to add growing errors instead of correcting decaying errors. The second aspect shows that the singular values of the observability matrix are a useful tool to identify the optimal spatial and temporal locations for the observations. The results show that the ability to extract the time-evolution information can be maximized by placing the observations far apart in time. The third aspect considers correcting errors that result in nonmodal rapid growth. 4DVAR is able to use the model dynamics to infer some of the vertical structure. However, the specification of the case-dependent background error variances plays a crucial role.

A potential energy surface for the ground state of formaldehyde, H2CO(1A1)

A model potential energy function for the ground state of H2CO has been derived which covers the whole space of the six internal coordinates. This potential reproduces the experimental energy, geometry and quadratic force field of formaldehyde, and dissociates correctly to all possible atom, diatom and triatom fragments. Thus there are good reasons for believing it to be close to the true potential energy surface except in regions where both hydrogen atoms are close to the oxygen. It leads to the prediction that there should be a metastable singlet hydroxycarbene HCOH which has a planar trans structure and an energy of 2•31 eV above that of equilibrium formaldehyde. The reaction path for dissociation into H2 + CO is predicted to pass through a low symmetry transition state with an activation energy of 4•8 eV. Both of these predictions are in good agreement with recently published ab initio calculations.

Gas-solid reactions of single crystals: a study of the reaction of bromine with single crystals of trans-cinnamic acid and a range of its derivatives by infrared and Raman microspectroscopy

Single crystals of trans-cinnamic acid and of a range of derivatives of this compound containing halogen substituents on the aromatic ring have been reacted with 165 Torr pressure of bromine vapour in a sealed desiccator at 20 degrees C for 1 week. Infrared and Raman microspectroscopic examination of the crystals shows that bromination of the aliphatic double bond, but not of the aromatic ring, has occurred. It is demonstrated also that the reaction is truly gas-solid in nature. A time-dependent study of these reactions shows that they do not follow a smooth diffusion-controlled pathway. Rather the reactions appear to be inhomogeneous and to occur at defects within the crystal. The reaction products are seen to flake from the surface of the crystal. It is shown, therefore, that these are not single crystal to single crystal transitions, as have been observed previously for the photodimerisation of trans-cinnamic acid and several of its derivatives. It is shown that there are no by-products of the reaction and that finely ground samples react to form the same products as single crystals.

Spectroscopy of highly excited vibrational states of HCN in its ground electronic state

An experimental technique based on a scheme of vibrationally mediated photodissociation has been developed and applied to the spectroscopic study of highly excited vibrational states in HCN, with energies between 29 000 and 30 000 cm(-1). The technique consists of four sequential steps: in the first one, a high power laser is used to vibrationally excite the sample to an intermediate state, typically (0,0,4), the nu(3) mode being approximately equivalent to the C-H stretching vibration. Then a second laser is used to search for transitions between this intermediate state and highly vibrationally excited states. When one of these transitions is found, HCN molecules are transferred to a highly excited vibrational state. Third, a ultraviolet laser photodissociates the highly excited molecules to produce H and CN radicals in its A (2)Pi electronic state. Finally, a fourth laser (probe) detects the presence of the CN(A) photofragments by means of an A-->B-->X laser induced fluorescence scheme. The spectra obtained with this technique, consisting of several rotationally resolved vibrational bands, have been analyzed. The positions and rotational parameters of the states observed are presented and compared with the results of a state-of-the-art variational calculation. (C) 2004 American Institute of Physics.

Kinetics of the reaction between OH radicals and monochlorodimethylsulphide (CH3SCH2Cl)

The gas-phase rate coefficient for the reaction between OH radicals and CH3SCH2Cl (MCDMS) was determined to be (2.5±1.3)×10−12 cm3 molecule−1 s−1 using the discharge–flow kinetic technique. An estimate of ≈10−10 cm3 molecule−1 s−1 was obtained for the rate coefficient for reaction of Cl with MCDMS. It would appear that the reaction with OH is not the main loss process for CH3SCH2Cl in the marine boundary layer. The possible implications for the MBL of halogen-promoted oxidation of dimethylsulphide are considered.

Temperature-tuned vector phase conjugation in azobenzene dye impregnated polymer films

Near-perfect vector phase conjugation was achieved at 488 nm in a methyl red dye impregnated polymethylmethacrylate film by employing a temperature tuning technique. Using a degenerate four-wave mixing geometry with vertically polarized counterpropagating pump beams, intensity and polarization gratings were written in the dye/polymer system using a vertically or horizontally polarized weak probe beam. Over a limited temperature range, as the sample was heated, the probe reflectivity from the polarization grating dropped but the reflectivity from the intensity grating rose sharply. At a sample temperature of approximately 50°C, the reflectivities of the gratings were measured to be equal and we confirmed that, at this temperature, the measured vector phase conjugate fidelity was very close to unity. We discuss a possible explanation of this effect.

Secondary structure prediction with support vector machines

Motivation: A new method that uses support vector machines (SVMs) to predict protein secondary structure is described and evaluated. The study is designed to develop a reliable prediction method using an alternative technique and to investigate the applicability of SVMs to this type of bioinformatics problem. Methods: Binary SVMs are trained to discriminate between two structural classes. The binary classifiers are combined in several ways to predict multi-class secondary structure. Results: The average three-state prediction accuracy per protein (Q3) is estimated by cross-validation to be 77.07 ± 0.26% with a segment overlap (Sov) score of 73.32 ± 0.39%. The SVM performs similarly to the 'state-of-the-art' PSIPRED prediction method on a non-homologous test set of 121 proteins despite being trained on substantially fewer examples. A simple consensus of the SVM, PSIPRED and PROFsec achieves significantly higher prediction accuracy than the individual methods. Availability: The SVM classifier is available from the authors. Work is in progress to make the method available on-line and to integrate the SVM predictions into the PSIPRED server.

Wind observations above an urban river using a new lidar technique, scintillometry and anemometry

Flow along rivers, an integral part of many cities, might provide a key mechanism for ventilation – which is important for air quality and heat stress. Since the flow varies in space and time around rivers, there is limited utility in point measurements. Ground-based remote sensing offers the opportunity to study 3D flow in locations which are hard to observe. For three months in the winter and spring of 2011, the atmospheric flow above the River Thames in central London was observed using a scanning Doppler lidar, a dual-beam scintillometer and sonic anemometry. First, an inter-comparison showed that lidar-derived mean wind-speed estimates compare almost as well to sonic anemometers (root-mean-square error (rmse) 0.65–0.68 m s–1) as comparisons between sonic anemometers (0.35–0.73 m s–1). Second, the lidar duo-beam scanning strategy provided horizontal transects of wind vectors comparison with scintillometer rmse 1.12–1.63 m s–1) which revealed mean and turbulent flow across the river and surrounds; in particular: chanelling flow along the river and turbulence changes consistent with the roughness changes between built to river environments. The results have important consequences for air quality and dispersion around urban rivers, especially given that many cities have high traffic rates on bankside roads.

Restriction fragment length polymorphism of polymerase chain reaction products applied to the differentiation of poultry campylobacters for epidemiological investigations

A technique for subtyping Camplobacter jejuni isolates has been developed by using the restriction fragment length polymorphism (Rnp) of polymerase chain reaction (PCR) products of the fluA and flaB genes. The technique was validated by using strains representing 28 serotypes of C jejuni and it may also be applied to C coli. From these strains 12 distinct RFLP profiles were observed but there was no direct relationship between the RFLP profile and the serotype. One hundred and thirty-five campylobacter isolates from 15 geographically distinct broiler flocks were investigated. All the isolates could be subtyped by using the RFLP method. Isolates from most of the flocks had a single RFLP profile despite data indicating that several serotypes were involved. Although it is possible that further restriction analysis may have demonstrated profile variations in these strains, it is more likely that antigenic variation can occur within genotypically related campylobacters. As a result, serotyping may give conflicting information for veterinary epidemiological purposes. This RFLP typing scheme appears to provide a suitable tool for the investigation of the sources and routes of transmission of campylobacters in chickens.

One-port de-embedding technique for the quasi-optical characterization of integrated components

We describe a one-port de-embedding technique suitable for the quasi-optical characterization of terahertz integrated components at frequencies beyond the operational range of most vector network analyzers. This technique is also suitable when the manufacturing of precision terminations to sufficiently fine tolerances for the application of a TRL de-embedding technique is not possible. The technique is based on vector reflection measurements of a series of easily realizable test pieces. A theoretical analysis is presented for the precision of the technique when implemented using a quasi-optical null-balanced bridge reflectometer. The analysis takes into account quantization effects in the linear and angular encoders associated with the balancing procedure, as well as source power and detector noise equivalent power. The precision in measuring waveguide characteristic impedance and attenuation using this de-embedding technique is further analyzed after taking into account changes in the power coupled due to axial, rotational, and lateral alignment errors between the device under test and the instruments' test port. The analysis is based on the propagation of errors after assuming imperfect coupling of two fundamental Gaussian beams. The required precision in repositioning the samples at the instruments' test-port is discussed. Quasi-optical measurements using the de-embedding process for a WR-8 adjustable precision short at 125 GHz are presented. The de-embedding methodology may be extended to allow the determination of S-parameters of arbitrary two-port junctions. The measurement technique proposed should prove most useful above 325 GHz where there is a lack of measurement standards.

A high-resolution near-infrared extraterrestrial solar spectrum derived from ground-based Fourier transform spectrometer measurements

A detailed spectrally-resolved extraterrestrial solar spectrum (ESS) is important for line-by-line radiative transfer modeling in the near-infrared (near-IR). Very few observationally-based high-resolution ESS are available in this spectral region. Consequently the theoretically-calculated ESS by Kurucz has been widely adopted. We present the CAVIAR (Continuum Absorption at Visible and Infrared Wavelengths and its Atmospheric Relevance) ESS which is derived using the Langley technique applied to calibrated observations using a ground-based high-resolution Fourier transform spectrometer (FTS) in atmospheric windows from 2000–10000 cm-1 (1–5 μm). There is good agreement between the strengths and positions of solar lines between the CAVIAR and the satellite-based ACE-FTS (Atmospheric Chemistry Experiment-FTS) ESS, in the spectral region where they overlap, and good agreement with other ground-based FTS measurements in two near-IR windows. However there are significant differences in the structure between the CAVIAR ESS and spectra from semi-empirical models. In addition, we found a difference of up to 8 % in the absolute (and hence the wavelength-integrated) irradiance between the CAVIAR ESS and that of Thuillier et al., which was based on measurements from the Atmospheric Laboratory for Applications and Science satellite and other sources. In many spectral regions, this difference is significant, as the coverage factor k = 2 (or 95 % confidence limit) uncertainties in the two sets of observations do not overlap. Since the total solar irradiance is relatively well constrained, if the CAVIAR ESS is correct, then this would indicate an integrated “loss” of solar irradiance of about 30 W m-2 in the near-IR that would have to be compensated by an increase at other wavelengths.

Contrasting the responses of three different ground-based instruments to energetic electron precipitation

In order to make best use of the opportunities provided by space missions such as the Radiation Belt Storm Probes, we determine the response of complementary subionospheric radiowave propagation measurements (VLF), riometer absorption measurements (CNA), and GPS-produced total electron content (vTEC) to different energetic electron precipitation (EEP). We model the relative sensitivity and responses of these instruments to idealised monoenergetic beams of precipitating electrons, and more realistic EEP spectra chosen to represent radiation belts and substorm precipitation. In the monoenergetic beam case, we find riometers are more sensitive to the same EEP event occurring during the day than during the night, while subionospheric VLF shows the opposite relationship, and the change in vTEC is independent. In general, the subionospheric VLF measurements are much more sensitive than the other two techniques for EEP over 200 keV, responding to flux magnitudes two-three orders of magnitude smaller than detectable by a riometer. Detectable TEC changes only occur for extreme monoenergetic fluxes. For the radiation belt EEP case, clearly detectable subionospheric VLF responses are produced by daytime fluxes that are ~10 times lower than required for riometers, while nighttime fluxes can be 10,000 times lower. Riometers are likely to respond only to radiation belt fluxes during the largest EEP events and vTEC is unlikely to be significantly disturbed by radiation belt EEP. For the substorm EEP case both the riometer absorption and the subionospheric VLF technique respond significantly, as does the change in vTEC, which is likely to be detectable at ~3-4 TECu.

Coordinated Cluster and ground-based instrument observations of transient changes in the magnetopause boundary layer during an interval of predominantly northward IMF: relation to reconnection pulses and FTE signatures

We study a series of transient entries into the low-latitude boundary layer (LLBL) of all four Cluster spacecraft during an outbound pass through the mid-afternoon magnetopause ([X(GSM), Y(GSM), Z(GSM)] approximate to [2, 7, 9] R(E)). The events take place during an interval of northward IMF, as seen in the data from the ACE satellite and lagged by a propagation delay of 75 min that is well-defined by two separate studies: (1) the magnetospheric variations prior to the northward turning (Lockwood et al., 2001, this issue) and (2) the field clock angle seen by Cluster after it had emerged into the magnetosheath (Opgenoorth et al., 2001, this issue). With an additional lag of 16.5 min, the transient LLBL events cor-relate well with swings of the IMF clock angle (in GSM) to near 90degrees. Most of this additional lag is explained by ground-based observations, which reveal signatures of transient reconnection in the pre-noon sector that then take 10-15 min to propagate eastward to 15 MLT, where they are observed by Cluster. The eastward phase speed of these signatures agrees very well with the motion deduced by the cross-correlation of the signatures seen on the four Cluster spacecraft. The evidence that these events are reconnection pulses includes: transient erosion of the noon 630 nm (cusp/cleft) aurora to lower latitudes; transient and travelling enhancements of the flow into the polar cap, imaged by the AMIE technique; and poleward-moving events moving into the polar cap, seen by the EISCAT Svalbard Radar (ESR). A pass of the DMSP-F15 satellite reveals that the open field lines near noon have been opened for some time: the more recently opened field lines were found closer to dusk where the flow transient and the poleward-moving event intersected the satellite pass. The events at Cluster have ion and electron characteristics predicted and observed by Lockwood and Hapgood (1998) for a Flux Transfer Event (FTE), with allowance for magnetospheric ion reflection at Alfvenic disturbances in the magnetopause reconnection layer. Like FTEs, the events are about 1 R(E) in their direction of motion and show a rise in the magnetic field strength, but unlike FTEs, in general, they show no pressure excess in their core and hence, no characteristic bipolar signature in the boundary-normal component. However, most of the events were observed when the magnetic field was southward, i.e. on the edge of the interior magnetic cusp, or when the field was parallel to the magnetic equatorial plane. Only when the satellite begins to emerge from the exterior boundary (when the field was northward), do the events start to show a pressure excess in their core and the consequent bipolar signature. We identify the events as the first observations of FTEs at middle altitudes.