Improving Multi-class Text Classification with Naive Bayes

There are numerous text documents available in electronic form. More and more are becoming available every day. Such documents represent a massive amount of information that is easily accessible. Seeking value in this huge collection requires organization; much of the work of organizing documents can be automated through text classification. The accuracy and our understanding of such systems greatly influences their usefulness. In this paper, we seek 1) to advance the understanding of commonly used text classification techniques, and 2) through that understanding, improve the tools that are available for text classification. We begin by clarifying the assumptions made in the derivation of Naive Bayes, noting basic properties and proposing ways for its extension and improvement. Next, we investigate the quality of Naive Bayes parameter estimates and their impact on classification. Our analysis leads to a theorem which gives an explanation for the improvements that can be found in multiclass classification with Naive Bayes using Error-Correcting Output Codes. We use experimental evidence on two commonly-used data sets to exhibit an application of the theorem. Finally, we show fundamental flaws in a commonly-used feature selection algorithm and develop a statistics-based framework for text feature selection. Greater understanding of Naive Bayes and the properties of text allows us to make better use of it in text classification.

Una aplicaci??n de la estimaci??n Bayes emp??rica para incrementar la fiabilidad de las puntuaciones parciales

Resumen tomado de la publicaci??n

Empirical Bayes self-test quiz

id 34 additional quiz resource

El planteamiento de problemas y la construcci??n del teorema de Bayes

Resumen basado en el de la publicaci??n

Ense??anza del teorema de Bayes con apoyo tecnol??gico

XII Jornadas de Investigaci??n en el Aula de Matem??ticas : estad??stica y azar, celebradas en Granada, noviembre y diciembre de 2006. Resumen tomado de la publicaci??n

A variational approach for calculating Franck-Condon factors including mode-mode anharmonic coupling

We have implemented our new procedure for computing Franck-Condon factors utilizing vibrational configuration interaction based on a vibrational self-consistent field reference. Both Duschinsky rotations and anharmonic three-mode coupling are taken into account. Simulations of the first ionization band of Cl O2 and C4 H4 O (furan) using up to quadruple excitations in treating anharmonicity are reported and analyzed. A developer version of the MIDASCPP code was employed to obtain the required anharmonic vibrational integrals and transition frequencies

Variational calculation of static and dynamic vibrational nonlinear optical properties

The vibrational configuration interaction method used to obtain static vibrational (hyper)polarizabilities is extended to dynamic nonlinear optical properties in the infinite optical frequency approximation. Illustrative calculations are carried out on H2 O and N H3. The former molecule is weakly anharmonic while the latter contains a strongly anharmonic umbrella mode. The effect on vibrational (hyper)polarizabilities due to various truncations of the potential energy and property surfaces involved in the calculation are examined

Variational calculation of vibrational linear and nonlinear optical properties

A variational approach for reliably calculating vibrational linear and nonlinear optical properties of molecules with large electrical and/or mechanical anharmonicity is introduced. This approach utilizes a self-consistent solution of the vibrational Schrödinger equation for the complete field-dependent potential-energy surface and, then, adds higher-level vibrational correlation corrections as desired. An initial application is made to static properties for three molecules of widely varying anharmonicity using the lowest-level vibrational correlation treatment (i.e., vibrational Møller-Plesset perturbation theory). Our results indicate when the conventional Bishop-Kirtman perturbation method can be expected to break down and when high-level vibrational correlation methods are likely to be required. Future improvements and extensions are discussed

Can wavelets improve the representation of forecast error covariances in variational data assimilation?

Two wavelet-based control variable transform schemes are described and are used to model some important features of forecast error statistics for use in variational data assimilation. The first is a conventional wavelet scheme and the other is an approximation of it. Their ability to capture the position and scale-dependent aspects of covariance structures is tested in a two-dimensional latitude-height context. This is done by comparing the covariance structures implied by the wavelet schemes with those found from the explicit forecast error covariance matrix, and with a non-wavelet- based covariance scheme used currently in an operational assimilation scheme. Qualitatively, the wavelet-based schemes show potential at modeling forecast error statistics well without giving preference to either position or scale-dependent aspects. The degree of spectral representation can be controlled by changing the number of spectral bands in the schemes, and the least number of bands that achieves adequate results is found for the model domain used. Evidence is found of a trade-off between the localization of features in positional and spectral spaces when the number of bands is changed. By examining implied covariance diagnostics, the wavelet-based schemes are found, on the whole, to give results that are closer to diagnostics found from the explicit matrix than from the nonwavelet scheme. Even though the nature of the covariances has the right qualities in spectral space, variances are found to be too low at some wavenumbers and vertical correlation length scales are found to be too long at most scales. The wavelet schemes are found to be good at resolving variations in position and scale-dependent horizontal length scales, although the length scales reproduced are usually too short. The second of the wavelet-based schemes is often found to be better than the first in some important respects, but, unlike the first, it has no exact inverse transform.

Weak constraints in four-dimensional variational data assimilation

The formulation of four-dimensional variational data assimilation allows the incorporation of constraints into the cost function which need only be weakly satisfied. In this paper we investigate the value of imposing conservation properties as weak constraints. Using the example of the two-body problem of celestial mechanics we compare weak constraints based on conservation laws with a constraint on the background state.We show how the imposition of conservation-based weak constraints changes the nature of the gradient equation. Assimilation experiments demonstrate how this can add extra information to the assimilation process, even when the underlying numerical model is conserving.

Four-dimensional variational assimilation of ozone profiles from the Microwave Limb Sounder on the Aura satellite

Ozone profiles from the Microwave Limb Sounder (MLS) onboard the Aura satellite of the NASA's Earth Observing System (EOS) were experimentally added to the European Centre for Medium-range Weather Forecasts (ECMWF) four-dimensional variational (4D-var) data assimilation system of version CY30R1, in which total ozone columns from Scanning Imaging Absorption Spectrometer for Atmospheric CHartographY (SCIAMACHY) onboard the Envisat satellite and partial profiles from the Solar Backscatter Ultraviolet (SBUV/2) instrument onboard the NOAA-16 satellite have been operationally assimilated. As shown by results for the autumn of 2005, additional constraints from MLS data significantly improved the agreement of the analyzed ozone fields with independent observations throughout most of the stratosphere, owing to the daily near-global coverage and good vertical resolution of MLS observations. The largest impacts were seen in the middle and lower stratosphere, where model deficiencies could not be effectively corrected by the operational observations without the additional information on the ozone vertical distribution provided by MLS. Even in the upper stratosphere, where ozone concentrations are mainly determined by rapid chemical processes, dense and vertically resolved MLS data helped reduce the biases related to model deficiencies. These improvements resulted in a more realistic and consistent description of spatial and temporal variations in stratospheric ozone, as demonstrated by cases in the dynamically and chemically active regions. However, combined assimilation of the often discrepant ozone observations might lead to underestimation of tropospheric ozone. In addition, model deficiencies induced large biases in the upper stratosphere in the medium-range (5-day) ozone forecasts.