Improving Multi-class Text Classification with Naive Bayes

There are numerous text documents available in electronic form. More and more are becoming available every day. Such documents represent a massive amount of information that is easily accessible. Seeking value in this huge collection requires organization; much of the work of organizing documents can be automated through text classification. The accuracy and our understanding of such systems greatly influences their usefulness. In this paper, we seek 1) to advance the understanding of commonly used text classification techniques, and 2) through that understanding, improve the tools that are available for text classification. We begin by clarifying the assumptions made in the derivation of Naive Bayes, noting basic properties and proposing ways for its extension and improvement. Next, we investigate the quality of Naive Bayes parameter estimates and their impact on classification. Our analysis leads to a theorem which gives an explanation for the improvements that can be found in multiclass classification with Naive Bayes using Error-Correcting Output Codes. We use experimental evidence on two commonly-used data sets to exhibit an application of the theorem. Finally, we show fundamental flaws in a commonly-used feature selection algorithm and develop a statistics-based framework for text feature selection. Greater understanding of Naive Bayes and the properties of text allows us to make better use of it in text classification.

Sparse Correlation Kernel Analysis and Reconstruction

This paper presents a new paradigm for signal reconstruction and superresolution, Correlation Kernel Analysis (CKA), that is based on the selection of a sparse set of bases from a large dictionary of class- specific basis functions. The basis functions that we use are the correlation functions of the class of signals we are analyzing. To choose the appropriate features from this large dictionary, we use Support Vector Machine (SVM) regression and compare this to traditional Principal Component Analysis (PCA) for the tasks of signal reconstruction, superresolution, and compression. The testbed we use in this paper is a set of images of pedestrians. This paper also presents results of experiments in which we use a dictionary of multiscale basis functions and then use Basis Pursuit De-Noising to obtain a sparse, multiscale approximation of a signal. The results are analyzed and we conclude that 1) when used with a sparse representation technique, the correlation function is an effective kernel for image reconstruction and superresolution, 2) for image compression, PCA and SVM have different tradeoffs, depending on the particular metric that is used to evaluate the results, 3) in sparse representation techniques, L_1 is not a good proxy for the true measure of sparsity, L_0, and 4) the L_epsilon norm may be a better error metric for image reconstruction and compression than the L_2 norm, though the exact psychophysical metric should take into account high order structure in images.

TU Graz: Course: 707.000 Web Science and Web Technology: Lecture 7: Link Analysis and Search

What are ways of searching in graphs? In this class, we will discuss basics of link analysis, including Google's PageRank algorithm as an example. Readings: The PageRank Citation Ranking: Bringing Order to the Web, L. Page and S. Brin and R. Motwani and T. Winograd (1998) Stanford Tecnical Report

COMP6043 Analysis of Textual Data

Class exercise to analyse qualitative data mediated on use of a set of transcripts, augmented by videos from web site. Discussion is around not only how the data is codes, interview bias, dimensions of analysis. Designed as an introduction.

COMP6049 Quantitative analysis

notes for class discussion and exercise

SOES3010/6005 - Scaling analysis (Week 1, end of lecture)

This is the end of the scaling analysis we saw in class on Friday. In class, we managed to scale the mass conservation equation and the x-momentum equation, but we didn't finish scaling the z-momentum equation in order to arrive at the hydrostatic approximation.

3D Analysis of the TCR/pMHCII Complex Formation in Monkeys Vaccinated with the First Peptide Inducing Sterilizing Immunity against Human Malaria

T-cell receptor gene rearrangements were studied in Aotus monkeys developing high antibody titers and sterilizing immunity against the Plasmodium falciparum malaria parasite upon vaccination with the modified synthetic peptide 24112, which was identified in the Merozoite Surface Protein 2 (MSP-2) and is known to bind to HLA-DR beta 1*0403 molecules with high capacity. Spectratyping analysis showed a preferential usage of V beta 12 and V beta 6 TCR gene families in 67% of HLA-DR beta 1*0403-like genotyped monkeys. Docking of peptide 24112 into the HLA-DR beta 1*0401-HA peptide-HA1.7TCR complex containing the VDJ rearrangements identified in fully protected monkeys showed a different structural signature compared to nonprotected monkeys. These striking results show the exquisite specificity of the TCR/pMHCII complex formation needed for inducing sterilizing immunity and provide important hints for a logical and rational methodology to develop multiepitopic, minimal subunit-based synthetic vaccines against infectious diseases, among them malaria.

Modelling, control and supervision for a class of hybrid systems

The aim of this thesis is to narrow the gap between two different control techniques: the continuous control and the discrete event control techniques DES. This gap can be reduced by the study of Hybrid systems, and by interpreting as Hybrid systems the majority of large-scale systems. In particular, when looking deeply into a process, it is often possible to identify interaction between discrete and continuous signals. Hybrid systems are systems that have both continuous, and discrete signals. Continuous signals are generally supposed continuous and differentiable in time, since discrete signals are neither continuous nor differentiable in time due to their abrupt changes in time. Continuous signals often represent the measure of natural physical magnitudes such as temperature, pressure etc. The discrete signals are normally artificial signals, operated by human artefacts as current, voltage, light etc. Typical processes modelled as Hybrid systems are production systems, chemical process, or continuos production when time and continuous measures interacts with the transport, and stock inventory system. Complex systems as manufacturing lines are hybrid in a global sense. They can be decomposed into several subsystems, and their links. Another motivation for the study of Hybrid systems is the tools developed by other research domains. These tools benefit from the use of temporal logic for the analysis of several properties of Hybrid systems model, and use it to design systems and controllers, which satisfies physical or imposed restrictions. This thesis is focused in particular types of systems with discrete and continuous signals in interaction. That can be modelled hard non-linealities, such as hysteresis, jumps in the state, limit cycles, etc. and their possible non-deterministic future behaviour expressed by an interpretable model description. The Hybrid systems treated in this work are systems with several discrete states, always less than thirty states (it can arrive to NP hard problem), and continuous dynamics evolving with expression: with Ki ¡ Rn constant vectors or matrices for X components vector. In several states the continuous evolution can be several of them Ki = 0. In this formulation, the mathematics can express Time invariant linear system. By the use of this expression for a local part, the combination of several local linear models is possible to represent non-linear systems. And with the interaction with discrete events of the system the model can compose non-linear Hybrid systems. Especially multistage processes with high continuous dynamics are well represented by the proposed methodology. Sate vectors with more than two components, as third order models or higher is well approximated by the proposed approximation. Flexible belt transmission, chemical reactions with initial start-up and mobile robots with important friction are several physical systems, which profits from the benefits of proposed methodology (accuracy). The motivation of this thesis is to obtain a solution that can control and drive the Hybrid systems from the origin or starting point to the goal. How to obtain this solution, and which is the best solution in terms of one cost function subject to the physical restrictions and control actions is analysed. Hybrid systems that have several possible states, different ways to drive the system to the goal and different continuous control signals are problems that motivate this research. The requirements of the system on which we work is: a model that can represent the behaviour of the non-linear systems, and that possibilities the prediction of possible future behaviour for the model, in order to apply an supervisor which decides the optimal and secure action to drive the system toward the goal. Specific problems can be determined by the use of this kind of hybrid models are: - The unity of order. - Control the system along a reachable path. - Control the system in a safe path. - Optimise the cost function. - Modularity of control The proposed model solves the specified problems in the switching models problem, the initial condition calculus and the unity of the order models. Continuous and discrete phenomena are represented in Linear hybrid models, defined with defined eighth-tuple parameters to model different types of hybrid phenomena. Applying a transformation over the state vector : for LTI system we obtain from a two-dimensional SS a single parameter, alpha, which still maintains the dynamical information. Combining this parameter with the system output, a complete description of the system is obtained in a form of a graph in polar representation. Using Tagaki-Sugeno type III is a fuzzy model which include linear time invariant LTI models for each local model, the fuzzyfication of different LTI local model gives as a result a non-linear time invariant model. In our case the output and the alpha measure govern the membership function. Hybrid systems control is a huge task, the processes need to be guided from the Starting point to the desired End point, passing a through of different specific states and points in the trajectory. The system can be structured in different levels of abstraction and the control in three layers for the Hybrid systems from planning the process to produce the actions, these are the planning, the process and control layer. In this case the algorithms will be applied to robotics ¡V a domain where improvements are well accepted ¡V it is expected to find a simple repetitive processes for which the extra effort in complexity can be compensated by some cost reductions. It may be also interesting to implement some control optimisation to processes such as fuel injection, DC-DC converters etc. In order to apply the RW theory of discrete event systems on a Hybrid system, we must abstract the continuous signals and to project the events generated for these signals, to obtain new sets of observable and controllable events. Ramadge & Wonham¡¦s theory along with the TCT software give a Controllable Sublanguage of the legal language generated for a Discrete Event System (DES). Continuous abstraction transforms predicates over continuous variables into controllable or uncontrollable events, and modifies the set of uncontrollable, controllable observable and unobservable events. Continuous signals produce into the system virtual events, when this crosses the bound limits. If this event is deterministic, they can be projected. It is necessary to determine the controllability of this event, in order to assign this to the corresponding set, , controllable, uncontrollable, observable and unobservable set of events. Find optimal trajectories in order to minimise some cost function is the goal of the modelling procedure. Mathematical model for the system allows the user to apply mathematical techniques over this expression. These possibilities are, to minimise a specific cost function, to obtain optimal controllers and to approximate a specific trajectory. The combination of the Dynamic Programming with Bellman Principle of optimality, give us the procedure to solve the minimum time trajectory for Hybrid systems. The problem is greater when there exists interaction between adjacent states. In Hybrid systems the problem is to determine the partial set points to be applied at the local models. Optimal controller can be implemented in each local model in order to assure the minimisation of the local costs. The solution of this problem needs to give us the trajectory to follow the system. Trajectory marked by a set of set points to force the system to passing over them. Several ways are possible to drive the system from the Starting point Xi to the End point Xf. Different ways are interesting in: dynamic sense, minimum states, approximation at set points, etc. These ways need to be safe and viable and RchW. And only one of them must to be applied, normally the best, which minimises the proposed cost function. A Reachable Way, this means the controllable way and safe, will be evaluated in order to obtain which one minimises the cost function. Contribution of this work is a complete framework to work with the majority Hybrid systems, the procedures to model, control and supervise are defined and explained and its use is demonstrated. Also explained is the procedure to model the systems to be analysed for automatic verification. Great improvements were obtained by using this methodology in comparison to using other piecewise linear approximations. It is demonstrated in particular cases this methodology can provide best approximation. The most important contribution of this work, is the Alpha approximation for non-linear systems with high dynamics While this kind of process is not typical, but in this case the Alpha approximation is the best linear approximation to use, and give a compact representation.

Sufficiency of Favard's condition for a class of band-dominated operators on the axis

The purpose of this paper is to show that, for a large class of band-dominated operators on $\ell^\infty(Z,U)$, with $U$ being a complex Banach space, the injectivity of all limit operators of $A$ already implies their invertibility and the uniform boundedness of their inverses. The latter property is known to be equivalent to the invertibility at infinity of $A$, which, on the other hand, is often equivalent to the Fredholmness of $A$. As a consequence, for operators $A$ in the Wiener algebra, we can characterize the essential spectrum of $A$ on $\ell^p(Z,U)$, regardless of $p\in[1,\infty]$, as the union of point spectra of its limit operators considered as acting on $\ell^p(Z,U)$.

Biodegradation of the herbicide mecoprop-p with soil depth and its relationship with class III tfdA genes

Mecoprop-p [(R)-2-(4-chloro-2-methylphenoxy) propanoic acid) is widely used in agriculture and poses an environmental concern because of its susceptibility to leach from soil to water. We investigated the effect of soil depth on mecoprop-p biodegradation and its relationship with the number and diversity of tfdA related genes, which are the most widely known genes involved in degradation of the phenoxyalkanoic acid group of herbicides by bacteria. Mecoprop-p half-life (DT50) was approximately 12 days in soil sampled from <30 cm depth, and increased progressively with soil depth, reaching over 84 days at 70–80 cm. In sub-soil there was a lag period of between 23 and 34 days prior to a phase of rapid degradation. No lag phase occurred in top-soil samples prior to the onset of degradation. The maximum degradation rate was the same in top-soil and sub-soil samples. Although diverse tfdAα and tfdA genes were present prior to mecoprop-p degradation, real time PCR revealed that degradation was associated with proliferation of tfdA genes. The number of tfdA genes and the most probable number of mecoprop-p degrading organisms in soil prior to mecoprop-p addition were below the limit of quantification and detection respectively. Melting curves from the real time PCR analysis showed that prior to mecoprop-p degradation both class I and class III tfdA genes were present in top- and sub-soil samples. However at all soil depths only tfdA class III genes proliferated during degradation. Denaturing gradient gel electrophoresis confirmed that class III tfdA genes were associated with mecoprop-p degradation. Degradation was not associated with the induction of novel tfdA genes in top- or sub-soil samples, and there were no apparent differences in tfdA gene diversity with soil depth prior to or following degradation.

"The past is still right here in the present": second-generation Bajan-Brit transnational migrants' views on issues relating to race and colour class

This paper deals with second-generation Barbadians or 'Bajan-Brits', who have decided to,return' to the birthplace of their parents, focusing on their reactions to matters relating to race relations and racialised identities. The importance of race and the operation of the 'colour-class' system in the Caribbean are established at the outset. Based on fifty-two qualitative in-depth interviews, the paper initially considers the positive things that the second-generation migrants report about living in a majority black country and the salience of such racial affirmation as part of their migration process. The paper then presents an analysis of the narratives provided by the Bajan-Brits concerning their reactions to issues relating to race relations in Barbadian society. The impressions of the young returnees provide clear commentaries on what are regarded as (i) the 'acceptance of white hegemony' within Barbadian society, (ii) the occurrence of de facto 'racial segregation, (iii) perceptions of the 'existence of apartheid, and (iv) 'the continuation of slavery'. The account then turns to the contemporary operation of the colour-class system. It is concluded that, despite academic arguments that the colour-class dimension has to be put to one side as the principal dimension of social stratification in the contemporary Caribbean, the second-generation migrants are acutely aware of the continued existence and salience of such gradations within society. Thus, the analysis not only serves to emphasise the continued importance of racial-based stratification in the contemporary Caribbean, but also speaks of the 'hybrid' and 'in-between' racialised identities of the second-generation migrants.

"Racism in a Melting Pot...?" Trinidadian mid-life transnational migrants' views on race and colour-class on return to their homes of descent

This paper deals with second-generation, one-and-a-half generation and ‘‘prolonged sojourner” Trinidadian transnational migrants, who have decided to ‘return’ to the birthplace of their parents. Based on 40 in-depth interviews, the paper considers both the positive and critical things that these youthful transnational migrants report about returning to, and living in, this multi-ethnic plural society and the salience of racial and colour-class stratification as part of their return migration experiences. Our qualitative analysis is based on the narratives provided by these youthful returnees, as relayed ‘‘in their own words”, presenting critical reflections on racism, racial identities and experiences as transnational Trinidadians. It is clear that it is contexts such as contemporary working environments, family and community that act as the reference points for the adaptation ‘‘back home” of this strongly middle-class cohort. We accordingly encounter a diverse, sometimes contesting set of racial issues that emerge as salient concerns for these returnees. The consensus is that matters racial remain as formidable legacies in the hierarchical stratification of Trinidadian society for a sizeable number. Many of our respondents reported the positive aspects of racial affirmation on return. But for another sub-set, the fact that multi-ethnic and multi-cultural mixing are proudly embraced in Trinidad meant that it was felt that return experiences were not overly hindered, or blighted by obstacles of race and colour-class. For these returnees, Trinidad and Tobago is seen as representing a 21st century ‘‘Melting Pot”. But for others the continued existence of racial divisions within society – between ethnic groups and among those of different skin shades – was lamented. In the views of these respondents, too much racial power is still ascribed to ‘near-whiteness’. But for the most part, the returnees felt that where race played a part in their new lives, this generally served to advantage them. However, although the situation in Trinidad appears to have been moderated by assumptions that it remains a racial ‘Melting Pot’, the analysis strongly suggests that the colour-class system of stratification is still playing an essential role, along with racial stereotyping in society at large.

Predicting feed quality - chemical analysis and in vitro evaluation

As the ideal method of assessing the nutritive value of a feedstuff, namely offering it to the appropriate class of animal and recording the production response obtained, is neither practical nor cost effective a range of feed evaluation techniques have been developed. Each of these balances some degree of compromise with the practical situation against data generation. However, due to the impact of animal-feed interactions over and above that of feed composition, the target animal remains the ultimate arbitrator of nutritional value. In this review current in vitro feed evaluation techniques are examined according to the degree of animal-feed interaction. Chemical analysis provides absolute values and therefore differs from the majority of in vitro methods that simply rank feeds. However, with no host animal involvement, estimates of nutritional value are inferred by statistical association. In addition given the costs involved, the practical value of many analyses conducted should be reviewed. The in sacco technique has made a substantial contribution to both understanding rumen microbial degradative processes and the rapid evaluation of feeds, especially in developing countries. However, the numerous shortfalls of the technique, common to many in vitro methods, the desire to eliminate the use of surgically modified animals for routine feed evaluation, paralleled with improvements in in vitro techniques, will see this technique increasingly replaced. The majority of in vitro systems use substrate disappearance to assess degradation, however, this provides no information regarding the quantity of derived end-products available to the host animal. As measurement of volatile fatty acids or microbial biomass production greatly increases analytical costs, fermentation gas release, a simple and non-destructive measurement, has been used as an alternative. However, as gas release alone is of little use, gas-based systems, where both degradation and fermentation gas release are measured simultaneously, are attracting considerable interest. Alternative microbial inocula are being considered, as is the potential of using multi-enzyme systems to examine degradation dynamics. It is concluded that while chemical analysis will continue to form an indispensable part of feed evaluation, enhanced use will be made of increasingly complex in vitro systems. It is vital, however, the function and limitations of each methodology are fully understood and that the temptation to over-interpret the data is avoided so as to draw the appropriate conclusions. With careful selection and correct application in vitro systems offer powerful research tools with which to evaluate feedstuffs. (C) 2003 Elsevier B.V. All rights reserved.

Comparative expression analysis of transcription factor genes in the endostyle of invertebrate chordates

The endostyle of invertebrate chordates is a pharyngeal organ that is thought to be homologous with the follicular thyroid of vertebrates. Although thyroid-like features such as iodine-concentrating and peroxidase activities are located in the dorsolateral part of both ascidian and amphioxus endostyles, the structural organization and numbers of functional units are different. To estimate phylogenetic relationships of each functional zone with special reference to the evolution of the thyroid, we have investigated, in ascidian and amphioxus, the expression patterns of thyroid-related transcription factors such as TTF-2/MoxE4 and Pax2/5/8, as well as the forkhead transcription factors FoxQ1 and FoxA. Comparative gene expression analyses depicted an overall similarity between ascidians and amphioxus endostyles, while differences in expression patterns of these genes might be specifically related to the addition or elimination of a pair of glandular zones. Expressions of Ci-FoxE and BbFoxE4 suggest that the ancestral FoxE class might have been recruited for the formation of thyroid-like region in a possible common ancestor of chordates. Furthermore, coexpression of FoxE4, Pax2/5/8, and TPO in the dorsolateral part of both ascidian and amphioxus endostyles suggests that genetic basis of the thyroid function was already in place before the vertebrate lineage. (c) 2005 Wiley-Liss, Inc.

Chromosomal mapping of ANTP class homeobox genes in amphioxus: piecing together ancestral genomes

Homeobox genes encode DNA-binding proteins, many of which are implicated in the control of embryonic development. Evolutionarily, most homeobox genes fall into two related clades: the ANTP and the PRD classes. Some genes in ANTP class, notably Hox, ParaHox, and NK genes, have an intriguing arrangement into physical clusters. To investigate the evolutionary history of these gene clusters, we examined homeobox gene chromosomal locations in the cephalochordate amphioxus, Branchiostoma floridae. We deduce that 22 amphioxus ANTP class homeobox genes localize in just three chromosomes. One contains the Hox cluster plus AmphiEn, AmphiMnx, and AmphiDll. The ParaHox cluster resides in another chromosome, whereas a third chromosome contains the NK type homeobox genes, including AmphiMsx and ArnphiTlx. By comparative analysis we infer that clustering of ANTP class homeobox genes evolved just once, during a series of extensive cis-duplication events of genes early in animal evolution. A trans-duplication event occurred later to yield the Hox and ParaHox gene clusters on different chromosomes. The results obtained have implications for understanding the origin of homeobox gene clustering, the diversification of the ANTP class of homeobox genes, and the evolution of animal genomes.