Text Classification and Indexing in IP Networks

Internet on elektronisen postin perusrakenne ja ollut tärkeä tiedonlähde akateemisille käyttäjille jo pitkään. Siitä on tullut merkittävä tietolähde kaupallisille yrityksille niiden pyrkiessä pitämään yhteyttä asiakkaisiinsa ja seuraamaan kilpailijoitansa. WWW:n kasvu sekä määrällisesti että sen moninaisuus on luonut kasvavan kysynnän kehittyneille tiedonhallintapalveluille. Tällaisia palveluja ovet ryhmittely ja luokittelu, tiedon löytäminen ja suodattaminen sekä lähteiden käytön personointi ja seuranta. Vaikka WWW:stä saatavan tieteellisen ja kaupallisesti arvokkaan tiedon määrä on huomattavasti kasvanut viime vuosina sen etsiminen ja löytyminen on edelleen tavanomaisen Internet hakukoneen varassa. Tietojen hakuun kohdistuvien kasvavien ja muuttuvien tarpeiden tyydyttämisestä on tullut monimutkainen tehtävä Internet hakukoneille. Luokittelu ja indeksointi ovat merkittävä osa luotettavan ja täsmällisen tiedon etsimisessä ja löytämisessä. Tämä diplomityö esittelee luokittelussa ja indeksoinnissa käytettävät yleisimmät menetelmät ja niitä käyttäviä sovelluksia ja projekteja, joissa tiedon hakuun liittyvät ongelmat on pyritty ratkaisemaan.

ICA as a preprocessing technique for classification

In this paper we propose the use of the independent component analysis (ICA) [1] technique for improving the classification rate of decision trees and multilayer perceptrons [2], [3]. The use of an ICA for the preprocessing stage, makes the structure of both classifiers simpler, and therefore improves the generalization properties. The hypothesis behind the proposed preprocessing is that an ICA analysis will transform the feature space into a space where the components are independent, and aligned to the axes and therefore will be more adapted to the way that a decision tree is constructed. Also the inference of the weights of a multilayer perceptron will be much easier because the gradient search in the weight space will follow independent trajectories. The result is that classifiers are less complex and on some databases the error rate is lower. This idea is also applicable to regression

Feature Selection, Ranking of Each Feature and Classification for the Diagnosis of Community Acquired Legionella Pneumonia

Diagnosis of community acquired legionella pneumonia (CALP) is currently performed by means of laboratory techniques which may delay diagnosis several hours. To determine whether ANN can categorize CALP and non-legionella community-acquired pneumonia (NLCAP) and be standard for use by clinicians, we prospectively studied 203 patients with community-acquired pneumonia (CAP) diagnosed by laboratory tests. Twenty one clinical and analytical variables were recorded to train a neural net with two classes (LCAP or NLCAP class). In this paper we deal with the problem of diagnosis, feature selection, and ranking of the features as a function of their classification importance, and the design of a classifier the criteria of maximizing the ROC (Receiving operating characteristics) area, which gives a good trade-off between true positives and false negatives. In order to guarantee the validity of the statistics; the train-validation-test databases were rotated by the jackknife technique, and a multistarting procedure was done in order to make the system insensitive to local maxima.

Agricultural land use and human presence around breeding sites increase stress-hormone levels and decrease body mass in barn owl nestlings.

Human activities can have a suite of positive and negative effects on animals and thus can affect various life history parameters. Human presence and agricultural practice can be perceived as stressors to which animals react with the secretion of glucocorticoids. The acute short-term secretion of glucocorticoids is considered beneficial and helps an animal to redirect energy and behaviour to cope with a critical situation. However, a long-term increase of glucocorticoids can impair e.g. growth and immune functions. We investigated how nestling barn owls (Tyto alba) are affected by the surrounding landscape and by human activities around their nest sites. We studied these effects on two response levels: (a) the physiological level of the hypothalamus-pituitary-adrenal axis, represented by baseline concentrations of corticosterone and the concentration attained by a standardized stressor; (b) fitness parameters: growth of the nestlings and breeding performance. Nestlings growing up in intensively cultivated areas showed increased baseline corticosterone levels late in the season and had an increased corticosterone release after a stressful event, while their body mass was decreased. Nestlings experiencing frequent anthropogenic disturbance had elevated baseline corticosterone levels, an increased corticosterone stress response and a lower body mass. Finally, breeding performance was better in structurally more diverse landscapes. In conclusion, anthropogenic disturbance affects offspring quality rather than quantity, whereas agricultural practices affect both life history traits.

A definition and classification of status epilepticus - Report of the ILAE Task Force on Classification of Status Epilepticus.

The Commission on Classification and Terminology and the Commission on Epidemiology of the International League Against Epilepsy (ILAE) have charged a Task Force to revise concepts, definition, and classification of status epilepticus (SE). The proposed new definition of SE is as follows: Status epilepticus is a condition resulting either from the failure of the mechanisms responsible for seizure termination or from the initiation of mechanisms, which lead to abnormally, prolonged seizures (after time point t1 ). It is a condition, which can have long-term consequences (after time point t2 ), including neuronal death, neuronal injury, and alteration of neuronal networks, depending on the type and duration of seizures. This definition is conceptual, with two operational dimensions: the first is the length of the seizure and the time point (t1 ) beyond which the seizure should be regarded as "continuous seizure activity." The second time point (t2 ) is the time of ongoing seizure activity after which there is a risk of long-term consequences. In the case of convulsive (tonic-clonic) SE, both time points (t1 at 5 min and t2 at 30 min) are based on animal experiments and clinical research. This evidence is incomplete, and there is furthermore considerable variation, so these time points should be considered as the best estimates currently available. Data are not yet available for other forms of SE, but as knowledge and understanding increase, time points can be defined for specific forms of SE based on scientific evidence and incorporated into the definition, without changing the underlying concepts. A new diagnostic classification system of SE is proposed, which will provide a framework for clinical diagnosis, investigation, and therapeutic approaches for each patient. There are four axes: (1) semiology; (2) etiology; (3) electroencephalography (EEG) correlates; and (4) age. Axis 1 (semiology) lists different forms of SE divided into those with prominent motor systems, those without prominent motor systems, and currently indeterminate conditions (such as acute confusional states with epileptiform EEG patterns). Axis 2 (etiology) is divided into subcategories of known and unknown causes. Axis 3 (EEG correlates) adopts the latest recommendations by consensus panels to use the following descriptors for the EEG: name of pattern, morphology, location, time-related features, modulation, and effect of intervention. Finally, axis 4 divides age groups into neonatal, infancy, childhood, adolescent and adulthood, and elderly.

Preoperative assessment and classification of benign laryngotracheal stenosis: a consensus paper of the European Laryngological Society.

Adult and pediatric laryngotracheal stenoses (LTS) comprise a wide array of various conditions that require precise preoperative assessment and classification to improve comparison of different therapeutic modalities in a matched series of patients. This consensus paper of the European Laryngological Society proposes a five-step endoscopic airway assessment and a standardized reporting system to better differentiate fresh, incipient from mature, cicatricial LTSs, simple one-level from complex multilevel LTSs and finally "healthy" from "severely morbid" patients. The proposed scoring system, which integrates all of these parameters, may be used to help define different groups of LTS patients, choose the best treatment modality for each individual patient and assess distinct post-treatment outcomes accordingly.

Classification and inventory management of abnormal demand items

The main objective of the study is to form a framework that provides tools to recognise and classify items whose demand is not smooth but varies highly on size and/or frequency. The framework will then be combined with two other classification methods in order to form a three-dimensional classification model. Forecasting and inventory control of these abnormal demand items is difficult. Therefore another object of this study is to find out which statistical forecasting method is most suitable for forecasting of abnormal demand items. The accuracy of different methods is measured by comparing the forecast to the actual demand. Moreover, the study also aims at finding proper alternatives to the inventory control of abnormal demand items. The study is quantitative and the methodology is a case study. The research methods consist of theory, numerical data, current state analysis and testing of the framework in case company. The results of the study show that the framework makes it possible to recognise and classify the abnormal demand items. It is also noticed that the inventory performance of abnormal demand items differs significantly from the performance of smoothly demanded items. This makes the recognition of abnormal demand items very important.

The fossil crown wasp Electrostephanus petiolatus Brues in Baltic Amber (Hymenoptera, Stephanidae): designation of a neotype, revised classification,and a key to amber Stephanidae.

The fossil crown wasp Electrostephanus petiolatus Brues comb. rev.(Stephanidae, Electrostephaninae) is re-described from a single male preserved in middle Eocene Baltic Amber. The holotype was lost or destroyed around the time of World War II and subsequent interpretations of its identity have been based solely on the brief descriptive comments provided by Brues in his original account. The new specimen matches the original description and illustration provided by Brues in every detail and we hereby consider them to be conspecific, selecting the specimen as a neotype for the purpose of stabilizing the nomenclature for this fossil species. This neotype exhibits a free first metasomal tergum and sternum, contrary to the assertion of previous workers who indicated these to be fused. Accordingly, this species does indeed belong to the genus Electrostephanus Brues rather than to Denaeostephanus Engel & Grimaldi (Stephaninae). Electrostephanus petiolatus is transferred to a new subgenus, Electrostephanodes n. subgen. , based on its elongate pseudo- petiole and slender gaster, but may eventually warrant generic status as the phylogenetic placement of these fossil lineages continues to be clarifi ed. A revised key to the Baltic amber crown wasps is provided.

Soil quality assessment through a multi-approach analysis in soils of abandoned terraced land in NE Spain

The abandonment of agricultural land in mountainous areas has been an outstanding problem along the last century and has captured the attention of scientists, technicians and administrations, for the dramatic consequences sometimes occurred due to soil instability, steep slopes, rainfall regimes and wildfires. Hidromorfological and pedological alterations causing exceptional floods and accelerated erosion processes has therefore been studied, identifying the cause in the loss of landscape heterogeneity. Through the disappearance of agricultural works and drainage maintenance, slope stability has resulted severely affected. The mechanization of agriculture has caused the displacement of vines, olives and corks trees cultivation in terraced areas along the Mediterranean catchment towards more economically suitable areas. On the one hand, land use and management changes have implicated sociological changes as well, transforming areas inhabited by agricultural communities into deserted areas where the colonization of disorganized spontaneous vegetation has buried a valuable rural patrimony. On the other hand, lacking of planning and management of the abandoned areas has produced badlands and infertile soils due to wildfire and high erosion rates strongly degrading the whole ecosystems. In other cases, after land abandonment a process of soil regeneration has been recorded. Investigations have been conducted in a part of NE Spain where extended areas of terraced soils previously cultivated have been abandoned in the last century. The selected environments were semi-abandoned vineyards, semi-abandoned olive groves, abandoned stands of cork trees, abandoned stands of pine trees, scrubland of Cistaceaea, scrubland of Ericaceaea, and pasture. The research work was focused on the study of most relevant physical, chemical and biological soil properties, as well as runoff and erosion under soils with different plant cover to establish the abandonment effect on soil quality, due to the peculiarity and vulnerability of these soils with a much reduced depth. The period of observation was carried out from autumn 2009 to autumn 2010. The sediment concentration of soil erosion under vines was recorded as 34.52 g/l while under pasture it was 4.66 g/l. In addition, the soil under vines showed the least amount of organic matter, which was 12 times lower than all other soil environments. The carbon dioxide (CO2) and total glomalin (TG) ratio to soil organic carbon (SOC) in this soil was 0.11 and 0.31 respectively. However, the soil under pasture contained a higher amount of organic matter and showed that the CO2 and TG ratio to SOC was 0.02 and 0.11 respectively indicating that the soil under pasture better preserves the soil carbon pool. A similar trend was found in the intermediate soils in the sequence of land use change and abandonment. Soil structural stability increased in the two soil fractions investigated (0.25-2.00 mm, 2.0-5.6 mm) especially in those soils that did not undergo periodical perturbations like wildfires. Soil quality indexes were obtained by using relevant physical and chemical soil parameters. Factor analysis carried out to study the relationship between all soil parameters allowed to related variables and environments and identify those areas that better contribute to soil quality towards others that may need more attention to avoid further degradation processes

Bayesian Networks for the Age Classification of Living Individuals: a Study on Transition Analysis

Over the past few decades, age estimation of living persons has represented a challenging task for many forensic services worldwide. In general, the process for age estimation includes the observation of the degree of maturity reached by some physical attributes, such as dentition or several ossification centers. The estimated chronological age or the probability that an individual belongs to a meaningful class of ages is then obtained from the observed degree of maturity by means of various statistical methods. Among these methods, those developed in a Bayesian framework offer to users the possibility of coherently dealing with the uncertainty associated with age estimation and of assessing in a transparent and logical way the probability that an examined individual is younger or older than a given age threshold. Recently, a Bayesian network for age estimation has been presented in scientific literature; this kind of probabilistic graphical tool may facilitate the use of the probabilistic approach. Probabilities of interest in the network are assigned by means of transition analysis, a statistical parametric model, which links the chronological age and the degree of maturity by means of specific regression models, such as logit or probit models. Since different regression models can be employed in transition analysis, the aim of this paper is to study the influence of the model in the classification of individuals. The analysis was performed using a dataset related to the ossifications status of the medial clavicular epiphysis and results support that the classification of individuals is not dependent on the choice of the regression model.

Probabilistic age classification with Bayesian networks: a study on the ossification status of the medial clavicular epiphysis

In the past few decades, the rise of criminal, civil and asylum cases involving young people lacking valid identification documents has generated an increase in the demand of age estimation. The chronological age or the probability that an individual is older or younger than a given age threshold are generally estimated by means of some statistical methods based on observations performed on specific physical attributes. Among these statistical methods, those developed in the Bayesian framework allow users to provide coherent and transparent assignments which fulfill forensic and medico-legal purposes. The application of the Bayesian approach is facilitated by using probabilistic graphical tools, such as Bayesian networks. The aim of this work is to test the performances of the Bayesian network for age estimation recently presented in scientific literature in classifying individuals as older or younger than 18 years of age. For these exploratory analyses, a sample related to the ossification status of the medial clavicular epiphysis available in scientific literature was used. Results obtained in the classification are promising: in the criminal context, the Bayesian network achieved, on the average, a rate of correct classifications of approximatively 97%, whilst in the civil context, the rate is, on the average, close to the 88%. These results encourage the continuation of the development and the testing of the method in order to support its practical application in casework.

Classification supervisée multi-étiquette en actes de dialogue: analyse discriminante et transformations de Schoenberg

Abstract This work studies the multi-label classification of turns in simple English Wikipedia talk pages into dialog acts. The treated dataset was created and multi-labeled by (Ferschke et al., 2012). The first part analyses dependences between labels, in order to examine the annotation coherence and to determine a classification method. Then, a multi-label classification is computed, after transforming the problem into binary relevance. Regarding features, whereas (Ferschke et al., 2012) use features such as uni-, bi-, and trigrams, time distance between turns or the indentation level of the turn, other features are considered here: lemmas, part-of-speech tags and the meaning of verbs (according to WordNet). The dataset authors applied approaches such as Naive Bayes or Support Vector Machines. The present paper proposes, as an alternative, to use Schoenberg transformations which, following the example of kernel methods, transform original Euclidean distances into other Euclidean distances, in a space of high dimensionality. Résumé Ce travail étudie la classification supervisée multi-étiquette en actes de dialogue des tours de parole des contributeurs aux pages de discussion de Simple English Wikipedia (Wikipédia en anglais simple). Le jeu de données considéré a été créé et multi-étiqueté par (Ferschke et al., 2012). Une première partie analyse les relations entre les étiquettes pour examiner la cohérence des annotations et pour déterminer une méthode de classification. Ensuite, une classification supervisée multi-étiquette est effectuée, après recodage binaire des étiquettes. Concernant les variables, alors que (Ferschke et al., 2012) utilisent des caractéristiques telles que les uni-, bi- et trigrammes, le temps entre les tours de parole ou l'indentation d'un tour de parole, d'autres descripteurs sont considérés ici : les lemmes, les catégories morphosyntaxiques et le sens des verbes (selon WordNet). Les auteurs du jeu de données ont employé des approches telles que le Naive Bayes ou les Séparateurs à Vastes Marges (SVM) pour la classification. Cet article propose, de façon alternative, d'utiliser et d'étendre l'analyse discriminante linéaire aux transformations de Schoenberg qui, à l'instar des méthodes à noyau, transforment les distances euclidiennes originales en d'autres distances euclidiennes, dans un espace de haute dimensionnalité.